Senior Data Engineer

Collaborattively designing, building, and maintaining microservices in our platform. Working closely with Data Science and Machine Learning teams in highly impactful and complex challenges, you will help redefine how our business processes work using AI. Helping to expand Companies data services and products, taking them to the next level while using state-of-the-art technologies. Collaborating with Data Scientists, Big Data, Software Engineers, Tech Ops, and Release Engineers to deliver efficient data products. Designing and developing scalable and performance oriented services with a strong emphasis on algorithmic design and scalability. Working with the Big Data team to develop and maintain large-scale Data Science services. Skills Requirements Expert in Python, Java or C++ backend development and microservices Passionate about code quality and delivering high-quality software Capable of delivering production-level code and managing the software lifecycle DevOps mindset and experience with any of the following Docker, Terraform, Ansible, Kubernetes, Cloud Environments (Azure, Google, AWS), CI/CD Experience in distributed data stores (Cassandra, Bigtable, HBase, MongoDB, HDFS) Exposure to batch and streaming processing (Hadoop, Spark, Kafka, Flink, Beam, Storm, Samza) Hands-on experience in developing big-data ETLs and orchestration (Hue, YARN, Airflow, Luigi, Zookeeper) Strong preference for proven experience in scaling and architecting production-level machine learning systems and data products

This job is provided by Shine.com