Job Description
Lead the design, development, and optimization of a multi-tenant data stack using managed stacks and services like AWS
• Design and implement scalable data models, ETL processes, and data pipelines using AWS services like Glue, Kinesis, and Lambda
• Develop and maintain data warehousing solutions using AWS services like Redshift, Snowflake, or BigQuery
• Implement efficient data ingestion techniques using technologies like Apache Kafka or AWS Kinesis
• Implement efficient data storage and retrieval techniques using technologies like S3, Parquet, and Protobuf
• Develop and maintain automated testing frameworks to ensure data quality and accuracy
• Develop and maintain data visualization dashboards and reports using AWS services like QuickSight or Tableau Server
• Monitor system performance and troubleshoot issues using AWS services like CloudWatch or X-Ray
• Continuously improve processes and systems to increase efficiency and scalability
• Lead and mentor a team of data engineers
Requirements
• Bachelor's degree in Computer Science, Mathematics, or a related field
• At least 7 years of experience in data engineering or a related field
• Proven experience leading a team of data engineers
• Extensive experience with data modeling, ETL processes, and data pipelines using AWS managed services like Glue, Kinesis, and Lambda
• Extensive experience with data warehousing solutions using AWS managed services like Redshift, Snowflake, or BigQuery
• Strong programming skills in Python, SQL, and ETL tools such as Apache Spark, Apache NiFi, and Airflow
• Experience with data visualization tools such as AWS QuickSight or Tableau Server
• Knowledge of database systems such as PostgreSQL, MySQL, and Oracle
• Familiarity with distributed computing systems such as Hadoop and Spark
• Strong problem-solving and analytical skills
• Ability to work independently and in a team environment
• Excellent written and verbal communication skills
• Strong attention to detail and ability to multi-task
This job is provided by Shine.com
• Design and implement scalable data models, ETL processes, and data pipelines using AWS services like Glue, Kinesis, and Lambda
• Develop and maintain data warehousing solutions using AWS services like Redshift, Snowflake, or BigQuery
• Implement efficient data ingestion techniques using technologies like Apache Kafka or AWS Kinesis
• Implement efficient data storage and retrieval techniques using technologies like S3, Parquet, and Protobuf
• Develop and maintain automated testing frameworks to ensure data quality and accuracy
• Develop and maintain data visualization dashboards and reports using AWS services like QuickSight or Tableau Server
• Monitor system performance and troubleshoot issues using AWS services like CloudWatch or X-Ray
• Continuously improve processes and systems to increase efficiency and scalability
• Lead and mentor a team of data engineers
Requirements
• Bachelor's degree in Computer Science, Mathematics, or a related field
• At least 7 years of experience in data engineering or a related field
• Proven experience leading a team of data engineers
• Extensive experience with data modeling, ETL processes, and data pipelines using AWS managed services like Glue, Kinesis, and Lambda
• Extensive experience with data warehousing solutions using AWS managed services like Redshift, Snowflake, or BigQuery
• Strong programming skills in Python, SQL, and ETL tools such as Apache Spark, Apache NiFi, and Airflow
• Experience with data visualization tools such as AWS QuickSight or Tableau Server
• Knowledge of database systems such as PostgreSQL, MySQL, and Oracle
• Familiarity with distributed computing systems such as Hadoop and Spark
• Strong problem-solving and analytical skills
• Ability to work independently and in a team environment
• Excellent written and verbal communication skills
• Strong attention to detail and ability to multi-task
This job is provided by Shine.com
💡 Quick Summary
Seeking a career-building opportunity? The Senior Data Engineer position is now open for candidates interested in the Work from home Jobs sector. This role in Mumbai offers a professional environment and growth potential.
Requirement Snapshot: Candidates should possess basic communication skills, a proactive attitude, and the ability to work in a team. Experience in Work from home Jobs is a plus.