Description
Role:- Senior Data Engineer - DWH
Our Data Engineers will typically have:
• Work in building and architecting multiple Data pipelines, end to end ETL and ELT processes for Data ingestion and transformation in AWS, and coordinating tasks amongst the team
• Build, maintain, and monitor batch and real-time ETL pipelines in an AWS architecture (Kinesis, S3, EMR, RedShift, etc.)
• Work closely with the Data Analytics teams to develop a clear understanding of data and data infrastructure needs assist with data-related technical issues
• Develop Data strategy (source, flow of data, storage, and usage), best practices, and patterns
• Perform Data validation and quality assurance
• Present technical solutions to various stakeholders
• Provide day-to-day support of the DW and DL environments, with excellent communications across teams, monitor new deployments and services, escalating issues where appropriate.
Who we prefer?
• Data Warehousing concepts (min 5 years)
• Building ETL pipelines (min 5 years)
• Performance Tuning of SQL queries (min 5 years)
• Data modeling, architecture, and Design data systems (min 3 years)
• Job Scheduling Frameworks (min 3 years)
• Documentation Skills
• Good to have – AWS, EMR, Spark
Education Qualification: BE / B.Tech / M.Tech