Job Description
Role Description
Experience Range:
5-10 years in a similar role
Hiring Locations:
Noida, Pune, Hyderabad, Bangalore, Kochi, Trivandrum, Chennai
Must-Have Skills
• Hands-on experience with PySpark and GCP (or any other cloud platform)
• Strong proficiency in SQL
• Expertise in designing, implementing, and optimizing data pipelines using Spark, Hadoop, Hive
• Proven experience in monitoring and troubleshooting data pipelines to ensure minimal downtime and optimal performance
• Strong problem-solving skills and ability to work in a collaborative team environment
• Excellent communication skills (written and verbal)
Good-to-Have Skills
• Experience working closely with product managers and data stewards to understand data requirements
• Familiarity with data governance and data quality best practices
• Knowledge of big data architecture and distributed computing
Key Responsibilities
• Design, implement, and optimize scalable data pipelines using Spark, Hadoop, Hive, and other relevant technologies
• Collaborate with product managers and data stewards to translate data requirements into efficient data workflows
• Monitor and troubleshoot data pipelines, ensuring reliability and performance
• Work in a fast-paced, agile environment, solving complex data challenges
• Stay updated with the latest data engineering trends and technologies
Skills
Spark,Hadoop,Hive,Gcp
Experience Range:
5-10 years in a similar role
Hiring Locations:
Noida, Pune, Hyderabad, Bangalore, Kochi, Trivandrum, Chennai
Must-Have Skills
• Hands-on experience with PySpark and GCP (or any other cloud platform)
• Strong proficiency in SQL
• Expertise in designing, implementing, and optimizing data pipelines using Spark, Hadoop, Hive
• Proven experience in monitoring and troubleshooting data pipelines to ensure minimal downtime and optimal performance
• Strong problem-solving skills and ability to work in a collaborative team environment
• Excellent communication skills (written and verbal)
Good-to-Have Skills
• Experience working closely with product managers and data stewards to understand data requirements
• Familiarity with data governance and data quality best practices
• Knowledge of big data architecture and distributed computing
Key Responsibilities
• Design, implement, and optimize scalable data pipelines using Spark, Hadoop, Hive, and other relevant technologies
• Collaborate with product managers and data stewards to translate data requirements into efficient data workflows
• Monitor and troubleshoot data pipelines, ensuring reliability and performance
• Work in a fast-paced, agile environment, solving complex data challenges
• Stay updated with the latest data engineering trends and technologies
Skills
Spark,Hadoop,Hive,Gcp
💡 Quick Summary
Seeking a career-building opportunity? The Lead I - Data Engineering position is now open for candidates interested in the IT Engineer & Developer Jobs sector. This role in Thiruvananthapuram offers a professional environment and growth potential.
Requirement Snapshot: Candidates should possess basic communication skills, a proactive attitude, and the ability to work in a team. Experience in IT Engineer & Developer Jobs is a plus.
