Job Description
Job Description
We are looking for a tech savvy Data Engineer to join our growing data team. The hire will be responsible for expanding and optimizing our data and data pipeline architecture, as well as optimizing data flow and collection for cross functional teams. The ideal candidate is an experienced data pipeline builder and data wrangler who enjoys optimizing data systems and building them from the ground up. The Data Engineer will support our software developers, data analysts and data scientists on data initiatives and will ensure optimal data delivery architecture is consistent throughout ongoing projects. The hire must be self-directed and comfortable supporting the data needs of multiple teams, systems and products.
Data Engineer Job Responsibilities
• Develop and maintain scalable data pipelines and build out new API integrations to support continuing increases in data volume and complexity.
• Implement processes and systems to monitor data accuracy, ensuring 100% data availability for key stakeholders and business processes that depend on it.
• Write unit/integration tests and document work.
• Perform data analysis required to troubleshoot data related issues and assist in the resolution of data issues.
• Design data integrations and reporting framework.
• Work with stakeholders including the Product, Data and Design teams to assist with data-related technical issues and support their data infrastructure needs
• Design and evaluate open source and vendor tools for data lineage.
• Work closely with all business units and engineering teams to develop strategy for long term data platform architecture.
Data Engineer Qualifications / Skills
• 3+ years of Java development experience
• Experience with or knowledge of Agile Software Development methodologies
• Excellent problem solving and troubleshooting skills
• Process oriented with great documentation skills
• Experience with big data technologies like Kafka, BigQuery, etc
• Experience with AWS cloud services: EC2, RDS, etc
• Experience with message queuing, stream-processing systems
Education, Experience And Licensing Requirements
• Degree in Computer Science, IT, or similar field; a Master’s is a plus
• 3+ years of hands on development experience
• 3+ years of SQL experience (No-SQL experience is a plus)
• 3+ years of experience with schema design and dimensional data modeling
• Experience designing, building and maintaining data processing systems
Skills:- Java, MySQL, Big Data, Amazon Web Services (AWS), Apache Kafka and BigQuery
💡 Quick Summary
Seeking a career-building opportunity? The Software Engineer position is now open for candidates interested in the Software Developer Jobs sector. This role in Pune offers a professional environment and growth potential.
Requirement Snapshot: Candidates should possess basic communication skills, a proactive attitude, and the ability to work in a team. Experience in Software Developer Jobs is a plus.
