Job Description
• An Individual Contributor who is capable of developing data pipelines in a highly autonomous enviornment -- including often needing to translate busines stakeholder requirements to technical requirements -- with an eye towards developing full stack or cross-skills across the Modern data landscape.
• Drives end to end design, implementation, and delivery of engineering components
• Works with Product Owners, Product Data Analysts and Machine Learning Engineers to understand product/end-user requirements and translate those into pragmatic and effective technical solutions.
• Supports key initiatives, both in terms of delivery and in a consulting capacity
• Reviews user stories to ensure a quality user experience, well-defined acceptance criteria and thorough test coverage
• Ensure Modern engineering practices like automated build and deployment pipelines, infrastructure as code, CI/CD and trunk-based development are defined and followed.
• Building scalable data pipelines
• Collaborates with multiple data source teams in getting data published to Data Platform using Data Lake and Data warehouse architecture (i.e. Data Lakehouse architecture)
• Engages in ongoing quality and performance improvement to ensure reliability and data security
• Participates in code reviews to ensure quality, coaching as necessary
• Works in an agile environment, contributing to story sizing and collaborates with the engineering teams (onshore and offshore) to deliver on integration projects to ensure deliverables are well-documented, secure and resilient.
• Designs for release and configuration management.
• Assists in troubleshooting and resolving production system issues.Job Requirement
Knowledge, Skills, and/or Abilities Required:
• 5+ years of overall professional experience in Data space. At least 3+ years' experience in Modern Data Stack/Data Lakehouse.
• Experience with cloud-based preferably AWS (or GCP / Azure) data management platforms and typical storage/compute services (Snowflake, Redshift, Azure Synapse, Databricks, Open Source -Iceberg/Delta etc.)
• Experienced in creating / adopting an industry standard modelling methodology (i.e. Dimensional or similar) for various consumer requirement needs Data Visualization, Machine Learning and Customer Data Syndication/Exchange.
• Working experience in Data Integration and Processing scripting/tools, for structured and semi-structured data using SQL (Advanced) and Python. Any experience in ELT/ETL tools like DBT, Talend/Stitch, Matillion, Meltano/Airbyte etc. Apache Spark capabilities would be a plus.
• Data Orchestration tools to build scalable data Pipelines using Airflow or similar tools (like Prefect and Dagster)
• Support Data Governance initiatives with other engineers/analysts in maintaining data catalogs, data quality measures and any frameworks
• Any experience or knowledge of Real-time Data streaming technologies like Apache Kafka and Spark Streaming would be a plus.
• Certifications in AWS and/or modern data technologies would be a plusEducational/Vocational/Previous Experience Recommendations:· Bachelor's degree in related field or equivalent business experience· 4+ years of relevant experienceWorking Conditions:· Onsite/Hybrid/Remote depending on location· 0-10% travel may be required
💡 Quick Summary
Seeking a career-building opportunity? The Principal Software Engineer position is now open for candidates interested in the Software Developer Jobs sector. This role in Pune offers a professional environment and growth potential.
Requirement Snapshot: Candidates should possess basic communication skills, a proactive attitude, and the ability to work in a team. Experience in Software Developer Jobs is a plus.
