Principal Software Engineer - Python with AWS
Place of work
PimpriChinchwad
Job details
Job description, work day and responsibilities
Company Description
GFK - Growth from Knowledge.
For over 8+ years, we have earned the trust of our clients around the world by solving critical questions in their decision-making process. We fuel their growth by providing a complete understanding of their consumers’ buying behavior, and the dynamics impacting their markets, brands and media trends.
In 2023, GfK combined with NIQ, bringing together two industry leaders with unparalleled global reach. With a holistic retail read and the most comprehensive consumer insights - delivered with advanced analytics through state-of-the-art platforms - GfK drives “Growth from Knowledge”.
Job Description
It's an exciting time to be a builder. Constant technological advances are creating an exciting new world for those who understand the value of data. The mission of NIQ’s Media Division is to turn NIQ into the global leader that transforms how consumer brands plan, activate and measure their media activities.
Recombine is the delivery area focused on maximising the value of data assets in our NIQ Media Division. We apply advanced statistical and machine learning techniques to unlock deeper insights, whilst integrating data from multiple internal and external sources. Our teams develop data integration products across various markets and product areas, delivering enriched datasets that power client decision-making.
Role Overview
We are looking for a Principal Software Engineer for our Recombine delivery area to provide technical leadership within our development teams, ensuring best practices, architectural coherence, and effective collaboration across projects. This role is ideal for a highly experienced engineer who can bridge the gap between data engineering, data science, and software engineering, helping teams build scalable, maintainable, and well-structured data solutions.
As a Principal Software Engineer, you will play a hands-on role in designing and implementing solutions while mentoring developers, influencing technical direction, and driving best practices in software and data engineering. This role includes line management responsibilities, ensuring the growth and development of team members. The role will be working within an AWS environment, leveraging the power of cloud-native technologies and modern data platforms
Key Responsibilities
Technical Leadership & Architecture
• Act as a technical architect, ensuring alignment between the work of multiple development teams in data engineering and data science.
• Design scalable, high-performance data processing solutions within AWS, considering factors such as governance, security, and maintainability.
• Drive the adoption of best practices in software development, including CI/CD, testing strategies, and cloud-native architecture.
• Work closely with Product Owners to translate business needs into technical solutions.
Hands-on Development & Technical Excellence
• Lead by example through high-quality coding, code reviews, and proof-of-concept development.
• Solve complex engineering problems and contribute to critical design decisions.
• Ensure effective use of AWS services, including AWS Glue, AWS Lambda, Amazon S3, Redshift, and EMR.
• Develop and optimise data pipelines, data transformations, and ML workflows in a cloud environment.
Line Management & Team Development
• Provide line management to engineers, ensuring their professional growth and development.
• Conduct performance reviews, set development goals, and mentor team members to enhance their skills.
• Foster a collaborative and high-performing engineering culture, promoting knowledge sharing and continuous improvement beyond team boundaries.
• Support hiring, onboarding, and career development initiatives within the engineering team.
Collaboration & Cross-Team Coordination
• Act as the technical glue between data engineers, data scientists, and software developers, ensuring smooth integration of different components.
• Provide mentorship and guidance to developers, helping them level up their skills and technical understanding.
• Work with DevOps teams to improve deployment pipelines, observability, and infrastructure as code.
• Engage with stakeholders across the business, translating technical concepts into business-relevant insights.
Governance, Security & Data Best Practices
• Champion data governance, lineage, and security across the platform.
• Advocate for and implement scalable data architecture patterns, such as Data Mesh, Lakehouse, or event-driven pipelines.
• Ensure compliance with industry standards, internal policies, and regulatory requirements.
Qualifications
Requirements & Experience
• Strong software engineering background with experience in designing and building production-grade applications in Python, Scala, Java, or similar languages.
• Proven experience with AWS-based data platforms, specifically AWS Glue, Redshift, Athena, S3, Lambda, and EMR.
• Expertise in Apache Spark and AWS Lake Formation, with experience building large-scale distributed data pipelines.
• Experience with workflow orchestration tools like Apache Airflow or AWS Step Functions.
• Cloud experience in AWS, including containerisation (Docker, Kubernetes, ECS, EKS) and infrastructure as code (Terraform, CloudFormation).
• Strong knowledge of modern software architecture, including microservices, event-driven systems, and distributed computing.
• Experience leading teams in an agile environment, with a strong understanding of CI/CD pipelines, automated testing, and DevOps practices.
• Excellent problem-solving and communication skills, with the ability to engage with both technical and non-technical stakeholders.
• Proven line management experience, including mentoring, career development, and performance management of engineering teams.
Additional Information
Our Benefits
• Flexible working environment
• Volunteer time off
• LinkedIn Learning
• Employee-Assistance-Program (EAP)
About NIQ
NIQ is the world’s leading consumer intelligence company, delivering the most complete understanding of consumer buying behavior and revealing new pathways to growth. In 2023, NIQ combined with GfK, bringing together the two industry leaders with unparalleled global reach. With a holistic retail read and the most comprehensive consumer insights—delivered with advanced analytics through state-of-the-art platforms—NIQ delivers the Full View™. NIQ is an Advent International portfolio company with operations in 100+ markets, covering more than +0% of the world’s population.
For more information, visit NIQ.com
Want to keep up with our latest updates?
Follow us on: LinkedIn | Instagram | Twitter | Facebook
Our commitment to Diversity, Equity, and Inclusion
NIQ is committed to reflecting the diversity of the clients, communities, and markets we measure within our own workforce. We exist to count everyone and are on a mission to systematically embed inclusion and diversity into all aspects of our workforce, measurement, and products. We enthusiastically invite candidates who share that mission to join us. We are proud to be an Equal Opportunity/Affirmative Action-Employer, making decisions without regard to race, color, religion, gender, gender identity or expression, ****** orientation, national origin, genetics, disability status, age, marital status, protected veteran status or any other protected class. Our global non-discrimination policy covers these protected classes in every market in which we do business worldwide. Learn more about how we are driving diversity and inclusion in everything we do by visiting the NIQ News Center: https://nielseniq.com/global/en/news-center/diversity-inclusion
Report this listing
Company address
You will be redirected to another website to apply.
Offer ID: #1154057,
Published: 6 days ago,
Company registered: 4 months ago
