Job Description
Role Overview:
Designs, builds and oversees the deployment and operation of technology architecture, solutions and software to capture, manage, store and utilize structured and unstructured data from internal and external sources. Reviews internal and external business and product requirements for data operations and activity and suggests changes and upgrades to systems and storage to accommodate ongoing needs.
This is a Hybrid position based in Bangalore. You must be within a commutable distance from the location. You will be required to be onsite on an as-needed basis; when not working onsite, you will work remotely from your home location.
Job Description:
About the role:
• Design and implement ETL / ELT pipelines aligned with the bronze, silver, and gold layers of the medallion architecture. Integrate diverse data sources.
• Build data pipelines to support Analytic and meaningful Insight.
Design low-latency, production-ready data pipelines to support real-time and batch model inference.
• Apply CI/CD principles for seamless pipeline deployment.
• Ensure pipelines comply with security and regulatory standards, particularly for handling PII, and maintain metadata and master data across the data catalogue.
• Work closely with Product Managers, Analytic team, Product Engineers and other stakeholders to align data transformation with business objectives.
About You:
• 7 to * years in data engineering and strong experience in SQL and Python programming for building Data sets.
• Should have worked in AWS Databrick and familiar with Big Data ecosystem and various AWS services like S3, Delta Lake, Unity Catalogue familiar with GitHub CI/CD tool.
• Good to have AI tool experience like Genie and Claude Code, proven experience managing pipelines on Databricks using Apache Spark, with a strong understanding of the medallion architecture.
• Experience building pipelines for real-time and batch model serving in production environments and knowledge of CI/CD practices for ETL/ELT pipeline development.
• Expertise in metadata and master data management within technical data catalogues.
• Understanding data security and compliance, especially for sensitive data such as PII.
#LI- Hybrid
Accommodations:
McAfee recognizes and supports its obligation to reasonably accommodate applicants and employees with disabilities. We are here to help. Please let us know if you need a reasonable accommodation for any part of the application, interviewing, hiring, or at any other time during the employment process. Please do not include personal medical information in the email.
Diversity is foundational for our business success. We want to be a workplace of choice for all people and we value the unique perspectives offered by a diverse workforce. McAfee does not unlawfully discriminate on the basis of race, color, religion, sex, ****** orientation, gender identity or expression, national origin, citizenship, disability, protected veteran status, age, ancestry, medical condition, genetic information, marital status, pregnancy, or any other legally protected status. This principle applies to all areas of employment: recruitment and hiring, training, performance evaluations, promotions and transfers, compensation and benefits, and social and recreational programs.
McAfee desires to be an employer of choice with an inclusive environment for all individuals. As part of this goal and in compliance with various laws and regulations, McAfee provides reasonable accommodation to applicants and employees. Requests for reasonable accommodation for applicants and employees are evaluated on a case-by-case basis.
Posting Statement:
McAfee prohibits discrimination based on race, color, religion, gender, national origin, age, disability, veteran status, marital status, pregnancy, gender expression or identity, ****** orientation or any other legally protected status.
💡 Quick Summary
Seeking a career-building opportunity? The Python Data Curation Engineer position is now open for candidates interested in the IT Engineer & Developer Jobs sector. This role in Bangalore offers a professional environment and growth potential.
Requirement Snapshot: Candidates should possess basic communication skills, a proactive attitude, and the ability to work in a team. Experience in IT Engineer & Developer Jobs is a plus.
