Job Description
Key Skills
Azure Data Engineer who has hands on Experience in Azure Data Factory Pyspark, Azure devops, Azure delta lake,
Job Description:
Utilizes software engineering principles to deploy and maintain fully automated data transformation pipelines that combine a large variety of storage and computation technologies to handle a distribution of data types and volumes in support of data architecture design. A Data Engineer designs data products and data pipelines that are resilient to change, modular, flexible, scalable, reusable, and cost effective.
Key Responsibilities:
· Design, develop, and maintain data pipelines and ETL processes using Microsoft Azure services (e.g., Azure Data Factory, Azure Synapse, Azure Databricks, Azure Fabric).
· Utilize Azure data storage accounts for organizing and maintaining data pipeline outputs. (e.g., Azure Data Lake Storage Gen 2 & Azure Blob storage).
· Collaborate with data scientists, data analysts, data architects and other stakeholders to understand data requirements and deliver high-quality data solutions.
· Optimize data pipelines in the Azure environment for performance, scalability, and reliability.
· Ensure data quality and integrity through data validation techniques and frameworks.
· Develop and maintain documentation for data processes, configurations, and best practices.
· Monitor and troubleshoot data pipeline issues to ensure timely resolution.
· Stay current with industry trends and emerging technologies to ensure our data solutions remain cutting-edge.
· Manage the CI/CD process for deploying and maintaining data solutions.
Azure Data Engineer who has hands on Experience in Azure Data Factory Pyspark, Azure devops, Azure delta lake,
Job Description:
Utilizes software engineering principles to deploy and maintain fully automated data transformation pipelines that combine a large variety of storage and computation technologies to handle a distribution of data types and volumes in support of data architecture design. A Data Engineer designs data products and data pipelines that are resilient to change, modular, flexible, scalable, reusable, and cost effective.
Key Responsibilities:
· Design, develop, and maintain data pipelines and ETL processes using Microsoft Azure services (e.g., Azure Data Factory, Azure Synapse, Azure Databricks, Azure Fabric).
· Utilize Azure data storage accounts for organizing and maintaining data pipeline outputs. (e.g., Azure Data Lake Storage Gen 2 & Azure Blob storage).
· Collaborate with data scientists, data analysts, data architects and other stakeholders to understand data requirements and deliver high-quality data solutions.
· Optimize data pipelines in the Azure environment for performance, scalability, and reliability.
· Ensure data quality and integrity through data validation techniques and frameworks.
· Develop and maintain documentation for data processes, configurations, and best practices.
· Monitor and troubleshoot data pipeline issues to ensure timely resolution.
· Stay current with industry trends and emerging technologies to ensure our data solutions remain cutting-edge.
· Manage the CI/CD process for deploying and maintaining data solutions.
💡 Quick Summary
Seeking a career-building opportunity? The Azure Engieering position is now open for candidates interested in the IT Engineer & Developer Jobs sector. This role in Mumbai offers a professional environment and growth potential.
Requirement Snapshot: Candidates should possess basic communication skills, a proactive attitude, and the ability to work in a team. Experience in IT Engineer & Developer Jobs is a plus.