Job Description
Apply
Manager
EXL
Anywhere
Apply
16 hours ago
Work from home
Temp work
Job Description
As an Azure Data Factory Engineer, your role is pivotal in designing, building, and maintaining data integration pipelines using Azure Data Factory. Your expertise will ensure seamless data movement, transformation, and orchestration across various sources and destinations. Your responsibilities may include:
• Data Integration: Design, develop, and deploy end-to-end data integration solutions within Azure Data Factory, enabling the smooth transfer of data between disparate systems. 2. ETL Workflows: Create, optimize, and manage Extract, Transform, Load (ETL) workflows to efficiently move and transform data from source to target systems.
• Data Transformation: Implement data transformations, data cleansing, and enrichment using Azure Data Factory's data flow capabilities to ensure data accuracy and quality.
• Data Orchestration: Develop data orchestration workflows that accommodate dependencies, scheduling, retries, and error handling for reliable and automated execution.
• Azure Services Integration: Leverage Azure services such as Azure SQL Database, Azure Data Lake Storage, Azure Databricks, and more to create comprehensive and scalable data solutions.
• Monitoring and Logging: Setup monitoring, alerting, and logging mechanisms to proactively identify and address issues in data integration pipelines.
• Data Security: Implement data security measures and access controls to protect sensitive information during data movement and transformation.
• Incremental Loading: Design strategies for incremental loading to efficiently update and synchronize data while minimizing processing overhead.
• Error Handling: Develop strategies for handling data integration errors, ensuring data consistency and accurate error reporting.
• Performance Optimization: Optimize data pipelines for performance and efficiency, considering factors like data partitioning, indexing, and parallel processing.
• Collaboration: Collaborate with data engineers, data analysts, and business stakeholders to understand data requirements and deliver solutions aligned with business needs.
• Documentation: Maintain comprehensive documentation of data integration pipelines, workflows, transformation logic, and dependencies.
• Stay Updated: Stay current with Azure Data Factory updates, Azure services, and best practices in data integration and ETL.
Eligibility Criteria
• Must possess prior experience in working for US HealthCare
• Good command over English Language and communication skills is a must
• Can independently manage tasks and responsibilities as assigned by the Team/ Project Manager
• Timely and accurate reporting to the stakeholders
• Should be flexible to work in US shift timings
Competencies Required
• Proficiency in Azure Data Factory, including pipeline creation, management, and deployment.
• Strong understanding of ETL concepts, data integration patterns, and data transformation. - Experience with data flow transformations within Azure Data Factory
• Familiarity with Azure services like Azure SQL Database, Azure Data Lake Storage, and Azure Databricks. - Solid SQL skills for querying and transformation operations
• Problem-solving skills to troubleshoot and optimize data pipelines
• Collaboration skills to work effectively with cross-functional teams
• Attention to detail to ensure accurate data movement and transformations
• Understanding of data governance and security practices
Manager
EXL
Anywhere
Apply
16 hours ago
Work from home
Temp work
Job Description
As an Azure Data Factory Engineer, your role is pivotal in designing, building, and maintaining data integration pipelines using Azure Data Factory. Your expertise will ensure seamless data movement, transformation, and orchestration across various sources and destinations. Your responsibilities may include:
• Data Integration: Design, develop, and deploy end-to-end data integration solutions within Azure Data Factory, enabling the smooth transfer of data between disparate systems. 2. ETL Workflows: Create, optimize, and manage Extract, Transform, Load (ETL) workflows to efficiently move and transform data from source to target systems.
• Data Transformation: Implement data transformations, data cleansing, and enrichment using Azure Data Factory's data flow capabilities to ensure data accuracy and quality.
• Data Orchestration: Develop data orchestration workflows that accommodate dependencies, scheduling, retries, and error handling for reliable and automated execution.
• Azure Services Integration: Leverage Azure services such as Azure SQL Database, Azure Data Lake Storage, Azure Databricks, and more to create comprehensive and scalable data solutions.
• Monitoring and Logging: Setup monitoring, alerting, and logging mechanisms to proactively identify and address issues in data integration pipelines.
• Data Security: Implement data security measures and access controls to protect sensitive information during data movement and transformation.
• Incremental Loading: Design strategies for incremental loading to efficiently update and synchronize data while minimizing processing overhead.
• Error Handling: Develop strategies for handling data integration errors, ensuring data consistency and accurate error reporting.
• Performance Optimization: Optimize data pipelines for performance and efficiency, considering factors like data partitioning, indexing, and parallel processing.
• Collaboration: Collaborate with data engineers, data analysts, and business stakeholders to understand data requirements and deliver solutions aligned with business needs.
• Documentation: Maintain comprehensive documentation of data integration pipelines, workflows, transformation logic, and dependencies.
• Stay Updated: Stay current with Azure Data Factory updates, Azure services, and best practices in data integration and ETL.
Eligibility Criteria
• Must possess prior experience in working for US HealthCare
• Good command over English Language and communication skills is a must
• Can independently manage tasks and responsibilities as assigned by the Team/ Project Manager
• Timely and accurate reporting to the stakeholders
• Should be flexible to work in US shift timings
Competencies Required
• Proficiency in Azure Data Factory, including pipeline creation, management, and deployment.
• Strong understanding of ETL concepts, data integration patterns, and data transformation. - Experience with data flow transformations within Azure Data Factory
• Familiarity with Azure services like Azure SQL Database, Azure Data Lake Storage, and Azure Databricks. - Solid SQL skills for querying and transformation operations
• Problem-solving skills to troubleshoot and optimize data pipelines
• Collaboration skills to work effectively with cross-functional teams
• Attention to detail to ensure accurate data movement and transformations
• Understanding of data governance and security practices
💡 Quick Summary
Seeking a career-building opportunity? The Manager position is now open for candidates interested in the Work from home Jobs sector. This role in Mumbai offers a professional environment and growth potential.
Requirement Snapshot: Candidates should possess basic communication skills, a proactive attitude, and the ability to work in a team. Experience in Work from home Jobs is a plus.