Requirements:
• Experience in Developing Data Pipelines that process large volumes of data using Python, PySpark, Pandas etc, on Azure.
• Experience in developing ETL, OLAP-based and Analytical Applications.
• Experience in ingesting batch and streaming data from various data sources.
• Strong Experience in writing complex SQL using any RDBMS (Oracle, PostgreSQL, SQL Server etc. ).
• Ability to quickly learn and develop expertise in existing highly complex applications and architectures.
• Azure Data Bricks (ADB), Azure Synapse Analytics, Azure Active Directory, Azure Storage, Azure Data Lake Services (ADLS), Azure key vault, Azure SQL DB, Azure HD Insight.
• Experience with DevOps and CD/CD tools.
• Familiarity with Rest APIs.
• Clear and precise communication skills.
• Experience with CI/CD pipelines, branching strategies, and GIT for code management.
• Comfortable working in Agile projects.