Job Description
Description :- Ensure stable, scalable, and secure operation of the Azure-based Data & Analytics platform, including Databricks, Azure-native components, Power BI, and CI/CD infrastructure- Offload operational workload from platform architects by taking ownership of infrastructure, deployment automation, and pipeline reliability- Enable smooth execution and troubleshooting of data pipelines written in Scala and PySpark, including hybrid integration scenarios such as Power BI with gateway infrastructureReports to : Head of Data & Analytics IT Competence CenterCollaborates with : Platform Architects, Data Engineers, ML Engineers, Power BI DevelopersGeography : Global (stakeholders in Germany, India, Manila)Operational Scope : Azure services, Databricks workspaces, CI/CD toolchains, Power BI service (incl. gateways), and Spark-based data pipelinesMain Tasks :- Operate and optimize Azure resources (ADF, Key Vault, Monitor, Event Hub)- Administer Databricks workspace access and cluster configs- Apply Infrastructure-as-Code (Terraform/Bicep)- Manage CI/CD pipelines for Scala and PySpark-based pipelines- Integrate build steps (e.g., Maven/SBT, Python wheels) into automated deployments- Enforce DevSecOps and IaC standards- Monitor Spark job execution, analyze failures and stage-level issues using Spark UI and logs- Configure alerts, metrics, and dashboards for pipelines and infrastructure- Lead post-incident reviews and reliability improvements- Administer Power BI tenant configuration, workspace access, and usage monitoring- Operate and monitor on-premises or VM-hosted enterprise gateways- Troubleshoot dataset refreshes and hybrid data integration- Support runtime execution of production pipelines and ensure SLA adherence- Collaborate with engineers to resolve Spark performance issues or deployment errors- Participate in schema evolution and environment transitions- Enforce platform policies (tagging, RBAC, audit logging)- Maintain credential and secrets security using Key Vault and managed identity- Conduct audits across Azure, Databricks, and Power BI environmentsQualifications :Education / Certification :- Bachelors or Masters degree in Computer Science, Engineering, Information Systems, or related field.- Preferred : Azure DevOps Engineer Expert, Power BI Admin, or Databricks Admin certificationsProfessional Experience :- Minimum 5 years in cloud platform engineering, DevOps, or SRE roles within data or analytics platforms- Hands-on experience with Spark (Databricks), PySpark, and CI/CD for JVM-based data applicationsProject or Process Experience :- Proven ability to deploy and operate complex data pipeline ecosystems using Scala and PySpark- Experience in managing Power BI service in enterprise setups, including hybrid gateway environmentsLeadership Experience :- No formal people leadership required; expected to lead through technical authority and cross-team collaborationIntercultural / International Experience :- Experience working in distributed teams across time zones and cultures; strong communication skills and resilience (ref:hirist.tech)
💡 Quick Summary
Seeking a career-building opportunity? The SkillsCapital position is now open for candidates interested in the Work from home Jobs sector. This role in Jaipur offers a professional environment and growth potential.
Requirement Snapshot: Candidates should possess basic communication skills, a proactive attitude, and the ability to work in a team. Experience in Work from home Jobs is a plus.