Azure Databricks Developer

Exp: 5+yrsMinimum 5 years + working exp as Databricks DeveloperMinimum 3 years + working exp on PySpark and AWSLocation:Kolkata5+ years relevant and progressive data engineering experienceDeep Technical knowledge and experience in Databricks, Python, Scala, Microsoft Azure architecture and platform including Synapse, ADF (Azure Data Factory) pipelines and Synapse stored proceduresHands-on experience working with data pipelines using a variety of source and target locations (e.g., Databricks, Synapse, SQL Server, Data Lake, file-based, SQL and No-SQL database)Experience in engineering practices such as development, code refactoring, and leveraging design patterns, CI/CD, and building highly scalable data applications and processesExperience developing batch ETL pipelines; real-time pipelines are a plusKnowledge of advanced data engineering concepts such as dimensional modeling, ETL, data governance, data warehousing involving structured and unstructured dataThorough knowledge of Synapse and SQL Server including T-SQL and stored proceduresExperience working with and supporting cross-functional teams in a dynamic environmentA successful history of manipulating, processing and extracting value from large disconnected datasets.Experience performing root cause analysis on internal and external data and processes to answer specific business questions and identify opportunities for improvement.Advanced working SQL knowledge and experience working with relational databases, query authoring (SQL) as well as working familiarity with a variety of databases.Advise, consult, mentor and coach other data and analytic professionals on data standards and practicesFoster a culture of sharing, re-use, design for scale stability, and operational efficiency of data and analytic solutionsDevelop and deliver documentation on data engineering capabilities, standards, and processes; participate in coaching, mentoring, design reviews and code reviewsPartner with business analysts and solutions architects to develop technical architectures for strategic enterprise projects and initiatives.Solve complex data problems to deliver insights that helps the organization achieve its goalsKnowledge and understanding of Boomi is a plus

India
West Bengal
Kolkata Show on map Get directions