Job Description
Responsibilities ? Design, develop, and maintain data ingestion and processing pipelines for various data sources and formats. ? Implement data quality checks, validation rules, and error handling mechanisms to ensure data accuracy and reliability.
? Collaborate with data scientists, machine learning engineers, and product managers to understand data requirements and deliver solutions. ? Optimize data pipelines for performance, scalability, and security.
? Document data models, schemas, and data flows. Requirements ? Bachelor's degree in computer science, engineering, or a related field.
? At least 5 years of experience in data engineering or a similar role. ? Proficient in Python, Spark, SQL, and cloud-based data platforms (e.g.
Azure). ? Experience with data ingestion and processing frameworks (e.g. Spark, Databricks, etc.).
? Knowledge of generative AI techniques and tools (e.g. GPT-4, OpenAI Codex, etc.) is a plus. ?
Strong communication, problem-solving, and analytical skills
? Collaborate with data scientists, machine learning engineers, and product managers to understand data requirements and deliver solutions. ? Optimize data pipelines for performance, scalability, and security.
? Document data models, schemas, and data flows. Requirements ? Bachelor's degree in computer science, engineering, or a related field.
? At least 5 years of experience in data engineering or a similar role. ? Proficient in Python, Spark, SQL, and cloud-based data platforms (e.g.
Azure). ? Experience with data ingestion and processing frameworks (e.g. Spark, Databricks, etc.).
? Knowledge of generative AI techniques and tools (e.g. GPT-4, OpenAI Codex, etc.) is a plus. ?
Strong communication, problem-solving, and analytical skills
💡 Quick Summary
Seeking a career-building opportunity? The SENIOR DATA ENGINEER | AZURE DATABRICKS| SQL| PYTHON position is now open for candidates interested in the Remote Jobs sector. This role in Pune offers a professional environment and growth potential.
Requirement Snapshot: Candidates should possess basic communication skills, a proactive attitude, and the ability to work in a team. Experience in Remote Jobs is a plus.
