Data brick Engineer/Architect

Place of work Achalpur
Contract type -
Start date -
Salary -

Job details

Job description, work day and responsibilities

Role & Responsibilities Overview:· Develop and optimize ETL pipelines from various data sources using Databricks on cloud (AWS, Azure, etc.)· Experienced in implementing standardized pipelines with automated testing, Airflow scheduling, Azure DevOps for CI/CD, Terraform for infrastructure as code, and Splunk for monitoring·Continuously improve systems through performance enhancements and cost reductions in compute and storage· Data Processing and API Integration: Utilize Spark Structured Streaming for real-time data processing and integrate data outputs with REST APIs· Lead Data Engineering Projects to manage and implement data-driven communication systems· Experienced with Scrum and Agile Methodologies to coordinate global delivery teams, run scrum ceremonies, manage backlog items, and handle escalations· Integrate data across different systems and platforms· Strong verbal and written communication skills to manage client discussionsCandidate Profile:· 8+ years experience in developing and implementing ETL pipelines from various data sources using Databricks on cloud· Based out of US· Some experience in insurance domain/ data is must· Programming Languages – SQL, Python· Technologies - IaaS (AWS or Azure or GCP), Databricks platform, Delta Lake storage, Spark (PySpark, Spark SQL).o Good to have - Airflow, Splunk, Kubernetes, Power BI, Git, Azure Devops

Company address

India
Maharashtra
Achalpur
Show on map Get directions
Company Name: EXL
You will be redirected to another website to apply.
Offer ID: #1117231, Published: 2 weeks ago, Company registered: 3 months ago

Other offers

Senior Data Engineer with expertise in Kafka topics and Flink jobs
2000login
· Achalpur, IN
We are seeking a Senior Data Engineer with expertise in Kafka topics and Flink jobs, along with 3-7 years of experience, to work from home for a 4-month contract. Your knowledge will be vital in optimizing Flink dashboar...
Virtual Assistant Jobs - Careers for Fresher
2000login
· Achalpur, IN
Job Summary The Elite Jobs is seeking a dedicated and detail-oriented Virtual Assistant to join our team. This is an exciting opportunity for freshers looking to kickstart their career in a remote and flexible work envir...
Python Developer - AI Training
2000login
· Achalpur, IN
Seeking programmers NOW! Be part of the artificial intelligence (AI) revolution.If you are a programmer, coder, hacker, software engineer, or just great at solving coding challenges (Codeforces, Sphere Online Judge, Leet...
Software Development Engineering
2000login
· Achalpur, IN
Job Description: OverviewThe Finance Company Dispute Resolution team is looking for a Senior Software Engineer to drive our strategy forward through innovation and problem-solving. The ideal candidate is highly motivated...
Remote Data Entry Clerk - Part-Time
2000login
· Achalpur, IN
Job Summary: FedEx is seeking a detail-oriented and dedicated Remote Data Entry Clerk to join our team on a part-time basis. This role is ideal for individuals who are highly organized, self-motivated, and have a keen ey...
Online Packing Jobs for Women No Commute, Work from Home
2000login
· Achalpur, IN
Job Summary Are you a motivated individual looking for a flexible, work-from-home opportunity? Join our team as an Online Packing Specialist! This entry-level role is specifically designed for women seeking a convenient,...
React Native (Mobile Development)
2000login
· Achalpur, IN
Title: React Native (Mobile Development)Location: RemoteType: Long term contractClient: TCS / WallmartSkillsStrong Knowledge of {{functional or object-oriented}} programmingAbility to write well-documented, clean Javascr...
work from home Night Shift Live Monitoring Specialist
2000login
· Achalpur, IN
Houston Skilled Consultancy is a leading provider of consulting services, specializing in delivering innovative solutions to clients worldwide. With a focus on excellence and client satisfaction, we pride ourselves on fo...
Data Scientist with NLP-Contract-Remote
2000login
· Achalpur, IN
Job description Responsibilities Accountable for end-to-end data science related project(s) Collaborate with team to formulate innovative solutions to experiment and implement advanced data science solutionsWork with lar...
Fashion Designer Fresher
2000login
· Achalpur, IN
Managing design process from conception through to final styling. - Conducting market research to identify new trends, fabrics and techniques, and seeking design inspiration. • *If you Want More information Send your CV ...
Project Manager- Scrum Master Agile Coach - Remote
2000login
· Achalpur, IN
##URGENTHIRING##Hello,We are hiring Project Manager- Scrum Master who enjoys working with Lean Agile mindset, Agile coaching and Sprint planning.Interested candidate can apply, OR you can refer a candidate and earn rewar...
Fresher Opening for Fashion Designer Jobs
2000login
· Achalpur, IN
Job Description Hurrry Up location : all Over Mumbai salary: 12k to 20k pf and Attractive Incentives job Timing :+:30 to 6:30 male/female Both Can Apply qualification 10th /12th Key Skills • Fashion Designing Industry Te...
Remote Customer Service Jobs | Beginner-Friendly
2000login
· Achalpur, IN
Job Summary Are you looking for a dynamic and rewarding remote position where you can make a difference from the comfort of your own home? At The Elite Job, we specialize in providing top-tier remote customer service opp...
Fashion Designer needed for clothing brand |Female Only|
2000login
· Achalpur, IN
Timings: 2 pm to 10 pm* • Min Experience 3-4 years* Work: • Design collection of outfits based on the theme given • Co-ordinate with technicians and get the work done as per design and size • Talk to clients for size and...