Add listing Add

Data Engineer Consultant - Spark/Python

Place of work Mumbai
Contract type -
Start date -
Salary -

Job details

Job description, work day and responsibilities

Job Description

Required Skills :
• Must have excellent knowledge in Apache Spark and Python programming experience
• Deep technical understanding of distributed computing and broader awareness of different Spark version
• Strong UNIX operating system concepts and shell scripting knowledge
• Hands-on experience using Spark & Python
• Deep experience in developing data processing tasks using PySpark such as reading data from external sources, merge data, perform data enrichment and load in to target data destinations.
• Externally certified in one of the cloud services (foundational or advanced)- (AWS, GCP, Azure, Snowflake, Databricks)
• Experience in deployment and operationalizing the code, knowledge of scheduling tools like Airflow, Control-M etc. is preferred
• Experience in creating visualizations in either of Tableau, PowerBI, Qlik, Looker or any of the other reporting tools
• Good knowledge of Hadoop, Hive and Cloudera/ Hortonworks Data Platform
• Should have exposure with Jenkins or equivalent CICD tool & Git repository
• Experience handling CDC operations for huge volume of data
• Should understand and have operating experience with Agile delivery model
• Should have experience in Spark related performance tuning
• Should be well versed with understanding of design documents like HLD, TDD etc
• Should be well versed with Data historical load and overall Framework concepts
• Should have participated in different kinds of testing like Unit Testing, System Testing, User Acceptance Testing, etc

Preferred Skills
• Exposure to PySpark, Cloudera/ Hortonworks, Hadoop and Hive.
• Exposure to AWS S3/EC2 and Apache Airflow

(ref:hirist.tech)

Company address

India
Maharashtra
Mumbai Show on map Get directions
Company Name: SKYGATE CONSULTING
You will be redirected to another website to apply.
Apply on Website
Offer ID: #1032434, Published: 3 weeks ago, Company registered: 7 months ago

Other offers

1820login
300 job offers
AI Developer (Fresher) JBU
1820login · Pune, IN
1820login
· Pune, IN
Company Description Our culture is defined by our values and our deep commitment to help our clients succeed. We are a division of the 38th largest company in the world and bring to bear the strength of a very large netw...
1820login
300 job offers
Customer Service Specialist
1820login · Pune, IN
1820login
· Pune, IN
Canadian Telecom Phoenix DOJ- 3/03/2025 Salary upto 5L CTC to 5.5L CTC Salary will be discussed by us post validation of Salary slips Phoenix requires MANDATORY 1 YEAR INTERNATIONAL BPO VOICE EXP WITH NO GAP WITH EXCELLE...
1820login
300 job offers
Information Technology Help Desk Coordinator
1820login · Mumbai, IN
1820login
· Mumbai, IN
We're Hiring: Helpdesk Co-ordinator! Join our dynamic IT Solutions team as a Helpdesk Co-ordinator, where you'll play a key role in managing service tickets, coordinating engineers, and ensuring seamless service delivery...
1820login
300 job offers
IT Strategic Sourcer
1820login · Pune, IN
1820login
· Pune, IN
Requirements: Qualification: • University degree (ideally in economics or Supply Management and/or Legal) or industry experience equivalent. • Additional Sourcing/Procurement certification will be advantageous. Experienc...
1820login
300 job offers
Field Representative
1820login · Pune, IN
1820login
· Pune, IN
We are searching for a business-savvy field representative to join our company. As the field representative, you will increase brand awareness, advise sales teams, develop expansion strategies, and prepare sales reports....
1820login
300 job offers
Technology Product Owner - C12 - PUNE
1820login · Pune, IN
1820login
· Pune, IN
The IT Product Senior Analyst is a seasoned professional role. Applies in-depth disciplinary knowledge, contributing to the development of new techniques and the improvement of processes and work-flow for the area or fun...
1820login
300 job offers
Zepto Delivery Partner Hiring
1820login · Bangalore, IN
1820login
· Bangalore, IN
Salary Range : Rs. 37500 - Rs. 67555 , based on skills, experience, and interview performance Educational Requirement : Tenth Pass Work Arrangement : Work From Office Gender Preference : Both male and female can apply Sk...
1820login
300 job offers
Store & Receiving Associate
1820login · Pune, IN
1820login
· Pune, IN
Job Description Job Description Prime Function: • Perform a variety of duties ensuring orderly and timely delivery of materials from vendors and supplying the same to the other departments. • Responsible for taking the n...
1820login
300 job offers
Delivery Executive/Delivery Partner
1820login · Bangalore, IN
1820login
· Bangalore, IN
Job Title: Delivery Boy SWIGGY Benefits: - Joining Bonus: Up to ₹10,000 - Insurance: Upto 10 Lacs - Flexible Working Hours - Competitive salary and incentives - Opportunities for career growth Job Summary: We are hiring ...
1820login
300 job offers
French Language Specialist
1820login · Pune, IN
1820login
· Pune, IN
French Language- FRESHERS PREFERRED Full time job- Monday to Friday Role- Product Specialist Location- Pune - Work from office Job Description ● Employees are expected to process country specific payroll as per process a...
1820login
300 job offers
Driver Cum Delivery Boy
1820login · Bangalore, IN
1820login
· Bangalore, IN
Hi we are from Logistic field,we require driver cum delivery associates who stays in a4+7nd around HBR,Kalyan Nagar,Horamavu,etc who is experienced in flipkart,Bigbasket etc. Job role:Driver Cum Delivery(Tata Ace) Locati...
1820login
300 job offers
System Design
1820login · Pune, IN
1820login
· Pune, IN
System Designer: System Integration Requirement Analysis, System/Sub system design, DfX DFMEA,DFMAT, PFMEA, Risk Management Functional expertise in electrical or mechanical. Engineering knowledge in electrical, mechnaica...
1820login
300 job offers
Van Delivery Boy Jobs in Flipkart - Bengaluru, Karnataka, India
1820login · Bangalore, IN
1820login
· Bangalore, IN
Job Requirements Job Title: Van Delivery Boy Jobs in Flipkart - Bengaluru Company: Flipkart Location: Bangalore, Karnataka, India Salary: ₹30,000 - ₹35,000 per month (Per-packet basis) Qualification: Minimum 10th Pass Wo...
1820login
300 job offers
LTIMindtree Hiring for Infinity Developer!!!
1820login · Pune, IN
1820login
· Pune, IN
Skill: Infinity Developer Location: Pune Notice Period: Immediate to 60 Days Job Description: • 8- 10 Years of experience in Core Java • Should have Mobile development knowledge of at least 1-2 year of experience • Shoul...
1820login
300 job offers
Delivery Support Expert
1820login · Bangalore, IN
1820login
· Bangalore, IN
We help the world run better At SAP, we enable you to bring out your best. Our company culture is focused on collaboration and a shared passion to help the world run better. How? We focus every day on building the founda...
Recommend to friend Share on facebook Print Get route to office