Senior PySpark Data Engineer
Job details
Job description, work day and responsibilities
Experience: 5.00 + years
Salary: Confidential (based on experience)
Shift: (GMT+05:30) Asia/Kolkata (IST)
Opportunity Type: Remote
Placement Type: Full time Permanent Position
(*Note: This is a requirement for one of Uplers client - Edstem Technologies)
What do you need for this opportunity
Must have skills required:
SQL, Python, Pyspark, Data Architectures, Data Pipelines, Airflow
Edstem Technologies is Looking for:
Role Overview Description
The Senior Data Engineer will work collaboratively with Data Science and Analytics teams to build scalable, robust, and efficient data pipelines to enable data-driven decision making.
Responsible for designing data architectures, building/maintaining data pipelines, and integrating and transforming data from various sources to maximize accessibility and usability.
Roles & Responsibilities
Design reliable and scalable data architectures and pipelines for streaming and batch data
Develop complex ETL processes to extract, transform and load data from various sources to destinations
Work on data quality monitoring and optimization processes
Collaborate with data scientists and analyst to understand their data and analytics needs
Qualifications
5+ years of experience as a Data Engineer
Expert level knowledge of SQL, Python and PySpark
Experience In Airflow Is Preferred
Strong software engineering fundamentals including systems design, algorithmic thinking and complexity analysis
How to apply for this opportunity
• Register or login on our portal & fill out the application form.
• Clear the given Video Screening (30 min) and Click on Apply to get shortlisted
• Once it's all done, your profile will be shared with the client for the Interview round.
• When selected, just meet the client and get your exciting career started!
About Uplers:
Our goal is to make hiring reliable, simple, and fast. Our role will be to help all our talents find and apply for relevant contractual onsite opportunities and progress in their career. We will support any grievances or challenges you may face during the engagement. You will also be assigned to a dedicated Talent Success Coach during the engagement.
(Note: There are many more opportunities apart from this on the portal. Depending on the assessments you clear, you can apply for them as well).
So, if you are ready for a new challenge, a great work environment, and an opportunity to take your career to the next level, don't hesitate to apply today. We are waiting for you!
Company address
You will be redirected to another website to apply.
Offer ID: #1036232,
Published: 4 days ago,
Company registered: 7 months ago