Senior PySpark Data Engineer

Experience: 5.00 + years

Salary: Confidential (based on experience)

Shift: (GMT+05:30) Asia/Kolkata (IST)

Opportunity Type: Remote

Placement Type: Full time Permanent Position

(*Note: This is a requirement for one of Uplers client - Edstem Technologies)

What do you need for this opportunity

Must have skills required:

SQL, Python, Pyspark, Data Architectures, Data Pipelines, Airflow

Edstem Technologies is Looking for:

Role Overview Description

The Senior Data Engineer will work collaboratively with Data Science and Analytics teams to build scalable, robust, and efficient data pipelines to enable data-driven decision making.

Responsible for designing data architectures, building/maintaining data pipelines, and integrating and transforming data from various sources to maximize accessibility and usability.

Roles & Responsibilities

Design reliable and scalable data architectures and pipelines for streaming and batch data

Develop complex ETL processes to extract, transform and load data from various sources to destinations

Work on data quality monitoring and optimization processes

Collaborate with data scientists and analyst to understand their data and analytics needs

Qualifications

5+ years of experience as a Data Engineer

Expert level knowledge of SQL, Python and PySpark

Experience In Airflow Is Preferred

Strong software engineering fundamentals including systems design, algorithmic thinking and complexity analysis

How to apply for this opportunity

• Register or login on our portal & fill out the application form.

• Clear the given Video Screening (30 min) and Click on Apply to get shortlisted

• Once it's all done, your profile will be shared with the client for the Interview round.

• When selected, just meet the client and get your exciting career started!

About Uplers:

Our goal is to make hiring reliable, simple, and fast. Our role will be to help all our talents find and apply for relevant contractual onsite opportunities and progress in their career. We will support any grievances or challenges you may face during the engagement. You will also be assigned to a dedicated Talent Success Coach during the engagement.

(Note: There are many more opportunities apart from this on the portal. Depending on the assessments you clear, you can apply for them as well).

So, if you are ready for a new challenge, a great work environment, and an opportunity to take your career to the next level, don't hesitate to apply today. We are waiting for you!