Pyspark Developer

Location: Chennai, Tamil Nadu

Category: Software Developer Jobs

Role: Pyspark Developer

Experience : 4+years

Location : Chennai, Hyderbad

Required Skill Set:

• Pyspark

• sql

Must-Have:

• Determining business needs via consultation, business analysis, and targeted observations.

• Assessing existing IT infrastructure and recommending improvements.

• Analyse requirement document(blueprint) received from business analyst for key decision making and strategic planning.

• Create High and Low-Level Design of the requirement for the complete development process and design the appropriate structure of tables.

• Develop PySpark scripts to process the source data ,calculate KPIs and load it into target.

• Troubleshooting and resolving issues to optimize performance.

• Experience in enhancing long running PySpark jobs to take less execution time using different resource allocation techniques ,caching, rewriting SQLs

Apply on Company Website You will be redirected to the employer’s website