Job Description
We are looking for a Senior spark developer with a minimum of 4+ years of experience, who will be a key member of the overall portfolio, working with a group of skilled and motivated individuals focused on identifying innovative strategies and products that can be integrated into the Platform in order to continue to provide an excellent Client Experience. As a key member of the technical team, you will be involved in reading, transforming, and analyzing vast amounts of raw data from various systems using Spark to perform Data Quality checks and provide a feed for various analytics in the product.
Responsibilities
• Create Scala/Spark jobs for data transformation and aggregation.
• Produce unit tests for Spark transformations and helper methods.
• Write Scala doc-style documentation with all code.
• Design data processing pipelines
Requirements
• Experience: 4+ yrs
• Scala (with a focus on the functional programming paradigm)
• Apache Spark 3 x
• Spark query tuning and performance optimization
• SQL database integration with major Relation, file, NoSQL, and cloud data sources
• Experience working withS3/ADLS/Big Query
• Scala test, JUnit, Mockito
• Deep understanding of distributed systems
Responsibilities
• Create Scala/Spark jobs for data transformation and aggregation.
• Produce unit tests for Spark transformations and helper methods.
• Write Scala doc-style documentation with all code.
• Design data processing pipelines
Requirements
• Experience: 4+ yrs
• Scala (with a focus on the functional programming paradigm)
• Apache Spark 3 x
• Spark query tuning and performance optimization
• SQL database integration with major Relation, file, NoSQL, and cloud data sources
• Experience working withS3/ADLS/Big Query
• Scala test, JUnit, Mockito
• Deep understanding of distributed systems
💡 Quick Summary
Seeking a career-building opportunity? The Senior | Lead Spark Developer position is now open for candidates interested in the Software Developer Jobs sector. This role in Hyderabad offers a professional environment and growth potential.
Requirement Snapshot: Candidates should possess basic communication skills, a proactive attitude, and the ability to work in a team. Experience in Software Developer Jobs is a plus.
