Job Description
Spark Scala Developer
Shift- Malaysian / EUR
Exp- 8 yrs
Full time Contract Opportunity
Fully Remote
please share resume at [email protected]
Responsibilities-
Create Scala / Spark jobs for data transformation and aggregation
Produce unit tests for Spark transformations and helper methods
Write Scaladoc-style documentation with all code
Design data processing pipelines
Skills-
Scala (with a focus on the functional programming paradigm)
Scalatest, JUnit, Mockito, Embedded Cassandra
Apache Spark 2.x
Apache Spark RDD API
Apache Spark SQL Data Frame API
Apache Spark MLlib API
Apache Spark GraphX API
Apache Spark Streaming API
Spark query tuning and performance optimization
Data Modelling, Data Warehousing, Hadoop, Hive, ETL
SQL database integration ,Microsoft, Oracle, Postgres, and / or MySQL
Experience working with HDFS, S3, Cassandra, and / or DynamoDB
Deep understanding of distributed systems (e.g. CAP theorem, partitioning, replication, consistency, and consensus)
Shift- Malaysian / EUR
Exp- 8 yrs
Full time Contract Opportunity
Fully Remote
please share resume at [email protected]
Responsibilities-
Create Scala / Spark jobs for data transformation and aggregation
Produce unit tests for Spark transformations and helper methods
Write Scaladoc-style documentation with all code
Design data processing pipelines
Skills-
Scala (with a focus on the functional programming paradigm)
Scalatest, JUnit, Mockito, Embedded Cassandra
Apache Spark 2.x
Apache Spark RDD API
Apache Spark SQL Data Frame API
Apache Spark MLlib API
Apache Spark GraphX API
Apache Spark Streaming API
Spark query tuning and performance optimization
Data Modelling, Data Warehousing, Hadoop, Hive, ETL
SQL database integration ,Microsoft, Oracle, Postgres, and / or MySQL
Experience working with HDFS, S3, Cassandra, and / or DynamoDB
Deep understanding of distributed systems (e.g. CAP theorem, partitioning, replication, consistency, and consensus)
💡 Quick Summary
Seeking a career-building opportunity? The Spark Scala Developer position is now open for candidates interested in the Helper Jobs sector. This role in Anand offers a professional environment and growth potential.
Requirement Snapshot: Candidates should possess basic communication skills, a proactive attitude, and the ability to work in a team. Experience in Helper Jobs is a plus.
