Job Description
· Project Role :Big Data Developer (Scala ,Hive ,Spark)
· Work Experience : 5 to 11 Years
· Work location : Mumbai
· Interview process : 2- Technical + HM round
· Educational Qualification : 15 years of full time education. Bachelor's Degree in Computer Science ,or Equivalent Degree is desired
Hybrid Mode
Np-Max 30 days.
Job Description Summary
KNOWLEDGE AND EXPERIENCE
Responsibilities : 5-10 years of development experience in object oriented applications with 2-4 years of experience in Scala.
1.In depth understanding/knowledge of Hadoop & spark Architecture and its components such as HDFS, Job Tracker, Task Tracker, executor cores and memory params.
2.Experience in Hadoop development, working experience on SPARK, SCALA is mandatory and Database exposure is must
3.Hands on experience in Spark and Spark Streaming creating RDD's, applying operations -Transformation and Actions.
4.Experience in code optimize to fine tune the applications.
5.Expertise in writing Hadoop/spark Jobs for analyzing data using Spark, Scala, Hive, Kafka and Python
6.Experienced with streaming work flow operations.
7.Experience with developing large-scale distributed applications and developing solutions to analyze large data sets efficiently.
8.Integration with Hadoop/HDFS, Real-Time Systems, Data Warehouses, and Analytics solutions. Experience in Data Warehousing and ETL processes.
+.Strong database, SQL, ETL and data analysis skills.
10.Knowledge in Maintaining the Log and Audit information in Hive/SQL tables, Experienced in providing Logging, Error Handling
11.Analyzed large amounts of data sets to determine optimal way to aggregate and report on it.
12.Configured Spark Streaming to receive real time data from the Apache Kafka and store the stream data to HDFS using Scala.
13.Experienced Scheduling jobs using Airflow/ESP.
14.Experienced in developing scripts for doing transformations using Scala.
15.Involved in developing Shell scripts to orchestrate execution of all other scripts and move the data files within and outside of HDFS.
Job Type: Full-time
Salary: Up to ₹2,500,000.00 per year
· Work Experience : 5 to 11 Years
· Work location : Mumbai
· Interview process : 2- Technical + HM round
· Educational Qualification : 15 years of full time education. Bachelor's Degree in Computer Science ,or Equivalent Degree is desired
Hybrid Mode
Np-Max 30 days.
Job Description Summary
KNOWLEDGE AND EXPERIENCE
Responsibilities : 5-10 years of development experience in object oriented applications with 2-4 years of experience in Scala.
1.In depth understanding/knowledge of Hadoop & spark Architecture and its components such as HDFS, Job Tracker, Task Tracker, executor cores and memory params.
2.Experience in Hadoop development, working experience on SPARK, SCALA is mandatory and Database exposure is must
3.Hands on experience in Spark and Spark Streaming creating RDD's, applying operations -Transformation and Actions.
4.Experience in code optimize to fine tune the applications.
5.Expertise in writing Hadoop/spark Jobs for analyzing data using Spark, Scala, Hive, Kafka and Python
6.Experienced with streaming work flow operations.
7.Experience with developing large-scale distributed applications and developing solutions to analyze large data sets efficiently.
8.Integration with Hadoop/HDFS, Real-Time Systems, Data Warehouses, and Analytics solutions. Experience in Data Warehousing and ETL processes.
+.Strong database, SQL, ETL and data analysis skills.
10.Knowledge in Maintaining the Log and Audit information in Hive/SQL tables, Experienced in providing Logging, Error Handling
11.Analyzed large amounts of data sets to determine optimal way to aggregate and report on it.
12.Configured Spark Streaming to receive real time data from the Apache Kafka and store the stream data to HDFS using Scala.
13.Experienced Scheduling jobs using Airflow/ESP.
14.Experienced in developing scripts for doing transformations using Scala.
15.Involved in developing Shell scripts to orchestrate execution of all other scripts and move the data files within and outside of HDFS.
Job Type: Full-time
Salary: Up to ₹2,500,000.00 per year
💡 Quick Summary
Seeking a career-building opportunity? The Big Data Developer position is now open for candidates interested in the Software Developer Jobs sector. This role in Mumbai offers a professional environment and growth potential.
Requirement Snapshot: Candidates should possess basic communication skills, a proactive attitude, and the ability to work in a team. Experience in Software Developer Jobs is a plus.
