Job Description
Big Data Engineer
Industry: IT Services & Consulting — Big Data & Analytics sector. We deliver large-scale data platforms, ETL and streaming solutions to help enterprises operationalize analytics and drive data-led decisions. This on-site role is based in India and seeks hands-on engineers to build, tune and support production-grade data pipelines.
Role & Responsibilities
• Design, build and maintain scalable batch and real-time data pipelines for ingestion, transformation and delivery to data lakes and analytics platforms.
• Implement ETL/ELT workflows using Spark and Hadoop ecosystems to process structured and unstructured data at scale.
• Develop and optimise Kafka-based streaming solutions for near real-time event processing and integration with downstream systems.
• Troubleshoot performance issues, perform query tuning (Hive/Spark SQL), and implement data partitioning/file formats (Parquet/ORC) for cost and latency improvements.
• Collaborate with data engineers, data scientists and platform teams to define schema, data contracts, and reliable data delivery SLAs.
• Create operational runbooks, monitoring alerts and CI/CD pipelines to ensure high availability and rapid deployments in on-site environments.
Skills & Qualifications
Must-Have
• Hadoop
• Apache Spark
• Apache Hive
• Apache Kafka
• Python
• SQL
Preferred
• Apache Airflow
• Scala
• AWS EMR
Benefits & Culture Highlights
• On-site, collaborative engineering environment focused on operational excellence and hands-on ownership.
• Opportunities for technical growth across data engineering, streaming architectures and cloud migrations.
• Competitive compensation and clear paths for career progression in a fast-growing analytics practice.
Location: India (On-site). To apply, please submit your resume highlighting relevant Big Data project experience, production deployments and the tools listed above.
Skills: apache spark,hadoop,bid data,sql,apache kafka,python
Industry: IT Services & Consulting — Big Data & Analytics sector. We deliver large-scale data platforms, ETL and streaming solutions to help enterprises operationalize analytics and drive data-led decisions. This on-site role is based in India and seeks hands-on engineers to build, tune and support production-grade data pipelines.
Role & Responsibilities
• Design, build and maintain scalable batch and real-time data pipelines for ingestion, transformation and delivery to data lakes and analytics platforms.
• Implement ETL/ELT workflows using Spark and Hadoop ecosystems to process structured and unstructured data at scale.
• Develop and optimise Kafka-based streaming solutions for near real-time event processing and integration with downstream systems.
• Troubleshoot performance issues, perform query tuning (Hive/Spark SQL), and implement data partitioning/file formats (Parquet/ORC) for cost and latency improvements.
• Collaborate with data engineers, data scientists and platform teams to define schema, data contracts, and reliable data delivery SLAs.
• Create operational runbooks, monitoring alerts and CI/CD pipelines to ensure high availability and rapid deployments in on-site environments.
Skills & Qualifications
Must-Have
• Hadoop
• Apache Spark
• Apache Hive
• Apache Kafka
• Python
• SQL
Preferred
• Apache Airflow
• Scala
• AWS EMR
Benefits & Culture Highlights
• On-site, collaborative engineering environment focused on operational excellence and hands-on ownership.
• Opportunities for technical growth across data engineering, streaming architectures and cloud migrations.
• Competitive compensation and clear paths for career progression in a fast-growing analytics practice.
Location: India (On-site). To apply, please submit your resume highlighting relevant Big Data project experience, production deployments and the tools listed above.
Skills: apache spark,hadoop,bid data,sql,apache kafka,python
💡 Quick Summary
Seeking a career-building opportunity? The Bigdata Developers position is now open for candidates interested in the IT Engineer & Developer Jobs sector. This role in Bangalore offers a professional environment and growth potential.
Requirement Snapshot: Candidates should possess basic communication skills, a proactive attitude, and the ability to work in a team. Experience in IT Engineer & Developer Jobs is a plus.