Job Description
Responsibilities
• The ideal candidate should have advanced SQL skills and be able to query and transform large structured/unstructured datasets using Spark/PySpark, Spark SQL/Hive and Hive/NoSQL.
• They should also have experience in developing Big Data pipelines in orchestration tools such as Airflow and Oozie, monitoring, data controls, and self-service ETL/Analytics pipelines.
• Other requirements include hands-on experience with On-Prem Big Data Platform, sound knowledge of Distributed Data Processing frameworks like YARN, and proficiency in writing data pipelines using Spark, Python
• The ideal candidate should also have experience in developing frameworks/utilities in Python, working in a Dev/Ops environment, and following development best practices such as code reviews and unit testing.
Required Skills
• 10+ years of experience
• 6+ years of experience with Big Data Engineer
• Big Data Technologies: Knowledge of Big Data technologies such as Hadoop, Spark, Hive
• Distributed Systems: Understanding of distributed systems and distributed computing principles
• Programming Languages: Proficiency in programming languages such as Java, Python, Scala, and SQL.
• Performance Tuning: Experience with performance tuning and optimization techniques for Big Data systems to ensure scalability, reliability, and high availability.
For more information on this role please visit our careers page https://www.dataflix.com/careers
• The ideal candidate should have advanced SQL skills and be able to query and transform large structured/unstructured datasets using Spark/PySpark, Spark SQL/Hive and Hive/NoSQL.
• They should also have experience in developing Big Data pipelines in orchestration tools such as Airflow and Oozie, monitoring, data controls, and self-service ETL/Analytics pipelines.
• Other requirements include hands-on experience with On-Prem Big Data Platform, sound knowledge of Distributed Data Processing frameworks like YARN, and proficiency in writing data pipelines using Spark, Python
• The ideal candidate should also have experience in developing frameworks/utilities in Python, working in a Dev/Ops environment, and following development best practices such as code reviews and unit testing.
Required Skills
• 10+ years of experience
• 6+ years of experience with Big Data Engineer
• Big Data Technologies: Knowledge of Big Data technologies such as Hadoop, Spark, Hive
• Distributed Systems: Understanding of distributed systems and distributed computing principles
• Programming Languages: Proficiency in programming languages such as Java, Python, Scala, and SQL.
• Performance Tuning: Experience with performance tuning and optimization techniques for Big Data systems to ensure scalability, reliability, and high availability.
For more information on this role please visit our careers page https://www.dataflix.com/careers
💡 Quick Summary
Seeking a career-building opportunity? The Sr| Big Data Developer position is now open for candidates interested in the Software Developer Jobs sector. This role in Hyderabad offers a professional environment and growth potential.
Requirement Snapshot: Candidates should possess basic communication skills, a proactive attitude, and the ability to work in a team. Experience in Software Developer Jobs is a plus.
