Job Description
Job description
Job Summary
We are seeking a Hadoop Engineer to join our team in Sydney. This role will be part of a major project for a Global Consulting firm.
Key Responsibilities:
Implementation experience in Big Data Platform, preferably in Cloudera Hadoop platform.
Minimum 2 years of development experience using Hadoop ecosystem tools & utilities: MapReduce, PySpark, Kafka, Sqoop, Impala, Hive, etc.
Minimum 2 years of development experience in traditional Enterprise Data Warehouse (EDW), ETL design & development using Informatica or Talend.
Ability to work independently and contribute to overall architecture and design.
Experience in writing Shell scripts in Linux Platform.
Knowledge of API management concepts and design.
Experience in CI/CD deployment automation in Big Data Platform.
Experience with Metadata management tools like Informatica Metadata Manager or Collibra.
Requirements:
Strong understanding of Hadoop ecosystem tools & utilities.
Experience in traditional Enterprise Data Warehouse (EDW) and ETL design & development.
Ability to work collaboratively and independently.
Excellent problem-solving skills and attention to detail.
Strong communication and interpersonal skills.
About Us:
We are a leading Recruitment Company based in Australia, specializing in Digital, ERP, and larger IT Services. We offer flexible, efficient, and collaborative solutions to any organization that requires IT experts.
Job Summary
We are seeking a Hadoop Engineer to join our team in Sydney. This role will be part of a major project for a Global Consulting firm.
Key Responsibilities:
Implementation experience in Big Data Platform, preferably in Cloudera Hadoop platform.
Minimum 2 years of development experience using Hadoop ecosystem tools & utilities: MapReduce, PySpark, Kafka, Sqoop, Impala, Hive, etc.
Minimum 2 years of development experience in traditional Enterprise Data Warehouse (EDW), ETL design & development using Informatica or Talend.
Ability to work independently and contribute to overall architecture and design.
Experience in writing Shell scripts in Linux Platform.
Knowledge of API management concepts and design.
Experience in CI/CD deployment automation in Big Data Platform.
Experience with Metadata management tools like Informatica Metadata Manager or Collibra.
Requirements:
Strong understanding of Hadoop ecosystem tools & utilities.
Experience in traditional Enterprise Data Warehouse (EDW) and ETL design & development.
Ability to work collaboratively and independently.
Excellent problem-solving skills and attention to detail.
Strong communication and interpersonal skills.
About Us:
We are a leading Recruitment Company based in Australia, specializing in Digital, ERP, and larger IT Services. We offer flexible, efficient, and collaborative solutions to any organization that requires IT experts.
💡 Quick Summary
Seeking a career-building opportunity? The Hadoop Engineer position is now open for candidates interested in the IT Engineer & Developer Jobs sector. This role in Sydney offers a professional environment and growth potential.
Requirement Snapshot: Candidates should possess basic communication skills, a proactive attitude, and the ability to work in a team. Experience in IT Engineer & Developer Jobs is a plus.
