Description
Role/ Job Title: Associate Data Engineer
Business: New Age
Function/ Department: Data & Analytics
Place of Work: Mumbai/Bangalore
Roles & Responsibilities:
'Minimum 1-2 years of Data Engineering experience
Proven experience in in SQL, Hadoop ecosystem
Have worked on multiple GBs/TBs of data volume from ingestion to consumption
Work with business stakeholders to identify and document business problems write code for business logic
Understanding of Data Lake/Lakehouse architecture and experience/exposure to Hadoop (cloudera, hortonworks) and/or AWS
Worked on complete or part of data ingestion pipeline and complete understanding of data warehouse A suitable candidate will also be proficient in Spark, hive, SQLs. A suitable candidate may demonstrate experience with big data infrastructure inclusive of MapReduce, Hive, HDFS, YARN, HBase, Oozie, etc. Skilled in technical debugging of the code in case of issues. Also, working with git for code versioning
Creating Technical Design Documentation of the projects/pipelines
Secondary Responsibilities :
'Ability to work independently and take active help from seniors in case of issues
Excellent oral and written communication skills Learn and use internally available analytic technologies
Identify key performance indicators and create educational/deliverables path to achieve the same
Use educational background in data engineering and perform data mining analysis
Work with BI analysts/engineers to create prototypes
Engage in the delivery and presentation of use cases
Key Success Metrics:
'Ensure timely deliverables.
Write and maintain excellent code quality Spot Data fixes. Solutionize technical aspects of the projects. Error free deliverables