Job Description
Job Purpose
"The Data Engineer is responsible for developing day to day data engineering projects and aiding in building the business’ data collection systems and processing pipelines.
Responsible for efficient code for building and maintaining optimized and highly available data pipelines that facilitate deeper analysis and reporting by the Data and Analytics department.
He/She works with Data and Analytics teams in leveraging data with reporting and scientific tools, for example, Tableau, Python, and Spark.
The Data Engineer strives to continuously develop most efficient code for data pipeline or use case needs."
Roles & Responsibilities
• Minimum 2-3 years of Data Engineering experience
• Proven experience in in SQL, Spark, Hadoop ecosystem
• Have worked on multiple TBs of data volume from ingestion to consumption.
• Work with business stakeholders to identify and document high impact business problems and potential solutions.
• Good understanding of Data Lake/Lakehouse architecture and experience/exposure to Hadoop (cloudera , hortonworks) and/or AWS
• Work on end-to-end data lifecycle from Data Ingestion, Data Transformation and Data Consumption layer. Versed with API and its usability.
• A suitable candidate will also be proficient in Spark, Spark Streaming, hive, SQLs.
• A suitable candidate will also demonstrate experience with big data infrastructure inclusive of MapReduce, Hive, HDFS, YARN, HBase, Oozie, etc.
• The candidate will additionally demonstrate substantial experience and a deep knowledge of relational databases.
• Good skills in technical debugging of the code in case of issues. Also, working with git for code versioning
• Creating Technical Design Documentation of the projects/pipelines"
Secondary Responsibilities
• Ability to work independently and handle your own development effort.
• Excellent oral and written communication skills Learn and use internally available analytic technologies.
• Identify key performance indicators and create educational/deliverables path to achieve the same.
• Use educational background in data engineering and perform data mining analysis.
• Work with BI analysts/engineers to create prototypes.
• Engage in the delivery and presentation of solutions.
• Managerial & Leadership Responsibilities
• Key Success Metrics "Ensure timely deliverables.
• Write and maintain excellent code quality
"The Data Engineer is responsible for developing day to day data engineering projects and aiding in building the business’ data collection systems and processing pipelines.
Responsible for efficient code for building and maintaining optimized and highly available data pipelines that facilitate deeper analysis and reporting by the Data and Analytics department.
He/She works with Data and Analytics teams in leveraging data with reporting and scientific tools, for example, Tableau, Python, and Spark.
The Data Engineer strives to continuously develop most efficient code for data pipeline or use case needs."
Roles & Responsibilities
• Minimum 2-3 years of Data Engineering experience
• Proven experience in in SQL, Spark, Hadoop ecosystem
• Have worked on multiple TBs of data volume from ingestion to consumption.
• Work with business stakeholders to identify and document high impact business problems and potential solutions.
• Good understanding of Data Lake/Lakehouse architecture and experience/exposure to Hadoop (cloudera , hortonworks) and/or AWS
• Work on end-to-end data lifecycle from Data Ingestion, Data Transformation and Data Consumption layer. Versed with API and its usability.
• A suitable candidate will also be proficient in Spark, Spark Streaming, hive, SQLs.
• A suitable candidate will also demonstrate experience with big data infrastructure inclusive of MapReduce, Hive, HDFS, YARN, HBase, Oozie, etc.
• The candidate will additionally demonstrate substantial experience and a deep knowledge of relational databases.
• Good skills in technical debugging of the code in case of issues. Also, working with git for code versioning
• Creating Technical Design Documentation of the projects/pipelines"
Secondary Responsibilities
• Ability to work independently and handle your own development effort.
• Excellent oral and written communication skills Learn and use internally available analytic technologies.
• Identify key performance indicators and create educational/deliverables path to achieve the same.
• Use educational background in data engineering and perform data mining analysis.
• Work with BI analysts/engineers to create prototypes.
• Engage in the delivery and presentation of solutions.
• Managerial & Leadership Responsibilities
• Key Success Metrics "Ensure timely deliverables.
• Write and maintain excellent code quality
💡 Quick Summary
Seeking a career-building opportunity? The Data Engineer position is now open for candidates interested in the Bank Jobs sector. This role in Mumbai offers a professional environment and growth potential.
Requirement Snapshot: Candidates should possess basic communication skills, a proactive attitude, and the ability to work in a team. Experience in Bank Jobs is a plus.
