Job Description
Basic Understanding Of
• Scheduling and workflow management & working experience in either ADF, Informatica, Airflow, or Similar
• Enterprise Data Modelling and Semantic Modelling & working experience in ERwin, ER/Studio, PowerDesigner, or Similar
• Logical/Physical model on Big Data sets or modern data warehouse & working experience in ERwin, ER/Studio, PowerDesigner, or Similar
• Agile Process (Scrum cadences, Roles, deliverables) & basic understanding in either Azure DevOps, JIRA, or Similar
• Architecture and data modeling for Data Lake on cloud & working experience in Amazon WebServices (AWS), Microsoft Azure, Google Cloud Platform (GCP)
• Basic understanding of Build and Release management & working experience in Azure DevOps, AWS CodeCommitt, or Similar
Strong In
• Writing code in programming language & working experience in Python, PySpakrk, Scala or Similar
• Big Data Framework & working experience in Spark or Hadoop or Hive (incl. derivatives like pySpark (preferred), SparkScala or SparkSQL) or Similar
• Data warehouse working experience of concepts and development using SQL on single (SQL Server, Oracle or Similar) and parallel platforms (Azure SQL Data Warehouse or Snowflake)
• Code Management & working experience in GIT Hub, Azure DevOps, or Similar
• End to End Architecture and ETL processes & working experience in ETL Tool or Similar
• Reading Data Formats & working experience in JSON, XML, or Similar
• Data integration processes (batch & real- time) using tools & working experience in either Informatica PowerCenter and/or Cloud, Microsoft SSIS,
• MuleSoft, DataStage, Sqoop, or Similar
• Writing requirement, functional & technical documentation & working experience in the Integration design document, architecture documentation, data testing plans or Similar
• SQL queries & working experience in SQL code or Stored Procedures or Functions or Views or Similar
• Database & working experience in any of the database like MS SQL, Oracle, or Similar
• Analytical Problem- Solving skills & working experience in resolving complex problems or Similar
• Communication (read & write in English), Collaboration & Presentation skills & working experience as a team player or Similar.
Good To Have
• Stream Processing & working experience in either Databricks Streaming, Azure Stream Analytics or HD Insight or Kinesis Data Analytics or Similar
• Analytical Warehouse & working experience in either SQL Data Warehouse or Amazon Athena or AWS Redshift or Big Query or Similar
• Real- Time Store & working experience in either Azure Cosmos DB or Amazon Dynamo- DB or Cloud Bigdata or Similar
• Batch Ingestion & working experience in Data Factory or Amazon Kinesis or Lambda or Cloud Pub/Sub or Similar Storage & working experience in Azure Data Lake Storage
• GEN1/GEN2 or Amazon S3 or Cloud Storage or Similar
• Batch Data Processing & working experience in either Azure Databricks or HD Insight or Amazon EMR or AWS Glue or Similar
• Orchestration & working experience in either Data Factory or HDInsight or Data Pipeline or Cloud composer or Similar
(ref:hirist.com
• Scheduling and workflow management & working experience in either ADF, Informatica, Airflow, or Similar
• Enterprise Data Modelling and Semantic Modelling & working experience in ERwin, ER/Studio, PowerDesigner, or Similar
• Logical/Physical model on Big Data sets or modern data warehouse & working experience in ERwin, ER/Studio, PowerDesigner, or Similar
• Agile Process (Scrum cadences, Roles, deliverables) & basic understanding in either Azure DevOps, JIRA, or Similar
• Architecture and data modeling for Data Lake on cloud & working experience in Amazon WebServices (AWS), Microsoft Azure, Google Cloud Platform (GCP)
• Basic understanding of Build and Release management & working experience in Azure DevOps, AWS CodeCommitt, or Similar
Strong In
• Writing code in programming language & working experience in Python, PySpakrk, Scala or Similar
• Big Data Framework & working experience in Spark or Hadoop or Hive (incl. derivatives like pySpark (preferred), SparkScala or SparkSQL) or Similar
• Data warehouse working experience of concepts and development using SQL on single (SQL Server, Oracle or Similar) and parallel platforms (Azure SQL Data Warehouse or Snowflake)
• Code Management & working experience in GIT Hub, Azure DevOps, or Similar
• End to End Architecture and ETL processes & working experience in ETL Tool or Similar
• Reading Data Formats & working experience in JSON, XML, or Similar
• Data integration processes (batch & real- time) using tools & working experience in either Informatica PowerCenter and/or Cloud, Microsoft SSIS,
• MuleSoft, DataStage, Sqoop, or Similar
• Writing requirement, functional & technical documentation & working experience in the Integration design document, architecture documentation, data testing plans or Similar
• SQL queries & working experience in SQL code or Stored Procedures or Functions or Views or Similar
• Database & working experience in any of the database like MS SQL, Oracle, or Similar
• Analytical Problem- Solving skills & working experience in resolving complex problems or Similar
• Communication (read & write in English), Collaboration & Presentation skills & working experience as a team player or Similar.
Good To Have
• Stream Processing & working experience in either Databricks Streaming, Azure Stream Analytics or HD Insight or Kinesis Data Analytics or Similar
• Analytical Warehouse & working experience in either SQL Data Warehouse or Amazon Athena or AWS Redshift or Big Query or Similar
• Real- Time Store & working experience in either Azure Cosmos DB or Amazon Dynamo- DB or Cloud Bigdata or Similar
• Batch Ingestion & working experience in Data Factory or Amazon Kinesis or Lambda or Cloud Pub/Sub or Similar Storage & working experience in Azure Data Lake Storage
• GEN1/GEN2 or Amazon S3 or Cloud Storage or Similar
• Batch Data Processing & working experience in either Azure Databricks or HD Insight or Amazon EMR or AWS Glue or Similar
• Orchestration & working experience in either Data Factory or HDInsight or Data Pipeline or Cloud composer or Similar
(ref:hirist.com
💡 Quick Summary
Seeking a career-building opportunity? The Interesting Opportunity| Data Engineer | Python|Big Data position is now open for candidates interested in the Database Administrator sector. This role in West Bengal offers a professional environment and growth potential.
Requirement Snapshot: Candidates should possess basic communication skills, a proactive attitude, and the ability to work in a team. Experience in Database Administrator is a plus.
