Job Description
Skill - Pyspark QA
Role / Tier - Senior Consultant / Tier 2
Job Description:
Experience with BIG Data technology mentioned below Hadoop Big Data HDFS,PYTHON,SPARK SQL MapReduce with PYSpark.
Hands on experience in build CI CD pipelines is required Outstanding coding, debugging and analytical skills,Core problem solving skills and data migration from different databases.
Good knowledge at using Spark APIs to cleanse,explore,aggregate,transform, store analyse available data and potential solutions,
eliminate possible solutions and select an optimal solution.
Experience in distributed processing, storage frameworks,RDD,Dataframe with operation like diff Action Transformation
Experience in UDF,Lambda,pandas,numpy.
Experience in installing,configuring, debugging and troubleshooting Hadoop clusters is desired skill.
Preferred skills
knowledge of deploying and managing ETL pipelines,RDBMS technologies PostgreSQL,MySQL,Oracle,etc.
knowledge with modern DevOps toolchains.
knowledge of dataframes,Pandas,data visualization tools,data mining.
knowledge of statistical ,machine learning models and business intelligence.
knowledge of JIRA,Bitbucket GitHub and scheduling tools like Automic Airflow.
knowledge of cloud-based infrastructure, AWS services EC2,EMR,S3,Lambda,EBS, IAM,Redshift,RDS etc
Role / Tier - Senior Consultant / Tier 2
Job Description:
Experience with BIG Data technology mentioned below Hadoop Big Data HDFS,PYTHON,SPARK SQL MapReduce with PYSpark.
Hands on experience in build CI CD pipelines is required Outstanding coding, debugging and analytical skills,Core problem solving skills and data migration from different databases.
Good knowledge at using Spark APIs to cleanse,explore,aggregate,transform, store analyse available data and potential solutions,
eliminate possible solutions and select an optimal solution.
Experience in distributed processing, storage frameworks,RDD,Dataframe with operation like diff Action Transformation
Experience in UDF,Lambda,pandas,numpy.
Experience in installing,configuring, debugging and troubleshooting Hadoop clusters is desired skill.
Preferred skills
knowledge of deploying and managing ETL pipelines,RDBMS technologies PostgreSQL,MySQL,Oracle,etc.
knowledge with modern DevOps toolchains.
knowledge of dataframes,Pandas,data visualization tools,data mining.
knowledge of statistical ,machine learning models and business intelligence.
knowledge of JIRA,Bitbucket GitHub and scheduling tools like Automic Airflow.
knowledge of cloud-based infrastructure, AWS services EC2,EMR,S3,Lambda,EBS, IAM,Redshift,RDS etc
💡 Quick Summary
Seeking a career-building opportunity? The Pyspark QA in | India position is now open for candidates interested in the MIS Executive sector. This role in Chennai offers a professional environment and growth potential.
Requirement Snapshot: Candidates should possess basic communication skills, a proactive attitude, and the ability to work in a team. Experience in MIS Executive is a plus.
