Job Description
Job description
We are looking for a Lead ETL Developer to join our C3 Data team based in Bangalore. This role offers a unique opportunity to work on Clarivate Customer Cloud (C3) and make rich content available across the Clarivate platform to all customers. As the Lead ETL Developer, you will support the data team by loading new content to Clarivate Customer Cloud, and you will have the chance to work with modern, cutting-edge big data technologies. Our team has expertise in Python, PySpark, Spark, Databricks, ECS, AWS, and Airflow -- and we would love to speak with you if you have experience in Spark, Databricks, or PySpark.
About You – experience, education, skills, and accomplishments
• At least 5+ years of experience in building ETL pipelines and proficiency in PySpark.
• At least 2 years of proficient in Python3 and experience with Databricks and Apache Spark
• Strong SQL and non-SQL database skills.
• Passionate about code and software architecture.
It would be great if you also had
• AWS services: EC2, ECS, RDS, S3
• OpenSearch, Snowflake
• Oracle, PostgreSQL
• Docker
What will you be doing in this role?
• Providing technical leadership and guidance, evaluating various technologies to balance business needs and cost-effectiveness.
• Collaborating with business and IT teams to design and implement a data lake platform.
• Maintaining the overall solution architecture for the data lake platform.
• Establishing technical best practices for big data management and solutions, from technology selection to architecture and implementation.
• Ensuring all components of the data lake platform meet SLAs.
• Leading technical investigations, POCs, and hands-on coding to make technical recommendations.
• Mentoring and coaching team members to enhance their technical and professional skills.
About the Team
The C3 Data team consists of over 50 experts across the globe who work on Clarivate Customer Cloud to provide access to data for products, consulting-led engagements, or direct customer access.
Hours of Work
This is a permanent position in Bangalore (8 hours per day as per IST Time zone).
At Clarivate, we are committed to providing equal employment opportunities for all persons with respect to hiring, compensation, promotion, training, and other terms, conditions, and privileges of employment. We comply with applicable laws and regulations governing non-discrimination in all locations.
We are looking for a Lead ETL Developer to join our C3 Data team based in Bangalore. This role offers a unique opportunity to work on Clarivate Customer Cloud (C3) and make rich content available across the Clarivate platform to all customers. As the Lead ETL Developer, you will support the data team by loading new content to Clarivate Customer Cloud, and you will have the chance to work with modern, cutting-edge big data technologies. Our team has expertise in Python, PySpark, Spark, Databricks, ECS, AWS, and Airflow -- and we would love to speak with you if you have experience in Spark, Databricks, or PySpark.
About You – experience, education, skills, and accomplishments
• At least 5+ years of experience in building ETL pipelines and proficiency in PySpark.
• At least 2 years of proficient in Python3 and experience with Databricks and Apache Spark
• Strong SQL and non-SQL database skills.
• Passionate about code and software architecture.
It would be great if you also had
• AWS services: EC2, ECS, RDS, S3
• OpenSearch, Snowflake
• Oracle, PostgreSQL
• Docker
What will you be doing in this role?
• Providing technical leadership and guidance, evaluating various technologies to balance business needs and cost-effectiveness.
• Collaborating with business and IT teams to design and implement a data lake platform.
• Maintaining the overall solution architecture for the data lake platform.
• Establishing technical best practices for big data management and solutions, from technology selection to architecture and implementation.
• Ensuring all components of the data lake platform meet SLAs.
• Leading technical investigations, POCs, and hands-on coding to make technical recommendations.
• Mentoring and coaching team members to enhance their technical and professional skills.
About the Team
The C3 Data team consists of over 50 experts across the globe who work on Clarivate Customer Cloud to provide access to data for products, consulting-led engagements, or direct customer access.
Hours of Work
This is a permanent position in Bangalore (8 hours per day as per IST Time zone).
At Clarivate, we are committed to providing equal employment opportunities for all persons with respect to hiring, compensation, promotion, training, and other terms, conditions, and privileges of employment. We comply with applicable laws and regulations governing non-discrimination in all locations.
💡 Quick Summary
Seeking a career-building opportunity? The Lead Software Engineer (Lead ETL PySpark Developer) position is now open for candidates interested in the Software Developer Jobs sector. This role in Bangalore offers a professional environment and growth potential.
Requirement Snapshot: Candidates should possess basic communication skills, a proactive attitude, and the ability to work in a team. Experience in Software Developer Jobs is a plus.