Job Description
Description
Are you passionate about helping people improve the impact of their business through the use of data and analytics? If you enjoy the challenges associated with making complex information systems more user-friendly and effective, we are looking for you to join a team of creative and highly motivated professionals who are driving innovation in the upstream oil field services industry! At National Oilwell Varco, we strive to lead technology innovation that delivers significant value to our customers. We are hiring a Data Engineer to help us build the data delivery pipeline.
Responsibilities
- This role carries a variety of responsibilities, including:
- Assist in implementing performant data ingestion pipelines from multiple sources
- Assist in Building large scale data migration scripts to migrate big data from native files in OSI PI and Timescale database into Data Lake
- Use data migration tools such as TwinTalk to migrate data between platforms
- Working with event based / streaming technologies to ingest and process data, Building scripts to read data from brokers like NATS and Kafka.
- Building utilities to monitor data migration scripts and streams
- Building automation for repetitive tasks carried out by support team that facilitate ML operations.
- Create/support Data APIs/packages to provide data to the customers
- Document the technical and usage details of all the tools
Skills
We're looking for a candidate with the right mix of technical and interpersonal skills for this role. Qualifications include:
Technical
- We believe applicants should have 5+ years of relevant experience with:
- Automation and scripting using .net, C#, Python, Javascript, GoLang, AWS Cloud APIs
- Database technologies and Timeseries databases like OSIPI, PostgreSQL, Timescale and SQL
- Developing applications and/or scripts utilizing Timeseries data
- Exposure/understanding with spark and/or Databricks(preferred), including spark cluster tuning.
- Linux, Windows OS, Containers
- Data management and data integration strategies
- Amazon Web services and/or cloud technologies
- Visualization/reporting tools such as Tableau, Spotfire, Grafana, etc.
- Understanding of CI/CD practices and technologies. GitHub and GitHub Actions(preferred), Jenkins, TeamCity, Udeploy, etc.
- Optimally communicating technical information
- Preferred Additional Experience
- Working knowledge of ML and AI model development and the data science development life cycle
- Experience with large datasets and understanding of batch processing
- Datadog
- Brokers like Kafka or NATS
- Container technologies
- Terraform
Interpersonal
- Ability to relate architectural decisions and recommendations to business needs
- Strong analytical and problem-solving skills
- Ability to communicate across all levels of the organization and work with diverse projects teams
- Willingness to demonstrate a growth-mindset when faced with new challenges and opportunities
Education
We prefer applicants who possess a Bachelors degree in computer science, information systems, or a related field. However, relevant experience will be
considered.
NOV is an equal opportunity employer.
We will ensure that individuals with disabilities are provided reasonable accommodation to participate in the job application or interview process, to perform essential job functions, and to receive other benefits and privileges of employment. Please contact us to request accommodation
Are you passionate about helping people improve the impact of their business through the use of data and analytics? If you enjoy the challenges associated with making complex information systems more user-friendly and effective, we are looking for you to join a team of creative and highly motivated professionals who are driving innovation in the upstream oil field services industry! At National Oilwell Varco, we strive to lead technology innovation that delivers significant value to our customers. We are hiring a Data Engineer to help us build the data delivery pipeline.
Responsibilities
- This role carries a variety of responsibilities, including:
- Assist in implementing performant data ingestion pipelines from multiple sources
- Assist in Building large scale data migration scripts to migrate big data from native files in OSI PI and Timescale database into Data Lake
- Use data migration tools such as TwinTalk to migrate data between platforms
- Working with event based / streaming technologies to ingest and process data, Building scripts to read data from brokers like NATS and Kafka.
- Building utilities to monitor data migration scripts and streams
- Building automation for repetitive tasks carried out by support team that facilitate ML operations.
- Create/support Data APIs/packages to provide data to the customers
- Document the technical and usage details of all the tools
Skills
We're looking for a candidate with the right mix of technical and interpersonal skills for this role. Qualifications include:
Technical
- We believe applicants should have 5+ years of relevant experience with:
- Automation and scripting using .net, C#, Python, Javascript, GoLang, AWS Cloud APIs
- Database technologies and Timeseries databases like OSIPI, PostgreSQL, Timescale and SQL
- Developing applications and/or scripts utilizing Timeseries data
- Exposure/understanding with spark and/or Databricks(preferred), including spark cluster tuning.
- Linux, Windows OS, Containers
- Data management and data integration strategies
- Amazon Web services and/or cloud technologies
- Visualization/reporting tools such as Tableau, Spotfire, Grafana, etc.
- Understanding of CI/CD practices and technologies. GitHub and GitHub Actions(preferred), Jenkins, TeamCity, Udeploy, etc.
- Optimally communicating technical information
- Preferred Additional Experience
- Working knowledge of ML and AI model development and the data science development life cycle
- Experience with large datasets and understanding of batch processing
- Datadog
- Brokers like Kafka or NATS
- Container technologies
- Terraform
Interpersonal
- Ability to relate architectural decisions and recommendations to business needs
- Strong analytical and problem-solving skills
- Ability to communicate across all levels of the organization and work with diverse projects teams
- Willingness to demonstrate a growth-mindset when faced with new challenges and opportunities
Education
We prefer applicants who possess a Bachelors degree in computer science, information systems, or a related field. However, relevant experience will be
considered.
NOV is an equal opportunity employer.
We will ensure that individuals with disabilities are provided reasonable accommodation to participate in the job application or interview process, to perform essential job functions, and to receive other benefits and privileges of employment. Please contact us to request accommodation
💡 Quick Summary
Seeking a career-building opportunity? The Data Engineer | Digital Services position is now open for candidates interested in the Database Administrator sector. This role in Surat offers a professional environment and growth potential.
Requirement Snapshot: Candidates should possess basic communication skills, a proactive attitude, and the ability to work in a team. Experience in Database Administrator is a plus.
