Job Description
Responsibilities :
- Build and optimize model serving infrastructure with a focus on inference latency and cost optimization.
- Architect efficient inference pipelines that balance latency, throughput, and cost across various acceleration options.
- Develop monitoring and observability solutions for ML systems.
- Collaborate with ML Engineers to establish best practices for optimized model deployment.
- Implement cost-efficient, enterprise-scale solutions.
- Collaborate in a cross-functional, distributed team for continuous system improvement.
- Work with MLEs, QA Engineers, and DevOps Engineers.
- Evaluate and implement new technologies and tools.
- Contribute to architectural decisions for distributed ML systems.
Requirements :
- 5+ years of experience in software engineering with Python.
- Experience with ML frameworks, particularly PyTorch.
- Experience optimizing ML models with hardware acceleration (AWS Neuron, ONNX, TensorRT).
- Experience with AWS ML services and hardware-accelerated instances (Sagemaker, Inferentia, Trainium).
- Proven experience building and operating AWS serverless architectures.
- Deep understanding of event-driven processing patterns, SQS/SNS, and serverless caching solutions.
- Experience with containerization using Docker and orchestration tools.
- Strong knowledge of RESTful API design and implementation.
- Proficiency in writing good-quality and secure code, and being familiar with static code analysis tools.
- Excellent analytical, conceptual, and communication skills in spoken and written English.
- Experience applying Computer Science fundamentals in algorithm design, problem solving, and complexity analysis.
- Experience with any of the following: model compilation and quantization, performance profiling, and benchmarking ML inference systems.
- Experience working in regulated industries with strict compliance requirements for cloud-native solutions.
(ref:hirist.tech)
- Build and optimize model serving infrastructure with a focus on inference latency and cost optimization.
- Architect efficient inference pipelines that balance latency, throughput, and cost across various acceleration options.
- Develop monitoring and observability solutions for ML systems.
- Collaborate with ML Engineers to establish best practices for optimized model deployment.
- Implement cost-efficient, enterprise-scale solutions.
- Collaborate in a cross-functional, distributed team for continuous system improvement.
- Work with MLEs, QA Engineers, and DevOps Engineers.
- Evaluate and implement new technologies and tools.
- Contribute to architectural decisions for distributed ML systems.
Requirements :
- 5+ years of experience in software engineering with Python.
- Experience with ML frameworks, particularly PyTorch.
- Experience optimizing ML models with hardware acceleration (AWS Neuron, ONNX, TensorRT).
- Experience with AWS ML services and hardware-accelerated instances (Sagemaker, Inferentia, Trainium).
- Proven experience building and operating AWS serverless architectures.
- Deep understanding of event-driven processing patterns, SQS/SNS, and serverless caching solutions.
- Experience with containerization using Docker and orchestration tools.
- Strong knowledge of RESTful API design and implementation.
- Proficiency in writing good-quality and secure code, and being familiar with static code analysis tools.
- Excellent analytical, conceptual, and communication skills in spoken and written English.
- Experience applying Computer Science fundamentals in algorithm design, problem solving, and complexity analysis.
- Experience with any of the following: model compilation and quantization, performance profiling, and benchmarking ML inference systems.
- Experience working in regulated industries with strict compliance requirements for cloud-native solutions.
(ref:hirist.tech)
💡 Quick Summary
Seeking a career-building opportunity? The Software Development Engineer III - Mlops position is now open for candidates interested in the IT Engineer & Developer Jobs sector. This role in Bangalore offers a professional environment and growth potential.
Requirement Snapshot: Candidates should possess basic communication skills, a proactive attitude, and the ability to work in a team. Experience in IT Engineer & Developer Jobs is a plus.
