Software Engineer ll

Microsoft bets on Artificial Intelligence (AI) as the next growth opportunity for the company. OpenAI, Mistral, and other Large language Model (LLM) driven innovations are happening throughout the industry. Azure AI is focused on building a platform that makes it easy for both first party Microsoft teams and third-party customers to build cutting edge applications on top of these large language models.

The Back Plane team in Azure Machine Learning is looking for a software engineer who loves to build scalable, highly available, and secure microservices that run in Kubernetes. The infrastructure team focuses on managing a large fleet of Azure Kubernetes Services (AKS) that represents the control plane for AzureML.

The Team Focuses On
• Managing Kubernetes Cluster Deployments at Scale.
• Secure Control Plane assets from malicious attacks and unauthorized access using industry standard tools and frameworks.
• Automate Monitors and critical alerts using best in class observability tools such as: Azure Monitor, Prometheus, Azure Data Explorer, Grafana.
• Automate CI/CD deployments using YAML builds and releases.

For the Azure ML platform, we build tools to increase the observability of the applications running in the Kubernetes clusters, improve the speed, security, and reliability of our deployments, secure our supply chain and services, and debug production with ease. We use the best of open source, like Prometheus, Grafana, and NGINX, and build solutions to enable Azure ML to deliver a global service that handles large scale ML training and inferencing workloads. #aiplatform , #azureml , #Infrastructure , #IDCAIPlatformHiring

Responsibilities

As a Software Engineer on our team, you will drive the design, development, and support of the platform that powers Azure Machine Learning. You’ll work across teams to help make the whole organization successful. Your responsibilities will include the following:
• Design, implement, and support scalable, reliable, high-performance services.
• Write clean and concise code with unit tests.
• Design, implement, and support new features as well as extend existing systems.
• Investigate live site issues and implement and deploy fixes.
• Participate in an on-call rotation.
• Drive quality engineering via code reviews and design discussions

Qualifications

Required Qualifications:
• Object oriented design fundamentals.
• Bachelor’s degree in computer science.
• 3+ years of experience with coding in one of C#, Python, Go, Rust, Java, C or C++.
• Experience with improving service operations or engineering fundamentals.
• Excellent collaboration skills, team player, thrive to make a difference.

Preferred Qualifications
• Prior experience using docker or Kubernetes in building large scale cloud services, distributed systems, or operating systems.
• Understanding of Microservices architecture, Docker, K8s, NGINX, Observability (Logs, Metrics, etc..), Network Layer protocols is a plus

Experience programming GPUs (graphics processing units), CUDA/cuDNN/NCCL - a plus

Microsoft is an equal opportunity employer. Consistent with applicable law, all qualified applicants will receive consideration for employment without regard to age, ancestry, citizenship, color, family or medical care leave, gender identity or expression, genetic information, immigration status, marital status, medical condition, national origin, physical or mental disability, political affiliation, protected veteran or military status, race, ethnicity, religion, *** (including pregnancy), ****** orientation, or any other characteristic protected by applicable local laws, regulations and ordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application process, read more about requesting accommodations.