MLOps Engineer

Role description

Who we are:

At UST, we help the world’s best organizations grow and succeed through transformation. Bringing together the right talent, tools, and ideas, we work with our client to co-create lasting change. Together, with over 30,000 employees in 30+ countries, we build for boundless impact - touching billions of lives in the process. Visit us at .

Job Description

We are seeking a hands-on AI Deployment Engineer specializing in ML Engineering, Model Deployment, Model Governance, and Model Observability. The engineer will own the complete lifecycle of Deep Learning models, LLMs, and SLMs across cloud, on-premises, hybrid, and air-gapped environments.

Scope of Work

Build and manage MLOps and LLMOps pipelines.

Deploy, host, and scale Deep Learning models, LLMs, and SLMs and Inference optimisation

Manage end-to-end model lifecycle including versioning, deployment, rollout, rollback, and retirement.

Host models on Databricks, Kubernetes, OpenShift, and GPU-based infrastructure.

Implement model governance, lineage, approval workflows, and compliance controls.

Build model monitoring, observability, tracing, logging, and drift detection capabilities.

Optimize model performance, latency, throughput, GPU utilization, and cost.

Support cloud, on-premises, hybrid, and air-gapped environments.

Must-Have Skills

3–5 years in MLOps, LLMOps, ML Engineering, or AI Engineering.

Strong Python development skills.

Hands-on experience with Databricks and/or Azure ML.

Experience with Deep Learning, LLMs, SLMs, RAG, and Hugging Face.

Experience deploying models built using PyTorch and TensorFlow.

Strong expertise in model deployment on:

o Kubernetes

o Databricks

o GPU Infrastructure

Experience with:

o vLLM

o Triton Inference Server

o Ray Serve

o SGLang

o Databricks Model Serving

Strong GPU knowledge including NVIDIA GPUs, CUDA, multi-GPU deployments, and inference optimization.

Experience in Model Registry, Model Governance, Model Monitoring, Drift Detection, and AI Observability.

Strong database knowledge (SQL Server, PostgreSQL, Oracle, MySQL, MongoDB).

Experience with Vector Databases (Pinecone, Chroma, FAISS, Milvus, Azure AI Search).

REST APIs, WebSockets, Streaming HTTP.

Experience with MLflow, OpenTelemetry, LangFuse, Splunk, and Grafana/ELK.

CI/CD using Jenkins, Azure DevOps.

Experience across Cloud, On-Premises, Hybrid, and Air-Gapped environments.

Experience with Auth setup like Keycloak

Good-to-Have Skills

Kafka, RabbitMQ, Event Hub

Fine-tuning and model optimization

Model Governance & Security

Experience with Llama, Mistral, DeepSeek, Qwen, Phi, and Gemma models

What we believe:

We’re proud to embrace the same values that have shaped UST since the beginning. Since day one, we’ve been building enduring relationships and a culture of integrity. And today, it's those same values that are inspiring us to encourage innovation from everyone, to champion diversity and inclusion and to place people at the centre of everything we do.

Humility:

We will listen, learn, be empathetic and help selflessly in our interactions with everyone.

Humanity:

Through business, we will better the lives of those less fortunate than ourselves.

Integrity:

We honour our commitments and act with responsibility in all our relationships.

All employment decisions shall be made without regard to age, race, creed, colour, religion, sex, national origin, ancestry, disability status, veteran status, sexual orientation, gender identity or expression, genetic information, marital status, citizenship status or any other basis as protected by federal, state, or local law.

UST reserves the right to periodically redefine your roles and responsibilities based on the requirements of the organization and/or your performance.

To support and promote the values of UST.

Comply with all Company policies and procedures

Skills

python,artificial intelligence,vector database,azure devops,

About UST

UST is a global digital transformation solutions provider. For more than 20 years, UST has worked side by side with the world’s best companies to make a real impact through transformation. Powered by technology, inspired by people and led by purpose, UST partners with their clients from design to operation. With deep domain expertise and a future-proof philosophy, UST embeds innovation and agility into their clients’ organizations. With over 30,000 employees in 30 countries, UST builds for boundless impact - touching billions of lives in the process.