USonsite$70k-$130k/yrPosted Jun 24, 2026

Skills

kubernetestypescriptregressiondockerpythonopenaiazurerustgooglecloudawsllmgoml

About the role

Must-Have Requirements

Requirement Details

Backend/Systems Experience

3+ years building production backend or distributed systems (pre-AI experience required)

Production AI Systems

Has shipped AI/LLM features serving real users at scale - not just prototypes or demos

Agentic Systems

Has built AI agents, skills, tools, or MCP (Model Context Protocol) integrations

Python

Proficient for backend development

Secondary Language

Working knowledge of Go, TypeScript, or Rust

Cloud Infrastructure

Deep experience with AWS/GCP/Azure - cost optimization, compute decisions, not just deployment

Container & Orchestration

Hands-on with Docker and Kubernetes - can build, deploy, debug, and scale services themselves

LLM Integration

Understands token economics, context limits, rate limiting, structured outputs, API failure modes

LLM Evaluation

Understands how to evaluate LLM outputs and the inherent challenges (non-determinism, quality measurement, regression detection)

Hands-On Engineer

Not just an architect - writes code, debugs production issues, deploys their own work

________________________________________

Preferred / Differentiators

Built multi-step agentic workflows with tool use and function calling

Experience with agent orchestration frameworks (LangGraph, CrewAI, Claude Agent SDK, Google ADK, OpenAI ADK)

Built guardrails, fallbacks, or graceful degradation for AI systems

Streaming inference and async agent orchestration

Cost/latency optimization: caching, batching, prompt compression

ML observability tools: Langfuse, Arize, Braintrust, W&B

Retrieval systems (vector search, hybrid search) - as a tool, not the focus

________________________________________

Screening Questions for Candidates

1. "Describe a production AI agent or skill system you built. What broke and how did you fix it?"

2. "Have you built MCP servers/integrations or custom tool-use systems for LLMs?"

3. "How do you evaluate whether an LLM-based feature is working well? What makes this hard?"

4. "Walk me through how you'd deploy and scale an AI service on Kubernetes."

________________________________________

Not a Fit If

Primarily a model trainer/fine-tuner (we're not training models)

AI experience is mainly academic, research, or tutorial-based

No production systems experience (only notebooks/demos)

Looking for entry-level role with heavy mentorship

Background is primarily data science/analytics rather than engineering

"Architects" who don't write or deploy code themselves

Location : Cupertino, CA

Salary Range: $70,000-$130,000 a year

Location

Cupertino, CA

Job Function

TECHNOLOGY

Role

Engineer

Job Id

418210

Desired Skills

Artificial Intelligence | AWS | ETL Testing

Salary Range

$70,000-$130,000 a year

Compensation

This Machine Learning Engineer role pays $70k-$130k/yr. Within typical range for machine learning engineer roles in United States.

Questions about this role

Click "Apply with AI Applyd" above. We auto-fill the application from your resume and answer screening questions in seconds. No copy and paste, no juggling tabs.

Compensation for Machine Learning Engineer roles in United States varies widely by seniority, employer size, and remote vs onsite arrangement. Check the salary range on this listing when published, or browse our Machine Learning Engineer hub for United States medians across recent openings.

Most applications complete in under 90 seconds. You can track the status in your dashboard and watch the screenshot proof land the moment the application submits.

AI Applyd supports Greenhouse, Lever, Ashby, Workday, iCIMS, SmartRecruiters, LinkedIn Easy Apply, and most other ATS platforms. If we can submit through the platform, we do.

Want AI Applyd to auto-apply to roles like this?

We tailor your resume per posting, fill the forms, and track replies for you.