Member of Technical Staff, Software Engineer

ABOUT US:

At Fireworks, we’re building the future of generative AI infrastructure. Our platform delivers the highest-quality models with the fastest and most scalable inference in the industry. We’ve been independently benchmarked as the leader in LLM inference speed and are driving cutting-edge innovation through projects like our own function calling and multimodal models. Fireworks is a Series C company valued at $4 billion and backed by top investors including Benchmark, Sequoia, Lightspeed, Index, and Evantic. We’re an ambitious, collaborative team of builders, founded by veterans of Meta PyTorch and Google Vertex AI.

In the last few months alone we launched Fireworks Training, partnered with Microsoft Azure Foundry, and published research straight from our production systems. A few examples of what that looks like in practice:

- Frontier RL is cheaper than the mega-cluster narrative suggests: we ran cross-region rollouts using 98% sparse weight deltas and published what we learned. (blog https://fireworks.ai/blog/frontier-rl-is-cheaper-than-you-think)

- Open source agents with frontier advisors: matching frontier performance through training and harness engineering. (blog https://fireworks.ai/blog/open-source-agents-frontier-advisors)

- The fine-tuning bottleneck is not the algorithm: integration friction and iteration speed are what actually stall teams; we documented the patterns across dozens of customer engagements. (blog) https://fireworks.ai/blog/fine-tuning-bottlenecks

THE ROLE:

You’ll be a core builder of the backend systems that power Fireworks:

- Our main web application

- Model and fine-tuning job orchestration

- Billing and enterprise features

- Accounts, org management, access controls

- Policy enforcement and governance

- APIs and developer tooling

- And many other cool things!

This is platform engineering with product impact. Your systems will directly shape how customers build on top of AI. You’ll work closely with product, frontend, infra, and GTM to ship end-to-end features — not just tickets.

WHAT YOU’LL DO

- Design and build scalable backend services

- Own major product surfaces from architecture to production

- Improve reliability, performance, and developer experience

- Work directly with customers to understand pain points

- Ship enterprise-grade features without enterprise slowness

- Use AI tooling aggressively — we expect you to automate yourself

YOU MIGHT BE A FIT IF

- You like building real products, not just infrastructure for infrastructure’s sake

- You enjoy driving initiatives across teams to get things done

- You think in terms of systems, tradeoffs, and business impact

- You care about developer experience and clean abstractions

- You’re curious about AI and want to build where the future is going

- You want ownership, not task lists

MINIMUM QUALIFICATIONS

- Comfortable collaborating with both humans and AI systems (Yes, We’re Serious)

- 5+ years of experience helping humans solve real problems

- 2+ years of working with AI — agents, bots, chats, or building on top of models

WHY FIREWORKS AI?

- Solve Hard Problems: Tackle challenges at the forefront of AI infrastructure, from low-latency inference to scalable model serving.

- Build What’s Next: Work with bleeding-edge technology that impacts how businesses and developers harness AI globally.

- Ownership & Impact: Join a fast-growing, passionate team where your work directly shapes the future of AI—no bureaucracy, just results.

- Learn from the Best: Collaborate with world-class engineers and AI researchers who thrive on curiosity and innovation.

Fireworks AI is an equal-opportunity employer. We celebrate diversity and are committed to creating an inclusive environment for all innovators.