Python + Gen AI Developer - New York

Photon

New York, USonsite$56k-$196k/yrPosted Jul 24, 2026
Posting intelligenceActively listedReposted 2×, possible evergreen/ghost posting

Skills

postgrestensorflowlangchainpytorchdockerpythonopenaicicdllmdeeplearningml

About the role

Role Summary:

We are seeking a Generative AI Engineer to build, optimize, and scale production-ready AI applications. You will design complex multi-agent systems, implement advanced RAG pipelines, and manage the deployment of both frontier and local LLMs. The ideal candidate blends deep machine learning expertise with modern software engineering practices.

Technical Stack:

LLMs: Gemini, OpenAI, Claude, Llama, and Local Model deployment.

Frameworks: LangChain, LlamaIndex, and Hugging Face.

Orchestration: LangGraph and Multi-Agent Systems (MAS).

Development: Python, FastAPI, and Asynchronous Programming.

RAG & Data: PostgreSQL, Vector Databases, and Advanced Retrieval strategies.

ML/DL: PyTorch, TensorFlow, and Model Fine-tuning.

Deployment: Docker, Production API management, and LLM monitoring.

Tools: Prompt Engineering, Workflow Design, and GenAI Optimization.

Key Responsibilities:

Develop and orchestrate sophisticated AI workflows using LangGraph and multi-agent architectures.

Build and maintain Advanced RAG systems utilizing LlamaIndex and vector databases for high-accuracy retrieval.

Integrate and swap diverse LLMs (commercial and open-source) based on performance and cost requirements.

Design and deploy high-performance, scalable backend services using FastAPI and Async Python.

Fine-tune large language models (LLMs) using PyTorch/TensorFlow to improve domain-specific performance.

Optimize GenAI workflows for latency, cost, and reliability using advanced prompt engineering and monitoring tools.

Containerize and deploy AI services via Docker to production environments.

Required Qualifications:

7+ years of hands-on experience building and deploying GenAI applications in a production setting.

Strong proficiency in Python and the modern AI library ecosystem (LangChain, LlamaIndex, etc.).

Experience with vector search, embedding models, and advanced data retrieval patterns.

Knowledge of model fine-tuning techniques and local LLM quantization/hosting.

Familiarity with production-grade monitoring, API security, and CI/CD for ML.

Compensation, Benefits and Duration

Minimum Compensation: USD 56,000

Maximum Compensation: USD 196,000

Compensation is based on actual experience and qualifications of the candidate. The above is a reasonable and a good faith estimate for the role.

Medical, vision, and dental benefits, 401k retirement plan, variable pay/incentives, paid time off, and paid holidays are available for full time employees.

This position is not available for independent contractors

No applications will be considered if received more than 120 days after the date of this post

Compensation

This LLM Engineer role pays $56k-$196k/yr. Within typical range for llm engineer roles in United States.

Questions about this role

Click "Apply with AI Applyd" above. We auto-fill the application from your resume and answer screening questions in seconds. No copy and paste, no juggling tabs.

Compensation for LLM Engineer roles in United States varies widely by seniority, employer size, and remote vs onsite arrangement. Check the salary range on this listing when published, or browse our LLM Engineer hub for United States medians across recent openings.

Most applications complete in under 90 seconds. You can track the status in your dashboard and watch the screenshot proof land the moment the application submits.

AI Applyd supports Greenhouse, Lever, Ashby, Workday, iCIMS, SmartRecruiters, Personio, Teamtailor and other major ATS platforms. If we can submit through the platform, we do.

Want AI Applyd to auto-apply to roles like this?

We tailor your resume per posting, fill the forms, and track replies for you.