New York City, USonsite$110k-$125k/yrPosted Jun 20, 2026
Posting intelligenceActively listedReposted 3×, possible evergreen/ghost posting

Skills

classificationlangchainpythonopenaiflaskazurenaturallanguageprocessingllmml

About the role

Job Description

Must Have Technical/Functional Skills

We are looking for experienced Prompt Engineers with strong hands-on expertise in Large Language Models (LLMs) to design, optimize, and operationalize high quality prompts for enterprise-grade GenAI solutions. The role demands deep understanding of model behavior, prompt patterns, and real world deployment in regulated environments.

4–7+ years overall experience, with 2–3+ years hands-on Prompt Engineering / GenAI work

Strong experience with LLMs (GPT 4 / GPT 4o / Gemini / Claude / LLaMA or equivalent)

Hands-on knowledge of RAG frameworks, embeddings, vector databases, and semantic search

Experience with Azure OpenAI / OpenAI APIs / Google Vertex AI / Hugging Face

Strong NLP fundamentals and ability to interpret LLM behavior

Programming experience in Python (FastAPI / Flask exposure preferred)

Experience using LangChain / LlamaIndex or similar orchestration frameworks

Strong analytical skills to evaluate and improve model output quality

Roles & Responsibilities

Design, test, and optimize advanced prompts (zero-shot, few-shot, chain-of-thought, tool calling, RAG-based prompts) for LLM-driven applications

Analyze model outputs and continuously refine prompts to ensure accuracy, consistency, and business relevance

Collaborate with Data Scientists, ML Engineers, and Product teams to integrate prompts into end to end AI workflows

Support RAG architectures by crafting effective prompts leveraging vector search, embeddings, and enterprise knowledge sources

Implement guardrails, validation strategies, and hallucination mitigation techniques

Fine tune prompt strategies based on domain-specific use cases (knowledge extraction, summarization, classification, Q&A, reasoning tasks)

Document prompt patterns, best practices, and reusable templates for enterprise adoption

Support client demos, POCs, and pilot rollouts of GenAI solutions

Salary Range: $110,000 to $125,000 per year

Qualifications: BACHELOR OF COMPUTER SCIENCE

Compensation

This Prompt Engineer role pays $110k-$125k/yr. Within typical range for prompt engineer roles in United States.

Questions about this role

Click "Apply with AI Applyd" above. We auto-fill the application from your resume and answer screening questions in seconds. No copy and paste, no juggling tabs.

Compensation for Prompt Engineer roles in United States varies widely by seniority, employer size, and remote vs onsite arrangement. Check the salary range on this listing when published, or browse our Prompt Engineer hub for United States medians across recent openings.

Most applications complete in under 90 seconds. You can track the status in your dashboard and watch the screenshot proof land the moment the application submits.

AI Applyd supports Greenhouse, Lever, Ashby, Workday, iCIMS, SmartRecruiters, Personio, Teamtailor and other major ATS platforms. If we can submit through the platform, we do.

Want AI Applyd to auto-apply to roles like this?

We tailor your resume per posting, fill the forms, and track replies for you.