USonsite$70k-$80k/yrPosted Jul 1, 2026
Posting intelligenceActively listedReposted 7×, possible evergreen/ghost posting

Skills

kubernetesmongojenkinsansibleangulardjangospringdockerpythonflaskkafkaredisreactml

About the role

Key Responsibilities

Develop object-oriented applications using Python with expert-level software engineering practices.

Work with Vector Databases for embedding storage and retrieval optimization.

Design and implement GenAI lifecycle management and RAG pipelines (chunking, embedding, retrieval, re-ranking, summarization) for banking use cases.

Evaluate and test embedding models and frameworks for performance, latency, memory, and cost optimization.

Apply prompt engineering, hallucination mitigation, and grounding techniques for AI solutions.

Build API-driven applications using FastAPI, API Gateway, and integrate with MongoDB, Redis, and front-end frameworks (Angular/React).

Develop utilities, automation frameworks, and data pipelines to support AI/ML and GenAI initiatives.

Create monitoring dashboards and automation scripts for system health and performance.

Collaborate with DevOps teams using enterprise tools (Git/Bitbucket, Jenkins, SonarQube, Artifactory, Ansible).

Work with large cross-functional teams to deliver secure, compliant, and scalable solutions.

Explore Agentic architectures for orchestration and multi-step reasoning in AI workflows.

________________________________________

Required Skills & Experience

Primary Skill: Python

Secondary Skills: Vector DB, Django, Flask, FastAPI, KAFKA, Containerization (OpenShift, Docker etc.)

Knowledge in GenAI lifecycle management and RAG pipelines.

Expertise in prompt engineering and AI safety techniques.

Hands-on experience with FastAPI, containerization (Docker/Kubernetes), and API integrations.

Understanding of DevOps practices and enterprise tooling.

Understanding of Kafka queue integration and configurations.

Ability to deploy python code on to containers using OpenShift and docker etc.

Ability to work effectively with large cross-functional teams in a regulated environment.

Salary Range: $70,000 to $80,000 per year

Location

Jersey City, NJ

Job Function

TECHNOLOGY

Role

Engineer

Job Id

419780

Desired Skills

Spring Boot

Salary Range

$70,000-$80,000 a year

Desired Candidate Profile

Qualifications : BACHELOR OF COMPUTER SCIENCE

Compensation

This LLM Engineer role pays $70k-$80k/yr. Within typical range for llm engineer roles in United States.

Questions about this role

Click "Apply with AI Applyd" above. We auto-fill the application from your resume and answer screening questions in seconds. No copy and paste, no juggling tabs.

Compensation for LLM Engineer roles in United States varies widely by seniority, employer size, and remote vs onsite arrangement. Check the salary range on this listing when published, or browse our LLM Engineer hub for United States medians across recent openings.

Most applications complete in under 90 seconds. You can track the status in your dashboard and watch the screenshot proof land the moment the application submits.

AI Applyd supports Greenhouse, Lever, Ashby, Workday, iCIMS, SmartRecruiters, Personio, Teamtailor and other major ATS platforms. If we can submit through the platform, we do.

Want AI Applyd to auto-apply to roles like this?

We tailor your resume per posting, fill the forms, and track replies for you.