Jobs
Required Skills
Python
LangGraph
LangChain
FastAPI
PostgreSQL
Machine Learning
Backend Development
At JFrog, we're reinventing DevOps to help the world's greatest companies innovate – and we want you along for the ride. This is a special place with a unique combination of brilliance, spirit, and just all-around great people. Here, if you're willing to do more, your career can take off. Thousands of customers, including the majority of the Fortune 100, trust JFrog to manage, accelerate, and secure their software delivery from code to production – a concept we call "liquid software." Wouldn't it be amazing if you could join us on our journey?
We are seeking an experienced, hands-on Senior AI Engineer to join the Generative AI applications Platform group at JFrog and lead the backend implementation and architecture of AI/LLM solutions – from agent graphs and tooling to RAG, streaming, and production deployment.
As a Senior ML Engineer at JFrog you will…
-
Design and own agent architectures – Build and evolve graph-based agent workflows (multi-node LLM flows, tool execution, routing, human-in-the-loop review gates) using Lang Graph, with clear state schemas, checkpointing, and streaming to production.
-
Turn product and user needs into backend AI – Work with Engineers, Product, and Analysts to translate business problems into technical requirements and implementations, including agent types, tools, RAG pipelines, and configuration-driven behavior.
-
Design, develop, and deploy GenAI capabilities end-to-end – Lang Chain tools and integrations, RAG (retrievers, vector stores, agentic flows), structured outputs, and APIs for chat, Copilot-style integrations, and MCP.
-
Raise the bar on quality and reliability – Establish patterns for observability (e.g., Lang Smith), error handling, content safety, bounded autonomy (tool schemas, review workflows), and evaluation systems so that AI behavior is predictable and auditable.
-
Mentor and align the team – Provide technical guidance on LLM backend architecture and Lang Graph/Lang Chain best practices so the team can iterate quickly and safely.
To be a Senior ML Engineer at JFrog you need…
-
Backend–LLM & agent architecture – 5+ years in production ML/AI and backend systems; recent hands-on experience with backend LLM systems, including agent workflows (e.g., Lang Graph or similar), Lang Chain tooling and chains, state management, and streaming (e.g., SSE). You think in terms of nodes, state schemas, routing, and human-in-the-loop.
-
Technical stack – Proficient in Python; comfortable with Lang Graph, Lang Chain, FastAPI, PostgreSQL, and optionally Azure AI Search or similar. Experience with LLM providers (OpenAI/Azure, Google Vertex AI, etc.) and RAG (retrievers, chunking, reranking) expected.
-
Generative AI in production – Proven track record building production GenAI applications, including multi-step agents, RAG, tool-augmented LLMs, and ideally human-in-the-loop or review flows. You care about observability, validation, and safe rollout.
-
Bachelor's degree or higher in Computer Science or a related field, and strong communication and collaboration skills.
Total Views
0
Apply Clicks
0
Mock Applicants
0
Scraps
0
Similar Jobs

Principal Research Engineer
Epic Games · Porto Alegre,Rio Grande do Sul,Brazil

Director of Engineering (AI-Native)
Nerdy (Varsity Tutors) · Remote - United States

Senior Software Engineer, Inertial Navigation
Waymo · Mountain View, California, USA

Channel Solutions Engineer
Netskope · Chile

Staff Machine Learning Engineer – VLM/LLM Evaluation
Waymo · Mountain View, CA, US; New York, NY, US; Seattle, WA, US
About JFrog

JFrog
PublicJFrog provides DevOps and DevSecOps platform solutions for software development and distribution. The company offers tools for artifact management, security scanning, and CI/CD pipeline automation.
1,001-5,000
Employees
Bozeman
Headquarters
$1.5B
Valuation
Reviews
2.6
9 reviews
Work Life Balance
2.3
Compensation
4.0
Culture
2.8
Career
3.2
Management
2.1
35%
Recommend to a Friend
Pros
Good compensation and benefits
Supportive team and welcoming environment
Fast-paced and innovative culture
Cons
Poor management and micromanagement
Toxic and fearful work environment
Fast-paced changes and unrealistic expectations
Salary Ranges
89 data points
Junior/L3
Senior/L5
Junior/L3 · Business Development Representative (BDR)
6 reports
$81,624
total / year
Base
$58,363
Stock
-
Bonus
-
$55,299
$124,042
Interview Experience
35 interviews
Difficulty
3.4
/ 5
Duration
14-28 weeks
Offer Rate
40%
Experience
Positive 62%
Neutral 22%
Negative 16%
Interview Process
1
Phone Screen
2
Technical Interview
3
Hiring Manager
4
Team Fit
Common Questions
Technical skills
Past experience
Team collaboration
Problem solving
News & Buzz
Teacher Retirement System of Texas Increases Stake in JFrog Ltd. $FROG - MarketBeat
Source: MarketBeat
News
·
5w ago
JFrog: Re-Accelerating Growth Supports Further Upside (NASDAQ:FROG) - Seeking Alpha
Source: Seeking Alpha
News
·
5w ago
JFrog Joins Rank Of Stocks With 95-Plus Composite Rating - Investor's Business Daily
Source: Investor's Business Daily
News
·
5w ago
Total Economic Impact Study: JFrog Unifies and Accelerates the Secure Software Supply Chain from Code to AI - Business Wire
Source: Business Wire
News
·
6w ago