Jobs
Required skills
Python
LangGraph
LangChain
FastAPI
PostgreSQL
Machine Learning
Backend Development
At JFrog, we're reinventing DevOps to help the world's greatest companies innovate – and we want you along for the ride. This is a special place with a unique combination of brilliance, spirit, and just all-around great people. Here, if you're willing to do more, your career can take off. Thousands of customers, including the majority of the Fortune 100, trust JFrog to manage, accelerate, and secure their software delivery from code to production – a concept we call "liquid software." Wouldn't it be amazing if you could join us on our journey?
We are seeking an experienced, hands-on Senior AI Engineer to join the Generative AI applications Platform group at JFrog and lead the backend implementation and architecture of AI/LLM solutions – from agent graphs and tooling to RAG, streaming, and production deployment.
As a Senior ML Engineer at JFrog you will…
-
Design and own agent architectures – Build and evolve graph-based agent workflows (multi-node LLM flows, tool execution, routing, human-in-the-loop review gates) using Lang Graph, with clear state schemas, checkpointing, and streaming to production.
-
Turn product and user needs into backend AI – Work with Engineers, Product, and Analysts to translate business problems into technical requirements and implementations, including agent types, tools, RAG pipelines, and configuration-driven behavior.
-
Design, develop, and deploy GenAI capabilities end-to-end – Lang Chain tools and integrations, RAG (retrievers, vector stores, agentic flows), structured outputs, and APIs for chat, Copilot-style integrations, and MCP.
-
Raise the bar on quality and reliability – Establish patterns for observability (e.g., Lang Smith), error handling, content safety, bounded autonomy (tool schemas, review workflows), and evaluation systems so that AI behavior is predictable and auditable.
-
Mentor and align the team – Provide technical guidance on LLM backend architecture and Lang Graph/Lang Chain best practices so the team can iterate quickly and safely.
To be a Senior ML Engineer at JFrog you need…
-
Backend–LLM & agent architecture – 5+ years in production ML/AI and backend systems; recent hands-on experience with backend LLM systems, including agent workflows (e.g., Lang Graph or similar), Lang Chain tooling and chains, state management, and streaming (e.g., SSE). You think in terms of nodes, state schemas, routing, and human-in-the-loop.
-
Technical stack – Proficient in Python; comfortable with Lang Graph, Lang Chain, FastAPI, PostgreSQL, and optionally Azure AI Search or similar. Experience with LLM providers (OpenAI/Azure, Google Vertex AI, etc.) and RAG (retrievers, chunking, reranking) expected.
-
Generative AI in production – Proven track record building production GenAI applications, including multi-step agents, RAG, tool-augmented LLMs, and ideally human-in-the-loop or review flows. You care about observability, validation, and safe rollout.
-
Bachelor's degree or higher in Computer Science or a related field, and strong communication and collaboration skills.
Total Views
0
Apply Clicks
0
Weekly mock applicants
0
Bookmarks
0
Similar jobs

Senior Machine Learning Engineer- LLMs & Self-Hosted AI
Navan · Tel-Aviv, Israel

Senior Software Engineer - IDE AI Experiences - LLM Engineer
Datadog · Tel Aviv, Israel

Sr Machine Learning Scientist
PayPal · Tel Aviv, Tel Aviv District, Israel

Senior Deep Learning Research Engineer
NVIDIA · Israel, Tel Aviv

Staff Software & AI Engineer
Marvell · Yokneam
About JFrog

JFrog
PublicJFrog provides DevOps and DevSecOps platform solutions for software development and distribution. The company offers tools for artifact management, security scanning, and CI/CD pipeline automation.
1,001-5,000
Employees
Bozeman
Headquarters
$1.5B
Valuation
Reviews
2.4
10 reviews
Work-life balance
2.5
Compensation
4.0
Culture
2.8
Career
3.5
Management
1.8
35%
Recommend to a friend
Pros
Good compensation and benefits
Great learning opportunities and experience
Innovative and fast-moving company
Cons
Poor management and micromanagement
Unrealistic expectations and poor treatment
Underqualified executives
Salary Ranges
67 data points
Junior/L3
L3
Junior/L3 · Data Scientist
0 reports
$150,943
total per year
Base
-
Stock
-
Bonus
-
$128,301
$173,585
Interview experience
35 interviews
Difficulty
3.4
/ 5
Duration
14-28 weeks
Offer rate
40%
Experience
Positive 62%
Neutral 22%
Negative 16%
Interview process
1
Phone Screen
2
Technical Interview
3
Hiring Manager
4
Team Fit
Common questions
Technical skills
Past experience
Team collaboration
Problem solving
News & Buzz
Buy Signal JFrog Ltd - 17 Apr 2026 @ 14:31 -> USD43.70
Ticker: **FROG** Exchange: **NASDAQ** Time: **17 Apr 2026 @ 14:31** Price: **USD43.70** Link: https://getagraph.com/NASDAQ/stock/live-signals/FROG/ENG
·
4d ago
·
1
Why JFrog’s Stock Is Sliding Despite AI Hype - TipRanks
TipRanks
News
·
4d ago
frustrated by the state of the IT job market as upcoming grad
I’m just venting, but i’m annoyed with the whole interview/job search as an upcoming CS grad. Ive completed a year as a Desktop Support Assistant at my university, a year being an IT Support Assistant at my university’s chancellors office, and a year with my current employer a large R&D contractor as a DevOps intern with a Secret Sec. Clearance (worked full time this past summer, since going back to school i’m part time but will not be brought on full time due to funding/contracts being cut)
·
4d ago
·
81
·
52
frustrated by the state of the IT job market as upcoming grad
I’m just venting, but i’m annoyed with the whole interview/job search as an upcoming CS grad. Ive completed a year as a Desktop Support Assistant at my university, a year being an IT Support Assistant at my university’s chancellors office, and a year with my current employer a large R&D contractor as a DevOps intern with a Secret Sec. Clearance (worked full time this past summer, since going back to school i’m part time but will not be brought on full time due to funding/contracts being cut)
·
4d ago
·
5
·
4