
AI computing company
Software Engineer, ML Inference Performance
Required skills
PyTorch
TensorFlow
Machine Learning
The era of pervasive AI has arrived. In this era, organizations will use generative AI to unlock hidden value in their data, accelerate processes, reduce costs, drive efficiency and innovation to fundamentally transform their businesses and operations at scale.
Samba Nova Suite™ is the first full-stack, generative AI platform, from chip to model, optimized for enterprise and government organizations. Powered by the intelligent SN40L chip, the Samba Nova Suite is a fully integrated platform, delivered on-premises or in the cloud, combined with state-of-the-art open-source models that can be easily and securely fine-tuned using customer data for greater accuracy. Once adapted with customer data, customers retain model ownership in perpetuity, so they can turn generative AI into one of their most valuable assets.
About The Role
The Principal Compiler Engineer - ML Systems position will be responsible for working with the different layers of the compiler stack and coordinating with other development teams here at Samba Nova. It is a critical role responsible for driving innovation in compiler infrastructure and optimization algorithms that enable state-of-the-art ML model performance on the Samba Nova platform. This can involve anything from digging through Py Torch and machine learning models to determining how to map operations on to our underlying hardware.
Responsibilities
-
Lead compiler engineering through ensuring standard methodologies, enterprise product insertion and process evolution.
-
Work with peers, domain experts, developers, customers, and work across the enterprise seeking optimal solutions.
-
Develop, integrate, and implement products.
-
Provide support for proposals in key areas aligned with core team competencies.
Basic Qualifications
- Bachelor’s or Master’s Degree in Computer Science, Computer Engineering, or equivalent with5-10 years of industry experience.
Additional Qualifications
-
Deep theoretical understanding of compiler fundamentals.
-
Experience building and deploying software products.
-
Experience with one or more deep learning frameworks (i.e. Tensor Flow, Py Torch) is a plus.
-
Experience with common compiler development practices and methodologies.
-
Excitement about high-performance systems engineering and performance debugging.
-
An appreciation for process and developing cross-disciplinary collaboration.
Preferred Qualifications
-
Experience with MLIR.
-
Familiarity with machine learning models and frameworks.
-
Familiarity with accelerated computing.
-
Exposure to dataflow architectures.
Submission Guidelines
Please note that in order to be considered an applicant for any position at Samba Nova Systems, you must submit an application form for each position for which you believe you are qualified.
EEO Policy
Samba Nova Systems is an Equal Opportunity/Affirmative Action Employer. All qualified applicants will receive consideration for employment without regard basis of age (40 and over), color, disability, gender identity, genetic information, marital status, military or veteran status, national origin/ancestry, race, religion, creed, sex (including pregnancy, childbirth, breastfeeding), sexual orientation, and any other applicable status protected by federal, state, or local laws.
Benefits Summary for US-Based, Full-Time Employment Positions
Samba Nova offers a competitive total rewards package, including the base salary, plus equity and benefits. We cover 95% premium coverage for employee medical insurance, and 77% premium coverage for dependents and offer a Health Savings Account (HSA) with employer contribution. We also offer Dental, Vision, Short/Long term Disability, Basic Life, Voluntary Life, and AD&D insurance plans in addition to Flexible Spending Account (FSA) options like Health Care, Limited Purpose, and Dependent Care. Our library of well-being benefits available to you and your dependents includes a full subscription to Headspace, Gympass+ membership with access to physical gyms, One Medical membership, counseling services with an Employee Assistance Program, and much more.
Total Views
0
Total Apply Clicks
0
Total Mock Apply
0
Total Bookmarks
0
Similar jobs
About SambaNova

SambaNova
PublicIntel Capital Corporation started off as the investment arm of Intel Corporation in 1991 and in January 2025, it spun off as a standalone investment fund.
201-500
Employees
Santa Clara
Headquarters
Reviews
10 reviews
4.3
10 reviews
Work-life balance
3.8
Compensation
4.2
Culture
4.5
Career
3.9
Management
3.4
78%
Recommend to a friend
Pros
Supportive team and colleagues
Good benefits and competitive compensation
Flexible work arrangements and remote options
Cons
Heavy workload and overtime expectations
Fast-paced and high-pressure environment
Management direction and communication issues
Salary Ranges
35 data points
Staff/L6
Staff/L6 · Principal Technical Writer
1 reports
$172,500
total per year
Base
$150,000
Stock
-
Bonus
-
$172,500
$172,500
Interview experience
1 interviews
Difficulty
4.0
/ 5
Duration
14-28 weeks
Interview process
1
Application Review
2
Recruiter Screen
3
Technical Phone Screen
4
Onsite/Virtual Interviews
5
Team Matching
6
Offer
Common questions
Coding/Algorithm
System Design
Behavioral/STAR
Technical Knowledge
Culture Fit
Latest updates
Intel investing at least $100M into SambaNova should help AI push: Wedbush - MSN
MSN
News
·
1w ago
SambaNova and TEPCO Systems Partner to Deliver Energy-Efficient AI Infrastructure to Japan’s Power Sector - sambanova.ai
sambanova.ai
News
·
2w ago
SambaNova and Intel target agentic inference - Jon Peddie Research
Jon Peddie Research
News
·
2w ago
Intel and SambaNova introduce a hardware system combining GPUs, RDUs, and CPUs - MSN
MSN
News
·
2w ago


