About the Job

• Build agents into development workflows and platforms.

• Design, build, and maintain back-end services, Application Programming Interfaces (APIs) and User Interface (UI) to support the agents.

• Evaluate Artificial Intelligence (AI) models by designing and utilizing custom evaluation sets focused on quality, coherence, and safety assessment.

• Work with data pipelines to collect, process, and analyze data for model evaluation and metric tracking.

• Drive cross-functional projects with multiple stakeholders.

Responsibilities

• Build agents into development workflows and platforms.

• Design, build, and maintain back-end services, Application Programming Interfaces (APIs) and User Interface (UI) to support the agents.

• Evaluate Artificial Intelligence (AI) models by designing and utilizing custom evaluation sets focused on quality, coherence, and safety assessment.

• Work with data pipelines to collect, process, and analyze data for model evaluation and metric tracking.

• Drive cross-functional projects with multiple stakeholders.

Minimum Qualifications

• Bachelor’s degree or equivalent practical experience.

• 5 years of experience with software development in one or more programming languages.

• 3 years of experience in testing, maintaining, or launching software products.

• 1 year of experience with software design and architecture.

Preferred Qualifications

• Master's degree or PhD in Computer Science or a related technical field.

• 2 years of experience in building developer tools (e.g., compilers, automated releases, code design and testing, test automation frameworks).

• Experience in using data science or statistical methods to develop insights and solve problems.

• Experience with Artificial Intelligence/Machine Learning (AI/ML) powered feature development and productization.

• Experience in working on open source projects and in open source ecosystems.