The Applications Development Senior Supervisor is an intermediate management level position responsible for providing full leadership and direction to a team of employees in an effort to establish and implement new or revised application systems and programs in coordination with the Technology team. The overall objective of this role is to lead applications systems analysis and programming activities.

Responsibilities:

• Build REST endpoints
• Refine prompts and write Agentic code
• Adjusting LLM Inference parameters
• Writing and refining prompts
• Selecting context for given LLM window size and setup
• Debugging Agent Self-Reflection loops
• Calling external search libraries and writing formatting code to connect prompt templates
• Writing code in compliance with risk restrictions
• Documenting code to ensure compliance and reusability of work
• Write SQL queries and optimize queries for LLM context retrieval
• Writing unit and integration tests for LLMs

Qualifications: AI ML Engineer

• 6+ years of total experience
• 3+ Years experience as a data scientist, or machine learning engineer (data-adjacent profession)
• Proficient in every aspect of the data pipeline, including:
• Data cleaning and preprocessing
• Model Selection
• Feature engineering
• Model training and retraining
• Model evaluation
• Moving models into productions
• Building APIs
• Python expertise
• Familiar with FastAPI, Flask
• Some python library or libraries for calling LLMs (Lang Chain or similar)
• Data manipulation libraries (Pandas, Numpy, Scipy)
• NLPText processing and parsing library experience (Spa Cy, NLTK, Text Blob
• Deep Learning Familiarity with model binaries and inferencing, experience with Hugging Face, Py Torch, or Tensorflow a plus
• LLMs Able to write prompts Understanding of the fundamentals of Language Modeling
• SQL

Education:

• Bachelor’s degree/University degree or equivalent experience

This job description provides a high-level review of the types of work performed. Other job-related duties may be assigned as required.

Job Family Group:

Technology

Job Family:

Applications Development

Time Type:

Full time

Most Relevant Skills

Please see the requirements listed above.

Other Relevant Skills

For complementary skills, please see above and/or contact the recruiter.

Citi is an equal opportunity employer, and qualified candidates will receive consideration without regard to their race, color, religion, sex, sexual orientation, gender identity, national origin, disability, status as a protected veteran, or any other characteristic protected by law.

If you are a person with a disability and need a reasonable accommodation to use our search tools and/or apply for a career opportunity review Accessibility at Citi.

View Citi’s EEO Policy Statement and the Know Your Rights poster.