About this role

Role Overview:We are looking for a forward-thinking AI Engineer to help redefine how quality is understood, measured, and improved across our engineering organization. This role goes beyond traditional test automation — it focuses on building intelligent systems that enhance decision-making, accelerate feedback loops, and elevate product quality through data-driven insights and adaptive tooling.
You will work at the intersection of AI, software testing, and engineering operations, applying techniques from Machine Learning (ML), Natural Language Processing (NLP), and Large Language Models (LLMs) to create scalable solutions that support quality assurance, risk analysis, and continuous improvement.

Key Responsibilities:

• Design and implement AI-driven components that support quality engineering across the SDLC.

• Develop NLP pipelines to extract insights from requirements, user feedback, and test artifacts.

• Fine-tune and deploy LLMs to support intelligent test generation, summarization, and anomaly detection.

• Collaborate with QA, DevOps and Product teams to integrate AI tooling into CI/CD pipelines and quality gates.

• Analyze historical test and defect data to identify patterns and optimize regression test coverage.

• Maintain and improve model performance through continuous learning and feedback loops.

Required Skills & Experience:

• Strong proficiency in Python and ML frameworks (e.g., Tensor Flow, Py Torch, Scikit-learn).

• Hands-on experience with NLP techniques and libraries (e.g., spa Cy, Hugging Face Transformers).

• Proven experience in fine-tuning LLMs for domain-specific tasks.

• Familiarity with software testing methodologies and QA lifecycle.

• Ability to work with structured and unstructured data sources.

• Excellent problem-solving and communication skills.

Preferred Qualifications:

• LLM Expertise: Experience fine-tuning and deploying large language models (e.g., GPT, LLaMA) for domain-specific tasks such as test case generation, summarization, and anomaly detection.

• Quality Engineering Knowledge: Familiarity with functional and regression testing principles, test case design, and QA lifecycle.

• Automation Frameworks: Hands-on experience with tools like Selenium, Playwright, or Cypress, and integrating AI into these frameworks.

• MLOps & Deployment: Exposure to MLOps practices including model versioning, monitoring, and CI/CD integration using platforms like MLflow, Kubeflow, or Azure ML.

• Cloud & Infrastructure: Experience working with cloud platforms (Azure) and containerization tools (Open Container Initiative (OCI) container packaging and runtime, Cloud-Native distributed containerized microservice orchestration) for scalable AI deployment.

• Data Engineering: Ability to work with large-scale datasets, including preprocessing, feature engineering, and data pipeline development.

• Security & Compliance Awareness: Understanding of data privacy, model interpretability, and compliance standards relevant to AI in enterprise environments.

• Collaboration & Communication: Proven ability to work cross-functionally with QA, DevOps, and product teams, and to communicate technical concepts to non-technical stakeholders.

• Exposure to Gherkin syntax and behavior-driven development (BDD) practices.

Our benefits

To help you stay energized, engaged and inspired, we offer a wide range of benefits including a strong retirement plan, tuition reimbursement, comprehensive healthcare, support for working parents and Flexible Time Off (FTO) so you can relax, recharge and be there for the people you care about.

Our hybrid work model

Black Rock’s hybrid work model is designed to enable a culture of collaboration and apprenticeship that enriches the experience of our employees, while supporting flexibility for all. Employees are currently required to work at least 4 days in the office per week, with the flexibility to work from home 1 day a week. Some business groups may require more time in the office due to their roles and responsibilities. We remain focused on increasing the impactful moments that arise when we work together in person – aligned with our commitment to performance and innovation. As a new joiner, you can count on this hybrid model to accelerate your learning and onboarding experience here at Black Rock.

About Black Rock

At Black Rock, we are all connected by one mission: to help more and more people experience financial well-being. Our clients, and the people they serve, are saving for retirement, paying for their children’s educations, buying homes and starting businesses. Their investments also help to strengthen the global economy: support businesses small and large; finance infrastructure projects that connect and power cities; and facilitate innovations that drive progress.

This mission would not be possible without our smartest investment – the one we make in our employees. It’s why we’re dedicated to creating an environment where our colleagues feel welcomed, valued and supported with networks, benefits and development opportunities to help them thrive.

For additional information on Black Rock, please visit @blackrock | Twitter: @blackrock | LinkedIn: www.linkedin.com/company/blackrock

Black Rock is proud to be an Equal Opportunity Employer. We evaluate qualified applicants without regard to age, disability, family status, gender identity, race, religion, sex, sexual orientation and other protected attributes at law.