Automation Test Engineer – Web

Position Overview:

Johnson Controls is seeking a highly skilled Automation Test Engineer – Web to join our global Marketing IT team responsible for delivering large‑scale, public‑facing websites. This role focuses on building robust automated test frameworks, ensuring high‑quality digital experiences, and leveraging Generative AI (GenAI) to accelerate QA processes. The ideal candidate has strong automation engineering experience, hands‑on expertise testing itecore‑based websites, deep familiarity with modern web technologies, and an
interest in applying AI-driven techniques to transform quality engineering.

Key Responsibilities: GenAI‑Driven QA Enhancements

• Use GenAI tools (M365 Copilot, GitHub Copilot, etc.) to auto‑generate test cases, regression suites, and boundary conditions.
• Convert requirements/user stories into structured test scenarios.
• Summarize test execution results and produce AI‑generated quality reports.
• Analyze defect patterns and accelerate root‑cause identification.
• Enhance exploratory testing with AI-driven scenario expansions.
• Collaborate with internal teams to develop lightweight AI‑powered QA utilities.

Test Automation & Quality Engineering

• Design, develop, and maintain automated test scripts for functional, regression, API, and end‑to‑end testing using tools such as Selenium, Playwright, etc.
• Implement and enhance automation frameworks aligned with best practices,
  scalability, and maintainability.
• Integrate automated tests into CI/CD pipelines (Azure DevOps, GitHub Actions, or Jenkins).
• Conduct cross‑browser, cross‑device validation using automation tools and cloud device farms.
• Perform code reviews for test automation scripts and ensure adherence to quality standards.
• Strong programming knowledge (Java, JavaScript/TypeScript, Python)
• Page Object Model (POM) and other design patterns
• Framework scalability and reusability
• Handling flaky tests and improving test stability

Quality Assurance for Web Platforms

• Analyze business requirements, technical specifications, and user stories to create detailed test plans and automated test cases

.

• Perform functional, non‑functional, accessibility, SEO, and security validations to ensure web excellence.
• Conduct thorough testing for Sitecore‑based websites (Sitecore XP, SXA, XM Cloud) including component rendering, personalization, content authoring workflows, Experience Editor validation, publishing pipelines, and media library interactions.
• Identify, log, and track defects; collaborate closely with developers for swift
  resolution.
• Validate website responsiveness, accessibility (WCAG), and compatibility across devices/browsers.

Performance, Security & Accessibility Testing

• Participate in performance and load testing using tools like JMeter, Load Runner etc.
• Support security testing by identifying vulnerabilities and ensuring compliance with organizational standards.
• Leverage accessibility tools to ensure inclusive design practices.

Collaboration & Documentation

• Work closely with developers, UX designers, content teams, and marketing
  stakeholders to validate user-facing features.
• Maintain detailed documentation for automation frameworks, test cases, execution logs, and KPIs.
• Champion QA process improvements and promote continuous testing culture.

Qualifications

• Bachelor’s degree in Computer Science, IT, or related field.
• 5–8 years of experience in Quality Engineering with strong automation expertise.
• Hands-on experience with modern web automation frameworks i.e. Playwright.
• Solid experience testing Sitecore websites or other enterprise CMS platforms.
• Familiarity with Agile/Scrum methodologies and tools like Jira, Confluence, Azure DevOps.
• Strong analytical, debugging, and problem‑solving abilities.
• Excellent written and verbal communication skills.
• Experience using GenAI for test generation, analysis, documentation, or automation enhancements.
• Exposure to Sitecore XP, SXA, XM Cloud in deeper technical capacities.
• Experience with accessibility (WCAG), SEO validation, and web security checks.
• Test certifications (ISTQB, CSM, Automation Testing Certifications