Milwaukee, Wisconsin

The future is being built today and Johnson Controls is making that future more productive, more secure and more sustainable. We are harnessing the power of cloud, data analytics, the Internet of Things (IoT), and user design thinking to deliver on the promise of intelligent buildings and smart cities that connect communities in ways that make people’s lives and the world better.

What you will do

The Johnson Controls AI Hub’s mission is to infuse AI capabilities into products using a collaborative approach working alongside multiple business units. It is imperative to ensure the quality of all AI/Analytical solutions to guarantee SLAs and provide value to our customers whether the services are running in the cloud or at the edge.

The AI Hub team is looking to accelerate the creation of tools, services and workflows to aid in the quick and widespread deployment of AI Services on a global scale. To this end, we are looking for a talented QA Automation Engineer with industry experience to serve as a domain expert in defining and rolling out standard automation frameworks, best practices and automation strategies across AI Hub solutions. The person will act as a technical lead to design, develop and maintain our automation testing architecture enabling the Quality Engineering team to improve the quality and accelerate release timelines. The QA Automation Engineer will work with software engineers, data scientists, platform/data engineers, and domain experts to develop these test plans and manage their execution.

How you will do it

  • Define and implement our test automation strategy including roadmap, tools, frameworks & approaches across projects
  • Oversee technological execution of the recommended automation solution roadmap across project teams
  • Collaborate with Product and Engineering teams to determine the scope and needs of automation testing
  • Provide leadership, guidance, training and mentoring to implement test automation across projects
  • Define and publish key performance metrics for the automated testing
  • Subject matter expert of current industry-wide quality & test processes, tools and technologies
  • Drive optimizations in various test processes to ensure product quality and keeping cost at a minimum
  • Designs, develops, documents, and implements automated and manual software test cases in accordance with backlog specifications as per SAFe Agile framework
  • Builds tools to track performance of our backend systems and test their load capacity
  • Mentors and provides technical input, feedback, and consultation as in regard to automation to other team members
  • Aids in debugging/troubleshooting, investigation, analysis, and data gathering in case of unexpected behavior of software
  • Implemented projects in AWS, Azure cloud technologies
  • For test cases reported as successful, verify that output data is consistent with expected results (i.e., within appropriate numerical ranges)
  • For test cases that fail, perform basic diagnosis to determine root cause (i.e., which input parameters cause the failure)
  • Identify edge cases that give unexpected or incorrect behavior
  • Work with the algorithm team to verify that failing cases are resolved or have more descriptive error messages
  • Provides Level 3 End User support as needed

What we look for


  • BS/Graduate degree in Computer Science/Electrical or Computer Engineering, or has a degree and demonstrated technical abilities in similar areas
  • Experience with functional RESTful API and performance testing automation
  • 5+ years of experience in Software Testing & Test Automation with experience in various industry leading tools and frameworks focused on UI, Service, Mobile, Database and Messages Streams
  • Hands on Experience in building Cross Platform, Cross Tool, Hybrid Automation frameworks in modern technologies like Angular, Node.js, React, Python, Cloud ML and Data Services, Spark ML etc.
  • Must have hands-on experience in enabling Continuous Testing - integrating test automation into CI/CD pipelines (preferably Github Actions, Jenkins)
  • Must have experience in testing stateless and stateful microservice applications.
  • Knowledge in Docker, Kubernetes, OpenShift is a plus.
  • Knowledge in testing ML Pipeline, Data Processing Pipelines is a plus.
  • Experience in working with Cloud Services like Azure DB’s, Azure Functions, Azure ML, Data Lake, API Management etc., – (preferable Azure)
  • Must have hands-on experience in leading automation projects
  • Must have hands-on experience in developing automation solutions using any 2 of the mentioned test automation tools: Webdriver io, Cypress io, Selenium-Protractor, Cucumber, or equivalent
  • Experience with cross browser testing tools such as Lambdatest, SauceLabs, or Browerstack
  • Experience in Python, PowerShell or scripting language
  • Experience creating test plans, suites in Test management tools like ALM, Xray, TestRail etc.
  • Familiarity with working with large data collections in both databases and spreadsheets. Experience with RDBMS and NoSQL databases
  • Demonstrated ability to work collaboratively in a team environment with engineers, data scientists/analysts, designers, and software developers
  • Ability to assimilate and implement new and emerging technologies
  • High degree of interpersonal skills including both oral and written communication


  • MS in Computer Science/Electrical or Computer Engineering
  • 6+ years of experience in defining/automating tests for APIs
  • 2+ years of experience as a Lead QA Engineer in any of the following fields: Data Science, Cloud Services, IoT
  • 1+ years of experience working alongside Data Scientists to test AI/ML Models

Johnson Controls is an equal employment opportunity and affirmative action employer and all qualified applicants will receive consideration for employment without regard to race, color, religion, sex, national origin, age, protected veteran status, status as a qualified individual with a disability, or any other characteristic protected by law. For more information, please view EEO is the Law. If you are an individual with a disability and you require an accommodation during the application process, please visit

Milwaukee, Wisconsin


Johnson Controls -

The future is being built today, and Johnson Controls is making that future more productive, more secure and more sustainable. We create intelligent buildings, efficient energy solutions, integrated infrastructure and next generation transportation systems that work seamlessly together to deliver on the promise of smart cities and communities. At its core, that promise is about delivering innovation that make people’s lives – and the world – better.

Johnson Controls is a global diversified technology and multi industrial leader serving a wide range of customers in more than 150 countries. Our commitment to sustainability dates back to our roots in 1885, with the invention of the first electric room thermostat. We are committed to helping our customers win and creating greater value for all of our stakeholders through strategic focus on our buildings and energy growth platforms.

Explore our site to learn how our innovative solutions are driving the future of urban efficiency.

Similar jobs