Job Opportunities API

The Public Ledger of Openings

← Back to the ledger

Software Quality Engineer - AI

Boomi
CompanyBoomi
CategoryEngineering
LocationCanada
RemoteOn-site (inferred)
EmploymentNot stated
LevelNot stated
SalaryNot stated by the employer
Posted17 Feb 2026
Last verified30 Jul 2026
SourceEmployer career page (greenhouse)
Applications are handled by the employer, not by us.Apply on the employer's site →
Description
About Boomi and What Makes Us Special Are you ready to work at a fast-growing company where you can make a difference? Boomi, the data activation company for AI, powers the agentic enterprise by bringing data to life across the business. The award-winning Boomi Enterprise Platform is the active data foundation that delivers essential agentic infrastructure enabling organizations to drive agentic transformation and harness the power of AI with secure, scalable connectivity.  Trusted by over 30,000 customers and supported by a network of 800+ partners, Boomi helps organisations of all sizes achieve agility, efficiency, and innovation at scale. At Boomi, you’ll work with world-class people and industry-leading technology. We hire trailblazers with an entrepreneurial spirit who can solve challenging problems, make a real impact, and want to be part of building something big. If this sounds like a good fit for you, check out  boomi.com   or visit our  Boomi Careers  page to learn more. How You'll Make An Impact As a Software Quality Engineer, you will bridge traditional software quality engineering with cutting-edge AI quality practices. You will design and implement comprehensive testing strategies that ensure both the reliability of backend infrastructure and the quality of Generative AI features powering our agentic applications. This role combines deep technical expertise in automated testing & AI/ ML focused quality engineering, enabling you to establish quality standards that span from microservices architecture to AI/ML models. You'll be instrumental in building the testing frameworks and quality processes that ensure our products are robust, reliable, and production-ready. What You Will Do Design and execute comprehensive test plans for backend services, APIs, and microservices architectures. Partner with Backend Engineers, AI Engineers, and Product teams to understand requirements and identify quality risks early in the development cycle. Develop automated testing frameworks using tools like Pytest, Playwright, unittest, and integration testing libraries. Build end-to-end test suites that validate the integration between backend systems, AI agents, databases & services. Advocate for quality-first practices, influencing architectural decisions and embedding testing into the development lifecycle. Design and implement automated evaluation frameworks for Generative AI features, including LLM / SLM model testing, prompt/ output validation, and behavioral assessment of agentic workflows. Develop quality metrics and evaluation methodologies for LLM-based applications, assessing accuracy, consistency, reliability, quality of AI/ML models. Create and maintain curated evaluation datasets and synthetic test data that cover edge cases, adversarial scenarios, and real-world variability. Leverage AI evaluation tools and frameworks & establish observability and monitoring requirements to quality assessment. Establish observability and monitoring requirements including structured logging, metrics collection, and tracing for both backend services and AI agent behavior. Implement quality gates and acceptance criteria and create test documentation including test plans, automation architecture, quality reports, and runbooks. Build strategies for testing in cloud environments & containerized execution. Implement performance testing, load testing, and reliability testing for production backend services and AI inference pipelines. Define and champion quality standards, best practices, and testing methodologies for both traditional backend systems and AI applications. Conduct code reviews with a focus on testability, quality patterns, and maintainability. Mentor junior quality engineers, sharing expertise in au
HOUSE ADYou found the opening. Now track it.Tracker, radar and AI drafts in one place.erioun.com →
Software Quality Engineer - AI — Boomi · Job Opportunities API