Engineering Manager - SDET
HighLevel
Date: 3 hours ago
City: Remote, Remote
Contract type: Full time
Remote
About HighLevel:
HighLevel is an AI powered, all-in-one white-label sales & marketing platform that empowers agencies, entrepreneurs, and businesses to elevate their digital presence and drive growth. We are proud to support a global and growing community of over 2 million businesses, comprised of agencies, consultants, and businesses of all sizes and industries. HighLevel empowers users with all the tools needed to capture, nurture, and close new leads into repeat customers. As of mid 2025, HighLevel processes over 4 billion API hits and handles more than 2.5 billion message events every day. Our platform manages over 470 terabytes of data distributed across five databases, operates with a network of over 250 microservices, and supports over 1 million hostnames.
Our People
With over 1,500 team members across 15+ countries, we operate in a global, remote-first environment. We are building more than software; we are building a global community rooted in creativity, collaboration, and impact. We take pride in cultivating a culture where innovation thrives, ideas are celebrated, and people come first, no matter where they call home.
Our Impact
As of mid 2025, our platform powers over 1.5 billion messages, helps generate over 200 million leads, and facilitates over 20 million conversations for the more than 2 million businesses we serve each month. Behind those numbers are real people growing their companies, connecting with customers, and making their mark - and we get to help make that happen.
About the Role:
We are looking for a highly skilled SDET Manager to spearhead the quality of AI application development at HighLevel. This role is very critical in ensuring the relevancy, consistency, reliability, contextual recall and fairness of our AI platform.
Ideal candidates will have a combination of technical depth in AI/ML, Agentic AI along with deep expertise in test automation covering model validation, agentic workflows, and quality leadership.
Requirements:
The company is an Equal Opportunity Employer. As an employer subject to affirmative action regulations, we invite you to voluntarily provide the following demographic information. This information is used solely for compliance with government record-keeping, reporting, and other legal requirements. Providing this information is voluntary and refusal to do so will not affect your application status. This data will be kept separate from your application and will not be used in the hiring decision.
HighLevel is an AI powered, all-in-one white-label sales & marketing platform that empowers agencies, entrepreneurs, and businesses to elevate their digital presence and drive growth. We are proud to support a global and growing community of over 2 million businesses, comprised of agencies, consultants, and businesses of all sizes and industries. HighLevel empowers users with all the tools needed to capture, nurture, and close new leads into repeat customers. As of mid 2025, HighLevel processes over 4 billion API hits and handles more than 2.5 billion message events every day. Our platform manages over 470 terabytes of data distributed across five databases, operates with a network of over 250 microservices, and supports over 1 million hostnames.
Our People
With over 1,500 team members across 15+ countries, we operate in a global, remote-first environment. We are building more than software; we are building a global community rooted in creativity, collaboration, and impact. We take pride in cultivating a culture where innovation thrives, ideas are celebrated, and people come first, no matter where they call home.
Our Impact
As of mid 2025, our platform powers over 1.5 billion messages, helps generate over 200 million leads, and facilitates over 20 million conversations for the more than 2 million businesses we serve each month. Behind those numbers are real people growing their companies, connecting with customers, and making their mark - and we get to help make that happen.
About the Role:
We are looking for a highly skilled SDET Manager to spearhead the quality of AI application development at HighLevel. This role is very critical in ensuring the relevancy, consistency, reliability, contextual recall and fairness of our AI platform.
Ideal candidates will have a combination of technical depth in AI/ML, Agentic AI along with deep expertise in test automation covering model validation, agentic workflows, and quality leadership.
Requirements:
- Overall 8-12 years of experience in which minimum of 1 year in testing AI products
- Good experience in Prompt Engineering, testing AI applications like conversations AI, voice AI, workflow AI
- Architect and scale test automation frameworks for APIs, micro-services, ML pipelines, and agentic AI workflows
- Experience in testing RAG based applications using frameworks like TruLens, RAGAs
- Leverage AI to improve coverage and efficiency across testing lifecycle
- Hands-on experience testing agentic AI frameworks (e.g., Agentic Studio, LangChain, AutoGen, crewAI)
- Strong programming skills in Python and Java or TypeScript/JavaScript
- Proven expertise in test automation frameworks (Selenium, Playwright, Cypress etc.)
- Experience with cloud platforms (AWS, GCP) and CI/CD pipelines
- Review testing strategies for AI application and fine tune strategy to minimize issues in production
- Establish evaluation pipelines for detecting hallucination, context retention, latency in multi model environments
- Generate right data set to simulate customer usage scenarios
- Test for data, model and code issues
- Define relevant KPIs for AI application testing
- Non Functional testing - Performance, Scalability, Reliability, Security
- Implement A/B testing at appropriate levels to identify customer impact
- Run down defect triaging for all customer issues to identify root cause and expand test coverage to mitigate gaps.
- Ensure quality deliverables from AI teams
- Hire top talent and mentor SDET team on AI testing skills
The company is an Equal Opportunity Employer. As an employer subject to affirmative action regulations, we invite you to voluntarily provide the following demographic information. This information is used solely for compliance with government record-keeping, reporting, and other legal requirements. Providing this information is voluntary and refusal to do so will not affect your application status. This data will be kept separate from your application and will not be used in the hiring decision.
How to apply
To apply for this job you need to authorize on our website. If you don't have an account yet, please register.
Post a resumeSimilar jobs
QA Tester
Sherweb,
Remote, Remote
1 week ago
Location: remote (India) Here’s what we do and why we do itWe work to simplify the cloud for IT professionals so they can focus on what really matters, making their customers' lives better. C2 ITSM, our complete and innovative ITSM, facilitates service management for our partners and customers. Find out how we do that here: https://c2-itsm.com/about-us/ and www.sherweb.com/about/Here's how you...
Power BI Analyst
Gainwell Technologies,
Remote, Remote
1 week ago
SummaryYour role in our missionEssential Job FunctionsCodes, tests, documents and implements programs according to the specifications provided. Provides moderately complex to complex technical and production support to end-users. Participates in and conducts peer reviews as needed. Participates in creating unit and other test plans for assigned programming tasks. Provides leadership and work guidance to less experienced personnel. Assists with analyzing...
Senior Global Payroll Analyst
Sumo Logic,
Remote, Remote
1 week ago
We are seeking a detail-oriented and collaborative team member to join the Sumo Payroll team and support our U.S. multi-state payroll operations. In this role, you will be responsible for ensuring accurate and timely processing of payroll, maintain compliance with federal and state regulations, and contributing to general ledger reconciliation and payroll reporting. You will work closely with our Sr....
