Engineering Manager - SDET
HighLevel
Date: 3 weeks ago
City: Remote, Remote
Contract type: Full time
Remote
About HighLevel:
HighLevel is an AI powered, all-in-one white-label sales & marketing platform that empowers agencies, entrepreneurs, and businesses to elevate their digital presence and drive growth. We are proud to support a global and growing community of over 2 million businesses, comprised of agencies, consultants, and businesses of all sizes and industries. HighLevel empowers users with all the tools needed to capture, nurture, and close new leads into repeat customers. As of mid 2025, HighLevel processes over 4 billion API hits and handles more than 2.5 billion message events every day. Our platform manages over 470 terabytes of data distributed across five databases, operates with a network of over 250 microservices, and supports over 1 million hostnames.
Our People
With over 1,500 team members across 15+ countries, we operate in a global, remote-first environment. We are building more than software; we are building a global community rooted in creativity, collaboration, and impact. We take pride in cultivating a culture where innovation thrives, ideas are celebrated, and people come first, no matter where they call home.
Our Impact
As of mid 2025, our platform powers over 1.5 billion messages, helps generate over 200 million leads, and facilitates over 20 million conversations for the more than 2 million businesses we serve each month. Behind those numbers are real people growing their companies, connecting with customers, and making their mark - and we get to help make that happen.
About the Role:
We are looking for a highly skilled SDET Manager to spearhead the quality of AI application development at HighLevel. This role is very critical in ensuring the relevancy, consistency, reliability, contextual recall and fairness of our AI platform.
Ideal candidates will have a combination of technical depth in AI/ML, Agentic AI along with deep expertise in test automation covering model validation, agentic workflows, and quality leadership.
Requirements:
The company is an Equal Opportunity Employer. As an employer subject to affirmative action regulations, we invite you to voluntarily provide the following demographic information. This information is used solely for compliance with government record-keeping, reporting, and other legal requirements. Providing this information is voluntary and refusal to do so will not affect your application status. This data will be kept separate from your application and will not be used in the hiring decision.
HighLevel is an AI powered, all-in-one white-label sales & marketing platform that empowers agencies, entrepreneurs, and businesses to elevate their digital presence and drive growth. We are proud to support a global and growing community of over 2 million businesses, comprised of agencies, consultants, and businesses of all sizes and industries. HighLevel empowers users with all the tools needed to capture, nurture, and close new leads into repeat customers. As of mid 2025, HighLevel processes over 4 billion API hits and handles more than 2.5 billion message events every day. Our platform manages over 470 terabytes of data distributed across five databases, operates with a network of over 250 microservices, and supports over 1 million hostnames.
Our People
With over 1,500 team members across 15+ countries, we operate in a global, remote-first environment. We are building more than software; we are building a global community rooted in creativity, collaboration, and impact. We take pride in cultivating a culture where innovation thrives, ideas are celebrated, and people come first, no matter where they call home.
Our Impact
As of mid 2025, our platform powers over 1.5 billion messages, helps generate over 200 million leads, and facilitates over 20 million conversations for the more than 2 million businesses we serve each month. Behind those numbers are real people growing their companies, connecting with customers, and making their mark - and we get to help make that happen.
About the Role:
We are looking for a highly skilled SDET Manager to spearhead the quality of AI application development at HighLevel. This role is very critical in ensuring the relevancy, consistency, reliability, contextual recall and fairness of our AI platform.
Ideal candidates will have a combination of technical depth in AI/ML, Agentic AI along with deep expertise in test automation covering model validation, agentic workflows, and quality leadership.
Requirements:
- Overall 8-12 years of experience in which minimum of 1 year in testing AI products
- Good experience in Prompt Engineering, testing AI applications like conversations AI, voice AI, workflow AI
- Architect and scale test automation frameworks for APIs, micro-services, ML pipelines, and agentic AI workflows
- Experience in testing RAG based applications using frameworks like TruLens, RAGAs
- Leverage AI to improve coverage and efficiency across testing lifecycle
- Hands-on experience testing agentic AI frameworks (e.g., Agentic Studio, LangChain, AutoGen, crewAI)
- Strong programming skills in Python and Java or TypeScript/JavaScript
- Proven expertise in test automation frameworks (Selenium, Playwright, Cypress etc.)
- Experience with cloud platforms (AWS, GCP) and CI/CD pipelines
- Review testing strategies for AI application and fine tune strategy to minimize issues in production
- Establish evaluation pipelines for detecting hallucination, context retention, latency in multi model environments
- Generate right data set to simulate customer usage scenarios
- Test for data, model and code issues
- Define relevant KPIs for AI application testing
- Non Functional testing - Performance, Scalability, Reliability, Security
- Implement A/B testing at appropriate levels to identify customer impact
- Run down defect triaging for all customer issues to identify root cause and expand test coverage to mitigate gaps.
- Ensure quality deliverables from AI teams
- Hire top talent and mentor SDET team on AI testing skills
The company is an Equal Opportunity Employer. As an employer subject to affirmative action regulations, we invite you to voluntarily provide the following demographic information. This information is used solely for compliance with government record-keeping, reporting, and other legal requirements. Providing this information is voluntary and refusal to do so will not affect your application status. This data will be kept separate from your application and will not be used in the hiring decision.
How to apply
To apply for this job you need to authorize on our website. If you don't have an account yet, please register.
Post a resumeSimilar jobs
Technical Support Engineer - Security & Compliance - Cloud Protection
Microsoft,
Remote, Remote
4 days ago
With more than 45,000 employees and partners worldwide, the Customer Experience and Success (CE&S) organization is on a mission to empower customers to accelerate business value through differentiated customer experiences that leverage Microsoft’s products and services, ignited by our people and culture. We drive cross-company alignment and execution, ensuring that we consistently exceed customers’ expectations in every interaction, whether in-product,...
Principal Project Manager
Microsoft,
Remote, Remote
1 week ago
As part of Microsoft Industry Solutions Delivery, RMQA (Risk Management and Quality Assurance) operates within the Delivery Excellence organization with the objective to mitigate risk and assure quality in deal shaping and project execution via effective solutioning, estimation and delivery monitoring by applying lessons learned, providing early warnings, resolving delivery issues and implementing a comprehensive quality accreditation program. The Quality...
Social Media Intern
Emmes,
Remote, Remote
1 week ago
Emmes Group: Building a better future for us all. Emmes Group is transforming the future of clinical research, bringing the promise of new medical discovery closer within reach for patients. Emmes Group was founded as Emmes more than 47 years ago, becoming one of the primary clinical research providers to the US government before expanding into public-private partnerships and commercial biopharma....
