- Home
- Engineering Jobs
- Engineering Jobs in Lahore
- Senior QA Engineer
Senior QA Engineer
Description:
We are looking for an experienced Senior QA Engineer to ensure the quality, reliability, and performance of AI agents and enterprise software platforms delivered to our clients.
In this hands-on role, you will be responsible for testing AI agents across chat and voice channels, validating their responses, identifying hallucinations, testing integrations, and ensuring systems meet enterprise security and performance standards.
You will independently plan, develop, and execute manual and automated test cases while working closely with engineering teams to ensure production-ready releases.
This is an individual contributor position with an opportunity to grow into a QA leadership role as the team expands.
Key Responsibilities
- Test AI agents end to end, including response accuracy, hallucinations, multi-turn conversations, tool calls, API integrations, and human handoffs.
- Build and execute LLM evaluation frameworks using tools such as Promptfoo, DeepEval, Ragas, and LLM-as-a-Judge.
- Perform AI safety and security testing, including prompt injection, data leakage, access control, and guardrail validation.
- Develop and maintain automated web and API testing suites using Playwright or Cypress with TypeScript, JavaScript, or Python.
- Integrate automated test suites into CI/CD pipelines using GitHub Actions, Jenkins, Azure DevOps, or similar tools.
- Perform API testing, SQL validation, and integration testing across enterprise systems such as CRM, ERP, and banking platforms.
- Conduct load, stress, and latency testing using tools such as k6, JMeter, or Locust.
- Validate AI response times, including time to first token and overall response latency.
- Prepare test plans, document defects, perform root-cause analysis, and provide release sign-off.
- Communicate testing results, quality metrics, and release risks to internal teams and clients.
Required Qualifications & Skills
- 3+ years of professional hands-on experience in Software Quality Assurance and Testing.
- Strong experience with Playwright or Cypress automation frameworks.
- Proficiency in TypeScript, JavaScript, or Python for test automation.
- Strong understanding of API testing using Postman or code-based testing frameworks.
- Solid SQL skills and experience with database validation.
- Experience integrating automated test suites into CI/CD pipelines.
- Practical experience testing enterprise applications and complex software integrations.
- Strong understanding of manual testing, automation testing, regression testing, and test case design.
- Excellent written communication and documentation skills.
- Ability to work independently in an onsite working environment.
- Willingness to commit exclusively to this full-time role, without other employment or freelance engagements.
Strongly Preferred Qualifications
- Experience testing production LLM applications, AI agents, chatbots, or voice-based AI systems.
- Hands-on experience with Promptfoo, DeepEval, Ragas, or LangSmith.
- Experience with AI red-teaming, prompt injection, and security testing.
- Performance and load testing experience using k6, JMeter, or Locust.
- Experience testing voice agents, telephony systems, and conversational workflows.
- Experience with Arabic, right-to-left (RTL) interfaces, or GCC-based clients.
- ISTQB certification.
- Previous experience in banking, fintech, insurance, healthcare, or other regulated industries.
| Organization | Digital Innovation (Pvt.) Ltd. |
| Industry | Engineering Jobs |
| Occupational Category | Senior QA Engineer |
| Job Location | Lahore, Pakistan |
| Shift Type | Morning |
| Job Type | Full Time |
| Gender | No Preference |
| Career Level | Experienced Professional |
| Experience | 3 Years |
| Posted at | 2026-11-12 6:16 pm |
| Expires on | 2026-12-27 |