- Posted a month ago
- Be among the first 10 applicants
Job Description
Experience Range: 7-10 years
Job Location: Bangalore with Hybrid
Primary Skill
AI Validation & Testing
Chatbot & RAG Testing • LLM/Prompt Evaluation • Python Validation
- AI Solution Testing: Validates AI-powered solutions including chatbots and generative AI features for accuracy, reliability, and edge cases
- RAG Validation: Tests Retrieval-Augmented Generation pipelines for retrieval relevance, grounding, and hallucination handling
- Agentic AI: Builds and tests agentic solutions such as MCP and prompting
Test Data & AI Evaluation
Data Quality • AI Eval Metrics • Responsible AI
- Test Data Management: Curates and versions golden/evaluation datasets and validates data pipelines for integrity, completeness, and drift across training and inference
- AI Evaluation: Hands-on with evaluation frameworks and metrics such as RAGAS, DeepEval, and LLM-as-judge, covering groundedness, relevance, and precision/recall
- Responsible AI & Privacy: Bias and fairness checks, safety/guardrail, and PII/data-leakage validation
Languages & Frameworks
Python • Pytest
- Core Languages: Proficient in Python for automation
- Test Frameworks: Hands-on with Pytest, or equivalent
- Framework Design: Build, scale, and maintain automation frameworks end-to-end
Secondary Skill
UI & API Testing
UI Automation • REST/GraphQL APIs • Contract Testing
- UI Automation: End-to-end browser testing across modern web applications. Well versed with BDD frameworks like Cucumber/SpecFlow
- API Testing: Validates REST/GraphQL APIs across microservices for correctness and edge cases
- Cross-layer Coverage: Bridges UI and API layers for integrated test coverage
- Tools: Experience with tools like Postman/Insomnia/Newman
Cloud, Infrastructure & CI/CD
AWS • SQL • CI/CD Pipelines
- Cloud Exposure: Working knowledge of AWS/Azure services for test environments
- SQL Proficiency: Uses SQL to query, validate, and debug data confidently
- CI/CD Integration: Integrates test suites into Jenkins, GitHub Actions, GitLab CI, etc.
Experience Range: 7-10 years
Job Location: Bangalore with Hybrid
Primary Skill
AI Validation & Testing
Chatbot & RAG Testing • LLM/Prompt Evaluation • Python Validation
- AI Solution Testing: Validates AI-powered solutions including chatbots and generative AI features for accuracy, reliability, and edge cases
- RAG Validation: Tests Retrieval-Augmented Generation pipelines for retrieval relevance, grounding, and hallucination handling
- Agentic AI: Builds and tests agentic solutions such as MCP and prompting
Test Data & AI Evaluation
Data Quality • AI Eval Metrics • Responsible AI
- Test Data Management: Curates and versions golden/evaluation datasets and validates data pipelines for integrity, completeness, and drift across training and inference
- AI Evaluation: Hands-on with evaluation frameworks and metrics such as RAGAS, DeepEval, and LLM-as-judge, covering groundedness, relevance, and precision/recall
- Responsible AI & Privacy: Bias and fairness checks, safety/guardrail, and PII/data-leakage validation
Languages & Frameworks
Python • Pytest
- Core Languages: Proficient in Python for automation
- Test Frameworks: Hands-on with Pytest, or equivalent
- Framework Design: Build, scale, and maintain automation frameworks end-to-end
Secondary Skill
UI & API Testing
UI Automation • REST/GraphQL APIs • Contract Testing
- UI Automation: End-to-end browser testing across modern web applications. Well versed with BDD frameworks like Cucumber/SpecFlow
- API Testing: Validates REST/GraphQL APIs across microservices for correctness and edge cases
- Cross-layer Coverage: Bridges UI and API layers for integrated test coverage
- Tools: Experience with tools like Postman/Insomnia/Newman
Cloud, Infrastructure & CI/CD
AWS • SQL • CI/CD Pipelines
- Cloud Exposure: Working knowledge of AWS/Azure services for test environments
- SQL Proficiency: Uses SQL to query, validate, and debug data confidently
- CI/CD Integration: Integrates test suites into Jenkins, GitHub Actions, GitLab CI, etc.
Experience Range: 7-10 years
Job Location: Bangalore with Hybrid
Primary Skill
AI Validation & Testing
Chatbot & RAG Testing • LLM/Prompt Evaluation • Python Validation
- AI Solution Testing: Validates AI-powered solutions including chatbots and generative AI features for accuracy, reliability, and edge cases
- RAG Validation: Tests Retrieval-Augmented Generation pipelines for retrieval relevance, grounding, and hallucination handling
- Agentic AI: Builds and tests agentic solutions such as MCP and prompting
Test Data & AI Evaluation
Data Quality • AI Eval Metrics • Responsible AI
- Test Data Management: Curates and versions golden/evaluation datasets and validates data pipelines for integrity, completeness, and drift across training and inference
- AI Evaluation: Hands-on with evaluation frameworks and metrics such as RAGAS, DeepEval, and LLM-as-judge, covering groundedness, relevance, and precision/recall
- Responsible AI & Privacy: Bias and fairness checks, safety/guardrail, and PII/data-leakage validation
Languages & Frameworks
Python • Pytest
- Core Languages: Proficient in Python for automation
- Test Frameworks: Hands-on with Pytest, or equivalent
- Framework Design: Build, scale, and maintain automation frameworks end-to-end
Secondary Skill
UI & API Testing
UI Automation • REST/GraphQL APIs • Contract Testing
- UI Automation: End-to-end browser testing across modern web applications. Well versed with BDD frameworks like Cucumber/SpecFlow
- API Testing: Validates REST/GraphQL APIs across microservices for correctness and edge cases
- Cross-layer Coverage: Bridges UI and API layers for integrated test coverage
- Tools: Experience with tools like Postman/Insomnia/Newman
Cloud, Infrastructure & CI/CD
AWS • SQL • CI/CD Pipelines
- Cloud Exposure: Working knowledge of AWS/Azure services for test environments
- SQL Proficiency: Uses SQL to query, validate, and debug data confidently
- CI/CD Integration: Integrates test suites into Jenkins, GitHub Actions, GitLab CI, etc.
More Info
Key Skills
CI CD Pipelines
Chatbot RAG Testing
AI Evaluation
LLM Prompt Evaluation
RAG Validation
AI Validation Testing
Newman
AI Solution Testing
GraphQL APIs
Agentic AI
Contract Testing
Responsible AI Privacy



