Search Jobs

Search by job, company or skills

AI - AI/ML Engineer

AI - AI/ML Engineer

Qualitest
Early Applicant
  • Posted a month ago
  • Be among the first 10 applicants

Job Description

Job description:

Experience Range: 7-10 years

Job Location: Bangalore with Hybrid

Primary Skill

AI Validation & Testing

Chatbot & RAG Testing • LLM/Prompt Evaluation • Python Validation

  • AI Solution Testing: Validates AI-powered solutions including chatbots and generative AI features for accuracy, reliability, and edge cases
  • RAG Validation: Tests Retrieval-Augmented Generation pipelines for retrieval relevance, grounding, and hallucination handling
  • Agentic AI: Builds and tests agentic solutions such as MCP and prompting

Test Data & AI Evaluation

Data Quality • AI Eval Metrics • Responsible AI

  • Test Data Management: Curates and versions golden/evaluation datasets and validates data pipelines for integrity, completeness, and drift across training and inference
  • AI Evaluation: Hands-on with evaluation frameworks and metrics such as RAGAS, DeepEval, and LLM-as-judge, covering groundedness, relevance, and precision/recall
  • Responsible AI & Privacy: Bias and fairness checks, safety/guardrail, and PII/data-leakage validation

Languages & Frameworks

Python • Pytest

  • Core Languages: Proficient in Python for automation
  • Test Frameworks: Hands-on with Pytest, or equivalent
  • Framework Design: Build, scale, and maintain automation frameworks end-to-end

Secondary Skill

UI & API Testing

UI Automation • REST/GraphQL APIs • Contract Testing

  • UI Automation: End-to-end browser testing across modern web applications. Well versed with BDD frameworks like Cucumber/SpecFlow
  • API Testing: Validates REST/GraphQL APIs across microservices for correctness and edge cases
  • Cross-layer Coverage: Bridges UI and API layers for integrated test coverage
  • Tools: Experience with tools like Postman/Insomnia/Newman

Cloud, Infrastructure & CI/CD

AWS • SQL • CI/CD Pipelines

  • Cloud Exposure: Working knowledge of AWS/Azure services for test environments
  • SQL Proficiency: Uses SQL to query, validate, and debug data confidently
  • CI/CD Integration: Integrates test suites into Jenkins, GitHub Actions, GitLab CI, etc.

Profile description:

Experience Range: 7-10 years

Job Location: Bangalore with Hybrid

Primary Skill

AI Validation & Testing

Chatbot & RAG Testing • LLM/Prompt Evaluation • Python Validation

  • AI Solution Testing: Validates AI-powered solutions including chatbots and generative AI features for accuracy, reliability, and edge cases
  • RAG Validation: Tests Retrieval-Augmented Generation pipelines for retrieval relevance, grounding, and hallucination handling
  • Agentic AI: Builds and tests agentic solutions such as MCP and prompting

Test Data & AI Evaluation

Data Quality • AI Eval Metrics • Responsible AI

  • Test Data Management: Curates and versions golden/evaluation datasets and validates data pipelines for integrity, completeness, and drift across training and inference
  • AI Evaluation: Hands-on with evaluation frameworks and metrics such as RAGAS, DeepEval, and LLM-as-judge, covering groundedness, relevance, and precision/recall
  • Responsible AI & Privacy: Bias and fairness checks, safety/guardrail, and PII/data-leakage validation

Languages & Frameworks

Python • Pytest

  • Core Languages: Proficient in Python for automation
  • Test Frameworks: Hands-on with Pytest, or equivalent
  • Framework Design: Build, scale, and maintain automation frameworks end-to-end

Secondary Skill

UI & API Testing

UI Automation • REST/GraphQL APIs • Contract Testing

  • UI Automation: End-to-end browser testing across modern web applications. Well versed with BDD frameworks like Cucumber/SpecFlow
  • API Testing: Validates REST/GraphQL APIs across microservices for correctness and edge cases
  • Cross-layer Coverage: Bridges UI and API layers for integrated test coverage
  • Tools: Experience with tools like Postman/Insomnia/Newman

Cloud, Infrastructure & CI/CD

AWS • SQL • CI/CD Pipelines

  • Cloud Exposure: Working knowledge of AWS/Azure services for test environments
  • SQL Proficiency: Uses SQL to query, validate, and debug data confidently
  • CI/CD Integration: Integrates test suites into Jenkins, GitHub Actions, GitLab CI, etc.

We offer:

Experience Range: 7-10 years

Job Location: Bangalore with Hybrid

Primary Skill

AI Validation & Testing

Chatbot & RAG Testing • LLM/Prompt Evaluation • Python Validation

  • AI Solution Testing: Validates AI-powered solutions including chatbots and generative AI features for accuracy, reliability, and edge cases
  • RAG Validation: Tests Retrieval-Augmented Generation pipelines for retrieval relevance, grounding, and hallucination handling
  • Agentic AI: Builds and tests agentic solutions such as MCP and prompting

Test Data & AI Evaluation

Data Quality • AI Eval Metrics • Responsible AI

  • Test Data Management: Curates and versions golden/evaluation datasets and validates data pipelines for integrity, completeness, and drift across training and inference
  • AI Evaluation: Hands-on with evaluation frameworks and metrics such as RAGAS, DeepEval, and LLM-as-judge, covering groundedness, relevance, and precision/recall
  • Responsible AI & Privacy: Bias and fairness checks, safety/guardrail, and PII/data-leakage validation

Languages & Frameworks

Python • Pytest

  • Core Languages: Proficient in Python for automation
  • Test Frameworks: Hands-on with Pytest, or equivalent
  • Framework Design: Build, scale, and maintain automation frameworks end-to-end

Secondary Skill

UI & API Testing

UI Automation • REST/GraphQL APIs • Contract Testing

  • UI Automation: End-to-end browser testing across modern web applications. Well versed with BDD frameworks like Cucumber/SpecFlow
  • API Testing: Validates REST/GraphQL APIs across microservices for correctness and edge cases
  • Cross-layer Coverage: Bridges UI and API layers for integrated test coverage
  • Tools: Experience with tools like Postman/Insomnia/Newman

Cloud, Infrastructure & CI/CD

AWS • SQL • CI/CD Pipelines

  • Cloud Exposure: Working knowledge of AWS/Azure services for test environments
  • SQL Proficiency: Uses SQL to query, validate, and debug data confidently
  • CI/CD Integration: Integrates test suites into Jenkins, GitHub Actions, GitLab CI, etc.

More Info

Job Type:
Industry:
Employment Type:

Key Skills

CI CD Pipelines

Chatbot RAG Testing

AI Evaluation

LLM Prompt Evaluation

RAG Validation

AI Validation Testing

Newman

AI Solution Testing

GraphQL APIs

Agentic AI

Contract Testing

Responsible AI Privacy

About Company

Similar Jobs

5-7 yrs
Bengaluru, India
Skills:
containerization , Apis, Microservices, Terraform, Helm, AI Agents Workflow Integration, RAG workflows, Context engineering, Agents orchestration, Monitoring and debugging, Open-source models, Cloud-native systems, Infrastructure as code, CI/CD, Serverless, Agentic solutions
5-7 yrs
Bengaluru, India
Skills:
OCP (OpenShift Container Platform), Banking Domain, Etl Tools, Pyspark, Informatica, Sql, Apache Airflow, Unix Linux, Numpy, Pandas, DataStage, Api Testing, Shell scripting, Robot Framework, Restful Apis, Postman, Python, ETL Concepts, AI ML Adoption, GitHub Copilot, Agentic AI
8-10 yrs
Bengaluru, India
Skills:
MLops, Data Knowledge Integration, Enterprise Integration Architecture, LLMOps, Responsible AI Governance, API Event-Driven Design, Cloud Platform Architecture, Architecture Leadership, AI ML Generative AI Solutions, Agentic AI Workflow Orchestration, Stakeholder Vendor Management
5-9 yrs
Bengaluru, India
Skills:
Github, Apis, Tensorflow, Numpy, Git, Pandas, MLops, Pytorch, Docker, Azure, Kubernetes, Python, AWS, agentic architecture, GenAI, scikit-learn, LLMOps, Llm, distributed services, infrastructure as code
5-7 yrs
Bengaluru, India
Skills:
Machine Learning, Apis, Natural Language Processing, Microservices, Devops, Data Privacy, Python, CI CD, cloud environments, responsible AI, AI services, Security, model-serving pipelines, large language models, data ingestion