Position Overview

Seeking a highly technical Software Engineer focused on strengthening the security posture, compliance controls, and quality assurance practices of enterprise Generative AI and agent orchestration solutions. The role centers on AI security testing, governance, assurance, risk assessment, and solution review, while also supporting software test automation initiatives.

Primary Duties

AI Security Assessments

Perform security and safety assessments of LLM, RAG, and agentic applications.
Evaluate risks including prompt injection, jailbreak attempts, unauthorized data disclosure, unsafe outputs, excessive permissions, tool misuse, and tenant isolation weaknesses.
Conduct AI-focused assurance activities and threat assessments.

Moonshot & Litmus Operations

Implement Moonshot and Litmus testing for applicable AI solutions.
Configure baseline and use-case-specific testing scenarios.
Develop adversarial test cases, analyze outcomes, and maintain assurance evidence.

AI Evaluation & Data Governance

Create representative datasets for security, safety, and functional validation.
Generate and manage synthetic test data securely.
Ensure data classification, masking, anonymization, retention, and disposal controls are enforced.

Security Governance & Risk Advisory

Translate organizational, security, and AI governance requirements into practical controls and testing activities.
Advise stakeholders regarding secure use of enterprise and sensitive data within AI solutions.
Review data access, tenant isolation, retention policies, logging, integrations, retrieval boundaries, and service selection risks.
Support security reviews, audits, remediation efforts, and production readiness assessments.

Secure Architecture Review

Evaluate proposed AI solution architectures.
Identify privacy, security, and compliance concerns.
Recommend mitigation measures and security-by-design practices throughout the development lifecycle.

Findings Management & Reporting

Document vulnerabilities, control weaknesses, impacts, risks, and remediation recommendations.
Verify remediation effectiveness with engineering teams.
Communicate technical and non-technical risks to stakeholders.
Track trends, recurring issues, and assurance metrics.

Security Automation Integration

Embed automated AI security validation into CI/CD workflows.
Establish release gates, regression checks, and security acceptance criteria.
Prevent material risks from reaching production environments.

Secondary Responsibilities

Test Automation Engineering

Develop automated API, regression, functional, and end-to-end tests.
Utilize tools such as Pytest, Playwright, Cypress, Postman, or equivalent technologies.

Root Cause Analysis

Investigate defects and operational issues.
Review application logs and cloud environments to identify root causes.
Produce actionable defect documentation.

Quality Enablement

Promote consistent testing standards and reusable testing assets.
Support shared ownership of product quality across teams.

Required Qualifications

Professional Experience

Minimum 3 years of experience in software engineering, cybersecurity, application security, AI assurance, software test engineering, or technical quality assurance.

AI Security Expertise

Strong understanding of security risks affecting LLM, RAG, and agentic systems.
Knowledge of prompt injection, unsafe outputs, excessive privileges, data leakage, application abuse, and insecure tool integrations.

AI Testing Platforms

Experience working with Moonshot, Litmus, or comparable AI evaluation and adversarial testing frameworks.
Ability to design test scenarios and interpret assurance results.

Security & Compliance Knowledge

Experience translating privacy, security, and AI governance requirements into controls, risk assessments, assurance evidence, and testing plans.

Architecture Review Skills

Experience evaluating system architectures, trust boundaries, cloud environments, and integration risks.
Ability to recommend secure and proportionate technical solutions.

Stakeholder Collaboration

Strong communication and consulting capabilities.
Able to explain risks, challenge assumptions, and influence secure implementation decisions.

Software Development & Automation

Proficiency in Python.
Working knowledge of JavaScript or TypeScript.
Experience with API, regression, functional, and end-to-end test automation.

Cloud & Data Security

Familiarity with AWS environments, SQL databases, container platforms, encryption, logging, access management, data classification, retention controls, and secure handling of sensitive information.

Preferred Experience

AI red-team exercises, AI threat modeling, security assurance, or application security review experience.
Familiarity with industry guidance such as OWASP GenAI Security Project, NIST AI Risk Management Framework, or MITRE ATLAS.
Experience testing RAG architectures, agent tooling, model integrations, RBAC implementations, tenant isolation controls, and AI-specific attack surfaces.
Experience supporting environments with stringent security and compliance requirements.

Software Engineer AI Security & Quality (GenAI)