Applied AI Engineer
Applied AI Engineer
potpie ai- Posted 26 days ago
- Over 50 applicants have applied
Job Description
About Potpie AI
Potpie AI enables developers to build, test, and deploy production-grade AI agents that understand large, complex codebases. We are pioneering developer tools for the age of generative AI.
Role Overview
We are looking for an Applied AI Engineer with deep expertise in Generative AI and strong Software Development Engineering background. You will build intelligent agentic workflows, RAG systems, and robust backend systems.
Key Responsibilities
Potpie AI enables developers to build, test, and deploy production-grade AI agents that understand large, complex codebases. We are pioneering developer tools for the age of generative AI.
Role Overview
We are looking for an Applied AI Engineer with deep expertise in Generative AI and strong Software Development Engineering background. You will build intelligent agentic workflows, RAG systems, and robust backend systems.
Key Responsibilities
- Design, build, and productionize resilient multi-agent execution graphs and advanced retrieval pipelines (hybrid search, semantic chunking, re-ranking, and graph-augmented RAG) built for deep reasoning over complex, large-scale codebases.
- Engineer low-latency, high-concurrency asynchronous backend services and microservices to integrate LLM reasoning into developer workflows, maintaining fault tolerance and rate-limiting.
- Implement continuous evaluation harnesses (hallucination detection, regression testing, task completion scoring) and optimize latency/cost trade-offs across proprietary APIs and fine-tuned open-source models using caching and speculative routing.
- Implement end-to-end tracing and observability pipelines for non-deterministic agent behavior (OpenTelemetry, Langfuse/Arize), driving high reliability and automated integration testing.
- Partner with frontend engineers, product architects, and security teams to translate raw model capabilities into deterministic, intuitive developer workflows.
- 2+ years of professional software development experience building and scaling high-concurrency backend services in production (Python, Go, or TypeScript/Node.js).
- Hands-on experience deploying Generative AI and advanced agentic workflows into production.
- Expertise in agentic orchestration patterns (e.g., LangGraph, AutoGen, CrewAI, LlamaIndex) and vector search architectures.
- Strong software engineering fundamentals: distributed systems design, asynchronous programming, databases, caching, and clean API contracts.
- Experience with LLM observability, evals, and production tracing frameworks.
- Passion for developer tools and building mission-critical AI systems.
More Info
Key Skills
Arize
distributed systems design
LLM observability
Langfuse
LlamaIndex
clean API contracts
OpenTelemetry
production tracing frameworks
vector search architectures
agentic orchestration patterns
AutoGen
CrewAI
Generative AI
LangGraph
About Company
Skills:
Data Architecture, Ml, AWS, Python, Azure, Gcp, Apis, LLM integration, Ai, scalable backend systems, model evaluation, performance optimisation, prompt engineering
Skills:
.NET, Github, Paas, Nodejs, ADO, Angular, Tensorflow, Nosql, React, Pytorch, Sonarqube, Python, AWS, Java, Sql, DevSecOps, AWS Bedrock, micro-services, SRE, LangFuse, MLflow, Azure OpenAI, LangSmith, FaaS, LangGraph, Vertex AI, LangChain, Lean, FinOps, infrastructure-as-code, unit testing frameworks, Xp
Skills:
Microservices, AWS, Nltk, Node.js, Azure, Gcp, Nlp, Javascript, Restful Apis, LLMs, OpenAI, Claude, Hugging Face, cloud platforms, NLU libraries and tools, Rasa, LLaMA, SpaCy
Skills:
Orchestration, C#, C++, Deep Learning, Numpy, Pytorch, Pandas, Decision Trees, Clustering, Python, Etl, LangChain, embeddings, vector search, agentic AI, tool calling, retrieval-augmented generation, CNNs, prompt engineering, LangGraph, ensembles
Skills:
Sql, Python, time-series forecasting, Generative AI tooling, R, tree-based models, classical ML modeling, observability monitoring tools