Back End Developer

Backend Engineer

My Client product is built for high reliability in long-running workflows — persistent context, real-world task completion, multi-step reasoning, and seamless interaction with external tools — all while remaining dependable despite the non-deterministic nature of model behavior.

The Role

• As a Backend Engineer, you'll own the inference and orchestration layer powering every interaction in there product. Your work sits at the critical intersection of models and users, where latency, correctness, reliability, and cost directly shape the real-world experience.
• You'll build and operate the production systems that transform raw model capability into fast, stable, observable APIs — used across our mobile and desktop clients.

What You'll Focus On

• Build and operate backend systems that serve AI-powered features in production
• Design inference pipelines, orchestration layers, and service boundaries around models
• Own production concerns end-to-end: monitoring, logging, alerting, and incident response
• Optimize latency and throughput across inference, caching, batching, and streaming

Ideal Experience

• Strong backend engineering fundamentals, proven in production environments
• Track record running high-throughput, low-latency services
• Familiarity with AI inference patterns — LLMs, embeddings, multimodal systems
• Comfortable debugging distributed systems under real-world load
• A bias toward shipping fast and learning from production behaviour

Outcomes You'll Drive

• Backend systems that run reliably at scale, handling production AI traffic with low latency and high throughput
• APIs that are stable, clear, and easy to integrate across frontend and ML systems
• Production incidents detected, diagnosed, and resolved quickly — minimizing user impact
• Continuous, iterative improvements to system performance and reliability based on real usage

Tech Stack

• Python · Node.js · PyTorch · OpenAI / Anthropic / open-source LLMs · SQL & NoSQL · Kubernetes · Docker

How We Work

• The best products in the world are built by small, world-class teams — and that's who we are: high talent density, hands-on, and fast-moving.
• We make decisions collectively and move at speed, balancing high-quality shipping with continuous learning. Joining our team means bringing structure, exercising sharp judgment, and executing independently.