AI Platform & Data Engineer (The "Telemetry" Owner)

AI Platform & Data Engineer (Telemetry Owner) Azure OpenAI

Experience: 58 Years

Role Type: Platform / Data Engineering

Focus: AI Telemetry, Observability & Runtime Configuration

• 
  
• Data Pipelines:Basic knowledge ofAzure Logic AppsorData Factoryto move data between logs and reporting tables.

Role Summary

We are looking for an AI Platform & Data Engineer to build the Brain's Memory of an enterprise AI platform.

You will design and manage the telemetry, logs, and AI runtime infrastructure that powers the Control Towercapturing who asked what, how the AI responded, and what it cost.

Key Responsibilities (MVP Scope)

• Telemetry Store:
• Design and implement Azure Cosmos DB and Log Analytics Workspaces to store high-volume AI transaction logs (prompts, responses, token counts).
• AI Runtime Configuration:
• Set up and manage Azure OpenAI deployments for GPT-3.5, GPT-4, and Embeddings.
• Cost & Usage Analytics:
• Write KQL (Kusto Query Language) queries to calculate cost per department based on token consumption.
• Basic RAG Setup:

Implement a basic Vector Database using Azure AI Search to support MVP-level Retrieval Augmented Generation.

Data Pipelines:

Move telemetry data between logs and reporting tables using Azure Logic Apps or Data Factory.

Collaboration:

Work closely with integration and AI engineering teams to ensure telemetry is accurate, scalable, and analytics-read

This is a hands-on engineering role with ownership across data storage, observability, and Azure OpenAI runtime configuration.