AI Data Engineer
- Posted a day ago
- Be among the first 10 applicants
Job Description
We are looking for a Senior AI / Data Engineer to join our team. In this role, you will design, build, and optimize high-throughput data architectures to support scalable analytics, network telemetry processing, and advanced AI/RAG applications. You will collaborate closely with data scientists, analysts, and system owners to translate complex business needs into robust, secure, and automated data pipelines.
Key Responsibilities
- Build and optimize batch and streaming data pipelines for high-volume datasets using modern big data technologies.
- Extract, transform, and organize complex network telemetry and business data across various APIs, relational databases, and enterprise systems.
- Automate manual workflows, enforce strict data security standards, and manage enterprise metadata governance.
- Partner with data scientists, business analysts, and system owners to support data visualization, AI/RAG solutions, and reporting platforms.
Requirements & Core Skills
- Bachelor's degree in Computer Science, Mathematics, Engineering, or a related technical field.
- 5 to 8+ years of hands-on experience in data engineering or large-scale big data applications.
- Strong proficiency in Python, PySpark, and Advanced SQL.
- Practical experience with Hadoop, Cloudera, Apache Spark, and workflow orchestration tools like Apache Airflow.
- Excellent verbal and written communication skills with a proven track record of bridging technical solutions with business requirements.
More Info
About Company
Skills:
operational support , Orchestration, release management, cloud security, Data Transformation, Performance Tuning, Pyspark, Apache Spark, Sql, Python, enterprise data architecture, CI CD, agentic AI use cases, Production Operations, RAG solutions, Access Control, streaming data pipelines, error handling, observability
Skills:
Pyspark, Kafka, Databricks, Sql, Delta Lake, Microsoft Fabric
Skills:
Pyspark, Apache Spark, Kafka, Sql, Databricks, Python, RAG solution stacks, enterprise data governance, embeddings, vector databases, Git version control, cloud-native observability, Delta Lake, CI/CD workflows
Skills:
Pyspark, AI ML solution implementation, Full-stack AI Integration Frontend to Backend, LLM Observability Evaluation Monitoring LLMOps, Data Engineering Skills, Git hub Copilot, Advanced Prompt Engineering, SQL proficiency and query optimization, Multi-Agent System Design Orchestration
Skills:
Pyspark, Apache Spark, Kafka, Sql, Databricks, Python, RAG solution stacks, enterprise data governance, embeddings, CI CD workflows, vector databases, Git version control, cloud-native observability, Delta Lake