Search by job, company or skills

Lead Data Engineer - SQL, ETL development, Python,

Lead Data Engineer - SQL, ETL development, Python,

staples india
8-10 Years
Not Disclosed
Early Applicant
  • Posted 3 months ago
  • Be among the first 30 applicants

Job Description

Duties & Responsibilities

  • Lead, Design, build, and maintain robust ETL pipelines for structured and unstructured data.

  • Develop and optimize SQL queries for data extraction, transformation, and reporting.

  • Automate workflows and business processes using Power Automate.

  • Create interactive dashboards and reports using Power BI to support business insights.

  • Write efficient and reusable Python scripts for data manipulation, integration, and automation.

  • Implement shell scripts for data orchestration and system-level automation.

  • Collaborate with cross-functional teams to understand data requirements and deliver scalable solutions.

  • Integrate and experiment with Generative AI tools to enhance data workflows and analytics capabilities.

  • Ensure data quality, integrity, and security across all data platforms.

Requirements

Basic Qualifications

  • Bachelor's or Master's degree in Computer Science, Information Systems, or related field

  • 8 years of hands-on experience in SQL, ETL development, Python, and Shell Scripting.

  • Proficiency in Power BI for data visualization and reporting.

  • Experience with Power Automate for workflow automation.

  • Familiarity with Generative AI concepts and tools (e.g., OpenAI, Azure AI, etc.).

  • Strong problem-solving skills and attention to detail.

  • Excellent communication and collaboration abilities.

  • Bachelor's or Master's degree in Computer Science, Engineering, or related field.

  • Ability to lead projects and deliver results in a fast-paced environment

  • Proficient understanding of code versioning tools, such as Git / SVN

Preferred Qualifications

  • Experience with cloud data platforms (Azure, AWS, GCP)

  • Familiarity with data warehousing concepts and tools (e.g., Snowflake)

  • Certification in Power BI, Excel, or related technologies

More Info

Job Type:
Industry:
Employment Type:

Key Skills

About Company

Similar Jobs

5-10 yrs
Chennai, India
Skills:
Sqlalchemy, Spring Boot, FastAPI, Restful Apis, Python, Sql, ORM frameworks, Pydantic
7-9 yrs
Chennai, India
Skills:
Apis, Kafka, Unit Testing, Version Control, Devops, Gcp, Python, AWS, GHA, Big Query, Airflow, Code reviews, CI/CD pipelines, Data pipelines
6-8 yrs
Chennai, India
Skills:
software design patterns , Oracle Database, Sql, Pl Sql, Rabbitmq, Svn, Kafka, Python, Git, Jms, AI-assisted development tools, build and deployment tools, event-driven architecture, Object-Oriented Programming, prompt engineering
6-8 yrs
Chennai, India
Skills:
Data Structures, Pyspark, Apache Spark, Rest API Development, Multithreading, Microservices, Backend Development, Oop, Django, Python Development, Flask, FastAPI, Problem Solving, Async-Await, Python GIL Performance, Asyncio, multiprocessing
4-8 yrs
Chennai, India
Skills:
.NET, AWS, Sql, ELT, Json, Rest Apis, Etl, Python, Xml, Azure, Docker, Git, Data Processing, ASP.NET Core