Senior Data Engineer

Job Description

• Education: Bachelor's or Master's degree in Computer Science, Engineering, or a related field.
• Experience: 5+ years of experience in data engineering or a similar role.

Technical Skills:

• Proficiency in Apache SPARK, pySpark, and AWS EMR.
• Strong experience with Apache Hadoop, Hive, and SQL (Postgres-SQL).
• Advanced programming skills in Python and Scala.
• Solid understanding of UNIX systems and shell scripting.
• Must have Databricks knowledge and experience

Functional understanding of API

• Experience with data storage and retrieval from S3 and Elasticsearch.
• Knowledge of ETL tools like Airflow and Autosys.
• Familiarity with version control systems (Git, SVN).
• Basic understanding of HTML for web development tasks.
• Strong SQL skills for data querying and manipulation.
• Experience with API development and integration.