Jobs
Services
Career Solutions
Featured profileProfile highlighterCareer BoosterBest SellerResume WritingLinkedin MakeoverAI Resume StudioAI Interview CoachAI Profile EdgeCareer Success Suite
Prep
Interview Preparation
Career Advice
Search Jobs
Please enter a job title/role/skill to search
Please enter a job title/role/skill to search
  • Fresher (< 1 year)

Search by job, company or skills

Python-Spark Scala
Infosys Limited

Python-Spark Scala

Infosys Limited
5-9 Years
Early Applicant
  • Posted 25 days ago
  • Be among the first 10 applicants

Job Description

Responsibilities :

5â€9 years of experience in Data Engineering / Big Data development. Strong hands-on experience with Python and Apache Spark (Scala & PySpark). Deep understanding of Spark architecture (RDD, DataFrames, Spark SQL). Experience in distributed computing and big data processing. Strong knowledge of SQL and data modeling concepts. Experience with data pipeline development (ETL/ELT). Familiarity with Linux/Unix environments. Experience with version control tools (Git).

Additional Responsibilities:

Experience with cloud platforms (AWS, Azure, or GCP). Hands-on with Databricks / EMR / Spark clusters. Knowledge of streaming technologies (Kafka, Spark Streaming, Structured Streaming). Experience with workflow orchestration tools (Airflow, Oozie). Familiarity with Delta Lake / Lakehouse architecture. Exposure to NoSQL databases (MongoDB, Cassandra). Knowledge of CI/CD and DevOps practices.

Technical and Professional Requirements:

Primary skills:Technology- Big Data - Data Processing- Spark,Technology- Functional Programming- Scala,Technology- Machine Learning- Python

More Info

Job Type:
Permanent Job
Industry:
Other
Role:
Technology Lead
Function:
Data Engineering
Employment Type:
Full time

Key Skills

DataFrames

Airflow

Delta Lake

Structured Streaming

Spark architecture

RDD

Devops
Sql
Databricks
Emr
Pyspark
Kafka
Linux
Spark Streaming
Etl
Cassandra
Gcp
Git
Scala
Oozie
ELT
Unix
Data Modeling
Apache Spark
AWS
Spark SQL
Python
Azure
MongoDB

About Company

Last Updated: 29-08-2026 05:50:08 AM

Similar Jobs

Python-Spark ScalaInfosys Limited
5-9 yrs
Bengaluru, India
Skills:
MongoDB, Sql, Databricks, Emr, Devops, Pyspark, Kafka, Linux, Spark Streaming, Etl, Cassandra, Gcp, Scala, Git, Oozie, ELT, Unix, Data Modeling, Apache Spark, AWS, Spark SQL, Python, Azure, DataFrames, Airflow, Delta Lake, Structured Streaming, Spark architecture, RDD
Staff Data Engineer (6-10 years exp - Java/Python, SQL, Scala, Spark, Hadoop)Visa
5-8 yrs
Bengaluru, India
Skills:
containerization , Hadoop, Kafka, Redis, Nosql, Hive, RDBMS, data pipelines, orchestration tools, unit integration and end-to-end tests, observability tools, data technologies, large-scale data processing, CI CD pipelines, secure coding practices, ML services
Senior Software Engineer - Bigdata ( Java / Scala / Python & Spark , SQL , AWS).Nielsen
4-8 yrs
Bengaluru, India
Skills:
Java, Spark SQL, Hadoop, Cloudformation, Scala, Apache Spark, Big Data, Cloud Architecture, Git, Hive, Spark Streaming, Docker, Terraform, Linux, Presto, Ansible, Shell scripting, Postgres, Gitlab, Oracle, AWS, Airflow, Service-oriented architecture