Senior/Expert Site Reliability Engineer - Big Data Responsibilities
Job Description
Job Description
- Deploy, operate, and maintain big data platforms, continuously improving their availability, reliability, scalability, and operational efficiency.
- Own monitoring, alerting, incident response, troubleshooting, performance optimization, and capacity planning for big data services and platforms.
- Build and improve platform observability capabilities, including metrics, logging, tracing, dashboards, and alert management.
- Turn operational knowledge and repetitive tasks into documentation, tools, automation, and standardized processes.
- Establish and continuously improve incident response procedures, contingency plans, and post-incident review practices to reduce failure rates and mean time to recovery.
- Collaborate with engineering, data, and infrastructure teams to optimize platform architecture and ensure production reliability and operational safety.
- Bachelor's degree or higher in Computer Science, Software Engineering, or any related fields.
- At least one year of experience in big data SRE, platform operations, or production support.
- Familiarity with the Hadoop ecosystem and hands-on operational experience with one or more technologies such as HDFS, YARN, Spark, Flink, Hive, Presto/Trino, Kafka, HBase, or ClickHouse.
- Solid knowledge of Linux systems and common operations tools, with practical experience in monitoring, troubleshooting, performance tuning, and capacity planning.
- Hands-on experience handling production incidents in big data environments, with a structured troubleshooting approach and the ability to identify root causes quickly.
- Proficiency in at least one programming or scripting language, such as Shell, Python, Java, or Scala, with the ability to develop operational tools and automation.
- Understanding of high availability, disaster recovery, observability, change management, and Site Reliability Engineering practices.
- Strong communication, collaboration, and cross-functional coordination skills, with a proactive mindset and a commitment to continuous improvement.
More Info
Key Skills
ClickHouse
Flink
Trino
Linux systems
Shell
About Company