As part of the Big Data Platform team, you will contribute to national security by building and managing a robust data infrastructure. You'll develop and maintain scalable, resilient big data solutions that power mission-critical systems. Working at the forefront of technology, you'll help shape the platform that ensures real-time data ingestion, processing, and persistence and be part of a team that values innovation, collaboration, and purpose.
Responsibilities
- Design, implement, and maintain real-time, high-volume data processing and storage solutions using Big Data technologies.
- Build highly available, resilient, and scalable Big Data platforms.
- Administer Big Data services across multiple clusters, including configuration, backup, and recovery.
- Use DevOps and automation tools to deploy and manage clusters efficiently.
- Develop tools for performance and health monitoring to maintain optimal system operation.
- Collaborate with internal teams to facilitate onboarding and ensure seamless platform operations.
- Conduct capacity planning and system scaling to meet growing data demands.
- Research and evaluate emerging technologies for integration into the platform.
- Continuously innovate and improve platform reliability and performance.
Requirements (Minimum Qualifications)
- Bachelor's degree in Computer Engineering, Computer Science, or a related discipline, or equivalent practical experience.
- Strong verbal and written communication skills.
- Team-oriented with a positive attitude and strong collaboration skills.
- Passionate about Big Data and emerging technologies.
- Enthusiastic about open-source solutions.
Nice-to-Haves
- Experience managing physical or virtual infrastructure.
- Familiarity with cluster management and DevOps tools (e.g., Ansible, Kubernetes).
- Experience working directly with application/product teams.
- Exposure to agile, fast-paced, and innovation-driven environments.