Lead the design and implementation of a high-performance, real-time data platform for financial systems, supporting petabyte-scale daily transaction data across ingestion, storage, and computation layers.
Architect a cloud-native data warehouse solution on AWS, incorporating Spark and Flink to support both batch and streaming use cases with millisecond-level latency for payment data insights.
Partner with key business units (e.g., acquiring and issuing teams) to develop data masking and auditing mechanisms that comply with PCI DSS and other regulatory standards.
Design and maintain dashboards that enable data-driven decision-making across business functions.
Integrate data from diverse payment systems to enable consistent, reliable, and scalable data flow across platforms.
Own the full data pipeline-from ingestion and processing to modeling and standardization-ensuring high data quality, consistency, and accessibility.
Enable cross-functional teams by driving data standardization, automation, and seamless access to clean, actionable datasets.
Collaborate with compliance, risk, and product teams to deliver secure and reliable data solutions in a regulated environment.
Required Qualifications
Minimum 5 years of experience in data engineering or data warehouse development, with a strong track record of independently building scalable data platforms.
Expertise in big data ecosystems and technologies, particularly Hadoop, Spark, and Flink, with deep knowledge of performance optimization techniques (e.g., shuffle tuning, checkpointing).
Proficient in dimensional data modeling (e.g., star schema), ETL development, and data governance best practices.
Industry experience in payments, fintech, or internet platforms is highly desirable familiarity with payment data structures is a significant advantage.
Strong interpersonal and communication skills, with the ability to work cross-functionally with product, compliance, and risk stakeholders.
Preferred Qualifications
Previous experience at a fintech or payment processing company.
Proven success delivering end-to-end data platforms and analytical dashboards from the ground up.
Knowledge of data compliance standards and secure data handling procedures.
