Senior software engineer - Data Platform Engineer (OLAP)

Adyen's Data Platform Engineers build foundational tooling for on-premise Big Data Platforms, supporting tens of products and thousands of daily jobs. They collaborate with data engineers and ML scientists to develop and operate large-scale platforms, including a cluster with 500+ nodes and 23+ PB of storage. The role focuses on scaling OLAP ecosystems (Druid, FastAPI, Java, Kafka) and data engineering ecosystems (data contracts, validation, Kafka ingestion).

• Scale: Developing and maintaining high-performance, distributed big data platforms.
• Distributed Systems: Working deeply with various flavors of databases, filesystems, and compute engines.
• Data Quality & Discoverability: Building tools that enhance metadata collection, data lineage, and platform-wide data quality.
• CI/CD & Infrastructure: Optimizing continuous release/deployment environments within a large-scale private cloud system.
• Streaming: Developing stream processing applications and frameworks to reduce time-to-insight for analysts and data scientists.

• Python or Java Expert: 6+ years of experience with object-oriented programming.
• Collaborative Enabler: A strong communicator who thrives on building bridges between the teams you enable (analysts, data scientists) and the teams you depend on (infrastructure, security).
• Distributed Systems Architect: Proven experience developing and maintaining distributed compute/data systems (e.g., Spark, Trino, Druid, ClickHouse).
• Experience with real-time and batch pipelines (Kafka, Spark Streaming) with a focus on user-friendliness and reliability.