Senior Data Platform Engineer

Our vision is to bring more innovation, efficiency, and equality of opportunity to the world by creating an open financial system. Our first step on that journey is making digital currency accessible and approachable for everyone. To achieve that, it is critical to have timely and reliable access to all of our data, from user clicks on our website down to blockchain transactions.

As a Data Platform Engineer, you will build our next generation data platform and accompanying services. Our data pipelines are growing rapidly, currently processing several terabytes of data from production databases and external providers to our data warehouse. We build foundational self-service systems that allow end users to create ETL flows and consume data in batch and streaming fashion for machine learning, fraud prevention, A/B testing and analytics purposes.

Responsibilities

Data ingestion pipeline: Build our next generation streaming ingestion pipeline for scale (10x data), speed (<1 minute of lag), and ease of use (<1 hour to add a new source). Read from a variety of upstream systems (MongoDB, Postgres, DynamoDB, MySQL, API) in both batch and streaming fashion (tail MongoDB’s oplog and Postgres’ WAL). Today we do this with Apache Airflow, Hadoop, Spark and a pure Kotlin service.

Requirements

Experience building (data) backend systems at scale with parallel/distributed compute

Experience building microservices

Experience with Python and/or Java/Scala

Knowledge of SQL

A data-oriented mindset

Preferred (not required):

Computer Science or related engineering degree

Deep knowledge of Apache Airflow, Spark, Hadoop, Hive, Kafka/Kinesis

What to send

A resume that describes scalable systems you’ve built

Coinbase is committed to diversity in its workforce and is proud to be an equal opportunity employer. Coinbase does not make hiring or employment decisions on the basis of race, color, religion, creed, gender, national origin, age, disability, veteran status, marital status, pregnancy, sex, gender expression or identity, sexual orientation, citizenship, or any other basis protected by applicable local, state or federal law. Coinbase will also consider for employment qualified applicants with arrest and conviction records in a manner consistent with San Francisco’s Fair Chance Ordinance and similar local laws.