Data Engineer

Data Engineer

Job description

If you want to compete with technology, by definition you can’t buy that technology. At Kramp hub, with a team of great professionals we are continuously seeking simple solutions for very complex challenges in the e-commerce world, within an industry that is becoming more important day by day - agriculture.

At the moment we are busy building a multi tenant greenfield platform and working on a data hub that will steer the decisions and directions of the immense business we are in, having 3 million euros in revenue going through the system daily. We just released an object recognition app and are very proud of it!

Our data team is building a data lake using Google Cloud Platform to make our own platform smarter with data driven functionalities, such as personalized search, recommendations and more. The data lake is intended as a self-service solution for our tenants and their data analysts.

When you join us in the Data Engineer role, you will be working together with our data analysts and developers on these smart functionalities and ensuring that they are scalable and react in NRT.

What keeps a Data Engineer at Kramp Hub busy day to day:

Real-time (and batch), distributed transformation pipelines

Modelling, handling and serving large amounts of data

Scheduling and orchestrating of data processes

Data ingress and egress for machine learning systems

Job requirements

Skillset you’d be bringing to the table:

Programming:

Java - a prerequisite, you must be very comfortable with Java as you will be using it every day

SQL

Frameworks:

Google Cloud Platform - a really big plus!

Data processing frameworks such as Beam, Flink, Spark

Stream processing: Cloud Pubsub, Kafka

Protobuf/gRPC

Software:

Git

Maven

Airflow

Databases:

Relational databases

NoSQL databases

Skills:

Big Data engineering

Distributed/parallel processing

Data warehousing

Software engineering / design

ETL processes

Machine learning - a big plus!

What we can offer:

A financially stable corporate startup

Small agile teams where every new colleague makes an immediate difference and impact

A team that celebrates small successes and milestones

International crowd with different backgrounds and knowledge to learn from

Working with great experts in the development world

An office right behind the Central Station in Utrecht, you can be anywhere in no time