Senior Data Engineer
2 dagen geleden
Rotterdam, Gem. Rotterdam; Zuid-Holland, Nederland
All Your BI
Voltijd
€ 85.000 - € 99.000 Tijdelijk
Gratis via e-mail of Google
Bewaar deze vacature en houd uw zoekopdracht georganiseerd
Maak een gratis account aan om vacatures op te slaan, waarschuwingen aan te maken en vanaf uw dashboard terug te keren naar deze vermelding.
Gratis via e-mail of Google
Als u doorgaat, gaat u akkoord met onze Voorwaarden & Privacybeleid.
ppMaybe you call yourself a Senior Data Engineer, a pipeline architect, a "why-is-this-TOS-data-a-mess" specialist… or maybe you just call yourself Sam. Whatever you call yourself, you'll join Terminal.exe, All Your BI's AI-native data platform for container terminal operators, and build the core of it: the pipelines and data model that turn fragmented, hard-to-trust terminal data into something operators run their day on.br/ph3strongWhat you get /strong /h3ullipA salary between €85,000-€99,000 per year inclusive of holiday allowance, based on your experience. /p /lilip€5,000 a year for your own growth, with a real say in how you spend it. /p /lilip25 vacation days + the option to buy up to 10 more + local public holidays + the option of a sabbatical up to 4 months. /p /lilipTwo trips abroad a year with the whole team + occasional drinks and team outings. /p /lilip€500 home-office budget and a great laptop. /p /lilipA well-earned "Hey, well done Buddy", so now and then. /p /lilipFully remote, within Europe. /p /li /ulpstrongBenefits across the EU: /strongthe perks above are AYBI's and go to everyone, everywhere. Statutory benefits (pension, health, social security, leave, sick pay, notice) follow the hire's country via their local contract or EOR.br/ph3strongAbout us /strong /h3pAll Your BI is a remote-first data agency based in Rotterdam. Since 2019 we've grown from a boutique consultancy into an international data team of more than 60 data heroes spread across Europe. We deliver managed BI services for logistics and industrial companies, helping reduce data waste and move businesses forward. We live for the WOW moment, that sparkle in users' eyes when they gain new insights and discover opportunities. We work according to Holacracy: little hierarchy, lots of ownership. Serious work. Serious fun.br/ph3strongAbout Terminal.exe /strong /h3pTerminal.exe is All Your BI's SaaS platform for container terminals. It unifies fragmented data, TOS, maintenance, gate, sensors, into one governed model, so every site works from the same numbers instead of rebuilding its own reporting from scratch. The platform is growing fast. You'll help shape the engineering foundations that need to scale next: multi-tenant data architecture, near-real-time pipelines from 24/7 operations, and a standardized data model that works across terminals worldwide.br/ph3strongWhat the job looks like /strong /h3pYou will design and build the pipelines that move data from terminal operating systems (such as Navis N4) into our platform, and the transformation layer that turns raw operational data into curated, documented datasets. /ppConcretely, you will work on: /pullipELT pipelines from on-premises terminal databases into our Azure-based platform, with near-real-time refresh (3-minute microbatch) for operational reporting and daily batch for analytics. Extraction uses watermark-based incremental queries over Kafka (Azure Event Hubs) to PostgreSQL staging. /p /lilipA multi-tenant data architecture on Azure PostgreSQL with database-per-tenant isolation and a standardized STG → ODS → DataMart layer structure driven by our internal declarative transformation framework (dewi) /p /lilipOur internal connector tooling written in Go, which you will help develop and extend /p /lilipData quality monitoring: gap detection, freshness alerting, and reconciliation /p /lilipThe standardized terminal data model: mapping source data from different TOS versions and configurations onto shared definitions of moves, calls, and equipment events /p /li /ulpYou will work directly with terminal operations staff, without intermediate layers. /pbrh3strongWhat you bring /strong /h3ullipstrongAttitude and
experience:
/strongcuriosity and a genuine appetite for architectural ownership, and 5+ years of data engineering experience, including end-to-end ownership of production data platforms. This is a product under active development, we need you comfortable deciding, not just executing. /p /lilipstrongCore stack: /strongstrong SQL and Python; Go experience is a significant plus (our connectors and consumers are written in Go). Solid experience with SQL Server as a source system and PostgreSQL as a target store. /p /lilipstrongPipelines and streaming: /strongexperience building and operating ELT pipelines against operational source systems, including watermark/incremental or CDC/replica-based extraction, and with event-driven or streaming architectures, we use Azure Event Hubs with a Kafka-compatible endpoint. /p /lilipstrongCloud and observability: /strongcloud data platform experience on Azure, familiarity with AKS, Azure DevOps CI/CD, and GitOps (Argo CD) is a plus, alongside a strong focus on data correctness and instrumentation, we use OpenTelemetry. /p /lilipstrongNice to have: /strongknowledge of the container terminal or port logistics industry, direct experience with Navis N4 or another TOS, multi-tenant SaaS data architecture experience, and familiarity with declara
experience:
/strongcuriosity and a genuine appetite for architectural ownership, and 5+ years of data engineering experience, including end-to-end ownership of production data platforms. This is a product under active development, we need you comfortable deciding, not just executing. /p /lilipstrongCore stack: /strongstrong SQL and Python; Go experience is a significant plus (our connectors and consumers are written in Go). Solid experience with SQL Server as a source system and PostgreSQL as a target store. /p /lilipstrongPipelines and streaming: /strongexperience building and operating ELT pipelines against operational source systems, including watermark/incremental or CDC/replica-based extraction, and with event-driven or streaming architectures, we use Azure Event Hubs with a Kafka-compatible endpoint. /p /lilipstrongCloud and observability: /strongcloud data platform experience on Azure, familiarity with AKS, Azure DevOps CI/CD, and GitOps (Argo CD) is a plus, alongside a strong focus on data correctness and instrumentation, we use OpenTelemetry. /p /lilipstrongNice to have: /strongknowledge of the container terminal or port logistics industry, direct experience with Navis N4 or another TOS, multi-tenant SaaS data architecture experience, and familiarity with declara