Traffic Label
Senior Data Engineer — Ingestion & Platform
🇬🇧London, England, United KingdomRemote available24 hours ago
SeniorFull TimeEN
Traffic Label is an affiliate marketing group in iGaming, 18+ years in the market, 300+ clients. The group owns a crypto casino (5Bet), a CRM platform (Sway Gaming), and a marketing data subsidiary (Acrum). We build internal data products that drive player acquisition and retention across all brands.
We are building a Customer Data Platform (CDP) that ingests data from 10+ casino partners, builds a unified player profile, and activates marketing campaigns through multiple ESPs (DotDigital, Adestra, FastTrack).
The platform is live: 5 sources in production, 30-40 dbt models in the silver layer, working email campaigns through DotDigital.
You’ll join a Data Platform team of 5-10 engineers (Senior DE, QA, DA, PM) reporting to the Data Engineering Lead. You will own the ingestion layer, source integrations, and platform tooling. Your job: make it so that connecting a new data source takes days, not months. You’ll design and build reusable pipeline templates and own integrations with external systems (both inbound and outbound).
This is not a “write one pipeline and move on” role. This is “build the system that generates pipelines” + own the integrations that feed and consume data.
Connecting a new data source currently takes 2-3 months. Your job: make it 5 days. This is a data platform engineering challenge, not a pipeline writing task.
This is the group’s flagship project. The CDP improves how the company works with players across all brands and directly generates revenue through better marketing activation.
The platform is 4 months old, modern stack, zero legacy. But already in production with real traffic, real campaigns, real money. You’re scaling a working system, not prototyping in isolation.
The core challenge is designing a system where adding a new data partner is a configuration. You’ll solve problems across the full spectrum: API design, schema evolution, orchestration patterns, data quality, and delivery to downstream consumers.
Design and build ingestion pipelines for REST API, database sources, etc., using Python
Own ETL and Reverse ETL end-to-end, including implementation, deployment, operations, and incident handling.
Understand how external systems work (casino platforms, ESPs, affiliate tools) to build reliable integrations with them.
Design DAG patterns: dependency management, partial retry, backfill procedures.
Implement and maintain authentication flows, token refresh handling, and secrets management.
Monitor, troubleshoot, and resolve integration issues in production environments.
Write and maintain automated tests to ensure the reliability and stability of integration services.
Collaborate closely with Engineering, Product, and Data teams to support platform scalability and operational efficiency.
Contribute to infrastructure improvements and Infrastructure-as-Code initiatives.
Write Architecture Decision Records (ADRs) for significant design choices.
Must have:
6+ years in data engineering.
Advanced Python: API clients, file processing, schema validation, integration logic.
Deep Airflow experience: DAG design, dynamic generation, sensors, retry patterns, backfill, pools, connections management.
dbt (mid+): bronze/silver models, source freshness, tests, materialisation strategy.
Snowflake (mid): external stages, COPY INTO, storage integration, basic optimisation.
API integration experience: authentication (OAuth, API keys), pagination, rate limiting, retry with backoff, error classification.
Proven experience building reusable pipeline frameworks/templates that others use daily.
Reverse ETL or outbound integration experience: pushed data from the warehouse to external systems.
Writes clear documentation: architecture decisions, pipeline templates, and onboarding guides for the team.
CI/CD pipeline design (GitHub Actions).
Terraform basics.
Metadata-driven / config-driven pipeline experience.
Experience with ESP platforms (DotDigital, SendGrid, Braze, or similar).
Gambling, marketing, or multi-tenant data platform experience.
Comfortable using AI coding assistants.
Competitive salary.
Fully remote work across Europe.
Flexible collaboration hours and strong work-life balance.
The opportunity to work on scalable, business-critical systems and integrations.
A collaborative culture focused on ownership, innovation, and continuous improvement.
