Back to all jobs
Transform logo

Senior Data Engineer

Transform
LondonHybrid8mo ago
Employment
Permanent Full Time
Seniority
Senior

About the role

Key Responsibilities

  • Managing quality of own and teams’ outputs
  • Delivering data engineering on a range of complex marketing and research processes
  • Working with clients to understand needs, and best implement that with our available technology solutions
  • Working with a range of data sources such as CRM, sales, research and HR data.
  • Building Single Customer Views, CDPs or Data Warehouses/Data Lakes to merge disparate data sets for marketing or sales activation
  • Building and configuring data ingestion methods from APIs, flat files, streaming, public data sources and survey data 

Skills, Knowledge and Expertise

  • Must have experience of using Azure or AWS Databricks and Medallion architecture 
  • Expert experience with Azure Data Factory or Python/Airflow and a range of associated libraries for data processing and manipulation
  • Experience with a range of database technologies including data lakes such as Azure SQL, SQL Server, Azure Data Lake, PostgreSQL, Snowflake, MySQL, Cosmos DB or Mongo DB 
  • Understanding of Azure DevOps and CI/CD processes
  • Knowledge of data warehouse or data lakes with SCVs or in conjunction with CDP platforms
  • Knowledge of data ingestion of streaming data using Databricks and Pyspark
  • Understanding and application of statistical methods
  • Ability to lead, and to work well as part of, a team using the agile methodology
  • A growth mindset
  • AI curious and ready to embrace opportunities 
  • Palantir Foundry (Pipeline Builder) experience
  • Knowledge of ELT/ETL tools such as Informatica DEI/BDM and Talend would be beneficial
  • Experience of mentoring junior to mid-level Data Engineers would be beneficial 

Our culture and benefits

  • We raise the bar
  • We look out for each other
  • We embrace our differences
  • We shape a changing world
  • We’re all in
  • Holiday entitlement, 28 days with the option to buy/sell up to 5 days (note that 3 days are held for Christmas holidays)
  • Day off (on or in the week of) your birthday 
  • Pension eligibility, up to 5% matched contributions
  • Private healthcare 
  • Life assurance
  • Enhanced maternity and enhanced paternity and shared parental leave 
  • Cycle to work schemes
  • Gym & retail discounts 
  • Regular social events/activities
  • A range of other benefits from our flexible benefits package

741,000+ hidden jobs like this

Transform and thousands of companies post here first — often days before LinkedIn or Indeed. Your first 5 applications are free; go Pro to apply without limits.

Everything Pro unlocks:

  • Unlimited applications — free stops at 5
  • Track every application in one place
  • Apply straight to the source, one click
  • Save & organize roles you love
  • Roles pulled from company boards before the big sites

Weekly

$9.99
$4.99/week

For an active search. Cancel anytime.

Most popular

Monthly

$24.99
$12.99/month

The smart pick. Save 35% vs weekly.

Lifetime

$99
$49.99once

Pay once. Every future feature, forever.