Senior Data Engineer

Job Reference: BH-79413

Posted by: Tom Johnson

Apply for this role
Contract
Industry: IT
London, UK
Negotiable

Description of role:

Senior Data Engineer (Databricks)
Location: London (Hybrid)
Rate: Negotiable, depending on experience
Duration: 6 months (initial)

We’re looking for a Senior Data Engineer (Databricks) to join a world-leading energy organisation on a key transformation programme within their trading and supply division. This is an exciting opportunity to play a pivotal role in building modern, scalable data solutions using Azure cloud technologies.

The Role

As a Senior Data Engineer, you’ll be responsible for designing and developing robust data foundations and end-to-end solutions that drive value across the business. You’ll help shape and embed data-driven thinking across both technical and business teams, ensuring the organisation continues to lead with insight and innovation.

You’ll act as a subject matter expert, guiding technical decisions, mentoring junior engineers, and ensuring data engineering best practices are consistently applied.

Key Responsibilities
  • Design and build data solutions aligned with business and IT strategy.
  • Lead development of scalable data pipelines and models using Azure and Databricks.
  • Support data foundation initiatives and ensure effective rollout across business units.
  • Act as a bridge between technical and non-technical stakeholders, presenting insights clearly.
  • Oversee change management, incident management, and data quality improvement.
  • Contribute to best practice sharing and community-building initiatives within the data engineering space.
Required Skills & Experience
  • Cloud Platforms: Strong expertise in AWS / Azure / SAP
  • ETL/ELT Pipelines: Advanced proficiency
  • Data Modelling: Expert level
  • Data Integration & Ingestion: Skilled
  • Databricks, SQL, Synapse, Data Factory and related Azure services
  • Version Control / DevOps tools: GITHUB, Azure DevOps, Actions
  • Testing & Automation tools: PyTest, SonarQube
Desirable Experience
  • Experience leading or running scrum teams
  • Exposure to planning tools such as BPC
  • Familiarity with external data ecosystems and documentation tools (e.g., MKDocs)
The Project

You’ll be joining a large-scale programme focused on modernising a global data warehouse platform using Azure technologies. The project aims to deliver a unified and standardised view of data across international operations — a key enabler for smarter, data-driven trading decisions.

If you’re a data engineer with deep Azure and Databricks experience, and you enjoy solving complex challenges within a global business, this contract offers a chance to make a real impact on a high-profile initiative.

Interested? 

Please apply now with your updated CV and reach out to Tom Johnson at Certain Advantage – Ref: 79413 


Apply for this role

Enter your details and drop your CV in the form below and a member of the team will be in touch.

Attach CV*