SPG Resourcing
Data Platform Lead
Get notified of more jobs like this · No spam, ever
How your CV stacks up
Upload your CV to see how well it fits this job role
?%
Senior Data Platform Lead
Outside IR35
Rate - DOE
We are recruiting for a Senior Data Platform Lead opportunity within a live, production-focused data environment, ideal for a technical leader who can protect service stability while improving platform performance and resilience.
This company is seeking someone who can take ownership when data stops flowing, drive diagnosis and recovery across complex pipelines, and keep critical business applications supported. The Senior Data Platform Lead will play a hands-on role across incident response, operational health, and continuous improvement, making this a high-impact opportunity for a candidate who thrives under pressure.
Responsibilities
- Lead technical diagnosis and recovery when incidents affect data flowing from ERP systems through ingestion, Azure storage and Databricks to downstream applications.
- Own platform health, monitoring, performance, cost optimization, and operational resilience.
- Provide hands-on leadership across PySpark, Spark SQL, Delta Lake, and Databricks Workflows.
- Set standards for Unity Catalog, access controls, data lineage, and production releases.
- Work with engineering, application, service management, and vendor teams to resolve complex issues and prevent recurrence.
- Improve runbooks, recovery procedures, and architecture documentation.
- Transfer knowledge to the wider team and support operational readiness.
- Participate in a 17x5 support model, with the working pattern confirmed during the briefing process.
Reasons to use Rodeo
Start with a chat, not a search bar
Grad scheme, placement, apprenticeship? Not sure what you want yet — that's fine. Your agent talks it through with you and turns "I have no idea" into a shortlist.
It searches the market for you
Every day your agent scans the market matching roles against what actually matters to you, not just keywords on a CV.
Only hits
No noise. No "maybe this fits." Just roles with a clear explanation of why they're right — and where to focus when applying.
Experience & Skills
- Strong, recent experience supporting Azure Databricks in production, including ownership of incidents and service restoration.
- Hands-on capability with PySpark, SQL, Delta Lake, Workflows, and Unity Catalog.
- Experience with ADLS Gen2, Azure DevOps, Git, CI/CD, and controlled production changes.
- Ability to troubleshoot data flows end to end, from transactional source systems through ingestion and transformation to the final consumer.
- Experience integrating ERP data, such as JD Edwards, Oracle ERP, SAP, or Dynamics.
- Confidence to lead a major incident, explain business impact clearly, and make sound recovery decisions under pressure.
- Useful experience in Qlik Replicate, CDC, supply chain data, or manufacturing environments.
- Ability to provide a brief example of a production Databricks incident personally diagnosed and resolved.
Get help with your application
Your very own career expert that helps elevate your application to the next level.
Additional
- Right to work in the UK required
- Equal opportunities employer
Equal Opportunity Statement:
SPG Resourcing is an equal opportunities employer and is committed to fostering an inclusive workplace which values and benefits from the diversity of the workforce we hire. We offer reasonable accommodation at every stage of the application and interview process.
If this is of interest, please feel free to reach out using the details below.
“It took my CV and asked me questions relevant to understanding what kind of jobs to suggest for me. Suggestions were almost perfect. Jobs were exactly what I’ve been looking for.”
Jessica, London
Location