Simpson Associates
Lead Databricks Engineer

How your CV stacks up
Upload your CV to see how well it fits this job role
?%
Simpson Associates transforms raw data into actionable insights that drive positive change.
Our Microsoft data expertise, our specialist sector knowledge, plus our innovative and trusted advice and guidance are just some of the reasons clients choose to work with us.
Our mission is to help purpose-led organisations from within the public and private sectors to harness data as a lever for change and enable them to realise business value more quickly. We provide the full range of services to support organisations on their data transformation journey. From advisory support and data strategy, to developing Data & AI solutions, right through to providing a range of managed services.
We are a Microsoft Solutions Partner for Cloud & AI Platforms and Security, holding Specialisations in AI Platform on Microsoft Azure, Build AI Apps on Microsoft Azure, Analytics on Microsoft Azure and Data Warehouse Migration to Microsoft Azure. Previously, Cloud & AI platforms were individual pillars for Data & AI, Digital & App innovation and Infrastructure.
But it's not just about the badges. We are proud to be recognised as the winner of the 2024 Microsoft Community Response Partner of the Year award, reflecting our dedication to using technology for positive change. We are also a Databricks partner, and an IBM Gold Partner, specialising in Cognos Analytics and Planning Analytics.
With offices in York and Sheffield, and a team based throughout the UK – we champion creativity, innovation and collaboration in the workplace.
The Role
The Lead Data Engineer plays a pivotal role within the Delivery capabilities delivering high-quality solutions using Databricks, Microsoft Fabric and Azure-native technologies. The role may involve running projects independently or leading workstreams within larger and more complex engagements under the direction of a Principal Consultant.
The Lead Data Engineer is the primary point of contact for customers during delivery and is expected to combine strong technical capability with excellent consultancy, communication and leadership skills. You will be responsible for shaping solutions, guiding delivery teams, and ensuring projects are delivered to time, cost and quality expectations, while supporting the development of junior consultants.
Reasons to use Rodeo
I’m in my final year doing Economics and I don’t know whether to apply for grad schemes now or do a masters first. What do you think?
Honest answer — it depends on where you want to end up. A lot of top grad schemes (Big 4, civil service, banking) don’t need a masters. Let’s look at the ones you’d be competitive for now, and we can decide if a masters actually adds anything.
Also worth knowing: most autumn 2026 applications are open now. Timing matters more than you think.
Start with a chat, not a search bar
Grad scheme, placement, apprenticeship? Not sure what you want yet — that's fine. Your agent talks it through with you and turns "I have no idea" into a shortlist.
Graduate Consultant — 2026 Scheme
Why you're a good match
StrongYour economics background and your summer at a regional bank line up with what PwC looks for on the consulting scheme. Applications close in four weeks.
See breakdownIt searches the market for you
Every day your agent scans the market matching roles against what actually matters to you, not just keywords on a CV.
Why you're a good match
You’ve got the grades and the economics background, and your bank internship is exactly the experience this scheme looks for. Apply soon — deadlines close within the month.
Experience fit
Your summer at the bank plus your econometrics coursework map directly to the day-one responsibilities on this scheme — client modelling, market briefings, and deal support.
Only hits
No noise. No "maybe this fits." Just roles with a clear explanation of why they're right — and where to focus when applying.
Key Responsibilities
- Lead the end-to-end delivery of data engineering projects, either independently or as part of larger multi-disciplinary programmes.
- Act as the primary service delivery contact for customers, building trusted relationships and providing clear technical leadership.
- Demonstrate deep technical expertise in data engineering, understanding how solutions fit within wider customer architectures and business requirements.
- Work with customers to identify, challenge and prioritise business and technical requirements, including running design and discovery workshops.
- Translate functional and non-functional requirements into robust, scalable data platform architectures and technical designs.
- Design and implement data engineering solutions using Microsoft Fabric and Databricks, following best-practice approaches.
- Produce clear technical documentation and communicate designs using appropriate visualisations (e.g. architecture diagrams, data flows).
- Accurately estimate delivery effort, contributing to proposals and addressing variances between pre-sales estimates and detailed requirements.
- Convert estimates into delivery plans and manage these throughout the project lifecycle, working with Project Management and Scheduling as required.
- Provide hands-on technical delivery alongside other consultants when appropriate.
- Take overall responsibility for solution and delivery quality, including code reviews, testing strategies and customer acceptance.
- Identify, manage and mitigate delivery risks and issues early, drawing on experience to pre-empt likely challenges.
- Ensure appropriate deployment, handover and transition into support or managed services.
- Mentor and support junior consultants, contributing to capability development within the Data Engineering team.
- Contribute to intellectual property, reusable assets, marketing content, case studies and blogs.


Get help with your application
Your very own career expert that helps elevate your application to the next level.
Skills and Attributes Required
Technical Skills
- Strong experience designing and delivering modern data engineering solutions on Azure.
- Hands-on expertise with Microsoft Fabric, including Lakehouse, Data Engineering and orchestration capabilities.
- Strong experience with Databricks, including Spark-based data processing and optimisation.
- Solid understanding of data modelling, data integration patterns, and ELT/ETL pipelines.
- Experience working with Azure data services such as Azure Data Lake, Azure SQL and related platform components.
- Knowledge of DevOps and deployment practices for data platforms (e.g. CI/CD, version control, automated testing).
Consulting & Delivery Skills
- Proven experience delivering projects within agreed time, cost and quality constraints.
- Strong ability to communicate complex technical concepts clearly to both technical and non-technical stakeholders.
- Experience leading delivery in both waterfall and agile environments and adapting approach to suit the customer and engagement.
- Commercial awareness and consultative mindset, with the ability to identify additional opportunities and add value for customers.
Personal Attributes
- Confident, proactive problem-solver who remains calm and reassuring in customer-facing situations.
- Strong organisational and time management skills, with the ability to manage multiple priorities simultaneously.
- A proven self-starter, comfortable working independently while contributing positively to team delivery.
- Commitment to continuous professional development and maintaining up-to-date technical and consultancy skills.
- Willingness to mentor others and contribute to a collaborative, knowledge-sharing culture.
Due to the nature of our work, successful applicants will need to successfully complete the relevant security clearance.
Simpson Associates reserves the right to close the recruitment process at any time.
“It took my CV and asked me questions relevant to understanding what kind of jobs to suggest for me. Suggestions were almost perfect. Jobs were exactly what I’ve been looking for.”
Jessica, London
Location