Department for Energy Security and Net Zero
Lead Data Engineer
How your CV stacks up
Upload your CV to see how well it fits this job role
?%
Birmingham, Bristol, Cardiff, Darlington, Edinburgh, London, Salford
Job Summary
The Integrated Corporate Services (ICS) is a shared corporate service. It provides corporate services (HR, Finance, Digital, Commercial, Security and Estates) across the Department for Energy Security & Net Zero (DESNZ) and the Department for Science, Innovation & Technology (DSIT).
Our team of over 400 professionals will be leading the way in how these functions will be delivered in the future. Our ambition is to be the leading provider of integrated corporate services for government and set the standard for quality, efficiency, and innovation in our field.
We offer great working benefits including a world-class pension, flexible working options and a career where your learning and development is taken seriously. We are enormously proud to be a Disability Confident Leader employer. We support candidates with adjustments throughout our recruitment process. Information about disability confidence and just some examples of the adjustments that you can request can be found in the reasonable adjustment section below.
Find Out More
You can also follow our LinkedIn Careers Page: https://www.linkedin.com/showcase/desnz-careers/
Job Description
Join ICS Digital, where innovation meets expertise to create digital solutions. We are a cohesive digital community who work in the open, solving problems together and fostering a culture of transparency and collaboration. Our commitment to user-focused design and data-driven decision-making ensures that we deliver accessible services tailored to the needs of our customers.
The Data and Development team is part of the D3 (Data, Delivery and Design) function within ICS Digital. We are a data-driven team that delivers data-focused services and products for colleagues across DESNZ and other government departments or bodies. Our close-knit team brings together Data Engineers, Data Scientists, Data Analysts, Data Transparency Specialists and Software Developers, working collaboratively to deliver insight, innovation and value.
We are looking for a Lead Data Engineer to join the team and own the development of the Data Management System, which provides end to end data ingestion, processing and storage capabilities that are used to provide insights and decision-making inputs that are core to the challenges that face the Departments today. For example, we have recently worked on projects that have enabled grants to be paid out to citizens and businesses as part of the Energy Affordability programme. Additionally, we have provided insights into key Energy Efficiency projects that have been at the heart of key Department delivery commitments.
Visit our blog to learn more about us and our work: https://icsdigital.blog.gov.uk/
To find out more about the Government Digital & Data profession visit: https://dsit.pagetiger.com/bzwfhzv/1
Person specification
Design, build and evolve secure, data pipelines that reliably support complex operational needs. Define and enforce standards for data engineering to ensure solutions are scalable, maintainable and safe to change. Provide strong technical leadership to the team, including setting direction, reviewing critical code, mentoring engineers and upholding high engineering standards. Build a high performing, motivated team by fostering a culture of learning, experimentation and professionalism, by being an effective, supportive line manager. Owning Data Engineering best practice through building a community of practice across the government departments ICS delivers for.
Reasons to use Rodeo
Start with a chat, not a search bar
Grad scheme, placement, apprenticeship? Not sure what you want yet — that's fine. Your agent talks it through with you and turns "I have no idea" into a shortlist.
It searches the market for you
Every day your agent scans the market matching roles against what actually matters to you, not just keywords on a CV.
Only hits
No noise. No "maybe this fits." Just roles with a clear explanation of why they're right — and where to focus when applying.
The above responsibilities are not exhaustive, and the post holders may be required to undertake some additional tasks not listed above, within the remit of their grade, to support the team.
As a line manager, you will be responsible for working with your members of staff to define their objectives, as well as managing their development and performance.
Essential Criteria
- Accomplished expert data engineer with experience of producing, maintaining and updating data models which solve business problems and are optimised for data analysis.
- Extensive experience using and managing an Azure based Data Platform with expertise in Azure Databricks, using Pyspark to build data pipelines; and using their experience to continuously improve the codebase and reliability of solutions.
- Experience transforming complex structured and semi-structured data into structures and layers that enable analysis, defining and promoting best practices for creating repeatable, reliable and reusable data solutions that therefore drive impact and value.
- Can listen to and interpret the needs of technical and non-technical stakeholders, manage their expectations and influence outcomes
- Experience of providing technical leadership, guiding and mentoring engineering teams.
- Experience in unit testing, end-to-end testing and quality assurance in a Data Engineering context.
- Analytical and problem-solving capabilities; self-starter willing to pro-actively problem-solve by researching, learning, testing, and deploying new code solutions independently.
- Experience writing code in Python and SQL.
Desirable Criteria
- Knowledge and experience of data modelling, analytical technologies, data visualisation.
- Experience in DevOps practices including Azure CI/CD, YAML pipelines, git and Terraform.
When completing your CV as part of the application please ensure to include the time you have worked for your organisations/employers, and your key objectives in each role.
It is unusual that all candidates will meet all the desirable criteria. If your skills and experience look slightly different from what we have identified and you think you can bring value to the Lead Data Engineer role and the team, we strongly encourage you to apply. We'd love to hear from you!
Behaviours
We'll assess you against these behaviours during the selection process:
- Making Effective Decisions
- Changing and Improving
- Developing Self and Others
We only ask for evidence of these behaviours on your application form:
Making Effective Decisions
Technical skills
We'll assess you against these technical skills during the selection process:
- Programming and build (data and analytics engineering) (Level: practitioner)
- Data integration design (Level: expert)
Alongside your salary of £56,900, Department for Energy Security & Net Zero contributes £16,483 towards you being a member of the Civil Service Defined Benefit Pension scheme. Find out what benefits a Civil Service Pension provides (opens in a new window).
The Department for Energy Security and Net Zero offers a competitive mix of benefits including:
- A culture of flexible working, such as job sharing, homeworking and compressed hours.
- Automatic enrolment into the Civil Service Pension Scheme, with an employer contribution of 28.97%.
- A minimum of 25 days of paid annual leave, increasing by 1 day per year up to a maximum of 30.
- An extensive range of learning & professional development opportunities, which all staff are actively encouraged to pursue.
- Access to a range of retail, travel and lifestyle employee discounts.
Get help with your application
Your very own career expert that helps elevate your application to the next level.
Office attendance
The Department operates a discretionary hybrid working policy, which provides for a combination of working hours from your place of work and from your home in the UK. The current expectation for staff is to attend the office or non-home based location for 40-60% of the time over the accounting period.
Artificial intelligence
Artificial intelligence can be a useful tool to support your application, however, all examples and statements provided must be truthful, factually accurate and taken directly from your own experience. Where plagiarism has been identified (presenting the ideas and experiences of others, or generated by artificial intelligence, as your own) applications may be withdrawn and internal candidates may be subject to disciplinary action. Please see our candidate guidance (opens in a new window) for more information on appropriate and inappropriate use.
Selection process details
This vacancy is using Success Profiles (opens in a new window), and will assess your Behaviours, Experience and Technical skills.
As part of the application process you will be asked to complete behavioural statements, a CV and personal statement. Further details around what this will entail are listed on the application form.
Please use your personal statement (in no more than 750 words) to describe how your past experience relate to the essential criteria outlined in this job description, focusing on your most recent career history.
In the event of a large number of applicants, applications will be sifted on the personal statement only.
The interview will consist of behaviour and technical questions.
The link to the technical/professional competency framework that candidates will be assessed against, for their reference: https://ddat-capability-framework.service.gov.uk/role/data-engineer#lead-data-engineer
Sift and interview dates to be confirmed.
Further Information
Reasonable Adjustment
We are proud to be a disability confident leader and we welcome applications from disabled candidates and candidates with long-term conditions.
Information about the Disability Confident Scheme (DCS) and some examples of adjustments that we offer to disabled candidates and candidates with long-term health conditions during our recruitment process can be found in our DESNZ Candidate Guidance. A DESNZ Plain Text Version of the guidance is also available.
We encourage candidates to discuss their adjustment needs by emailing the job contact which can be found under the contact point for applicants section.
If you are experiencing accessibility problems with any attachments on this advert, please contact the email address in the 'Contact point for applicants' section.
If successful and transferring from another Government Department a criminal record check may be carried out.
New entrants are expected to join on the minimum of the pay band.
A location based reserve list of successful candidates will be kept for 12 months. Should another role become available within that period you may be offered this position.
Candidates who meet the minimum benchmark may be placed on a Reserve List for consideration for similar roles, including those at a lower grade. Candidates who narrowly miss the benchmark and are not placed on the Reserve List may still be considered for an offer in a similar role at a lower grade.
Please note terms and conditions are attached. Please take time to read the document to determine how these may affect you.
Any move to the Department for Energy, Security
“It took my CV and asked me questions relevant to understanding what kind of jobs to suggest for me. Suggestions were almost perfect. Jobs were exactly what I’ve been looking for.”
Jessica, London
Skills
Location