Department for Work and Pensions (DWP)
Data Engineer
How your CV stacks up
Upload your CV to see how well it fits this job role
?%
This role may be located in one of the following locations; Birmingham, Blackpool, Leeds, Manchester, Newcastle, Sheffield or Caxton House, London.
Please note that Caxton House, London is only available to existing DWP employees already based at Caxton House and Sanctuary Buildings, London. All other locations are available to all candidates.
Please find further information on the Corporate hub locations here.
Please note that for candidates requesting to work in Newcastle, the role will initially be based at Benton Park View. It will then move to 1 Pilgrim Place in Newcastle city centre by the end of 2027.
Job Summary
Please note this role requires you to pass Security Check clearance. For further information, please see 'Selection process details'.
Are you an experienced Data Engineer with strong Analytical skills?
Do you want to utilise best in class technologies to deliver exceptional cloud-based data products for Data Analysts and Scientists?
DWP’s Digital Group is looking for experienced Data Engineers to fill post in Management Information (MI) team.
The MI team provides strategic capabilities for MI reporting and data visualisations across DWP. Working with modern cloud environments alongside legacy on-premises technologies, you’ll play a key role in developing the DWP Data Engineering Strategy for MI products and services.
Successful candidates will join a fast-paced environment with a wide portfolio of products for analytical use and a challenging delivery roadmap. You’ll focus on a variety of tasks, supporting platform live service and delivering high quality, data transformation products.
Job Description
- Building and maintain scalable data engineering solutions that power analytical reporting, working in line with DWP’s engineering standards.
- Collaborating with stakeholders across DWP to gather and clarify requirements where needed and translate them into scalable back-end data processes that support MI reporting needs.
- Maintaining comprehensive technical documentation and collaborative workspaces in Confluence to improve transparency, knowledge sharing, and onboarding.
- Working closely with other junior data engineers to provide guidance, share technical expertise, and actively support ongoing knowledge sharing.
- Reviewing code developed by fellow engineers to ensure quality, maintainability, and adherence to DWP coding standards.
- Building and maintain scalable data engineering solutions that power analytical reporting, working in line with DWP’s engineering standards.
- Collaborating with stakeholders across DWP to gather and clarify requirements where needed and translate them into scalable back-end data processes that support MI reporting needs.
- Maintaining comprehensive technical documentation and collaborative workspaces in Confluence to improve transparency, knowledge sharing, and onboarding.
- Working closely with other junior data engineers to provide guidance, share technical expertise, and actively support ongoing knowledge sharing.
- Reviewing code developed by fellow engineers to ensure quality, maintainability, and adherence to DWP coding standards.
Person specification
See selection process for further details.
If you would like to learn more about the role, please contact Oliver.canham1@dwp.gov.uk.
Technical skills
We'll assess you against these technical skills during the selection process:
Technical Breadth
Alongside your salary of £44,447, Department for Work and Pensions contributes £12,876 towards you being a member of the Civil Service Defined Benefit Pension scheme. Find out what benefits a Civil Service Pension provides opens in a new window.
Reasons to use Rodeo
Start with a chat, not a search bar
Grad scheme, placement, apprenticeship? Not sure what you want yet — that's fine. Your agent talks it through with you and turns "I have no idea" into a shortlist.
It searches the market for you
Every day your agent scans the market matching roles against what actually matters to you, not just keywords on a CV.
Only hits
No noise. No "maybe this fits." Just roles with a clear explanation of why they're right — and where to focus when applying.
We also have a broad benefits package built around your work-life balance which includes:
- Working patterns to support work/life balance such as job sharing, term-time working, flexi-time and compressed hours.
- Generous annual leave – at least 25 days on entry, increasing up to 30 days over time (pro–rata for part time employees), plus 9 days public and privilege leave.
- Support for financial wellbeing, including interest-free season ticket loans for travel, a cycle to work scheme and an employee discount scheme.
- Health and wellbeing support including our Employee Assistance Programme for specialist advice and counselling and the opportunity to join HASSRA a first-class programme of competitions, activities and benefits for its members (subscription payable monthly).
- Family friendly policies including enhanced maternity and shared parental leave pay after 1 year’s continuous service.
- Funded learning and development to support progress in your role and career. This includes industry recognised qualifications and accreditations, coaching, mentoring and talent development programmes.
- An inclusive and diverse environment with opportunities to join professional and interpersonal networks including Women’s Network, National Race Network, National Disability Network (THRIVE) and many more.
Hybrid Working
This role may be suitable for hybrid working, which is where an employee works part of the week in their DWP office and part of the week from home. This is a voluntary, non-contractual arrangement and your office will be your contractual place of work.
If a hybrid working arrangement is suitable for the role and for you, you will normally be required to spend a minimum of 60% of your contracted working hours from your DWP office.
If you have a disability, caring responsibilities, or other circumstances that may affect your ability to meet the minimum office attendance requirement, please discuss this with us using the contact details in this advert.
Salary Information
Pay for this role in National locations is from £44,447 to £54,813.
The maximum salary for the grade is £46,547, however a Digital Allowance of up to £8,266 per annum is available for exceptional candidates. Digital Allowance is non-salary, and non-pensionable, and is classed as a temporary allowance. It is reviewed annually where it could be retained, amended, or removed.
Pay for this role in London is from £50,044 to £51,528.
Our offer to successful candidates will be based on an assessment of your skills and experience as demonstrated at interview.
Existing Civil Servants who secure a new role on lateral transfer will maintain their current substantive salary.
Civil Servants who gain promotion will move to the bottom of the grade pay scale or receive a 10% increase applied to their current substantive salary, whichever is greater.
Any temporary allowances that you are currently in receipt of will not form part of the calculation to determine your pay. Any allowances that are in payment will cease when you move into your new role.
Artificial intelligence
Artificial intelligence can be a useful tool to support your application, however, all examples and statements provided must be truthful, factually accurate and taken directly from your own experience. Where plagiarism has been identified (presenting the ideas and experiences of others, or generated by artificial intelligence, as your own) applications may be withdrawn and internal candidates may be subject to disciplinary action. Please see our candidate guidance opens in a new window for more information on appropriate and inappropriate use.
Get help with your application
Your very own career expert that helps elevate your application to the next level.
Selection process details
This vacancy is using Success Profiles opens in a new window, and will assess your Experience and Technical skills.
Stage 1: Application
Your Application Will Consist Of Four Parts
- A Personal Details application form.
- Employment history - this should contain your work experience and any skills, qualifications and accomplishments relevant to the jobs you have completed.
- Personal statement - up to 750 words. This statement should be used to provide examples of how you meet the essential criteria below:
- Practitioner: Ability to orchestrate PySpark jobs on EMR, managing dependencies, workflow execution, and operational efficiency.
- Working: Knowledge of designing event-driven architectures, leveraging AWS Lambda functions to trigger PySpark workflows based on real-time data ingestion and processing needs.
- Practitioner: Experienced in provisioning cloud infrastructure using Amazon EC2, and automating deployment, configuration, and data workflows with Bash scripting across scalable environments.
- Working: Ability to apply Agile best practices in developing CI/CD pipelines, using continuous integration, testing, and deployment within a collaborative development framework.
- Practitioner: Understanding of optimising queries, storage formats, and data structures to enhance efficiency, reduce processing time, and ensure high data quality standards in complex cloud architectures.
- Technical statement (up to 250 words). The following statement is aligned to the required technical skill of Technical Breadth. This statement should be used to provide example(s) of how you meet the criterion below:
- Practitioner: Good understanding of designing and automating ETL pipelines using PySpark and Spark SQL, ensuring seamless extraction, transformation, and loading of structured and unstructured data across cloud environments.
Ensure that all examples provided in your statements are taken directly from your own experience and that you describe the examples in your own words. If you choose to use gen-AI to support your statements, you must follow the guidelines outlined in the Artificial intelligence and recruitment guide.
The sift panel will use the information in your employment history, personal statement, and technical statement to assess your experience, skills and knowledge.
An initial sift will be conducted using the technical statement. Candidates who pass the initial sift will be progressed to a full sift.
If you do progress to a full sift, you will be provided with one combined overall assessment score for both your employment history and Personal Statement.
For Hints and Tips on completing your application visit Applying for jobs at DWP Digital.
Important Information
- You will be asked to complete your employment history. Any information that you would customarily share on a CV should therefore be entered onto the application form.
- Personal details that could be used to identify you including your name, contact details and address must be removed for your application to be considered.
- If your employment history, personal statement or technical statement contain any personal details your application will be withdrawn.
Stage 2: Interview 1
If you’re successful at sift stage, you will be invited to a 15 minute video interview via Microsoft Teams.
You will be asked questions to
“It took my CV and asked me questions relevant to understanding what kind of jobs to suggest for me. Suggestions were almost perfect. Jobs were exactly what I’ve been looking for.”
Jessica, London
Skills
Location