Halian | Managed Services, Recruitment Agency & Contract Staffing
Software Engineer
Get notified of more jobs like this · No spam, ever
How your CV stacks up
Upload your CV to see how well it fits this job role
?%
About the Company
Senior Python Data Engineer | AWS | Spark | Airflow | Public Sector
Location: UK Remote / Hybrid
Rate: Competitive Daily Rate
Duration: Long-Term Contract
Sector: Public Sector
We are supporting a major public sector programme and are looking for an experienced Senior Data Engineer to join a high-performing cloud data team delivering business-critical data solutions.
About the Role
This is an opportunity to work on large-scale data platforms, helping design, build and optimise modern cloud-native data services that support analytics, reporting and operational decision-making.
Responsibilities
- Design, develop and maintain scalable data pipelines and ETL/ELT solutions
- Build and optimise cloud-native data platforms within AWS
- Develop Spark and PySpark workloads for large-scale data processing
- Create and maintain Apache Airflow workflows and orchestration pipelines
- Implement Infrastructure as Code using Terraform
- Support batch and real-time data ingestion frameworks
- Work closely with data architects, analysts, data scientists and engineering teams
- Drive data quality, automation, monitoring and performance optimisation
- Contribute to CI/CD processes and engineering best practices
Reasons to use Rodeo
Start with a chat, not a search bar
Grad scheme, placement, apprenticeship? Not sure what you want yet — that's fine. Your agent talks it through with you and turns "I have no idea" into a shortlist.
It searches the market for you
Every day your agent scans the market matching roles against what actually matters to you, not just keywords on a CV.
Only hits
No noise. No "maybe this fits." Just roles with a clear explanation of why they're right — and where to focus when applying.
Qualifications
Experience Required
- Previous experience delivering within public sector or highly regulated environments
- Experience working on large-scale cloud data transformation programmes
- Strong stakeholder engagement and problem-solving skills
- Ability to work independently and contribute within agile delivery teams
Required Skills
- Python
- AWS
- Apache Spark / PySpark
- Apache Airflow
- Terraform
- SQL
- ETL / ELT Development
- Data Integration
- Data Warehousing
- Cloud Data Platforms
Get help with your application
Your very own career expert that helps elevate your application to the next level.
Preferred Skills
- AWS Glue
- Athena
- EMR
- Lambda
- Databricks
- Kafka
- Docker
- Kubernetes
- GitLab CI/CD
- Jupyter Notebooks
- Snowflake
- Event-Driven Architectures
- Data Governance & Data Quality Frameworks
Pay range and compensation package
Rate: Competitive Daily Rate
Duration: Long-Term Contract
Equal Opportunity Statement
We welcome applications from all suitably qualified candidates and are committed to creating an inclusive environment for all employees, including those working within public sector or highly regulated environments.
Apply
If you have strong AWS, Python, Spark, Airflow and Terraform experience and would like to hear more about this opportunity, please apply with your latest CV and contact details.
“It took my CV and asked me questions relevant to understanding what kind of jobs to suggest for me. Suggestions were almost perfect. Jobs were exactly what I’ve been looking for.”
Jessica, London