Agilisys
Senior Data Engineer
Get notified of more jobs like this · No spam, ever
How your CV stacks up
Upload your CV to see how well it fits this job role
?%
ABOUT US
Agilisys is at the forefront of digital transformation and innovation in the public services sector. With over two decades of experience, we have established ourselves as a trusted partner for governments, local authorities, and organizations nationwide. Our mission is to empower our clients to deliver exceptional public services by harnessing the full potential of technology and data.
OUR VALUES
- Partnership: We become one team and family with organisations, helping them to navigate change and stay agile.
- Integrity: Our people really care, going beyond the brief to make change happen for organisations and citizens.
- Innovation: We bring together the right technologies and services to design solutions that work.
- Passion: We are passionate about - and dedicated to - public services and improving people’s lives.
THE ROLE
The Senior Data Engineer – Microsoft Fabric & Azure is a senior, hands-on role within Agilisys’ Data & AI Practice. You will take engineering ownership of modern data-platform workstreams from approved design through build, testing, production deployment and handover, with Microsoft Fabric and the Azure Data Platform at the core.
Working closely with architects, analysts, delivery teams, and client stakeholders, you will help turn architecture into secure, scalable, and supportable solutions. You will also contribute to engineering standards, mentor other engineers, and help clients move from proof-of-value or legacy data platforms to production-grade services.
KEY RESPONSIBILITIES
- Deliver Fabric and Azure data platforms end to end: Build and productionise Microsoft Fabric solutions using OneLake, Lakehouses, Warehouses, Data Pipelines, Notebooks, Dataflows, and Azure Data Factory, including integration with legacy, cloud, and on-premises data sources.
- Engineer reliable data pipelines and models: Design batch, incremental, and near-real-time ETL/ELT using SQL, Python, and PySpark; apply medallion, dimensional/Kimball, normalised, and data-product patterns as appropriate; and use production-grade techniques such as CDC, SCD, schema-change handling, idempotency, retry/replay, backfill, and source-to-target reconciliation.
- Own Dev/Test/Production delivery and CI/CD: Configure Fabric workspace structures and environment-specific settings, and implement controlled promotion using Git, Azure DevOps/GitHub, Fabric Deployment Pipelines, APIs, or controlled manual steps where Fabric item limitations require them. Apply branch protection, peer review, testing, approvals, rollback, and release evidence.
- Build for security, governance, and compliance: Implement secure-by-design controls using Microsoft Entra ID, RBAC, Fabric workspace/item/data permissions, managed identities or service principals, encryption, and appropriate network controls. Work with architects and governance specialists on Fabric-native governance and Microsoft Purview requirements where these are in project scope.
- Optimise, monitor, and troubleshoot production workloads: Tune SQL, Spark, Delta/Parquet storage, partitioning, and compute for performance, cost, and reliability. Establish monitoring and alerting for pipelines, notebooks, semantic-model refreshes, data freshness, and Fabric capacity, and diagnose failures, data-quality issues, and performance problems during delivery and hypercare.
- Support Power BI and data consumption: Work effectively with data analysts for Power BI semantic models and reporting solutions, including Direct Lake and Import concepts, refresh, RLS/OLS, performance, and deployment considerations, and enable governed consumption through semantic models, SQL endpoints, data products, and APIs where required.
- Lead engineering delivery and handover: Own assigned engineering workstreams, collaborate with stakeholders, mentor engineers, contribute to design and engineering standards, and produce clear technical documentation including implementation details, HLD/LLD contributions, operational runbooks, and knowledge-transfer materials for client and support teams.
Reasons to use Rodeo
Start with a chat, not a search bar
Grad scheme, placement, apprenticeship? Not sure what you want yet — that's fine. Your agent talks it through with you and turns "I have no idea" into a shortlist.
It searches the market for you
Every day your agent scans the market matching roles against what actually matters to you, not just keywords on a CV.
Only hits
No noise. No "maybe this fits." Just roles with a clear explanation of why they're right — and where to focus when applying.
ESSENTIAL TECHNICAL EXPERIENCE
- You will have a strong track record of hands-on data engineering delivery, with the technical depth to work independently and the communication skills to operate confidently with technical and business stakeholders.
- 5+ years’ commercial data engineering experience, including experience operating at Senior Data Engineer level, with strong recent hands-on Microsoft Fabric delivery experience (ideally 18–24+ months) and demonstrable delivery of at least one production-grade Fabric implementation.
- Strong Microsoft Fabric experience across OneLake, Lakehouse, Warehouse, Data Pipelines, Notebooks, and Dev/Test/Production workspace patterns.
- Advanced SQL, Python, and PySpark, with practical experience of Delta/Parquet, medallion architecture, and production-grade batch/incremental ETL/ELT.
- Strong Git and CI/CD experience using Azure DevOps and/or GitHub, including controlled release, testing, deployment, rollback, and environment promotion practices.
- Good Azure data-platform experience, including Azure Data Factory and secure cloud/on-premises connectivity using gateway, managed private endpoint, or related network patterns where required.
- Working knowledge of Power BI semantic-model integration, Direct Lake/Import concepts, refresh, RLS/OLS, performance, and deployment.
- Practical experience of Microsoft Entra ID, RBAC, managed identities/service principals, secure engineering, data quality, testing, troubleshooting, operational documentation, and runbooks.
- Strong stakeholder management, mentoring, and communication skills, with the ability to work in fast-moving multidisciplinary teams and contribute constructively to architecture and engineering decisions.
- Experience of public-sector, local-government, or other regulated environments is strongly valued. You must hold active Security Clearance or be eligible and willing to undertake BPSS/security clearance appropriate to client requirements.
Get help with your application
Your very own career expert that helps elevate your application to the next level.
DESIRABLE EXPERIENCE & CERTIFICATION
- Microsoft Certified: Fabric Data Engineer Associate (DP-700); DP-600 is also beneficial.
- Microsoft Purview and Fabric-native governance capabilities.
- Fabric Real-Time Intelligence, Eventstreams, and Eventhouse/KQL.
- Private Link, managed private endpoints, Azure Key Vault, and gateway infrastructure.
- Fabric REST APIs, PowerShell/Azure CLI, Infrastructure as Code, and deployment automation.
- Experience with Databricks and/or Snowflake.
THE OPPORTUNITY
You will join a growing Data & AI Practice delivering modern Data, AI, Analytics, and Cloud solutions across the public sector, with particular emphasis on Microsoft Fabric and the wider Microsoft ecosystem. The role offers hands-on exposure to enterprise-scale programmes, complex production challenges, and the opportunity to influence how Agilisys designs and engineers modern data platforms.
WHAT WE CAN OFFER YOU
- This role will offer exposure to the right mix of challenges, within a culture that promotes continuous learning and development.
- Benefits include:
- Enhanced Pension Scheme
- Life Assurance
- Access to exclusive discounts and offers through the company’s “Perks at Work” scheme
- 25 days annual leave (with the option to buy more)
PROCESS
Simply submit your CV.
By submitting your CV, you understand that we have a legitimate interest to use your personal data for the purposes of assessing your eligibility for this role. This means that we may use your personal data to contact you to discuss your CV or arrange an interview or transfer your CV to the hiring manager(s) of the role you have applied for. You can ask us at any time to remove your CV from our database by emailing talentacquisition@agilisys.co.uk – but please note that this means we will no longer consider you for the role you have applied for. We have a rigorous recruitment process, which we use for all our roles to ensure we attract the very best talent.
Individuals seeking employment at Agilisys must note that we see diversity as something that creates a better workplace and delivers better outcomes. As such, we are keen to maximise the diversity of our workforce and actively encourage applications from all. We encourage diversity through perspective, background, identity, and thought whilst also fostering an environment where everyone can express themselves regardless of your race, religion, sex, gender, colour, national origin, disability, or any other applicable legally protected characteristic. We are committed to continuing to nurture an inclusive environment and building a diverse workforce.
“It took my CV and asked me questions relevant to understanding what kind of jobs to suggest for me. Suggestions were almost perfect. Jobs were exactly what I’ve been looking for.”
Jessica, London
Skills