Data Engineer

Location: London (Hybrid)
Salary: £55,000 - £70,000 DOE
Industry: Insurance

The Opportunity

I'm currently working with a well-established Insurance organisation based in London that is looking to hire an experienced Data Engineer to join its IT team.

This is a key opportunity to play a pivotal role in designing, building and optimising the organisation's foundational data infrastructure. You'll be responsible for developing scalable data pipelines, maintaining high data integrity across complex risk and financial datasets, and enabling efficient data processing to support business intelligence and advanced analytics.

The business is continuing to modernise its data environment, including the migration of existing on-premises data pipelines to Azure cloud services. You'll work across modern Data Stack technologies including Python, SQL, dbt and orchestration tooling, while also working with the unique data challenges associated with the insurance industry.

A key part of the role will involve working with scheme, non-scheme and London Market bordereaux, normalising inconsistent formats and resolving data quality issues across complex insurance datasets.

You'll also act as a bridge between the technical data environment and the wider business, working directly with Insurance Brokers and Technicians to understand operational requirements and translate them into effective technical solutions.

If you're an experienced Data Engineer with strong Python and SQL skills, Azure experience and a background working with insurance data, this could be an excellent opportunity to have a genuine impact on the organisation's data capabilities.

Key Responsibilities

• Design, develop and maintain scalable, automated and reliable data pipelines using Python and SQL.
• Build and optimise data architectures including data lakes and warehouses, ensuring they are performant, cost-effective and aligned with DataOps principles.
• Modernise existing on-premises data pipelines as part of the wider migration to Azure cloud services.
• Develop sophisticated ETL/ELT processes and custom API integrations across internal insurance systems, SaaS platforms and third-party financial feeds.
• Work with scheme, non-scheme and London Market bordereaux, including normalising inconsistent formats and resolving data quality issues.
• Use Power Automate for lightweight workflow automation and integrations within the Microsoft ecosystem.
• Work closely with Insurance Brokers and Technicians to translate operational requirements into clear technical solutions.
• Implement automated data quality checks, validation rules and monitoring/alerting systems to maintain data integrity and a single version of the truth.
• Ensure data solutions adhere to security, GDPR/DPA compliance and internal governance requirements.
• Optimise database performance, indexing and query efficiency to support real-time and near-real-time reporting.
• Develop and maintain high-impact dashboards and reports using Power BI, defining KPIs alongside senior stakeholders.
• Present technical findings and data-driven recommendations to business leaders in a clear and non-technical manner.
• Leverage LLMs and AI-assisted tools to support coding, documentation and development workflows where appropriate.