Webologix Ltd/ INC
Senior Data Engineer
How your CV stacks up
Upload your CV to see how well it fits this job role
?%
Senior Data Engineer
Senior Data Engineer – IC Data Platform
About the Role
The Interconnectors Data Platform (ICDP) is a cloud-based data warehouse enabling critical commercial, financial modelling, and operational decision-making. As the platform transitions to a modernised Medallion Architecture and Azure-native ingestion patterns, we are seeking a Senior Data Engineer to deliver technical leadership and architectural direction.
Responsibilities
(Up to 10 key tasks—avoiding repetition)
Data Architecture & Platform Engineering
- Lead the design and implementation of scalable data architectures (Bronze/Silver/Gold layered models).
- Drive the platform’s architectural roadmap, ensuring alignment with modern engineering best practices.
- Develop secure, observable, and scalable ingestion and transformation pipelines.
Pipeline Development & Operations
- Transition from legacy ETL tools (e.g., Matillion) to modern Azure-based pipelines, including Azure Functions, Azure Data Factory (ADF), and event-driven frameworks.
- Build and maintain high-performance SQL transformations, curated data models, and reusable components.
- Embed CI/CD, automated testing, version control, and observability into workflows.
Reasons to use Rodeo
Start with a chat, not a search bar
Grad scheme, placement, apprenticeship? Not sure what you want yet — that's fine. Your agent talks it through with you and turns "I have no idea" into a shortlist.
It searches the market for you
Every day your agent scans the market matching roles against what actually matters to you, not just keywords on a CV.
Only hits
No noise. No "maybe this fits." Just roles with a clear explanation of why they're right — and where to focus when applying.
Data Quality & Governance
- Implement robust data validation, reconciliation, profiling, and auditability across platform layers.
- Collaborate with business stakeholders to ensure analytical and operational requirements are met.
Leadership
- Mentor junior engineers and strengthen technical capability within the ICDP team.
- Partner with Product, IT&D, and external partners to deliver high-quality outcomes.
- Serve as the technical authority on engineering patterns, standards, and architecture decisions.
Your Profile
Essential Skills & Experience
Technical Knowledge
- Python: Deep expertise in production-grade data pipelines, transformations, and orchestration.
- Advanced SQL: Proficient in analytical query optimisation, data modelling, and transformation logic.
- Azure Cloud: Hands-on experience with Azure Functions, Azure Data Factory (ADF), Azure Storage, Key Vault, and cloud security fundamentals.
- Data Warehousing: Strong understanding of scalable enterprise architecture, dimensional modelling, and robust data layering.
- DevOps & Version Control: Proficiency in Git, CI/CD pipelines, testing strategies, and branching paradigms.
- Pipeline Resilience: Experience with API/SFTP ingestion, retries, dead-letter queues, and fault tolerance.
Get help with your application
Your very own career expert that helps elevate your application to the next level.
Soft Skills
- Exceptional problem-solving and architectural thinking.
- Ability to communicate complex technical concepts clearly to diverse stakeholders.
- Flexibility to navigate ambiguity and high-pressure environments.
Desirable (Bonus) Experience
- Contribution to major data-platform re-architectures (medallion, lakehouse, or cloud-native designs).
- Familiarity with Databricks, Spark, or similar big data ecosystems.
- Work in regulated or high-assurance data environments (compliance, auditing, CICD pipelines).
- Experience bridging engineering and data modelling teams (e.g., working with analysts or BI teams).
“It took my CV and asked me questions relevant to understanding what kind of jobs to suggest for me. Suggestions were almost perfect. Jobs were exactly what I’ve been looking for.”
Jessica, London
Skills
Location