Pyramid Consulting, Inc
Data Engineer
Get notified of more jobs like this · No spam, ever
How your CV stacks up
Upload your CV to see how well it fits this job role
?%
Senior Data Engineer – London-UK, Spain, Germany & Portugal
Remote
Role Overview
We are looking for a Senior Data Engineer with strong expertise in Python, SQL, Data Engineering, and AI/ML to design, build, and deliver scalable data and AI solutions.
The role involves owning technical workstreams end-to-end, contributing to Generative AI and Agentic AI solutions, and applying modern data engineering, MLOps, and LLMOps practices across enterprise environments.
Key Responsibilities
- Design, develop, and maintain scalable data engineering and AI solutions.
- Lead technical workstreams and mentor junior engineers while promoting strong software engineering practices.
- Build Generative AI, Agentic AI, Machine Learning, and Business Intelligence solutions.
- Work with technologies such as Spark, LangChain, Databricks, Dask, Airflow, Dagster, and Kedro.
- Develop AI capabilities using prompt engineering, RAG, embeddings, vector databases, and context engineering.
- Own AI feature delivery from development through production, including evaluation, reliability, guardrails, and performance optimisation.
- Implement data security and governance, including PII/PHI protection, authentication, and RBAC.
- Establish and maintain MLOps and LLMOps pipelines, including CI/CD and automated AI/agent evaluation.
- Use tools such as LangSmith, Opik, Langfuse, and Terraform across AWS, Azure, and GCP environments.
- Work effectively in polyglot enterprise environments involving Python, SQL, Scala, and Java.
- Independently manage technical deliverables, priorities, and timelines.
- Collaborate effectively with technical and business stakeholders.
- Travel occasionally when required.
Reasons to use Rodeo
Start with a chat, not a search bar
Grad scheme, placement, apprenticeship? Not sure what you want yet — that's fine. Your agent talks it through with you and turns "I have no idea" into a shortlist.
It searches the market for you
Every day your agent scans the market matching roles against what actually matters to you, not just keywords on a CV.
Only hits
No noise. No "maybe this fits." Just roles with a clear explanation of why they're right — and where to focus when applying.
Required Skills & Experience
- Degree in Computer Science, Engineering, or equivalent professional experience.
- 5+ years of relevant experience in Data Engineering.
- Strong experience leading technical initiatives, mentoring engineers, and driving engineering best practices.
- Expert-level Python and SQL skills.
- Hands-on experience with Generative AI, Agentic AI, Machine Learning, and BI solutions.
- Strong knowledge of RAG, embeddings, vector databases, prompt engineering, and context construction.
- Experience with modern frameworks and platforms such as Spark, Databricks, LangChain, Airflow, Dagster, Dask, or Kedro.
- Experience with MLOps/LLMOps, CI/CD, AI evaluation, and production AI systems.
- Knowledge of LangSmith, Opik, Langfuse, or similar AI evaluation/observability tools.
- Experience with Terraform and cloud environments such as AWS, Azure, and GCP.
- Understanding of data security, governance, PII/PHI, authentication, and RBAC.
- Strong English communication skills and proficiency in the relevant local language.
- Ability to work independently with strong ownership, organisation, and time-management skills.
Get help with your application
Your very own career expert that helps elevate your application to the next level.
Nice to Have
- Experience using AI coding assistants/agents such as Cursor, Claude Code, or Codex.
- Experience working with Scala and Java in enterprise environments.
- Previous experience delivering production-grade AI/LLM solutions.
- Willingness to travel when required.
Location: Spain, Germany or Portugal, UK
Work Model: Remote
“It took my CV and asked me questions relevant to understanding what kind of jobs to suggest for me. Suggestions were almost perfect. Jobs were exactly what I’ve been looking for.”
Jessica, London
Location