Permutable
Senior Data Platform Engineer - Python & AWS
London
Posted about 18 hours ago
Get notified of more jobs like this · No spam, ever
How your CV stacks up
1Upload CV
2Analyse CV
3Improve CV
Upload your CV to see how well it fits this job role
?%
About Permutable
At Permutable, we’re building real-time AI systems that turn large volumes of global news, market and proprietary data into market intelligence and systematic signals for financial institutions.
About the Role
We’re looking for an experienced Data Platform Engineer with strong Python and AWS skills to build and scale the systems behind our data ingestion, processing, storage and delivery.
Responsibilities
- Build production data pipelines: Design and develop Python services and pipelines to ingest, validate, transform and deliver large volumes of news, market and proprietary data.
- Develop our AWS data platform: Build and scale infrastructure across S3, RDS/PostgreSQL, Lambda, ECS and EKS, choosing the right services for each workload.
- Build event-driven systems: Develop services using messaging, queues and asynchronous processing to support faster data updates and reliable distributed workflows.
- Improve data quality and reliability: Build validation, deduplication, schema handling, retries and recovery into our pipelines. Make it straightforward to identify missing data, investigate failures and reprocess historical datasets.
- Own storage and data access: Improve how we store, query and serve data to support research, production models and client-facing applications.
- Support AI and quantitative workloads: Work with AI engineers and researchers to provide reliable data inputs and integrate NLP, LLM and quantitative model outputs into the platform.
- Automate infrastructure and deployments: Manage infrastructure through Pulumi and build CI/CD workflows using GitHub Actions.
- Monitor and optimise production: Develop monitoring and alerting for pipeline health, data freshness and service performance. Diagnose production issues and improve processing speed, resilience and AWS costs.
Reasons to use Rodeo
Start with a chat, not a search bar
Grad scheme, placement, apprenticeship? Not sure what you want yet — that's fine. Your agent talks it through with you and turns "I have no idea" into a shortlist.
It searches the market for you
Every day your agent scans the market matching roles against what actually matters to you, not just keywords on a CV.
Only hits
No noise. No "maybe this fits." Just roles with a clear explanation of why they're right — and where to focus when applying.
Requirements
- Strong production Python experience: You can design, build, test and maintain substantial Python services and data pipelines.
- Strong AWS experience: Hands-on experience building and operating production systems on AWS, including services such as S3, RDS/PostgreSQL, Lambda, ECS or EKS.
- Experience building data platforms: A substantial track record in data platform engineering, data engineering or backend engineering, with ownership of production data systems.
- SQL and database skills: Strong SQL and practical experience with PostgreSQL, data modelling, query performance and processing large datasets.
- Event-driven and distributed systems experience: A solid understanding of messaging, queues, asynchronous processing and reliable workflows, including retries and failure recovery.
- Infrastructure-as-Code and CI/CD: Experience with Pulumi, Terraform or equivalent, alongside automated testing and deployment pipelines.
- Production ownership: Comfortable working with Linux, containers, monitoring and logging, and diagnosing problems across application code, pipelines and infrastructure.
- Engineering judgement: Able to make practical architecture decisions and balance performance, reliability, cost and delivery speed.
- Startup mindset: Proactive, resourceful and comfortable taking responsibility in a small, fast-moving engineering team.
- Relevant technical background: A degree in computer science, software engineering or a related discipline, or equivalent practical experience.
Get help with your application
Your very own career expert that helps elevate your application to the next level.
Bonus if you have
- Apache Airflow
- Real-time data processing
- Kubernetes
- AI/ML infrastructure
- LLM workflows
- GPU infrastructure
- Financial-market data
What We Offer
- Real responsibility: Own important parts of our data platform and see your work used in production.
- An ambitious, collaborative culture: Work closely with our founder, engineers and researchers, with regular opportunities to contribute ideas and influence technical decisions.
- A strong startup culture and office vibe: Join a close-knit team that makes time for regular socials, company offsites, sports events and office treats.
- Hybrid flexibility: Spend three or more days each week in our Vauxhall hub, with flexibility to work remotely for the remainder.
- Share in Our Growth: Equity options give you the opportunity to share in Permutable’s long-term success as you help build the business.
Trusted by 25,000+ job seekers
“It took my CV and asked me questions relevant to understanding what kind of jobs to suggest for me. Suggestions were almost perfect. Jobs were exactly what I’ve been looking for.”
Jessica, London
Location