Adroit People Limited (UK)
Software Engineer - Cloud Data Pipelines (R/Python)
Get notified of more jobs like this · No spam, ever
How your CV stacks up
Upload your CV to see how well it fits this job role
?%
Role: Software Engineer - Cloud Data Pipelines (R/Python)
Location: Stevenage, UK (Hybrid)
Employment: Permanent/Fixed term Full time
We are seeking a Software Engineer to design, build, and maintain robust data pipelines that ingest, process, and execute custom R and Python scripts at scale. You will work within our cloud infrastructure (Google Cloud Platform or Azure) to automate data workflows, ensure high performance, and integrate advanced analytical models into production environments.
Key Responsibilities
- Execute R/Python Workloads: Containerize, deploy, and orchestrate custom R and Python scripts to run reliably in cloud-native serverless or containerized environments.
- Cloud Integration: Leverage managed cloud services on GCP (e.g., Cloud Functions, Cloud Run, BigQuery, Dataflow) or Azure (e.g., Azure Data Factory, Azure Functions, Databricks, Synapse Analytics).
- Workflow Orchestration: Implement and maintain workflow tools (such as Apache Airflow or Prefect) to schedule and monitor script execution.
- Ensure Data Quality: Implement automated logging, error handling, and testing frameworks to validate data integrity and script outputs.
- Optimize Performance: Tune data processing jobs and cloud resource allocation for cost-efficiency, speed, and scalability.
Reasons to use Rodeo
Start with a chat, not a search bar
Grad scheme, placement, apprenticeship? Not sure what you want yet — that's fine. Your agent talks it through with you and turns "I have no idea" into a shortlist.
It searches the market for you
Every day your agent scans the market matching roles against what actually matters to you, not just keywords on a CV.
Only hits
No noise. No "maybe this fits." Just roles with a clear explanation of why they're right — and where to focus when applying.
Required Qualifications & Technical Skills
- Programming: Advanced proficiency in Python and/or R, with strong experience writing clean, modular, and well-tested code.
- Cloud Platforms: Hands-on production experience with either Google Cloud Platform (GCP) or Microsoft Azure.
- Containerization & Tools: Experience with Docker, Kubernetes, and CI/CD pipelines (GitHub Actions, GitLab CI).
- Data Stores: Proficiency with SQL and relational/non-relational databases (PostgreSQL, BigQuery, Snowflake, or Azure SQL).
- Software Engineering Practices: Solid foundation in version control (Git), automated testing, and API design.
Get help with your application
Your very own career expert that helps elevate your application to the next level.
Preferred Qualifications
- Experience migrating legacy local R/Python analytical scripts into distributed cloud architectures.
- Knowledge of Infrastructure as Code (Terraform or Bicep).
“It took my CV and asked me questions relevant to understanding what kind of jobs to suggest for me. Suggestions were almost perfect. Jobs were exactly what I’ve been looking for.”
Jessica, London