Creditsafe Group
Data Engineer
Get notified of more jobs like this · No spam, ever
How your CV stacks up
Upload your CV to see how well it fits this job role
?%
About Creditsafe
With the largest owned database supported by a partner network, Creditsafe provides data on 320 million companies in over 100 countries to support its customers in this regard. Creditsafe is scaling business and currently going through a significant growth stage. Being a data company, Creditsafe collects and processes large amounts of complex data, received from multiple channels with the only purpose of serving our clients with opportunities to gain actionable insights. Our holistic data aggregation helps our clients to fill the knowledge gaps, influence decision making, and find hidden patterns.
This opportunity is to join a team of highly technically skilled engineers who are designing Creditsafe’s new data and AI platform with data quality, data lineage, and auditability as the primary goals whilst maintaining high throughput and scalability. The data platform will be built using AWS infrastructure such as S3, Iceberg, Aurora, DynamoDB, Lambda, Fargate, ECS, Airflow, Spark. A key aspect of this role will be helping to implement the integration of the AWS data platform across Snowflake and Databricks to meet the data needs of our customers in their native data cloud platform. The platform is expected to manage over one hundred million objects with a high volume of daily updates handling addition, deletion, and correction of our data and indexes in an auditable manner. We will also be building AI capabilities on top of these platforms based on MCP and AI agentic workflows. Our data processing application is entirely based on Python and we use Terraform to build re-creatable infrastructure.
Reasons to use Rodeo
Start with a chat, not a search bar
Grad scheme, placement, apprenticeship? Not sure what you want yet — that's fine. Your agent talks it through with you and turns "I have no idea" into a shortlist.
It searches the market for you
Every day your agent scans the market matching roles against what actually matters to you, not just keywords on a CV.
Only hits
No noise. No "maybe this fits." Just roles with a clear explanation of why they're right — and where to focus when applying.
What you will be doing?
- Actively contribute to the codebase and participate in peer reviews.
- Help to design and build metadata driven, event-based distributed data processing platform using technologies such as Python, Spark, Airflow, Iceberg, DynamoDB, AWS Glue, S3.
- Work on integrating our AWS data lake with other data platforms such as Snowflake and Databricks.
- As an experienced Engineer, play a critical role in the design, development, and deployment of our business-critical system.
- Build and scale Creditsafe’s data pipelines combining batch and streaming approaches and targeting sub-100ms latency serving.
- Understand domain data to make recommendations to improve the existing product.
- Build AI-based solutions leveraging approaches such as semantic search, MCP and agentic workflows.
- Employ various AI tools such as Perplexity, Cursor, CoPilot, etc to aid in all aspects of your work.
What are we looking for?
- Track record of successfully implementing and operating production data platforms using Python and AWS.
- Hands-on experience with modern cloud data platforms including Snowflake and/or Databricks.
- Understanding and ability to implement data engineering best practices.
- Demonstrate the ability to write clean & efficient code and combine it with the cloud environment for best performance.
- Proven experience of development experience within a commercial environment creating production-grade data pipelines in Python.
- Looking to grow your skills through daily technical challenges and enjoy problem-solving, whiteboarding in collaboration with the team.
- Excellent communication skills, and ability to explain your views clearly to the team and are open to understanding the views of others.
- Share your ideas collaboratively via wikis, discussion boards, etc and share any decisions made, for the benefit of others.
- Ability to take ownership of end-to-end deliverables from planning all the way to production.
Get help with your application
Your very own career expert that helps elevate your application to the next level.
Why Creditsafe?
- Career Progression: Clearly defined career progression path with opportunities to grow as a technical leader or move into adjacent roles.
- Learning & Development: Access to a plethora of learning resources and courses to perpetually enhance your skills, with weekly dedicated training and focus time.
- Work-Life Balance: Committed to promoting a balanced lifestyle with flexible working hours and hybrid work options.
- Innovation: Engage in exciting projects, harnessing the power of the latest technologies in cloud computing and data management.
- Our Technology Stack: Python, Linux, Airflow, AWS DynamoDB, S3, Glue, Athena, Redshift, Lambda, API Gateway, Terraform, CI/CD
Benefits
- Competitive Salary
- Bonus Scheme
- 25 Days Annual Leave (plus bank holidays)
- Hybrid working model
- Healthcare & Company Pension
- Cycle to work and Wellbeing Programme
- Global Company gatherings and events
- E-learning and excellent career progression opportunities
- Plus more that can be found on the benefits section on the Careers page, https://creditsafecareers.kinsta.cloud/gb/
“It took my CV and asked me questions relevant to understanding what kind of jobs to suggest for me. Suggestions were almost perfect. Jobs were exactly what I’ve been looking for.”
Jessica, London
Location