Jack & Jill
Lead Data Engineer at LightWork AI
How your CV stacks up
Upload your CV to see how well it fits this job role
?%
Job Title
Lead Data Engineer
Salary
Not Disclosed
Company Description
LightWork AI is an early-stage AI company building the foundational data infrastructure to power its next-generation AI platform. Based in London, the team is focused on creating the robust architecture required to support advanced machine learning and real-time AI inference at scale.
Job Description
As the first senior data hire at LightWork AI, you will lead the design and implementation of our data architecture. You'll define engineering standards, select core tooling, and build scalable pipelines from scratch. This critical role offers the opportunity to shape the data strategy and build the team for a high-growth AI startup.
Location
London, UK
Why this role is remarkable
- Join as the first senior data hire, giving you unprecedented influence over the technical roadmap, architectural choices, and future engineering culture.
- Work at the cutting edge of AI infrastructure, implementing advanced vector databases and high-throughput real-time data streaming solutions for inference support.
- Shape the future of a high-potential AI platform while building out and eventually leading your own dedicated data engineering team in a greenfield environment.
Reasons to use Rodeo
Start with a chat, not a search bar
Grad scheme, placement, apprenticeship? Not sure what you want yet — that's fine. Your agent talks it through with you and turns "I have no idea" into a shortlist.
It searches the market for you
Every day your agent scans the market matching roles against what actually matters to you, not just keywords on a CV.
Only hits
No noise. No "maybe this fits." Just roles with a clear explanation of why they're right — and where to focus when applying.
What You Will Do
- Architect and build robust data pipelines using technologies like Spark, Airflow, and Kafka to support real-time AI platform capabilities.
- Implement and manage specialized data stores, including PostgreSQL, MongoDB, and vector databases like Qdrant, Milvus, or pgvector for high-performance search.
- Establish rigorous engineering standards for data quality, observability, and performance while mentoring future hires as the company scales its operations.
The ideal candidate
- Brings 7+ years of experience in data or backend engineering, with a proven track record of owning complex, distributed data systems at scale.
- Possesses deep expertise in Python and the Spark/Airflow/Kafka stack, alongside hands-on experience with vector search and large-scale ML data pipelines.
- Thrives in early-stage environments and holds a high-prestige degree in a technical field from a top-tier university with a strong academic record.
Who are Jack & Jill?
Ok, I'll go first. I'm Jack, an AI that gets to know you on a quick call, learning what you're great at and what you want from your career. Then I help you land your dream job by finding unmissable opportunities as they come up, supporting you with applications, interview prep, and moral support.
Get help with your application
Your very own career expert that helps elevate your application to the next level.
And I'm Jill, an AI Recruiter who talks to companies to understand who they're looking to hire. Then I recruit from Jack's network, making an introduction when I spot an excellent candidate.
How does this work?
Jack's an AI agent for job searching and career coaching. He works for you.
Jill is the AI recruiter working for the company. She recruits from Jack's network.
If it's a match and the company wants to meet you, they'll make the intro. In the meantime, if you'd like, Jack will send you excellent alternatives.
We never post fake jobs
This isn't a trick. This is an open role that Jill is currently recruiting for from Jack's network.
Sometimes Jill's clients ask her to anonymize their jobs when she advertises them, which means she can't share all the details in the job description.
We appreciate this can make them look a bit suspect, but there isn't much we can do about it.
Give Jack a spin! You could land this role. If not, most people find him incredibly helpful with their job search, and we're giving his services away for free.
“It took my CV and asked me questions relevant to understanding what kind of jobs to suggest for me. Suggestions were almost perfect. Jobs were exactly what I’ve been looking for.”
Jessica, London
Skills
Location