How your CV stacks up
Upload your CV to see how well it fits this job role
?%
Ready to build the future with AI?
At Genpact, we don’t just keep up with technology—we set the pace. AI and digital innovation are redefining industries, and we’re leading the charge. Genpact’s AI Gigafactory, our industry-first accelerator, is an example of how we’re scaling advanced technology solutions to help global enterprises work smarter, grow faster, and transform at scale. From large-scale models to agentic AI, our breakthrough solutions tackle companies’ most complex challenges.
If you thrive in a fast-moving, innovation-driven environment, love building and deploying cutting-edge AI solutions, and want to push the boundaries of what’s possible, this is your moment.
Genpact (NYSE: G) is an advanced technology services and solutions company that delivers lasting value for leading enterprises globally. Through our deep business knowledge, operational excellence, and cutting-edge solutions – we help companies across industries get ahead and stay ahead. Powered by curiosity, courage, and innovation, our teams implement data, technology, and AI to create tomorrow, today. Get to know us at genpact.com and on LinkedIn, X, YouTube, and Facebook.
Inviting applications for the role of Lead Data Engineer
In this role, you will Design and optimize scalable data pipelines on Azure Databricks using PySpark and Spark SQL, implementing distributed transformations and architecting Delta Lake tables aligned to Medallion (Bronze/Silver/Gold) principles. Develop modular frameworks and orchestrated workflows with incremental processing patterns while ensuring performance optimization, data quality governance, operational logging, and successful migration of legacy workloads into Spark-native solutions. Onsite requirement for 3 to 4 days in London office of client.
Reasons to use Rodeo
Start with a chat, not a search bar
Grad scheme, placement, apprenticeship? Not sure what you want yet — that's fine. Your agent talks it through with you and turns "I have no idea" into a shortlist.
It searches the market for you
Every day your agent scans the market matching roles against what actually matters to you, not just keywords on a CV.
Only hits
No noise. No "maybe this fits." Just roles with a clear explanation of why they're right — and where to focus when applying.
Responsibilities
- Advanced proficiency in PySpark and Spark SQL
- Complex DataFrame transformations
- Window functions and advanced aggregations
- Distributed joins and performance tuning
- Error handling and logging patterns
- Strong expertise in Delta Lake
- ACID transactions
- Schema enforcement and evolution
- Time travel and versioning
- MERGE and incremental data processing strategies
- Hands-on experience with Azure Databricks
- Notebook structuring and modular code design
- Databricks Workflows (job orchestration and task chaining)
- Cluster configuration and optimization
- Integration with Azure storage (ADLS Gen2)
- Solid understanding of data modeling and Lakehouse architecture
- Medallion architecture implementation
- Partitioning and optimization strategies
- Strong SQL proficiency
- Familiarity with CI/CD practices in Databricks environments
- Demonstrate thought leadership and engage with business users such as (Product owners for example) in determining a solution
- Critical thinking and solid communication skills
Qualifications we seek in you!
Minimum Qualifications
- Bachelor's Degree required. Preferably in Computer Science, Information Systems, or related field.
Preferred Qualifications/ Skills
- Experience supporting legacy workload modernization (e.g., ETL migration from tools such as Alteryx) is beneficial but not primary)
Why join Genpact?
- Lead AI-first transformation – Build and scale AI solutions that redefine industries
- Make an impact – Drive change for global enterprises and solve business challenges that matter
- Accelerate your career—Gain hands-on experience, world-class training, mentorship, and AI certifications to advance your skills
- Grow with the best – Learn from top engineers, data scientists, and AI experts in a dynamic, fast-moving workplace
- Committed to ethical AI – Work in an environment where governance, transparency, and security are at the core of everything we build
- Thrive in a values-driven culture – Our courage, curiosity, and incisiveness - built on a foundation of integrity and inclusion - allow your ideas to fuel progress
Get help with your application
Your very own career expert that helps elevate your application to the next level.
Come join the 140,000+ coders, tech shapers, and growth makers at Genpact and take your career in the only direction that matters: Up.
Let’s build tomorrow together.
Genpact is an Equal Opportunity Employer and considers applicants for all positions without regard to race, color, religion or belief, sex, age, national origin, citizenship status, marital status, military/veteran status, genetic information, sexual orientation, gender identity, physical or mental disability or any other characteristic protected by applicable laws. Genpact is committed to creating a dynamic work environment that values respect and integrity, customer focus, and innovation.
Furthermore, please do note that Genpact does not charge fees to process job applications and applicants are not required to pay to participate in our hiring process in any other way. Examples of such scams include purchasing a 'starter kit,' paying to apply, or purchasing equipment or training.
“It took my CV and asked me questions relevant to understanding what kind of jobs to suggest for me. Suggestions were almost perfect. Jobs were exactly what I’ve been looking for.”
Jessica, London
Skills
Location