Sundayy
Data Engineer
Get notified of more jobs like this · No spam, ever
How your CV stacks up
Upload your CV to see how well it fits this job role
?%
About The Company
At Anaplan, we are a team of innovators dedicated to transforming business decision-making through our cutting-edge AI-infused scenario planning and analysis platform. Our mission is to empower organizations to outpace their competition and adapt swiftly to market changes by providing them with robust, scalable, and intelligent data solutions. With a customer base that includes Fortune 50 companies such as Coca-Cola, LinkedIn, Adobe, LVMH, and Bayer, we pride ourselves on delivering best-in-class technology that drives strategic insights and operational excellence. Our culture is built on a foundation of diversity, inclusion, and a shared commitment to our customers' success, fostering an environment where innovation thrives and every team member's unique contributions are valued.
About The Role
We are seeking a highly skilled Principal Data Engineer to join our dynamic team. In this role, you will be responsible for overseeing the full stack of Anaplan’s data platform, setting the technical direction for data ingestion, transformation, storage, serving, and governance at scale. Your expertise will enable the development of high-performance, resilient data pipelines capable of processing vast volumes of data in real-time and batch modes. This foundational work is critical for empowering business users to leverage extensive datasets in their planning workflows and supports our advanced analytics and artificial intelligence initiatives. The ideal candidate will possess deep knowledge of distributed computing, data architecture, and software engineering, enabling them to address complex, large-scale data challenges effectively.
Qualifications
- Extensive experience in data engineering with a proven track record of delivering complex data solutions.
- Deep understanding of database ecosystems supporting AI and machine learning, including vector databases, NoSQL, and document stores.
- Hands-on experience building, scaling, and deploying large-scale data platforms in production environments.
- Proficiency with distributed data processing frameworks such as Apache Spark, Flink, or Hadoop.
- Strong knowledge of message brokers and event streaming platforms like Apache Kafka and Kinesis.
- Experience with data pipeline lifecycle development, including workflow orchestration tools such as Apache Airflow or Dagster.
- Expertise with cloud data warehouses (Snowflake, BigQuery, Redshift) and data lake architectures (Databricks, Delta Lake, Apache Iceberg).
- Advanced SQL skills and proficiency in Python programming.
- Solid understanding of modern software development practices, including testing, code review, CI/CD, and Infrastructure as Code.
- Desirable: Leadership experience in technical projects, mentoring engineering teams, and familiarity with cloud-native infrastructure (AWS, GCP, Azure).
- Knowledge of data observability, monitoring frameworks, and experience with enterprise planning platforms such as Anaplan is a plus.
Reasons to use Rodeo
Start with a chat, not a search bar
Grad scheme, placement, apprenticeship? Not sure what you want yet — that's fine. Your agent talks it through with you and turns "I have no idea" into a shortlist.
It searches the market for you
Every day your agent scans the market matching roles against what actually matters to you, not just keywords on a CV.
Only hits
No noise. No "maybe this fits." Just roles with a clear explanation of why they're right — and where to focus when applying.
Responsibilities
- Lead the design, architecture, and deployment of scalable, high-throughput Big Data systems into production environments.
- Develop and manage foundational data systems that support modern AI and analytics infrastructure, including vector, NoSQL, and document databases.
- Create end-to-end data engineering solutions, including robust ETL/ELT pipelines, API services, and data ingestion frameworks.
- Design and implement storage and processing layers such as data lakes, data warehouses, distributed file systems, and real-time streaming architectures.
- Engineer feature-rich data pipelines that process large enterprise datasets, seamlessly integrating batch and streaming data patterns.
- Optimize distributed queries and data transformations to ensure high performance and low latency for end users.
- Implement data quality frameworks to ensure data integrity, reliability, and governance across all assets.
- Collaborate with analytics, product, and platform teams to develop data models that accurately capture customer metrics, hierarchies, and relationships.
- Stay current with emerging trends in the data stack, evaluating new tools and technologies for potential integration into our platform.
Get help with your application
Your very own career expert that helps elevate your application to the next level.
Benefits
- Competitive salary and comprehensive health benefits.
- Opportunities for professional development and continuous learning.
- Collaborative and inclusive work environment that values diversity and innovation.
- Flexible work arrangements to support work-life balance.
- Participation in cutting-edge projects involving AI, big data, and cloud technologies.
- Employee recognition programs and team-building activities.
Equal Opportunity
At Anaplan, we are committed to creating a diverse and inclusive workplace. We believe that attracting, retaining, and developing a diverse workforce enhances our ability to innovate and serve our customers effectively. We provide equal employment opportunities to all qualified individuals regardless of gender, gender identity or expression, sexual orientation, religion, ethnicity, age, neurodiversity, disability status, citizenship, or any other characteristic protected by law. We are dedicated to ensuring reasonable accommodations are available to candidates and employees with disabilities throughout the hiring and employment process. Join us and bring your authentic self to work as we build what’s next together.
“It took my CV and asked me questions relevant to understanding what kind of jobs to suggest for me. Suggestions were almost perfect. Jobs were exactly what I’ve been looking for.”
Jessica, London
Location