ATG (Auction Technology Group)
Data Engineer
Get notified of more jobs like this · No spam, ever
How your CV stacks up
Upload your CV to see how well it fits this job role
?%
About ATG
Auction Technology Group (ATG) operates digital marketplaces that connect auctioneers with bidders around the world. Our platforms support thousands of auction houses, buyers in more than 170 countries, and over $15 billion in annual sales. We are continuing to modernize the auction industry by making it easier to discover, evaluate, and buy specialized assets online.
The opportunity
We are investing in the data foundation behind ATG's customer experiences and business decisions. As a Senior Data Engineer on the Data Enablement team, you will build production-grade data products that serve analytics, search, recommendations, personalization, and machine learning. You will work closely with product managers, analysts, data scientists, ML engineers, and software engineers to turn ambiguous needs into dependable, well-documented datasets and pipelines.
This is a hands-on engineering role for someone who cares about maintainability, data quality, and measurable outcomes. You will help shape standards and architecture while still writing code, reviewing designs, troubleshooting failures, and improving the platform.
What you will do
Build durable data products
- Design, build, and operate batch and event-driven pipelines for auction, inventory, customer, and transaction data.
- Develop reusable transformation models and curated datasets in Snowflake and dbt for analytics and operational use cases.
- Orchestrate complex dependencies with Airflow, Dagster, or a comparable workflow platform.
- Design data models and interfaces that are clear, scalable, and easy for downstream teams to use.
Raise reliability and data quality
- Define data contracts, validation rules, freshness expectations, lineage, and service-level objectives for critical datasets.
- Implement automated testing, anomaly detection, alerting, and observability across the data lifecycle.
- Own production issues through diagnosis, recovery, root-cause analysis, and prevention.
- Improve query performance, warehouse efficiency, and cloud cost without compromising reliability.
Reasons to use Rodeo
Start with a chat, not a search bar
Grad scheme, placement, apprenticeship? Not sure what you want yet — that's fine. Your agent talks it through with you and turns "I have no idea" into a shortlist.
It searches the market for you
Every day your agent scans the market matching roles against what actually matters to you, not just keywords on a CV.
Only hits
No noise. No "maybe this fits." Just roles with a clear explanation of why they're right — and where to focus when applying.
Enable machine learning and customer experiences
- Create versioned training, validation, and inference datasets for search, recommendations, personalization, and other ML products.
Strengthen engineering practices
- Apply software engineering practices to data work, including modular design, code review, automated testing, CI/CD, and infrastructure as code.
- Improve documentation, discoverability, access controls, and governance for shared data products.
- Contribute to architectural decisions, technical standards, and pragmatic platform improvements.
- Mentor engineers and help the team make sound trade-offs among speed, scale, cost, and maintainability.
AUCTION TECHNOLOGY GROUP | JOB DESCRIPTION
Senior Data Engineer - Data Enablement
Partner with ML engineers and data scientists to make feature computation reproducible and consistent across experimentation and production.
- Support experimentation by delivering trustworthy exposure, interaction, and outcome data for A/B testing and model evaluation.
What you bring
- Five or more years of experience building and operating data pipelines or data platforms in production.
- Strong Python and advanced SQL skills, including testing, debugging, performance tuning, and maintainable code design.
- Hands-on experience with Snowflake or another modern cloud data platform, plus practical knowledge of dimensional and analytical data modeling.
- Production experience with dbt or a comparable transformation framework and with Airflow, Dagster, Prefect, or similar orchestration tooling.
- Experience with AWS data services and cloud storage; equivalent experience on another major cloud platform is welcome.
- A working understanding of data quality, lineage, observability, data contracts, and operational ownership.
- Comfort with Git, code review, automated testing, and CI/CD for data pipelines.
- Clear communication and the ability to work across product, analytics, software engineering, data science, and ML teams.
- A bachelor's degree in a relevant field or equivalent practical experience.
Get help with your application
Your very own career expert that helps elevate your application to the next level.
Useful, but not required
- Event streaming or real-time processing with Kafka, Kinesis, Flink, Spark Structured Streaming, or similar technologies.
- Distributed processing with Spark and familiarity with Parquet, Avro, JSON, and open table formats.
- Search or retrieval systems such as Elasticsearch/OpenSearch, vector databases, or embedding pipelines.
- Feature stores, ML data pipelines, model monitoring, or other MLOps capabilities.
- Infrastructure as code and container platforms, including Terraform, Docker, or Kubernetes.
- Data catalogs, semantic layers, master data management, or metadata-driven governance.
- Experience with ecommerce, marketplaces, auctions, GDPR, privacy controls, or regulated data environments.
How success will be measured
- Critical pipelines and datasets are reliable, observable, and trusted by their users.
- Teams can find and use well-documented data products without unnecessary handoffs.
“It took my CV and asked me questions relevant to understanding what kind of jobs to suggest for me. Suggestions were almost perfect. Jobs were exactly what I’ve been looking for.”
Jessica, London
Location