Oxford Global Resources
AWS Data Engineers - Data Catalogue & Lineage
How your CV stacks up
Upload your CV to see how well it fits this job role
?%
Temporary employment role through Oxford UK
Location: Remote
Start Date: ASAP
Length: Until Dec, 31st initially. Potential extensions
Platform: AWS SageMaker Unified Studio (SMUS)
Stack: Redshift · Glue · Lake Formation · DBT
Position Overview
We are looking for a hands-on Data Engineer to design, build, and operate a Data Catalog & Lineage solution on SMUS. You will make enterprise data assets discoverable, trustworthy, and traceable. The role focuses on metadata management, governance, and lineage automation — understanding how transformations flow through Redshift, Glue, Lake Formation, and DBT, and capturing that lineage end-to-end.
Core Responsibilities
Data Catalog Design & Lineage Automation
- Design and implement the enterprise data catalog in SMUS as the single source of truth for data discovery
- Define metadata standards, business glossaries, data domains, and classification taxonomies
- Configure SMUS domains, governance policies, and access controls
- Integrate metadata from Glue Data Catalog, Redshift system tables, Lake Formation, and DBT docs
- Build end-to-end lineage (including column-level) from DBT manifests, Redshift logs, and Glue jobs
- Implement lineage visualization for impact analysis and change management (OpenLineage / custom connectors)
- Develop automated metadata ingestion & data profiling workflows
Reasons to use Rodeo
Start with a chat, not a search bar
Grad scheme, placement, apprenticeship? Not sure what you want yet — that's fine. Your agent talks it through with you and turns "I have no idea" into a shortlist.
It searches the market for you
Every day your agent scans the market matching roles against what actually matters to you, not just keywords on a CV.
Only hits
No noise. No "maybe this fits." Just roles with a clear explanation of why they're right — and where to focus when applying.
AWS Platform & Governance
- Manage SMUS environments: domain setup, user roles, project structures
- Leverage Lake Formation for fine-grained access control and governed tables
- Work with Glue crawlers/classifiers to feed metadata into SMUS
- Optimize Redshift metadata extraction (SVL/SVV views, query history, DDLs)
- Implement IaC (Terraform / CloudFormation) for repeatable deployments
- Monitor catalog completeness, lineage coverage, and metadata freshness
Technical Requirements
Core Skills
- Python for automation, metadata extraction, and API integrations
- Strong SQL — system catalogs, DDL parsing, complex transformations
- Data modeling knowledge (star/snowflake, Informatica, data vault) to interpret lineage
- Git, CI/CD, and infrastructure-as-code (Terraform)
Get help with your application
Your very own career expert that helps elevate your application to the next level.
AWS & Catalog Expertise
- SMUS: governance policies, catalog features, lineage visualization
- Glue: Data Catalog, crawlers, classifiers, schema registry
- Redshift: system views (SVL/SVV), Spectrum metadata, DDL management
- Lake Formation: fine-grained permissions, tag-based access control
- S3 / Lambda / Step Functions: storage & serverless metadata workflows
- Experience with a catalog platform (SMUS, DataHub, Collibra, Alation, OpenMetadata)
- Knowledge of OpenLineage, Marquez, or custom lineage frameworks
- Data quality frameworks (Great Expectations, Soda, DBT tests) integrated into catalog
- Governance principles: data ownership, stewardship, access policies, compliance
Nice-to-Have
- Apache Iceberg / Hudi table formats; data mesh & federated governance
- Graph databases / knowledge graphs for lineage; event-driven metadata capture (Kinesis, EventBridge)
“It took my CV and asked me questions relevant to understanding what kind of jobs to suggest for me. Suggestions were almost perfect. Jobs were exactly what I’ve been looking for.”
Jessica, London
Skills
Location