Role Overview

I'm working with a client who is scaling their Databricks platform to support AI and GenAI use cases, and they need people who can make sure it's governed properly from the start. This is about hands-on Databricks delivery, not just certifications. This is a remote first contract but you must be based in the UK. This is outside IR35.

What They're Building

• Unity Catalog as the single governance layer across data, ML models and AI assets
• Governed GenAI and agent workloads using Mosaic AI and Agent Bricks
• Secure, auditable AI pipelines from ingestion to model serving, all within the Databricks platform

Databricks Project Experience We're Looking For

• Unity Catalog implementations or migrations from Hive metastore, including metastore design, catalog and schema structure, and workspace and environment separation
• Fine-grained access control in Unity Catalog: row filters, column masks, and attribute-based access control (ABAC) with governed tags
• Unity Catalog lineage and system tables used for auditing, usage monitoring and compliance reporting
• Data classification and sensitive data tagging in Unity Catalog for PII and regulated datasets
• Mosaic AI Model Serving and AI Gateway, including access controls, rate limiting, guardrails and usage tracking
• Models in Unity Catalog via MLflow: registry, versioning, lineage and permissions, plus MLflow tracing and evaluation for GenAI applications
• Agent Bricks or the Mosaic AI Agent Framework in production, with governance over the data and tools agents can access
• Databricks Lakehouse Monitoring and data quality expectations in Lakeflow Spark Declarative Pipelines supporting AI reliability
• Delta Sharing or Databricks Clean Rooms for governed data collaboration
• Databricks Asset Bundles and CI/CD with governance policies built into deployment