Jobgether
AI Observability Engineer
How your CV stacks up
Upload your CV to see how well it fits this job role
?%
Job Description: AI Observability Engineer
This position is listed on behalf of a partner company, who manages all applications and next steps. Our partner is looking for an AI Observability Engineer based in United Kingdom.
This role offers the opportunity to build and evolve the observability foundation behind advanced AI platforms. You will help ensure AI workloads, LLM applications, and cloud infrastructure remain measurable, reliable, and production-ready.
Working at the intersection of AI engineering, cloud platforms, and DevOps, you will design systems that improve visibility, performance, and operational excellence.
You will contribute to monitoring strategies, telemetry pipelines, dashboards, and automation frameworks supporting large-scale AI environments.
The role requires a strong engineering mindset, hands-on technical expertise, and the ability to transform complex operational data into actionable insights.
This is an opportunity to shape the reliability of next-generation AI infrastructure within an innovative and globally distributed environment.
Accountabilities:
- Own the tools, processes, and systems that provide visibility into AI applications, platform services, and infrastructure performance.
- Collaborate with engineering teams to improve reliability, detect issues proactively, and establish scalable observability practices.
- Design, implement, and operate observability solutions for AI workloads, including LLM and agent monitoring.
- Configure and maintain AI tracing systems to capture latency, token usage, cost, quality metrics, prompt analytics, model versions, and safety signals.
- Develop internal tooling and automation solutions using Python for instrumentation and data collection.
- Build and maintain dashboards, metrics, and monitoring solutions using Grafana, Prometheus, and cloud observability platforms.
- Instrument AI platforms and workloads to provide visibility into health, usage, performance, cost, and service-level objectives.
- Create actionable telemetry pipelines and operational insights to support platform engineering improvements.
- Manage infrastructure-as-code workflows using Terraform and maintain CI/CD pipelines for observability tooling.
- Support incident investigations, troubleshooting activities, and root-cause analysis.
- Define and improve monitoring strategies around logs, metrics, traces, alerting, SLIs, and SLOs.
- Collaborate with engineering teams to enhance reliability, scalability, and operational maturity across AI systems.
Reasons to use Rodeo
Start with a chat, not a search bar
Grad scheme, placement, apprenticeship? Not sure what you want yet — that's fine. Your agent talks it through with you and turns "I have no idea" into a shortlist.
It searches the market for you
Every day your agent scans the market matching roles against what actually matters to you, not just keywords on a CV.
Only hits
No noise. No "maybe this fits." Just roles with a clear explanation of why they're right — and where to focus when applying.
Requirements:
- 5–8 years of experience in observability, Site Reliability Engineering, platform engineering, DevOps, or cloud engineering roles.
- Strong hands-on experience with Azure Monitor, Application Insights, Log Analytics, and Managed Grafana.
- Experience working with Langfuse, Grafana, and Prometheus for AI and application monitoring.
- Solid knowledge of Terraform and CI/CD practices.
- Strong Python skills for automation, instrumentation, exporters, and internal tooling development.
- Familiarity with machine learning workloads and AI-specific observability requirements.
- Understanding of logs, metrics, traces, dashboards, alerting strategies, SLIs, and SLOs.
- Ability to work effectively in distributed, fast-paced, and collaborative environments.
- Intermediate or higher English communication skills.
Preferred Qualifications:
- Experience with PromQL and Kusto Query Language.
- Knowledge of OpenTelemetry, including Generative AI semantic conventions.
- Familiarity with LLM evaluation frameworks and AI quality measurement approaches.
- Experience building AI cost monitoring dashboards and FinOps solutions.
- Background with alerting systems, on-call processes, and incident management tooling.
- Experience with Kubernetes and AKS observability.
Get help with your application
Your very own career expert that helps elevate your application to the next level.
Benefits:
- Competitive compensation package.
- Career development and continuous learning opportunities.
- Flexible working environment with strong ownership and autonomy.
- Opportunity to work on impactful AI infrastructure and technology projects.
- Collaborative culture with highly skilled international teams.
- Chance to contribute to the evolution of next-generation AI platforms.
- Fast-paced environment focused on innovation, growth, and meaningful impact.
How Jobgether Works:
We use an AI-powered matching process to ensure your application is reviewed quickly, objectively, and fairly against the role's core requirements. Our system identifies the top-fitting candidates, and this shortlist is then shared directly with the hiring company. The final decision and next steps (interviews, assessments) are managed by their internal team.
Why Apply Through Jobgether?
Data Privacy Notice: By submitting your application, you acknowledge that Jobgether will process your personal data to evaluate your candidacy and share relevant information with the hiring employer. This processing is based on legitimate interest and pre-contractual measures under applicable data protection laws (including GDPR). You may exercise your rights (access, rectification, erasure, objection) at any time. #LI-CL1
“It took my CV and asked me questions relevant to understanding what kind of jobs to suggest for me. Suggestions were almost perfect. Jobs were exactly what I’ve been looking for.”
Jessica, London
Skills
Location