SME Careers
Attorney and Lawyer
Get notified of more jobs like this · No spam, ever
How your CV stacks up
Upload your CV to see how well it fits this job role
?%
In this hourly, remote contractor role, you will work as an Attorney / Lawyer Subject Matter Expert (SME) to review AI-generated legal responses and/or create expert legal content, evaluating reasoning quality and step-by-step issue analysis while providing precise written feedback.
You will assess solutions for accuracy, clarity, completeness, and adherence to the prompt; identify errors in legal reasoning, rule application, procedural steps, and risk/assumption handling; fact-check legal concepts and (when required) citations; write high-quality explanations and model answers that demonstrate correct legal analysis and clear communication; and rate and compare multiple responses based on correctness and reasoning quality. This role is with SME Careers, a fast-growing AI Data Services company and subsidiary of SuperAnnotate, delivering training data for many of the world’s largest AI companies and foundation-model labs. Your legal expertise directly helps improve the world’s premier AI models by making their legal reasoning more accurate, reliable, and clearly explained.
Important
Reasons to use Rodeo
Start with a chat, not a search bar
Grad scheme, placement, apprenticeship? Not sure what you want yet — that's fine. Your agent talks it through with you and turns "I have no idea" into a shortlist.
It searches the market for you
Every day your agent scans the market matching roles against what actually matters to you, not just keywords on a CV.
Only hits
No noise. No "maybe this fits." Just roles with a clear explanation of why they're right — and where to focus when applying.
There is no immediate project for this role; however, if qualified, you will be among the first experts we reach out to when relevant opportunities arise. This will also provide you with access to future projects available through our expert network.
Get help with your application
Your very own career expert that helps elevate your application to the next level.
Key Responsibilities
- Develop AI Training Content: Create detailed prompts and gold-standard legal outputs (issue analyses, drafting examples, checklists, policies, and memos).
- Optimize AI Performance: Evaluate and rank AI responses to improve correctness, clarity, defensibility, and risk awareness.
- Ensure Model Integrity: Test AI outputs for inaccuracies, misleading certainty, confidentiality risks, and bias; validate reliability across legal scenarios.
Your Profile
- JD/LLB (or equivalent law degree) and active bar membership (or eligibility) in at least one jurisdiction.
- 5+ years of professional experience practicing law (law firm, in-house, government, or legal aid).
- Strong ability to perform issue spotting and structured legal analysis (rules → application → conclusion), including identifying assumptions and uncertainty.
- Demonstrated experience in one or more practice areas (e.g., commercial/contracts, employment, privacy, corporate, litigation, IP, real estate, compliance).
- Strong research skills: locating and synthesizing primary authority (statutes, regulations, cases) and accurately characterizing holdings.
- Excellent drafting/editing skills: contracts/clauses, memos, letters, policies, pleadings (as applicable), with attention to precision and tone.
- Exceptional attention to detail when fact-checking and identifying overconfident claims, missing exceptions, jurisdictional pitfalls, or procedural risks; minimum C1 English proficiency.
- Comfortable evaluating answers for internal consistency, client safety, and appropriateness to context (e.g., consumer vs business, HR vs litigation).
- Reliable, self-directed, and able to deliver consistent quality in an hourly, remote contractor workflow across time zones.
- Prior experience with AI data training/annotation, legal QA, editorial review, or knowledge-management work is strongly preferred.
“It took my CV and asked me questions relevant to understanding what kind of jobs to suggest for me. Suggestions were almost perfect. Jobs were exactly what I’ve been looking for.”
Jessica, London
Location