YO IT Consulting
Astronomer QA Lead - Remote
How your CV stacks up
Upload your CV to see how well it fits this job role
?%
Astronomer QA Lead - Remote
Astronomer Quality Assurance Lead
Job Title
Astronomer Quality Assurance Lead (Contract, Remote)
About This Role
In this hourly, remote contractor role, you will serve as the Astronomer Quality Assurance Lead, overseeing quality, consistency, and trainer performance across astronomy and astrophysics AI training projects.
Key Duties
- Review AI-generated astronomy/astrophysics content and trainer/QA work, evaluating output against project guidelines.
- Assess for scientific accuracy, physical reasoning, mathematical correctness, terminology quality, unit handling, observational context, clarity, formatting, and adherence to project-specific rubrics.
- Identify recurring quality issues, communicate updates to trainers and QAs, support onboarding, maintain documentation, and activate contributors working inconsistently.
Impact
- Contribute to high-quality AI training data for leading global AI companies and foundation-model labs.
- Ensure linear, scientifically sound, well-documented astronomy/astrophysics content aligned with client expectations.
- Shape scalable QA processes for future AI training projects.
Selection Process
- AI interview
- Domain-specific task
- Interview with a recruiter
Note: While there is no immediate project, qualified candidates will be prioritised for future opportunities through the expert network.
Your Profile
Qualifications
- Bachelor’s, Master’s, or PhD in Astronomy, Astrophysics, Physics, Space Science, Planetary Science, Cosmology, or a closely related field.
- Strong command of English (for following guidelines, team communication, and feedback provision).
- 3+ years experience in:
- Astronomy/astrophysics research, teaching, science communication, academic review, data analysis, observatory work, or related scientific workflows.
- Remote team leadership or support (researchers, educators, reviewers, annotators, science writers, QAs—experience is a plus).
Reasons to use Rodeo
Start with a chat, not a search bar
Grad scheme, placement, apprenticeship? Not sure what you want yet — that's fine. Your agent talks it through with you and turns "I have no idea" into a shortlist.
It searches the market for you
Every day your agent scans the market matching roles against what actually matters to you, not just keywords on a CV.
Only hits
No noise. No "maybe this fits." Just roles with a clear explanation of why they're right — and where to focus when applying.
Subject Matter Expertise
- Deep understanding of:
- Celestial mechanics
- Stellar evolution
- Galaxies & cosmology
- Electromagnetic radiation
- Observational methods & spectroscopy
- Planetary systems & black holes
- Scientific uncertainty management
Technical & Review Skills
- Ability to review astronomy/astrophysics content against detailed rubrics, identifying:
- Incorrect physical assumptions
- Wrong units
- Flawed calculations
- "Hallucinated" facts
- Misleading explanations
- Oversimplified conclusions
Preferred Tools/Methods
Knowledge of:
- Python, astronomical datasets, telescope/observatory data, spectroscopy, photometry, simulations, LaTeX, Jupyter notebooks, or scientific visualisation.
Soft Skills & Admin
- Detail-oriented, organised, and capable of:
- Maintaining style guides, FAQs, trackers, onboarding materials, and documents.
- Managing rubric calibrations and honeypot tasks.
- Comfortable with fast-paced remote workflows using:
- Discord, Google Sheets, Google Docs, trackers, dashboards, and project management systems.
Key Responsibilities
Get help with your application
Your very own career expert that helps elevate your application to the next level.
-
Quality Monitoring
- Spot-check astronomy/astrophysics items.
- Identify recurring/critical quality issues.
- Provide timely DM feedback and escalate issues when needed.
-
Scientific Review
- Evaluate AI-generated explanations, diagrams, observational interpretations, comparisons, and reasoning for accuracy & clarity.
-
Team Communication
- Update trainers & QAs on:
- New project guidelines and workflow changes.
- Quality expectations
- Astronomy/astrophysics-specific rubrics.
- Update trainers & QAs on:
-
Question Resolution
- Answer technical queries quickly, especially around:
- Physical assumptions
- Units
- Astronomical terminology
- Observational methods
- Formulas
- Rubric applicability.
- Answer technical queries quickly, especially around:
-
Trainer/QA Activation Management
- DM inactive contributors, encourage engagement, track follow-ups, and report availability issues.
-
Documentation
- Create/maintain:
- Style guides
- FAQs
- Quality notes
- Examples
- Honeypots
- Onboarding materials
- Create/maintain:
-
Onboarding & Training
- Conduct onboarding calls covering:
- Project expectations
- Workflows
- Rubrics
- Quality standards
- Astronomy/astrophysics review requirements
- Conduct onboarding calls covering:
-
Consistency Alignment
- Ensure all trainers and QAs apply astronomy-specific guidelines consistently across evolving projects.
-
Risk Management
- Flag misleading, overconfident, physically impossible, or poorly-sourced claims.
-
Process Improvement
- Identify quality gaps and propose scalable workflow enhancements for future AI astronomy projects.
“It took my CV and asked me questions relevant to understanding what kind of jobs to suggest for me. Suggestions were almost perfect. Jobs were exactly what I’ve been looking for.”
Jessica, London
Skills