Johnson & Johnson Innovative Medicine
Post Doctoral Researcher, Evaluation & Standards in Clinical Operations
How your CV stacks up
Upload your CV to see how well it fits this job role
?%
Johnson & Johnson
At Johnson & Johnson, we believe health is everything. Our strength in healthcare innovation empowers us to build a world where complex diseases are prevented, treated, and cured, where treatments are smarter and less invasive, and solutions are personal. Through our expertise in Innovative Medicine and MedTech, we are uniquely positioned to innovate across the full spectrum of healthcare solutions today to deliver the breakthroughs of tomorrow, and profoundly impact health for humanity.
Learn more at jnj.com.
As guided by Our Credo, Johnson & Johnson is responsible to our employees who work with us throughout the world. We provide an inclusive work environment where each person is considered as an individual. At Johnson & Johnson, we respect the diversity and dignity of our employees and recognize their merit.
Job Function
Career Programs
Job Sub Function
Post Doc – Data Analytics & Computational Sciences
Job Category
Career Program
All Job Posting Locations
- Barcelona, Spain
- Beerse, Antwerp, Belgium
- High Wycombe, Buckinghamshire, United Kingdom
- Madrid, Spain
- Raritan, New Jersey, United States of America
- Titusville, New Jersey, United States of America
- Toledo, Spain
- Zug, Switzerland
Job Description
About the Role
We are deploying generative AI agents across clinical operations and global development workflows: clinical data review, anomaly detection in trial data, protocol Q&A for site teams, Informed Consent Form generation and translation, and protocol element document assembly. Each system needs rigorous evaluation. In specialized clinical contexts, "good" is not a single number. It depends on the user, the regulatory context, the therapeutic area, and the cost profile of errors.
We are looking for a postdoctoral researcher to help us develop the evaluation frameworks, rubrics, and quality systems that determine when these AI agents are ready for our scientists, clinical operations specialists, and site teams to rely on.
Key Responsibilities
- Develop evaluation frameworks and rubrics for AI agents operating in clinical operations and global development contexts
- Define quality dimensions for specialized outputs, e.g. clinical data queries, anomaly detection, protocol Q&A responses, ICF content, regulatory documents, that reflect how clinical-ops users actually judge quality
- Design and run human evaluation protocols with clinical, regulatory, and site-facing subject matter experts
- Build benchmark datasets and evaluation pipelines that the broader GenAI organization uses across AI applications
- Partner with our AI engineering teams to translate evaluation findings into measurable improvement
- Contribute to the methodology of how a regulated pharma organization evaluates AI in clinical work
Reasons to use Rodeo
Start with a chat, not a search bar
Grad scheme, placement, apprenticeship? Not sure what you want yet — that's fine. Your agent talks it through with you and turns "I have no idea" into a shortlist.
It searches the market for you
Every day your agent scans the market matching roles against what actually matters to you, not just keywords on a CV.
Only hits
No noise. No "maybe this fits." Just roles with a clear explanation of why they're right — and where to focus when applying.
What we're looking for
Domain expertise
- Strong understanding of clinical operations and global development workflows, e.g. clinical data management, monitoring, regulatory documentation, site operations, or related areas
- Familiarity with how clinical-ops specialists, monitors, regulatory authors, and site teams actually do their work and assess quality
Educational background
- PhD or equivalent research experience in a clinical, biomedical, regulatory, biostatistics, or closely related field
Enthusiasm for AI agents
- Genuine interest in working hands-on with generative AI and agentic systems
- Curiosity about how LLMs behave in specialized domains and where they fail
- Comfort prototyping with modern AI tooling (LLM APIs, vector databases, evaluation frameworks)
Aptitude for evaluation systems
- Demonstrated ability to develop frameworks, rubrics, and structured assessment protocols
- Experience designing evaluations with multiple quality dimensions, expert raters, or non-trivial inter-rater reliability considerations
- Strong analytical and writing skills; comfort with ambiguity and unsolved problems
Practical skills
- Python and the modern ML/data stack
- Comfort working across disciplines, e.g. clinical operations, regulatory affairs, AI engineering, data science
Practical details
- Duration: 2-year postdoctoral appointment
- Reports to: [TBD]
- Works closely with: Generative AI Teams, Scientific Fellow, clinical operations and regulatory subject matter experts across J&J global development
Get help with your application
Your very own career expert that helps elevate your application to the next level.
Required Skills
Preferred Skills
The anticipated pay range for this position, in the primary posting location, is: €60.000,00 - €96.255,00
The anticipated pay ranges for additional locations are:
- UK: GBP 40.100 to GBP 63.595
- SWITZERLAND: CHF 93.500 to CHF 149.615
- USA: USD 79.000 to USD 127.650
- SPAIN: EUR 43.600 to EUR 70.150
Benefits
In addition to base pay, we offer the following benefits*:
- Annual bonus with set target (% of pay) depending on pay grade / location, where the actual amount is based on the employees’ and companies’ performance of the previous calendar year, or sales commissions.
- Vacation days, parental leave for a minimum of 12 weeks, bereavement leave, caregiver leave, volunteer leave, well-being reimbursement.
- Programs for financial, physical and mental health.
- Service anniversary and recognition awards.
- Subject to the terms of their respective plans, employees - and in some location’s eligible dependents - can participate in several insurance plans.
For more information, visit Employee benefits | Supporting well-being & career growth | Johnson & Johnson Careers. *This is for informative purposes only. Amounts and actual benefits may vary by location and are subject to change.
At Johnson & Johnson, we believe health is everything. Our strength in healthcare innovation empowers us to build a world where complex diseases are prevented, treated, and cured, where treatments are smarter and less invasive, and solutions are personal. Through our expertise in Innovative Medicine and MedTech, we are uniquely positioned to innovate across the full spectrum of healthcare solutions today to deliver the breakthroughs of tomorrow, and profoundly impact health for humanity.
Learn more at https://www.jnj.com/.
Do Not Sell or Share My Personal Information
Limit the Use of My Personal Information
“It took my CV and asked me questions relevant to understanding what kind of jobs to suggest for me. Suggestions were almost perfect. Jobs were exactly what I’ve been looking for.”
Jessica, London
Skills
Location