PhD Position: Investigating Human Biases in AI-Assisted Systematic Reviews

1 week geleden


Utrecht, Utrecht, Nederland Sticky Voltijd
About the Position

We are seeking a highly motivated PhD researcher to join our team at Sticky, a leading institution in the field of social sciences. The successful candidate will have the opportunity to work on a cutting-edge project that explores the intersection of human judgment and AI in systematic reviewing.

Project Overview

The project, titled "Transparent and Reproducible AI-aided Systematic Reviewing for the Social Sciences (TRASS)", aims to investigate the nuances of human biases in AI-assisted systematic reviews. The researcher will be responsible for conducting high-quality experiments to address questions such as:

  • Which biases, such as position bias or authority bias, do humans display when reviewing abstracts?
  • How does knowledge about these biases generalize to other contexts, such as in doing research and university work generally?
  • Should we replace human screeners with an AI, or should we keep a human in the loop?
  • How do (or should) humans interact with AI-aided screening models spotlighting potential biases inherent in AI-assisted processes?
  • How can we reduce biases by humans and AI?
Requirements

We are looking for an enthusiastic colleague who meets multiple of the following requirements:

  • You have (completed or almost completed) a Research Master's degree in Psychology, Sociology, Methods & Statistics, Organisation Science, Economics, Management, Public Administration, or a similar study.
  • You have the ambition to conduct excellent scientific research and are motivated to create an impact with your research.
  • You have an affinity with transdisciplinary research.
  • You have demonstrable affinity and experience with quantitative research such as (field/lab) experiments and/or questionnaires.
  • You need an interest in systematic reviewing and AI-aided techniques, or have used software like ASReview, to accelerate the screening process.
  • You have an affinity with or strong interest in machine learning / AI / NLP.
  • You have a demonstrable affinity with open science, open-code and/or open-source software.
  • You have experience with R (Markdown) or Python (Jupyter Notebooks).
  • You are familiar with Github.
  • You have excellent verbal and written communication skills in English (or Dutch), which you can prove with for instance your Bachelor's or Master's thesis.
  • You are social, well-organised, communicative, and collaborative.
  • You are interested in contributing to high-quality teaching, including supervising students, teaching lectures in data science and statistics.
What We Offer

We offer:

  • a collaborative, enthusiastic, and dedicated team that guides you in your research, teaching, and other tasks;
  • high-quality PhD education, being part of a research school, following courses, presenting at international conferences, etc.;
  • a position for 4-4,5 years (depending on the amount of teaching);
  • a working week of 38 hours and a gross monthly salary between €2,770 and €3,539 in the case of full-time employment (salary scale P under the Collective Labour Agreement for Dutch Universities (CAO NU));
  • 8% holiday pay and 8.3% year-end bonus;
  • a pension scheme, partially paid parental leave and flexible terms of employment based on the CAO NU.
About Us

A better future for everyone. This ambition motivates our scientists in executing their leading research and inspiring teaching. At Sticky, the various disciplines collaborate intensively towards major societal challenges. Our focus is on Dynamics of Youth, Institutions for Open Societies, Life Sciences and Pathways to Sustainability.

The Faculty of Social and Behavioural Sciences is one of the leading faculties in Europe providing research and academic teaching in cultural anthropology, educational sciences, interdisciplinary social science, pedagogical sciences, psychology, and sociology. Almost 7,000 students are enrolled in a broad range of and programmes. The Faculty of Social and Behavioural Sciences has some 1,100 faculty and staff members, all providing their individual contribution to the training and education of young talent and to the research into and finding solutions for scientific and societal issues. The faculty is located at near the historical city centre of Utrecht.

The current project will be part of the DISC-AI-lab (), one of the official at Utrecht University. You will be officially appointed at the Methodology and Statistics Department of the Faculty of Social and Behavioural Sciences and will work one day per week in the AI-lab with Rens van de Schoot. The other days you work at the Utrecht School of Governance and will be part of the Public Management Research group, where Lars Tummers and Henrico van Roekel are also situated. You can work 1-2 days a week from home.



  • Utrecht, Utrecht, Nederland Sticky Voltijd

    About the PositionWe are seeking a highly motivated and talented PhD candidate to join our team at Sticky, a leading organization in the field of AI-assisted systematic reviewing. The successful candidate will have the opportunity to work on a cutting-edge project that explores the intersection of human judgment and AI in systematic reviewing.Research...


  • Utrecht, Utrecht, Nederland Sticky Voltijd

    About the PositionWe are seeking a highly motivated PhD researcher to join our team at Sticky, a leading organization in the field of AI-assisted systematic reviewing. The successful candidate will have the opportunity to contribute to a groundbreaking project that aims to understand the nuances of human biases in AI-assisted systematic reviewing.Key...


  • Utrecht, Utrecht, Nederland Sticky Voltijd

    About the ProjectWe are seeking a highly motivated PhD researcher to join our team in investigating the complex dynamics of human biases in AI-assisted systematic reviewing. This project aims to explore the nuances of human-AI collaboration and its implications for the systematic review process.Key ResponsibilitiesConduct high-quality experiments to...


  • Utrecht, Utrecht, Nederland Sticky Voltijd

    About the ProjectWe are seeking a highly motivated PhD researcher to join our team and contribute to a groundbreaking project that explores the intersection of human judgment and AI in systematic reviewing. The project aims to investigate the complex dynamics of human-AI collaboration and its implications for systematic reviewing.Key ResponsibilitiesConduct...


  • Utrecht, Utrecht, Nederland Sticky Voltijd

    About the ProjectWe are seeking a highly motivated PhD researcher to join our team and contribute to the Transparent and Reproducible AI-aided Systematic Reviewing for the Social Sciences (TRASS) project. This project aims to explore the nuances of human biases in AI-assisted systematic reviewing and develop strategies to mitigate these biases.Research...


  • Utrecht, Utrecht, Nederland Sticky Voltijd

    About the ProjectWe are seeking a highly motivated PhD researcher to join our team in investigating the complex dynamics of human biases in AI-assisted systematic reviewing. This project aims to explore the nuances of human-AI collaboration and its implications for the systematic review process.Research QuestionsWhich biases, such as position bias or...


  • Utrecht, Utrecht, Nederland Sticky Voltijd

    About the PositionWe are seeking a highly motivated PhD researcher to join our team at Sticky, a leading organization in the field of AI-assisted systematic review. The successful candidate will have the opportunity to work on a cutting-edge project that aims to develop optimal models for AI-assisted systematic review.Key ResponsibilitiesConduct high-quality...


  • Utrecht, Utrecht, Nederland Sticky Voltijd

    About the RoleWe are seeking a highly motivated PhD researcher to join our team at Sticky, a leading institution in the field of AI-assisted systematic review. As a PhD researcher, you will be responsible for conducting high-quality simulation studies combining active learning models and large language models to test their performance on 500+ labeled...


  • Utrecht, Utrecht, Nederland Sticky Voltijd

    About the RoleWe are seeking a highly motivated PhD researcher to join our team at Sticky, a leading institution in the field of AI-assisted systematic review. As a PhD researcher, you will be responsible for conducting high-quality simulation studies combining active learning models and large language models to test their performance on 500+ labeled...


  • Utrecht, Utrecht, Nederland Sticky Voltijd

    About the PositionWe are seeking a highly motivated PhD researcher to join our team at Sticky, a leading organization in the field of AI-assisted systematic review. The successful candidate will have the opportunity to work on a cutting-edge project that aims to develop and evaluate optimal AI models for systematic review.Job DescriptionThe PhD researcher...


  • Utrecht, Utrecht, Nederland UMC Utrecht Voltijd

    About the PositionWe are seeking a highly motivated PhD candidate to join our interdisciplinary department Bioethics & Health Humanities at UMC Utrecht. As a PhD student, you will conduct research on human-AI collaboration in medicine, focusing on the ethics of medical innovation and the integration of AI in clinical care.Key ResponsibilitiesConduct...


  • Utrecht, Utrecht, Nederland UMC Utrecht Voltijd

    About the PositionWe are seeking a highly motivated PhD student to join our interdisciplinary department Bioethics & Health Humanities at UMC Utrecht. As a PhD candidate, you will conduct research on human-AI collaboration in medicine, focusing on the ethics of medical innovation and the integration of AI in clinical care.Key ResponsibilitiesConduct...

  • Fellow in Medical AI Ethics

    5 dagen geleden


    Utrecht, Utrecht, Nederland UMC Utrecht Voltijd

    Job DescriptionResearcher in Human-AI CollaborationWe are seeking a highly motivated and skilled researcher to join our interdisciplinary department Bioethics & Health Humanities at UMC Utrecht. As a PhD Candidate, you will conduct ethical-empirical research and normative research into human-AI collaboration in medicine.Key ResponsibilitiesConduct research...

  • Fellow in Medical AI Ethics

    2 dagen geleden


    Utrecht, Utrecht, Nederland UMC Utrecht Voltijd

    Job DescriptionResearch Position in Medical AI EthicsWe are seeking a highly motivated and qualified researcher to join our interdisciplinary department Bioethics & Health Humanities at UMC Utrecht. As a PhD Candidate, you will conduct ethical-empirical research and normative research into human-AI collaboration in medicine.Key ResponsibilitiesConduct...


  • Utrecht, Utrecht, Nederland Universiteit Utrecht Voltijd

    About the JobWe are seeking two PhD students to join our research team at the Copernicus Institute for Sustainable Development, Utrecht University. The successful candidates will be part of the POTRANSI project, a 5-year research initiative funded by the European Research Council (ERC). The project aims to explore the power dynamics underlying social...


  • Utrecht, Utrecht, Nederland Universiteit Utrecht Voltijd

    About the JobWe are seeking a highly motivated PhD candidate to join our research group at Universiteit Utrecht. The successful candidate will work on developing novel protein sensors and artificial cells to investigate the effects of intracellular crowding on protein behavior.Key ResponsibilitiesDesign and develop advanced protein sensors for measuring...


  • Utrecht, Utrecht, Nederland Universiteit Utrecht Voltijd

    About the JobWe are seeking a highly motivated PhD candidate to join our research group at Universiteit Utrecht. The successful candidate will work on developing novel protein sensors and artificial cells to investigate the effects of intracellular crowding on protein behavior.Key ResponsibilitiesDesign and develop advanced protein sensors for measuring...


  • Utrecht, Utrecht, Nederland Universiteit Utrecht Voltijd

    {"h1": "Visual Attention Researcher Wanted", "p": "We are seeking a highly motivated PhD candidate to join our research team in the field of visual attention. As a researcher in this project, you will contribute to the development of new methods for understanding individual differences in attentional processing. Your work will involve designing and...

  • Fellow in Medical AI Ethics

    2 dagen geleden


    Utrecht, Utrecht, Nederland UMC Utrecht Voltijd

    Job DescriptionResearcher in Human-AI CollaborationWe are seeking a highly motivated and skilled researcher to join our interdisciplinary department Bioethics & Health Humanities at UMC Utrecht. As a PhD Candidate, you will conduct ethical-empirical research and normative research into human-AI collaboration in medicine.Key ResponsibilitiesConduct research...


  • Utrecht, Utrecht, Nederland Universiteit Utrecht Voltijd

    Job DescriptionWe are seeking a highly motivated PhD candidate to join our research team in the AttentionLab at Utrecht University. The successful candidate will be part of a dynamic and interdisciplinary team working on a NWO VICI project, 'EyeMdifferent', which aims to understand individual differences in visual attention processing.The PhD project will...