Collaborating Expert on the development of a validation framework for AI systems

4 dagen geleden

Amsterdam, Nederland The European Medicines Agency (EMA) Voltijd

Organizational Unit:

 Data Analytics and Methods Task Force

Real World Evidence Office

Place of work: Flexible (occasionally on EMA premises and remote).

The position is  part time . The successful candidate will be able to dedicate 16-25 hours per week to the collaboration.

Proposed length : 6 months(extendable if needed). 

Remuneration:  Experts should be salaried by their employer or be a post-graduate student (financed by their educational entity or self-financed). 

The European Medicines Agency is a decentralized body of the European Union with all its offices and Headquarters based in Amsterdam, the Netherlands. Its core responsibility is the protection and promotion of public and animal health through the evaluation and supervision of medicines.

The Collaborating Expert Programme is addressed to scientists and professionals who can share their expertise in a particular area of European Medicines Agency’s activities or are interested in collaborative research projects related to EMA’s scientific work.

The aim is to provide a mechanism for EMA and external researchers to collaborate in identifying and tackling important research questions to support regulatory decision-making.

This will help ensure that regulatory science remains at the cutting edge so that EMA can deliver its fundamental mission of protecting human and animal health and facilitating the availability of medicines to patients.

Strategic area / objective

MAWP Focus area 2.2. Data analytics, digital tools and digital transformation

EMA aims to enable the safe and responsible use of AI for the benefit of public and animal health. 
Critical to that aim is the ability to validate consistently the performance characteristics of different AI systems including identifying the relevant metrics to measure performance, defining the counterfactual (what AI is measured against, the gold standard) depending on the type of AI and defining how to communicate this information and update it along the lifecycle of the AI system. 

Specific projects

• The collaborating expert will help create a framework to validate AI systems implemented at EMA and monitor performance, including how to identify relevant metrics to measure performance, how to define the counterfactual, the type and level of documentation required (including, e.g. creating model fiches, or considering how model repositories can be implemented) and how to ensure prospective validation along the lifecycle of the AI system, among other activities. These activities will be aligned to the requirements of the AI Act.
• To conduct the above, the collaborating expert will be involved in the development of AI systems, specifically those based on large language models, that will serve as use cases for the development of the framework above.
• The collaborating expert will also be expected to communicate and engage with stakeholders on methods to validate AI systems based on LLMs, including e.g. the AI SIA.

Deliverables

• Scientific article in a peer reviewed journal
• Evaluation tools developed and implemented on at least one LLM developed within EMA.
• A proposed framework for validation of AI systems including documentation artefacts, such as model fiches.

Benefits for the expert

• Gain experience in the field of AI in the EU regulatory context
• Contribution to the development of AI tools to be used in the regulatory setting
• Gain experience of working in an EU organisation and of the EMA’s work and role in regulatory science
• Building a personal and inter-institutional collaboration with EMA

Benefits for the collaborating institution

• Exchange of knowledge and expertise
• Knowledge transfer 
• Joint research undertaking, and if publication, joint publication

Essential requirements

Eligibility criteria:
• Be an EU or EEA national
• Meet the requirements stated in the profile description;
• Be a paid employee from European academia, research institutions, public sector or international organisations, or a post graduate student within such organisations. Proof of employment/student status and agreement in principle of employer/academic institution will be requested.;
• Have a thorough knowledge of English (at least level C1). Good knowledge of another official EU language (at least B2) is an asset, as per the Common European Framework for Languages.

University degree(s)
Essential : PhD or Master’s degree in mathematics, or related fields
Desirable : Experience in development and assessment of quantitative methods used in drug development and evaluation

Experience and additional skills
Essential: 
•  Demonstrated experience in writing, analysis and reporting of results in scientific reports and peer-reviewed publications
• Demonstrated knowledge in the field of AI
Desirable: 
Knowledge of regulatory environment

Behavioural competencies
Essential: 
• Communication skills 
• Interpersonal skills - dynamic, motivated and organised
• Working with others but also with some degree of autonomy
• Adaptability

______________________________________________________________________________________________________

  • Collaborating Expert on experimentation and validation of AI and LLM

    4 dagen geleden

    Amsterdam, Nederland The European Medicines Agency (EMA) Voltijd

    Organizational Unit:  Digital Business Transformation Task Force Digital Change Office Place of work: Flexible (occasionally on EMA premises and remote). The position is  part time . The successful candidate will be able to dedicate 16 hours per week to the collaboration. Proposed length : 9 months(extendable if needed).  ...

  • Collaborating Expert on risk assessment of the use of AI in medicines regulation

    4 dagen geleden

    Amsterdam, Nederland The European Medicines Agency (EMA) Voltijd

    Organizational Unit:  Data Analytics and Methods Task Force Not applicable TDA Office Place of work: Flexible (occasionally on EMA premises and remote). The position is  part time . The successful candidate will be able to dedicate 8 hours per week to the collaboration. Proposed length : 6 months(extendable if needed).  Remuneration:...

  • Collaborating Expert On Risk Assessment of The Use

    4 dagen geleden

    Amsterdam Zuid, Nederland European Medicines Agency Voltijd

    **Organizational Unit**: Data Analytics and Methods Task Force Not applicable TDA Office **Place of work**: Flexible (occasionally on EMA premises and remote). **Proposed length**: 6 months(extendable if needed). **Remuneration**: Experts should be salaried by their employer or be a post-graduate student (financed by their educational entity or...

  • Postdoc On Trustworthy Ai-based Systems for

    1 week geleden

    Amsterdam, Nederland Universiteit van Amsterdam Voltijd

    Postdoc on Trustworthy AI-based Systems for Sustainable Growth **Faculteit/Dienst**:Faculteit der Natuurw., Wiskunde & Informatica**Opleidingsniveau**:Gepromoveerd**Functie type**:Wetenschappelijk Personeel**Sluitingsdatum**:10 juni 2024**Vacaturenummer**:13000- Are you interested in making contributions to trustworthy AI-based systems **and** in...

  • Ai Embedded Software Intern

    1 week geleden

    Amsterdam, Noord-Holland, Nederland Axelera AI Voltijd

    About UsAxelera AI stands at the forefront of the semiconductor industry, driving advancements in artificial intelligence acceleration.In just over 2 years, we've assembled a team of over 140 brilliant engineers, developers, and business experts from across the globe. Guided by the brightest minds in the AI sphere and supported by renowned innovation leaders...

  • Postdoc On Trustworthy Ai-based Systems for

    1 week geleden

    Amsterdam, Noord-Holland, Nederland Universiteit van Amsterdam Voltijd

    Postdoc on Trustworthy AI-based Systems for Sustainable GrowthFaculteit/Dienst:Faculteit der Natuurw, Wiskunde & InformaticaOpleidingsniveau:GepromoveerdFunctie type:Wetenschappelijk PersoneelSluitingsdatum:10 juni 2024Vacaturenummer:13000- Are you interested in making contributions to trustworthy AI-based systems and in understanding and uncovering policy...

  • Collaborating Expert-Analysis of early stakeholder interaction and advice on RWE/RWD related topics

    4 dagen geleden

    Amsterdam, Nederland The European Medicines Agency (EMA) Voltijd

    Organizational Unit:  Data Analytics and Methods Task Force Real World Evidence Office Place of work: Flexible (occasionally on EMA premises and remote). The position is  part time . The successful candidate will be able to dedicate 16-24 hours per week to the collaboration. Proposed length : 8 months(extendable if needed).  ...

  • Postdoc on Trustworthy AI-based Systems for Sustainable Growth

    1 maand geleden

    Amsterdam, Nederland Universiteit van Amsterdam Voltijd

    What are you going to do ? This one-year position is part of the ten-year ROBUST program, an initiative of ICAI, the national Innovation Center for Artificial Intelligence. The position is based in Amsterdam, with leading experts Roel Dobbe (Delft University of Technology) and Maarten de Rijke (University of Amsterdam) as supervisors. You will have...

  • Postdoc on Trustworthy AI-based Systems for Sustainable Growth

    4 weken geleden

    Amsterdam, Nederland Universiteit van Amsterdam Voltijd

    What are you going to do ? This one-year position is part of the ten-year ROBUST program, an initiative of ICAI, the national Innovation Center for Artificial Intelligence. The position is based in Amsterdam, with leading experts Roel Dobbe (Delft University of Technology) and Maarten de Rijke (University of Amsterdam) as supervisors. You will have...

  • Ai Training for Dutch Writers

    1 week geleden

    Amsterdam, Nederland Outlier AI Voltijd

    FOR DUTCH WRITING EXPERTS ONLY **Are you interested in helping to train AI models to become better writers?** **How it works**: - We have several open projects where we are looking for talented writers to help train generative artificial intelligence models to become better Dutch writers. - You can work on all of our projects remotely. Hours are flexible,...

  • Collaborating Expert On Contribution of Rwe to The

    4 dagen geleden

    Amsterdam Zuid, Nederland European Medicines Agency Voltijd

    **Organizational Unit**: Data Analytics and Methods Task Force Real World Evidence Office **Place of work**: Flexible (occasionally on EMA premises and remote). **Proposed length**: 12 months(extendable if needed). **Remuneration**: Experts should be salaried by their employer or be a post-graduate student (financed by their educational entity or...

  • Trainee (Healthcare Data Analyst with a Focus On Ai

    3 weken geleden

    Amsterdam Zuid, Nederland European Medicines Agency Voltijd

    **Selection procedure reference**: EMA/TR/10442 The European Medicines Agency (EMA) is a decentralised agency of the European Union (EU), located in Amsterdam. It began operating in 1995. It is responsible for the scientific evaluation, supervision and safety monitoring of medicines in the EU. - About the traineeship programme- The Agency is looking for...

  • Applied Scientist, Ring AI

    2 maanden geleden

    Amsterdam, Nederland Ring of Security B.V. - H42 Voltijd

    Are you fueled by a passion for computer vision, machine learning and AI, and are eager to leverage your skills to enrich the lives of millions across the globe? Join us at Ring AI team, where we're not just offering a job, but an opportunity to revolutionize safety and convenience in our neighborhoods through cutting-edge innovation. You will be part of a...

  • Ai Training for Dutch Writers

    1 week geleden

    Amsterdam, Noord-Holland, Nederland Outlier AI Voltijd

    FOR DUTCH WRITING EXPERTS ONLYAre you interested in helping to train AI models to become better writers?How it works: We have several open projects where we are looking for talented writers to help train generative artificial intelligence models to become better Dutch writers. You can work on all of our projects remotely. Hours are flexible, so you can work...

  • AI Engineer

    2 dagen geleden

    Amsterdam, Noord-Holland, Nederland &Work Voltijd

    At IntelliGents, we are dedicated to equipping our team with the necessary tools. You'll be provided with the latest Macbook Pro, empowering you to seamlessly contribute to AI development and image generation from the comfort of your home office. If you're an AI developer seeking a balance of impactful work and the benefits of remote collaboration, consider...

  • Applied Scientist II, Ring AI

    4 weken geleden

    Amsterdam, Nederland Ring of Security B.V. - H42 Voltijd

    Are you fueled by a passion for computer vision, machine learning and AI, and are eager to leverage your skills to enrich the lives of millions across the globe? Join us at Ring AI team, where we're not just offering a job, but an opportunity to revolutionize safety and convenience in our neighborhoods through cutting-edge innovation. You will be part of a...

  • Applied Scientist, Ring AI

    1 week geleden

    Amsterdam, Noord-Holland, Nederland Ring of Security B.V. - H42 Voltijd

    Are you fueled by a passion for computer vision, machine learning and AI, and are eager to leverage your skills to enrich the lives of millions across the globe? Join us at Ring AI team, where we're not just offering a job, but an opportunity to revolutionize safety and convenience in our neighborhoods through cutting-edge innovation. You will be part of a...

  • Applied Scientist II, Ring AI

    1 week geleden

    Amsterdam, Noord-Holland, Nederland Ring of Security B.V. - H42 Voltijd

    Are you fueled by a passion for computer vision, machine learning and AI, and are eager to leverage your skills to enrich the lives of millions across the globe? Join us at Ring AI team, where we're not just offering a job, but an opportunity to revolutionize safety and convenience in our neighborhoods through cutting-edge innovation. You will be part of a...

  • Senior Consultant Model Validation

    2 maanden geleden

    Amsterdam, Nederland Protiviti Voltijd

    Protiviti The Netherlands advises appealing national and international clients in various market segments. Our team (over 100 FTE) consists of experienced, ambitious management consulting professionals that are specialised in the field of Risk Management. Our company culture is based on team spirit, professionalism and entrepreneurial spirit in an informal...

  • Collaborating Expert in Developing and Applying

    4 dagen geleden

    Amsterdam Zuid, Nederland European Medicines Agency Voltijd

    **Organizational Unit**: Stakeholders & Communication Division Not applicable Public Engagement & Stakeholders Office **Place of work**: Flexible (occasionally on EMA premises and remote). **Proposed length**: 9-12 months(extendable if needed). **Remuneration**: Experts should be salaried by their employer or be a post-graduate student (financed by their...