Internship | Foundation models for robotics

4 weken geleden


The Hague, Nederland TNO Voltijd

About this position

Foundation models are AI models that are trained on a large amount of data and can be adapted to a wide range of applications in different domains ( The most wide-known foundation model is currently ChatGPT, developed by OpenAI. Other foundation models available to the public are DALL-E and BERT. Some models are language-only (BERT, ChatGPT), some vision only (DALL-E), but also a combination of language and vision can be found. Currently, new variants are developed combining different modalities and tasks including planning. Foundation models have the potential to improve many AI capabilities of autonomous systems, and can revolutionize robotics. In other words, foundation models have the potential for disruptive advantages in this field. For an overview of current developments, see e.g.

What will be your role?

The deployment of foundation models for robotics is promising, but also challenging. Your role would be 1) to implement a state-of-the-art foundation model in our robotics pipeline, and 2) to investigate the advantages and challenges with respect to the earlier used more traditional deep learning approaches in this pipeline. Typical questions are: in what situations will this foundation model improve the performance, what are its limitations, and how can this be optimized. Depending on your interest, also the risks of using foundation models and its compliance to legal and ethical values can be investigated.

You will perform this assignment within TNO’s Intelligent Imaging department. The Intelligent Imaging department is a passionate, creative, and dedicated team of professionals (50 people) specialized in developing groundbreaking applications in the field of computer vision. Our team members have diverse backgrounds, ranging from physics to artificial intelligence. Intelligent Imaging is a young and growing department which has built up a lot of expertise over the past years in AI and deep learning.

Keywords for this project include: foundation models, robotics, vision, planning.

What we expect from you

You are in the final stages of your Master's in artificial intelligence, computer science, physics, mathematics, electrical engineering, robotics, or a similar field and have some track record in the field of computer vision or robotics.

The project duration is flexible within the range of 6 to 12 months. Please mention in your application whether you are looking for an internship or a graduation project, the preferred duration of your project and your desired starting date.

What you'll get in return

You want to work on the precursor of your career; a work placement gives you an opportunity to take a good look at your prospective future employer. TNO goes a step further. It’s not just looking that interests us; you and your knowledge are essential to our innovation. That’s why we attach a great deal of value to your personal and professional development. You will, of course, be properly supervised during your work placement and be given the scope for you to get the best out of yourself. Furthermore, we provide:

A highly professional, innovative working environment, with top experts as colleagues. A suitable internship allowance ( euro for wo- and hbo-students, euro for mbo-students, for a full-time internship). Eight hours of leave per internship month (for a full-time internship). A free membership of , where you can meet TNO-colleagues and join , such as sports activities, (work-related) courses or the yearly ski-trip. Use of a laptop. An allowance for travel expenses in case you don’t receive an OV-card.

  • The Hague, Nederland TNO Voltijd

    About this position For robots, it’s essential to understand physical properties of objects, such as size, weight and material. Current models are not good at this. Recent developments show improvements via instructing-tuning of vision-language models, e.g. “Physically Grounded Vision-Language Models for Robotic Manipulation” ( Essentially, this...


  • The Hague, Nederland TNO Voltijd

    About this position For robots, it’s essential to understand physical properties of objects, such as size, weight and material. Current models are not good at this. Recent developments show improvements via instructing-tuning of vision-language models, e.g. “Physically Grounded Vision-Language Models for Robotic Manipulation” ( Essentially, this...


  • The Hague, Nederland TNO Voltijd

    About this position Currently, wireless communication and radar sensing are two separate worlds. This is partly because radar mainly works at high frequencies (such as mmWave radar at 77 GHz) due to the required resolution and wireless communication currently only takes place below 6 GHz. In 6G, the differences in frequency will disappear, meaning...


  • The Hague, Nederland TNO Voltijd

    About this position Currently, wireless communication and radar sensing are two separate worlds. This is partly because radar mainly works at high frequencies (such as mmWave radar at 77 GHz) due to the required resolution and wireless communication currently only takes place below 6 GHz. In 6G, the differences in frequency will disappear, meaning...


  • The Hague, Nederland TNO Voltijd

    About this position As cities strive towards creating sustainable and livable urban environments, there is increasing pressure on logistics systems to be designed with minimal impact. This research focuses on merging urban logistics models with digital twin technologies to enable smarter decision making. What will be your role? As policy...


  • The Hague, Nederland TNO Voltijd

    About this position Within military operations, tactical decisions are made to achieve specific goals during the mission. Tactical decision-making is performed at various layers (from brigades to platoons or even single soldiers) and contains key aspects like terrain analysis, fire support and maneuver, enemy assessment etc. Tactical decisions in...


  • The Hague, Nederland TNO Voltijd

    About this position Within military operations, tactical decisions are made to achieve specific goals during the mission. Tactical decision-making is performed at various layers (from brigades to platoons or even single soldiers) and contains key aspects like terrain analysis, fire support and maneuver, enemy assessment etc. Tactical decisions in...

  • Model Risk Validator

    4 weken geleden


    The Hague, Nederland Aegon Voltijd

    Description Aegon Asset Management (Aegon AM) is a leading global investor. Our 375 investment professionals manage and advise on assets of US $306 billion for a global client base of pension plans, public funds, insurance companies, banks, wealth managers, family offices and foundations. We organize our firm around four investment platforms: fixed...

  • Model Risk Validator

    4 weken geleden


    The Hague, Nederland Aegon Voltijd

    Description Aegon Asset Management (Aegon AM) is a leading global investor. Our 375 investment professionals manage and advise on assets of US $306 billion for a global client base of pension plans, public funds, insurance companies, banks, wealth managers, family offices and foundations. We organize our firm around four investment platforms: fixed...

  • Model Risk Validator

    3 weken geleden


    The Hague, Nederland Aegon Asset Management Voltijd

    Job Description SummaryJob DescriptionAegon Asset Management (Aegon AM) is a leading global investor. Our 375 investment professionals manage and advise on assets of US $306 billion for a global client base of pension plans, public funds, insurance companies, banks, wealth managers, family offices and foundations.We organize our firm around four investment...


  • The Hague, Nederland TNO Voltijd

    About this position Federated learning (FL) is a hot research topic enabling training on databases of multiple organizations while preserving the privacy of people whose personal data is stored in the databases. FL supports sharing of deep learning (DL) models between the different organizations during the training process without sharing personal...


  • The Hague, Nederland TNO Voltijd

    About this position Federated learning (FL) is a hot research topic enabling training on databases of multiple organizations while preserving the privacy of people whose personal data is stored in the databases. FL supports sharing of deep learning (DL) models between the different organizations during the training process without sharing personal...


  • The Hague, Nederland TNO Voltijd

    About this position Vision-language models for object detection, with early multimodal fusion mechanisms, are known to have issues regarding false positives. Can we improve the calibration of the object scores, in order to reduce such errors? The paper “Multi-Modal Classifiers for Open-Vocabulary Object Detection” ( improved such models to be...


  • The Hague, Nederland TNO Voltijd

    About this position Vision-language models for object detection, with early multimodal fusion mechanisms, are known to have issues regarding false positives. Can we improve the calibration of the object scores, in order to reduce such errors? The paper “Multi-Modal Classifiers for Open-Vocabulary Object Detection” ( improved such models to be...

  • Internship

    2 maanden geleden


    The Hague, Nederland HSD Campus Voltijd

    Get in touch with us about the posibilities for an internship! We are always looking for enthausiastic new interns for different types of internships. aXite Security Tools is an accredited work placement company in the Netherlands. Are you considering doing an internship at aXite Security Tools?   If you: Have a teamplayer mentality, are...


  • The Hague, Nederland TNO Voltijd

    What will be your role? TNO’s offers a wide variety of internship, MSc and PhD-level assignments. Some assignments are practical: develop prototypes of a real societal use case based using SSI technologies (e.g. on skills, health, flexwork, defense, organisation-ID, product passport, …). Other assignments are more fundamental: develop...


  • The Hague, Nederland TNO Voltijd

    What will be your role? TNO’s offers a wide variety of internship, MSc and PhD-level assignments. Some assignments are practical: develop prototypes of a real societal use case based using SSI technologies (e.g. on skills, health, flexwork, defense, organisation-ID, product passport, …). Other assignments are more fundamental: develop...


  • The Hague, Nederland Siemens Gamesa Voltijd

    It takes the brightest minds to be a technology leader. It takes imagination to create green energy for the generations to come. At Siemens Gamesa we make real what matters, join our global team. •Structural design: pre-stressed/post-stressed structures, pre-casted and in-situ structures, high performance concrete, fiber reinforced concrete,...


  • The Hague, Nederland Siemens Gamesa Voltijd

    It takes the brightest minds to be a technology leader. It takes imagination to create green energy for the generations to come. At Siemens Gamesa we make real what matters, join our global team. •Structural design: pre-stressed/post-stressed structures, pre-casted and in-situ structures, high performance concrete, fiber reinforced concrete,...


  • The Hague, Nederland TNO Voltijd

    About this position The energy transition requires the formation of new value chains for, among others, energy storage. A significant challenge in the formation of new value chains is the accurate assessment of risks. Previous TNO research has shown that it is difficult for individual investors to assess risk in other parts of the value chain. As a...