PhD Position in 3D Perception and Large Language Models

2 maanden geleden


Delft, Nederland Delft University of Technology Voltijd

3D Perception and Large Language Models Job description

The world we inhabit is highly structured. Consider how humans operate in a 3D environment, where passive objects and active agents (e.g. machines, humans, and animals) coexist. Understanding scenes and spatial awareness is fundamental for enabling robots to interact with their surroundings effectively. Just as humans intuitively break down scenes into object-centric representations, robots can benefit from information about object types, their appearance, constituent parts, and their position and orientation in 3D space.

This PhD project is designed to enhance the environmental understanding of robots in a manufacturing setting, where they need to collaborate with each other and humans. This project aims to contribute to the field by utilizing large language models to support the robots’ perception and improve their communication capabilities.

We are looking for a highly motivated PhD candidate to join our team and work on cutting-edge research in 3D perception, scene understanding and large language models.

Your Role:

Use cutting-edge 3D computer vision and machine learning methods Design and set up experiments Deploy your algorithms on robots Write well-documented code Prepare demonstrators Write scientific papers Guide Master's students Connect with academic and industry partners and promote your work

This position is situated at the p4MARS research group within the Faculty of Aerospace Engineering of the Technical University of Delft. p4MARS is a young research group working on robot perception for manufacturing and space applications.

Delft University of Technology is a world-renowned institution ranked 3rd globally in Aeronautical, Manufacturing and Mechanical Engineering. As a member of the prestigious IDEA League, our collaborative culture and innovative spirit offer endless opportunities for personal and professional growth. Join our community of over 23,000 students and 3,300 scientific staff and be part of shaping the future of technology. Requirements

Master's degree in Aerospace/Mechanical/Electrical Eng., Computer Science, Applied Math or related disciplines Strong programming skills in Python and/or C++ Knowledge in machine learning and deep learning methods and LLMs Knowledge in OpenCV, ROS, and Gazebo Well organized and excellent in time management Excellent command of English and communication skills

Doing a PhD at TU Delft requires English proficiency at a certain level to ensure that the candidate is able to communicate and interact well, participate in English-taught Doctoral Education courses, and write scientific articles and a final thesis. Conditions of employment

Doctoral candidates will be offered a 4-year period of employment in principle, but in the form of 2 employment contracts. An initial 1,5 year contract with an official go/no go progress assessment within 15 months. Followed by an additional contract for the remaining 2,5 years assuming everything goes well and performance requirements are met.

Salary and benefits are in accordance with the Collective Labour Agreement for Dutch Universities, increasing from € 2770 per month in the first year to € 3539 in the fourth year. As a PhD candidate you will be enrolled in the TU Delft Graduate School. The TU Delft Graduate School provides an inspiring research environment with an excellent team of supervisors, academic staff and a mentor. The Doctoral Education Programme is aimed at developing your transferable, discipline-related and research skills.

The TU Delft offers a customisable compensation package, discounts on health insurance, and a monthly work costs contribution. Flexible work schedules can be arranged.

For international applicants, TU Delft has the Coming to Delft Service. This service provides information for new international employees to help you prepare the relocation and to settle in the Netherlands. The Coming to Delft Service offers a Dual Career Programme for partners and they organise events to expand your (social) network. TU Delft (Delft University of Technology)

Delft University of Technology is built on strong foundations. As creators of the world-famous Dutch waterworks and pioneers in biotech, TU Delft is a top international university combining science, engineering and design. It delivers world class results in education, research and innovation to address challenges in the areas of energy, climate, mobility, health and digital society. For generations, our engineers have proven to be entrepreneurial problem-solvers, both in business and in a social context.

At TU Delft we embrace diversity as one of our core values and we actively engage to be a university where you feel at home and can flourish. We value different perspectives and qualities. We believe this makes our work more innovative, the TU Delft community more vibrant and the world more just. Together, we imagine, invent and create solutions using technology to have a positive impact on a global scale. That is why we invite you to apply. Your application will receive fair consideration.

Challenge. Change. Impact Faculty Aerospace Engineering

The Faculty of Aerospace Engineering at Delft University of Technology is one of the world’s most highly ranked (and most comprehensive) research, education and innovation communities devoted entirely to aerospace engineering. More than 200 science staff, around 270 PhD candidates and close to 3000 BSc and MSc students apply aerospace engineering disciplines to address the global societal challenges that threaten us today, climate change without doubt being the most important. Our focal subjects: sustainable aerospace, big data and artificial intelligence, bio-inspired engineering and smart instruments and systems. Working at the faculty means working together. With partners in other faculties, knowledge institutes, governments and industry, both aerospace and non-aerospace. Working in field labs and innovation hubs on our university campus and beyond.



  • Delft, Zuid-Holland, Nederland Delft University of Technology Voltijd

    3D Perception and Large Language ModelsJob descriptionThe world we inhabit is highly structured. Consider how humans operate in a 3D environment, where passive objects and active agents (e.g. machines, humans, and animals) coexist. Understanding scenes and spatial awareness is fundamental for enabling robots to interact with their surroundings effectively....


  • Delft, Nederland TU Delft Voltijd

    Job description The world we inhabit is highly structured. Consider how humans operate in a 3D environment, where passive objects and active agents (e.g. machines, humans, and animals) coexist. Understanding scenes and spatial awareness is fundamental for enabling robots to interact with their surroundings effectively. Just as humans intuitively...


  • Delft, Nederland TU Delft Voltijd

    PhD Position Aerodynamics and Aeroelasticity of Extra-Large Wind Turbines- Job description The energy transition necessitates a substantial expansion of wind energy, requiring a six-fold increase in the current installed wind energy capacity. Increased turbine sizes with larger rotor diameters that capture more wind power are an important cost reduction...


  • Delft, Zuid-Holland, Nederland TU Delft Voltijd

    Job OverviewThe energy transition requires a significant expansion of wind energy, necessitating a substantial increase in installed capacity. To achieve this, larger turbine sizes with increased rotor diameters are being developed, capturing more wind power and reducing costs. This PhD project is part of the NEXTgenT MSCA Doctoral Networks, aiming to train...


  • Delft, Nederland TU Delft Voltijd

    PhD Position Modeling and Monitoring of Fiber-reinforced Composite Ships Under Extreme Loads- **_This PhD position deals with development of innovative modeling and monitoring methods for ship structures made of fiber-reinforced composites under extreme loads._** Job description Fiber-reinforced composite (FRC) structural members offer significant...


  • Delft, Zuid-Holland, Nederland TU Delft Voltijd

    Job Description**Autonomous Vehicle Perception Researcher**We are seeking a highly skilled researcher to join our team at TU Delft to work on a project focused on developing foundation models for radar-based autonomous vehicle perception. The successful candidate will have a strong background in sensor processing, machine learning, and deep learning, with a...


  • Delft, Zuid-Holland, Nederland TU Delft Voltijd

    Job OverviewThe energy transition requires a significant expansion of wind energy, necessitating a substantial increase in installed capacity. To achieve this, larger turbine sizes with increased rotor diameters are being developed, capturing more wind power and reducing costs. This PhD project is part of the NEXTgenT MSCA Doctoral Networks, aiming to train...


  • Delft, Nederland Delft University of Technology Voltijd

    Job description The energy transition necessitates a substantial expansion of wind energy, requiring a six-fold increase in the current installed wind energy capacity. Increased turbine sizes with larger rotor diameters that capture more wind power are an important cost reduction driver. It is foreseen that the rated capacity of OWTs will continue to grow,...


  • Delft, Nederland TU Delft Voltijd

    Job description The energy transition necessitates a substantial expansion of wind energy, requiring a six-fold increase in the current installed wind energy capacity. Increased turbine sizes with larger rotor diameters that capture more wind power are an important cost reduction driver. It is foreseen that the rated capacity of OWTs will...


  • Delft, Nederland TU Delft Voltijd

    PhD Position Process-based modeling of fluvial deposits at (sub)reservoir scale- **_Challenge: Predicting subsurface properties and their heterogeneity._** **_ Change: Simulating the processes that built the rock record._** **_ Impact: Better managing subsurface resources like water and heat._** Job description From freshwater to energy and raw...


  • Delft, Nederland TU Delft Voltijd

    PhD Position Physics-Aware Foundation Models for Climate Research- Job description This PhD project will address the following fundamental challenges on how to achieve this for practical large-scale systems.: - Developing a large-scale physically consistent FM: You will integrate atmosphere, surface, and subsurface earth observations to develop FMs for...


  • Delft, Nederland TU Delft Voltijd

    PhD Position Improving the Quantification and Mitigation of the Climate Impact of Aviation Contrails by Use of Observational Data- Challenge: Improve understanding and modeling of aviation contrails and their climate impact. Change: Use observational data to improve and develop models. Impact: Contribute to sustainable aviation. Job description Contrails...


  • Delft, Zuid-Holland, Nederland TU Delft Voltijd

    Job DescriptionWe are seeking a highly motivated and skilled researcher to join our team at TU Delft and contribute to the development of innovative climate finance mechanisms and adaptation strategies. The successful candidate will work on a PhD project focused on quantifying the national and regional distribution effects of private and public adaptation...

  • Phd Position Immersive Lab

    6 dagen geleden


    Delft, Nederland TU Delft Voltijd

    PhD Position Immersive Lab- **_Immersive Data Visualization and Virtual Environments._** Immersive technologies, such as virtual reality (VR), augmented reality (AR), and mixed reality (MR), can transform how we perceive, interact, and communicate with the world and each other. Job description The Immersive AI Lab will be structured around several...

  • PhD Position Immersive Lab

    6 dagen geleden


    Delft, Nederland Delft University of Technology Voltijd

    Immersive Data Visualization and Virtual Environments. Immersive technologies, such as virtual reality (VR), augmented reality (AR), and mixed reality (MR), can transform how we perceive, interact, and communicate with the world and each other. Job description TU Delft together with Erasmus have created the Immersive AI Lab. Here, we want to help unlock more...

  • PhD Position Immersive Lab

    6 dagen geleden


    Delft, Nederland TU Delft Voltijd

    Job description TU Delft together with Erasmus have created the Immersive AI Lab. Here, we want to help unlock more of the potential of immersive technologies by exploring fundamental questions and innovative application contexts. Our goal is to gain insights that are generally applicable, while simultaneously opting for concrete outcomes that...


  • Delft, Zuid-Holland, Nederland TU Delft Voltijd

    Job DescriptionThe emergence of general-purpose large AI models, known as "foundation models," has revolutionized the field of artificial intelligence. However, their application to critical areas like climate, environment, and natural energy often lacks interpretability and reliability. Integrating principles of physical consistency into these models is...


  • Delft, Nederland TU Delft Voltijd

    PhD Position Impact of Demographic and Societal Developments on Police Operations- Teaser **_Challenge_**_: Developing models geared to decision-making under deep uncertainty._ **_ Change_**_: Leveraging different scopes in system dynamics modelling._ **_ Impact_**_: Enabling decision-making geared to long-term police strategies and policies._ Job...


  • Delft, Nederland TU Delft Voltijd

    PhD Position Effective Metadata Management for Data-Driven Plant Resilience Enhancement- **_Join us in advancing the frontier of plant sciences and making a tangible impact on agricultural resilience through the power of machine learning!_** Job description This exciting opportunity will involve analyzing the research gaps for establishing effective...


  • Delft, Zuid-Holland, Nederland TU Delft Voltijd

    Job DescriptionThe emergence of general-purpose large AI models, known as "foundation models," has marked a significant advancement in AI. However, their application to critical areas like climate, environment, and natural energy often lacks interpretability and reliability, largely due to their data-driven nature. Integrating principles of physical...