PhD position on understanding algorithmic collusion by decentralized multiagent reinforcement learning

6 maanden geleden


Enschede, Nederland University of Twente Voltijd

How can we design decentralized multiagent reinforcement learning (MARL) algorithms with equilibrium selection control? This is the central research question of this PhD project. We will be particularly interested in determining whether decentralized MARL algorithms used for pricing or trading can learn to collaborate to raise prices. By developing an understanding of if and how this is possible, we can inform policymakers on how to regulate the use of algorithms in such environments.

To address this issue, we will begin by characterizing the probability of reaching different equilibria under the dynamics of provably convergent decentralized MARL algorithms. With this characterization in hand, we will study how design choices in the algorithmic structure affect these probabilities. These two steps will initially be executed for simple environments and with deterministic dynamics, and then they will be scaled up to more complex environments with stochastic dynamics. Our starting point will be the Decentralized Q-learning algorithm, as it offers significant flexibility in its design and is provably convergent in a large class of games.

Your profile

You are an enthusiastic and highly motivated researcher. The societal impact of your work plays an important role in your motivation. You have, or will shortly, acquire a master degree in the field of mathematics, theoretical computer science or theoretical physics (or a related field). You have a creative mindset and excellent analytical and communication skills. You have a good team spirit and like to work in an interdisciplinary and internationally oriented environment. You are proficient in English. You preferably have previous experience with reinforcement learning and/or game theory. The UT and the faculty EEMCS are inclusive toward underrepresented groups and strive to increase the proportion of female staff. Female applicants are particularly welcome.

Our offer

As a PhD candidate at UT, you will be appointed to a full-time position for four years, with a qualifier in the first year, within a very stimulating and exciting scientific environment; The University offers a dynamic ecosystem with enthusiastic colleagues; Your salary and associated conditions are in accordance with the collective labour agreement for Dutch universities (CAO-NU); You will receive a gross monthly salary ranging from € 2.770,- (first year) to € 3.539,- (fourth year); There are excellent benefits including a holiday allowance of 8% of the gross annual salary, an end-of-year bonus of 8.3%, and a solid pension scheme; The flexibility to work (partially) from home; A minimum of 232 leave hours in case of full-time employment based on a formal workweek of 38 hours. A full-time employment in practice means 40 hours a week, therefore resulting in 96 extra leave hours on an annual basis. Free access to sports facilities on campus A family-friendly institution that offers parental leave (both paid and unpaid); You will have a training programme as part of the Twente Graduate School where you and your supervisors will determine a plan for a suitable education and supervision; We encourage a high degree of responsibility and independence, while collaborating with close colleagues, researchers and other staff.

  • Enschede, Overijssel, Nederland University of Twente Voltijd

    Research Project OverviewWe are seeking a highly motivated PhD candidate to join our research team in the field of decentralized multiagent reinforcement learning. The successful candidate will be responsible for designing and developing novel algorithms for equilibrium selection control in decentralized MARL systems.Key Research QuestionsHow can we design...


  • Enschede, Overijssel, Nederland University of Twente Voltijd

    We are seeking a highly motivated PhD researcher to join our team at the University of Twente in the field of decentralized multiagent reinforcement learning. As a researcher, you will be part of a dynamic and international environment where you will contribute to the development of novel MARL algorithms and their applications in real-world scenarios.**Key...


  • Enschede, Overijssel, Nederland University of Twente Voltijd

    Central Research QuestionWe are looking for a highly motivated and enthusiastic researcher to join our team and tackle the central research question of this PhD project: How can we design decentralized multiagent reinforcement learning (MARL) algorithms with equilibrium selection control?To address this issue, the successful candidate will characterize the...


  • Enschede, Overijssel, Nederland University of Twente Voltijd

    Company OverviewThe University of Twente is an internationally renowned research university located in the eastern part of the Netherlands. Our campus is a vibrant community where students and researchers from diverse backgrounds come together to create innovative solutions for some of the world's most pressing challenges.SalaryWe offer a competitive salary...


  • Enschede, Overijssel, Nederland University of Twente Voltijd

    At the University of Twente, we are seeking a highly motivated PhD candidate to join our research team and contribute to the development of decentralized multiagent reinforcement learning (MARL) algorithms. Our central research question is: How can we design MARL algorithms with equilibrium selection control? This project offers a unique opportunity to...


  • Enschede, Overijssel, Nederland University of Twente Voltijd

    University of Twente">We are seeking a highly motivated PhD candidate to join our research team at the University of Twente. This position is focused on understanding and supporting professional learning for ethically responsible AI.Job Description:">This PhD position involves interdisciplinary research, combining science and practice, to understand how...


  • Enschede, Nederland Universiteit Twente Voltijd

    **Key takeaways**: - Hours- 38 - 40 hr.- - Salary indication- Salary gross/monthly based on full-time - € 2,872 - € 3,670- - Deadline- 1 Dec 2024Currently, there is a high demand for increased accessibility of mental healthcare. Capacity management, and more personalized diagnosis and treatment, are seen as important solutions. However, the...


  • Enschede, Overijssel, Nederland University of Twente Voltijd

    About the RoleWe are seeking a highly motivated PhD student to join our research project on professional learning for ethically responsible AI development. As a member of our team, you will embark on an exciting journey to understand how software development teams address ethical issues and transform their working practices.


  • Enschede, Nederland University of Twente Voltijd

    Artificial Intelligence (AI) empowers many applications in virtually all aspects of life. More and more devices, machines, and sensors connect to the Internet of Things (IoT), which creates large amounts of data. Even fast networks sometimes struggle to transfer data to a data centre or the ‘cloud’ for analysis, demanding incredible power. Solving this...


  • Enschede, Overijssel, Nederland Universiteit Twente Voltijd

    Job DescriptionWe are seeking a highly motivated PhD candidate to join our research team in the field of numerical mathematics. The successful candidate will work on the development of reduced-order models of port-Hamiltonian systems, focusing on both analysis and application.The project involves the review and development of new methods for model reduction...


  • Enschede, Overijssel, Nederland University of Twente Voltijd

    At the University of Twente, we are seeking a highly motivated PhD candidate to join our research team in the field of ethically responsible AI development. The successful candidate will work on a project that aims to understand and support professional learning for ethically responsible AI in software development teams.As a PhD student, you will be...


  • Enschede, Nederland Universiteit Twente Voltijd

    **Key takeaways**: - Hours- 40 hr.- - Salary indication- Salary gross/monthly based on full-time - € 2,872 - € 3,670- - Deadline- 10 Nov 2024**The project**: The landscape of wearable assistive robots is evolving. These devices are becoming lighter, more flexible, and more integrated with the user. However, current human-machine interface models fail to...


  • Enschede, Overijssel, Nederland University of Twente Voltijd

    In the realm of cybersecurity, the increasing deployment of machine learning (ML) solutions in Security Operations Centres (SOCs) has led to a surge in false positives and a lack of understanding in how these systems work. To address this, the University of Twente is seeking a highly motivated PhD candidate to develop novel ML algorithms that reduce analyst...


  • Enschede, Nederland University of Twente Voltijd

    The statistics research group at the University of Twente invites applications for one PhD (four years) and two postdoc positions (up to 3 years). These positions are part of an ERC consolidator grant. The aim of the research program is to generalize the recent statistical theory from artificial neural networks to biological neural networks. While deep...


  • Enschede, Overijssel, Nederland University of Twente Voltijd

    Job Description We are seeking a highly motivated PhD candidate to work on the fundamentals of microfluidic lipid nanoparticle formation as part of the NANOSPRESSO-NL consortium. The project aims to develop a disruptive technology for decentralized and small-scale bedside production of high-quality and affordable nucleic acid nanomedicines for the treatment...


  • Enschede, Nederland Universiteit Twente Voltijd

    **Key takeaways**: - Hours- 32 - 40 hr.- - Salary indication- Salary gross/monthly based on full-time - € 2,872 - € 3,670- - Deadline- 6 Oct 2024Nowadays so much new and complex software is being developed that there are by far not enough specialists to test this software properly. As a result, companies need more time/resources to develop software, and...


  • Enschede, Nederland Universiteit Twente Voltijd

    **Key takeaways**: - Hours- 38 - 40 hr.- - Salary indication- Salary gross/monthly based on full-time - € 2,770 - € 3,539- - Deadline- 15 Nov 2024**Your profile**: - You are an enthusiastic and highly motivated researcher. - You have, or will shortly, acquire a master’s degree in the field of (chemical) engineering, physical chemistry, physics, bio...


  • Enschede, Nederland University of Twente Voltijd

    You will investigate filtration behavior of flexible particles and components (e.g. gel particles, droplets, cells), and design membrane separation processes based on your findings. The deformability of these particles under actual filtration conditions is far from understood, and likely is influenced by bulk and surface characteristics. You will employ...


  • Enschede, Nederland University of Twente Voltijd

    In recent years, machine learning (ML) solutions are increasingly being deployed in Security Operations Centres (SOCs) to enhance security coverage, and to reduce the number of missed attacks. Not only do these ML systems create many false positives, it is often very difficult to understand how they work in the first place. Moreover, the forensic analysis...


  • Enschede, Overijssel, Nederland Universiteit Twente Voltijd

    Job DescriptionWe are seeking a highly motivated PhD candidate to join our research team at the University of Twente. The successful candidate will work on developing novel models of human-exosuit interaction during movement, with a focus on improving the efficiency and comfort of these systems.Key ResponsibilitiesDevelop and validate novel models of...