Making Large Language Models (LLMs) Interact with Physical World
Project Description
The recent advancements in Large Language Models (LLMs) such as ChatGPT have paved the way for innovative applications that extend beyond conventional natural language processing tasks, such as robotic control. Our initiative introduces a novel concept termed "Penetrative AI," which aims at integrating LLMs with Internet of Things (IoT) technologies to interact with the physical world.
This project aims to leverage the principles of Penetrative AI to investigate and develop practical IoT-related applications using LLMs. These applications are designed to expand the functionalities of LLMs from purely digital interactions into tangible, physical-world applications.
For additional insights into Penetrative AI, please visit https://dapowan.github.io/wands_penetrative-ai/.
This project aims to leverage the principles of Penetrative AI to investigate and develop practical IoT-related applications using LLMs. These applications are designed to expand the functionalities of LLMs from purely digital interactions into tangible, physical-world applications.
For additional insights into Penetrative AI, please visit https://dapowan.github.io/wands_penetrative-ai/.
Supervisor
LI, Mo
Quota
2
Course type
UROP1100
UROP2100
UROP3100
Applicant's Roles
- A basic understanding of LLMs and prior experience with LLMs or deep learning projects, e.g., having completed relevant courses such as 5221 (Advanced Artificial Intelligence) or 5211 (Natural Language Processing).
- Prior experience in developing mobile applications (Android or iOS) or web servers will be considered a plus.
- Previous involvement in research projects or scholarly publications will be considered a plus.
- Prior experience in developing mobile applications (Android or iOS) or web servers will be considered a plus.
- Previous involvement in research projects or scholarly publications will be considered a plus.
Applicant's Learning Objectives
Learning Outcomes:
- Develop fundamental research skills.
- Gain insights into the capabilities of LLMs and their integration into tangible, real-world applications.
- Develop fundamental research skills.
- Gain insights into the capabilities of LLMs and their integration into tangible, real-world applications.
Complexity of the project
Moderate