Epidemiological Multi-Agent System Safety
Project Description
Large Language Models (LLMs)-based multi-agent systems (MAS) are vulnerable to the rapid propagation of toxicity, hallucinations, and adversarial attacks. Traditional defenses, which rely on static network topologies or binary “blocklists”, either fail to contain influential “super-spreaders” or unnecessarily fragment the network after minor errors. To address this, we propose EMAS, an Epidemiological Multi-Agent System framework with probabilistic connections. EMAS is a self-regulating network topology in which agent interactions are governed by probabilistic permeability rather than fixed connections. Drawing inspiration from epidemiological models, our framework dynamically adjusts communication bandwidth based on the interplay between a sender’s risk profile and a receiver’s robustness. This approach isolates malicious agents without manual intervention while preserving the flow of healthy information.
Supervisor
SONG Yangqiu
Quota
5
Course type
UROP1000
UROP1100
UROP2100
UROP3100
UROP3200
UROP4100
Applicant's Roles
Working together with PhD and MPhil student mentors on task formulation, designing and running experiments, analyzing results, and writing research papers.
Applicant's Learning Objectives
1. Have hands-on experience in Large Language Model (LLM) inference via several inference service providers and building large scale agent framework in Python.
2. Learn how to research with them for diverse LLM-based multi-agent system attack and defense scenarios.
3. Gain deep understanding of recent advancements in LLM-based multi-agent system.
2. Learn how to research with them for diverse LLM-based multi-agent system attack and defense scenarios.
3. Gain deep understanding of recent advancements in LLM-based multi-agent system.
Complexity of the project
Challenging