Next-Generation Building Structure Inspection with Advanced Robotics and AI
Project Description
This project introduces a cutting-edge research opportunity in the field of robotics, artificial intelligence, and computer vision. The goal is to develop an advanced robotic system using a state-of-the-art robot dog equipped with a high-resolution mobile mapping system to conduct building surveys. The data collected will be processed and analyzed using Large Vision Language Models (VLMs) to identify structural defects, anomalies, and other critical features with unprecedented accuracy.
Supervisor
WANG, Yu-Hsing
Quota
5
Course type
UROP1000
UROP1100
UROP2100
UROP3100
UROP3200
UROP4100
Applicant's Roles
As a participant in this project, you will play an integral role in both the experimental and analytical phases. Your responsibilities will include:
1. Experimentation:
- Assisting with the deployment of the advanced robot dog for building surveying tasks.
- Setting up and calibrating the mobile mapping system (e.g., LiDAR, RGB cameras).
- Supporting data collection during field experiments in various building environments.
- Ensuring the smooth operation of the robot and troubleshooting issues during tests.
2. Data Processing and Analysis:
- Help preprocess the collected data, including cleaning and organizing it for analysis.
- Using Large Vision Language Models (VLMs) to analyze the survey data and identify structural defects.
- Visualizing and interpreting results to validate the system's performance.
3. Collaborative Research:
- Working closely with the project team to refine methodologies and ensure accuracy.
- Documenting experiment outcomes and contributing to progress reports or publications.
- Offering creative insights to improve both the robot’s surveying capability and AI analysis.
This role will provide you with practical experience in robotics, AI, and engineering applications, preparing you for advanced research or careers in cutting-edge industries.
1. Experimentation:
- Assisting with the deployment of the advanced robot dog for building surveying tasks.
- Setting up and calibrating the mobile mapping system (e.g., LiDAR, RGB cameras).
- Supporting data collection during field experiments in various building environments.
- Ensuring the smooth operation of the robot and troubleshooting issues during tests.
2. Data Processing and Analysis:
- Help preprocess the collected data, including cleaning and organizing it for analysis.
- Using Large Vision Language Models (VLMs) to analyze the survey data and identify structural defects.
- Visualizing and interpreting results to validate the system's performance.
3. Collaborative Research:
- Working closely with the project team to refine methodologies and ensure accuracy.
- Documenting experiment outcomes and contributing to progress reports or publications.
- Offering creative insights to improve both the robot’s surveying capability and AI analysis.
This role will provide you with practical experience in robotics, AI, and engineering applications, preparing you for advanced research or careers in cutting-edge industries.
Applicant's Learning Objectives
By participating in this project, students will:
1. Gain Technical Proficiency:
- Develop hands-on experience with advanced robotic systems, including their hardware and software integration.
- Learn to operate and troubleshoot mobile mapping technologies, such as LiDAR and RGB cameras.
2. Acquire AI and Data Analysis Skills:
- Understand the application of Large Vision Language Models (VLMs) for analyzing and interpreting visual data.
- Gain experience in data preprocessing, defect detection, and result validation.
3. Enhance Problem-Solving Abilities:
- Tackle real-world challenges in robotics and AI, such as environmental adaptability, data quality, and model optimization.
- Collaborate in interdisciplinary settings to refine experimental methodologies.
4. Understand the Role of Technology in Engineering:
- Explore how robotics and AI can revolutionize building surveying, defect detection, and infrastructure maintenance.
- Appreciate the impact of smart technologies in shaping sustainable urban environments.
These objectives ensure students build a strong foundation in robotics and AI while gaining valuable insights into their application in solving real-world problems.
1. Gain Technical Proficiency:
- Develop hands-on experience with advanced robotic systems, including their hardware and software integration.
- Learn to operate and troubleshoot mobile mapping technologies, such as LiDAR and RGB cameras.
2. Acquire AI and Data Analysis Skills:
- Understand the application of Large Vision Language Models (VLMs) for analyzing and interpreting visual data.
- Gain experience in data preprocessing, defect detection, and result validation.
3. Enhance Problem-Solving Abilities:
- Tackle real-world challenges in robotics and AI, such as environmental adaptability, data quality, and model optimization.
- Collaborate in interdisciplinary settings to refine experimental methodologies.
4. Understand the Role of Technology in Engineering:
- Explore how robotics and AI can revolutionize building surveying, defect detection, and infrastructure maintenance.
- Appreciate the impact of smart technologies in shaping sustainable urban environments.
These objectives ensure students build a strong foundation in robotics and AI while gaining valuable insights into their application in solving real-world problems.
Complexity of the project
Challenging