The aim of this project is to develop a ROS2-based platform to enable the integration of voice commands and information recognized by the robot's vision and to operate the robot.
The project members are listed below:
| Name | Student ID | Role | Contact |
|---|---|---|---|
| Renwei Hu | 1067974 | Product Owner | [email protected] |
| Sicheng Nie | 1206202 | Scrum Master | [email protected] |
| George Wang | 1084224 | Architecture Lead | [email protected] |
| Siyi Liu | 710301 | Deployment Lead | [email protected] |
The project is divided into four modules based on prioritization:
- Computer Vision
- Voice Command Recognition
- Decision Making
- Robotic Control We will develop them in order.
Sprint tag: COMP90082_2023_SM2_AI_RedBack_BL_SPRINTX
Branch Naming Convention: <user_story_id>-<"feature/bug_fix">-<person>-<description>
All demos reflecting our project progress have been uploaded to a YouTube Playlist. Demo video for each independent module can also be accessed via direct links below:
The project is mainly divided into two repos: AI RedBack and AI RedBack Vision(Client requested). AI RedBack has all the sprint documents and Voice Recognition content, while AI RedBack Vision mainly focuses on Vision.
- Official documentation can be found here: https://docs.ros.org/en/humble/Installation.html
- Confluence guide document: This link will guide you to install the ROS2.
- Official documentation can be found here: https://frankaemika.github.io/docs/installation_linux.html
- Confluence guide document: This link will guide you to install the Libfranka.
- Official documentation can be found here: https://support.franka.de/docs/franka_ros2.html
- Confluence guide document: This link will guide you to install the Franka_ros2.
-
Version Oct 6, 2023
- Updated semantic analysis ROS2 node to capture more information. Updated the recording app to enable it to start and end recording using space operations
-
Version Sep 21, 2023
- Upload the ROS2 node version of the application used for recording voice and update the document
-
Version Sep 18, 2023
- Upload ROS2 Python node files for voice to text conversion and their test. wav files
-
Version Sep 6, 2023
- Upload ROS2 python node
-
Version Sep 3, 2023
- Upload Python files for semantic analysis using OpenAI
-
Version Aug 18, 2023
- Upload documents related to sprint 1
-
Version Aug 16, 2023
- Create Github repo
"Please correct the grammar of the following text: "{transcript}""
"Translate the sentence into action, object and location, for example a sentence 'slowly move that red cup to the top of the table' should be 'Action: slowly move; Object: red cup; Location: top of the table'. If there is no location information, Location should be N/A. Now please translate {sentence}"
This file contains all the file list.