End-to-End Move Prediction System for Indoor Rock Climbing: Beta Caller
| dc.contributor.author | Cardenas, Kevin | |
| dc.contributor.author | Semwal, Sudhanshu | |
| dc.contributor.author | Maher, James | |
| dc.contributor.editor | Skala, Václav | |
| dc.date.accessioned | 2024-07-20T18:03:40Z | |
| dc.date.available | 2024-07-20T18:03:40Z | |
| dc.date.issued | 2024 | |
| dc.description.abstract-translated | We developed Beta Caller, an end-to-end system supporting the sport of rock climbing for climbers with visual impairment. Beta Caller provides real-time, audible instructions containing a prediction for the climber’s next move while they are actively climbing a rock wall. This system leverages computer vision techniques to collect key information about the climber’s environment, enabling Beta Caller to make move predictions on climbing walls it has never encountered before. Neural networks are used to predict where the climber should move next, based on information provided by the computer vision models. The predicted move is translated into a verbal message guiding the climber to the next hold and then transmitted via wireless headphones using a text-to-speech model. This novel idea makes one of the fastest growing sports in the world even more appealing and approachable to climbers with visual impairment, however, this tool can be utilized by all climbers to improve their climbing skills. Beta Caller achieved 80.08% accuracy predicting which limb the climber should move next and, when predicting the location of the next hold, Beta Caller achieved a bounding box error of only 6.79%. These results pioneer a strong foundation shaping the future landscape of rock climbing prediction tools for visually impaired climbers | en |
| dc.format | 8 s. | cs_CZ |
| dc.format | 8 s. | cs |
| dc.format.mimetype | application/pdf | |
| dc.identifier.citation | Journal of WSCG. 2024, vol. 32, no. 1-2, p. 13-20. | en |
| dc.identifier.doi | https://www.doi.org/10.24132/JWSCG.2024.2 | |
| dc.identifier.issn | 1213 – 6972 | |
| dc.identifier.issn | 1213 – 6980 (CD-ROM) | |
| dc.identifier.issn | 1213 – 6964 (on-line) | |
| dc.identifier.uri | http://hdl.handle.net/11025/57340 | |
| dc.language.iso | en | en |
| dc.publisher | Václav Skala - UNION Agency | cs |
| dc.rights | © Václav Skala - UNION Agency | cs |
| dc.rights | © Václav Skala - UNION Agency | en |
| dc.rights.access | openAccess | en |
| dc.subject | umělá inteligence | cs |
| dc.subject | počítačové vidění | cs |
| dc.subject | interakce člověka s počítačem | cs |
| dc.subject | detekce objektu | cs |
| dc.subject | odhad pozice | cs |
| dc.subject | predikce lidského pohybu | cs |
| dc.subject | horolezectví | cs |
| dc.subject.translated | artificial intelligence | en |
| dc.subject.translated | computer vision | en |
| dc.subject.translated | human computer interaction | en |
| dc.subject.translated | object detection | en |
| dc.subject.translated | pose estimation | en |
| dc.subject.translated | human motion prediction | en |
| dc.subject.translated | rock climbing | en |
| dc.title | End-to-End Move Prediction System for Indoor Rock Climbing: Beta Caller | en |
| dc.type | článek | cs |
| dc.type | article | en |
| dc.type.status | Peer-reviewed | en |
| dc.type.version | publishedVersion |
Files
Original bundle
1 - 1 out of 1 results
No Thumbnail Available
- Name:
- A61-2024.pdf
- Size:
- 7.07 MB
- Format:
- Adobe Portable Document Format
- Description:
- Plný text
License bundle
1 - 1 out of 1 results
No Thumbnail Available
- Name:
- license.txt
- Size:
- 1.71 KB
- Format:
- Item-specific license agreed upon to submission
- Description: