A Framework for Art-directed Augmentation of Human Motion in Videos on Mobile Devices

dc.contributor.authorDebski, R.
dc.contributor.authorSchmitt, O.
dc.contributor.authorTrenz, P.
dc.contributor.authorReimann, M.
dc.contributor.authorDöllner, J.
dc.contributor.authorTrapp, M.
dc.contributor.authorSemmo, A.
dc.contributor.authorPasewaldt, S.
dc.contributor.editorSkala, Václav
dc.date.accessioned2023-10-03T16:18:45Z
dc.date.available2023-10-03T16:18:45Z
dc.date.issued2023
dc.description.abstract-translatedThis paper presents a framework and mobile video editing app for interactive artistic augmentation of human motion in videos. While creating motion effects with industry-standard software is time-intensive and requires expertise, and popular video ef fect apps have limited customization options, our approach enables a multitude of art-directable, highly customizable motion effects. We propose a graph-based video processing framework that uses mobile-optimized machine learning models for hu man segmentation and pose estimation to augment RGB video data, enabling the rendering and animation of content-adaptive graphical elements that highlight and emphasize motion. Our modular framework architecture enables effect designers to create diverse motion effects that include body pose-based effects such as glow stick or light trail effects, silhouette-based effects such as halos and outlines, and layer-based effects that provide depth perception and enable interaction with virtual objectsen
dc.format11 s.cs
dc.format.mimetypeapplication/pdf
dc.identifier.citationJournal of WSCG. 2023, vol. 31, no. 1-2, p. 80-90.en
dc.identifier.doihttps://www.doi.org/10.24132/JWSCG.2023.9
dc.identifier.issn1213 – 6972 (hard copy)
dc.identifier.issn1213 – 6980 (CD-ROM)
dc.identifier.issn1213 – 6964 (on-line)
dc.identifier.urihttp://hdl.handle.net/11025/54287
dc.language.isoenen
dc.publisherVáclav Skala - UNION Agencyen
dc.rights© Václav Skala - UNION Agencyen
dc.rights.accessopenAccessen
dc.subjectstylizace videacs
dc.subjectmobilní zpracovánícs
dc.subjectlidský pohybcs
dc.subjectzobrazující dynamikucs
dc.subjectvideo efektycs
dc.subject.translatedvideo stylizationen
dc.subject.translatedmobile processingen
dc.subject.translatedhuman motionen
dc.subject.translateddepicting dynamicsen
dc.subject.translatedvideo effectsen
dc.titleA Framework for Art-directed Augmentation of Human Motion in Videos on Mobile Devicesen
dc.typečlánekcs
dc.typearticleen
dc.type.statusPeer-revieweden
dc.type.versionpublishedVersionen

Files

Original bundle
Showing 1 - 1 out of 1 results
No Thumbnail Available
Name:
!_2023-Journal_WSCG-90-100.pdf
Size:
3.65 MB
Format:
Adobe Portable Document Format
Description:
Plný text
License bundle
Showing 1 - 1 out of 1 results
No Thumbnail Available
Name:
license.txt
Size:
1.71 KB
Format:
Item-specific license agreed upon to submission
Description: