Robotic Arm Generative Painting Through Real-time Analysis of Music Performance

Richard Savery; Anna Savery; Justin Baird

doi:10.1145/3527188.3563913

Robotic Arm Generative Painting Through Real-time Analysis of Music Performance

Richard Savery, Anna Savery, Justin Baird

Research output: A Conference proceeding or a Chapter in Book › Conference contribution › peer-review

4 Citations (Scopus)

Abstract

This paper describes a prototype audio-visual performance of a Ufactory Uarm Swift and a live musician. In this setting, the robotic arm was used as an AI agent to create a visual representation of a musical work in real-time. An A4 white canvas was gradually filled with a mixture of black, blue, red and yellow paints across the span of approximately eight minutes. The musician, performing on an acoustic violin, fitted with a custom built audio interface, performed multiple versions of an improvisatory work developed specifically for the prototype performance. The following sections discuss our technical approach to programming and implementing the Ufactory Uarm Swift as a painting arm, reflections of the musical process and propose future directions for this project.

Original language	English
Title of host publication	HAI 2022 - Proceedings of the 10th Conference on Human-Agent Interaction
Publisher	Association for Computing Machinery, Inc
Pages	253-255
Number of pages	3
ISBN (Electronic)	9781450393232
DOIs	https://doi.org/10.1145/3527188.3563913
Publication status	Published - 5 Dec 2022
Externally published	Yes
Event	10th Conference on Human-Agent Interaction, HAI 2022 - Christchurch, New Zealand Duration: 5 Dec 2022 → 8 Dec 2022

Publication series

Name	HAI 2022 - Proceedings of the 10th Conference on Human-Agent Interaction

Conference

Conference	10th Conference on Human-Agent Interaction, HAI 2022
Country/Territory	New Zealand
City	Christchurch
Period	5/12/22 → 8/12/22

Access to Document

10.1145/3527188.3563913Licence: Unspecified

Cite this

Savery, R., Savery, A., & Baird, J. (2022). Robotic Arm Generative Painting Through Real-time Analysis of Music Performance. In HAI 2022 - Proceedings of the 10th Conference on Human-Agent Interaction (pp. 253-255). (HAI 2022 - Proceedings of the 10th Conference on Human-Agent Interaction). Association for Computing Machinery, Inc. https://doi.org/10.1145/3527188.3563913

@inproceedings{e9c47dfa97a44fce9258554903b3af19,

title = "Robotic Arm Generative Painting Through Real-time Analysis of Music Performance",

abstract = "This paper describes a prototype audio-visual performance of a Ufactory Uarm Swift and a live musician. In this setting, the robotic arm was used as an AI agent to create a visual representation of a musical work in real-time. An A4 white canvas was gradually filled with a mixture of black, blue, red and yellow paints across the span of approximately eight minutes. The musician, performing on an acoustic violin, fitted with a custom built audio interface, performed multiple versions of an improvisatory work developed specifically for the prototype performance. The following sections discuss our technical approach to programming and implementing the Ufactory Uarm Swift as a painting arm, reflections of the musical process and propose future directions for this project.",

keywords = "artwork, audio, human-robot interaction, music, painting, sound",

author = "Richard Savery and Anna Savery and Justin Baird",

note = "Publisher Copyright: {\textcopyright} 2022 ACM.; 10th Conference on Human-Agent Interaction, HAI 2022 ; Conference date: 05-12-2022 Through 08-12-2022",

year = "2022",

month = dec,

day = "5",

doi = "10.1145/3527188.3563913",

language = "English",

series = "HAI 2022 - Proceedings of the 10th Conference on Human-Agent Interaction",

publisher = "Association for Computing Machinery, Inc",

pages = "253--255",

booktitle = "HAI 2022 - Proceedings of the 10th Conference on Human-Agent Interaction",

}

Savery, R, Savery, A & Baird, J 2022, Robotic Arm Generative Painting Through Real-time Analysis of Music Performance. in HAI 2022 - Proceedings of the 10th Conference on Human-Agent Interaction. HAI 2022 - Proceedings of the 10th Conference on Human-Agent Interaction, Association for Computing Machinery, Inc, pp. 253-255, 10th Conference on Human-Agent Interaction, HAI 2022, Christchurch, New Zealand, 5/12/22. https://doi.org/10.1145/3527188.3563913

Robotic Arm Generative Painting Through Real-time Analysis of Music Performance. / Savery, Richard; Savery, Anna; Baird, Justin.
HAI 2022 - Proceedings of the 10th Conference on Human-Agent Interaction. Association for Computing Machinery, Inc, 2022. p. 253-255 (HAI 2022 - Proceedings of the 10th Conference on Human-Agent Interaction).

Research output: A Conference proceeding or a Chapter in Book › Conference contribution › peer-review

TY - GEN

T1 - Robotic Arm Generative Painting Through Real-time Analysis of Music Performance

AU - Savery, Richard

AU - Savery, Anna

AU - Baird, Justin

PY - 2022/12/5

Y1 - 2022/12/5

N2 - This paper describes a prototype audio-visual performance of a Ufactory Uarm Swift and a live musician. In this setting, the robotic arm was used as an AI agent to create a visual representation of a musical work in real-time. An A4 white canvas was gradually filled with a mixture of black, blue, red and yellow paints across the span of approximately eight minutes. The musician, performing on an acoustic violin, fitted with a custom built audio interface, performed multiple versions of an improvisatory work developed specifically for the prototype performance. The following sections discuss our technical approach to programming and implementing the Ufactory Uarm Swift as a painting arm, reflections of the musical process and propose future directions for this project.

AB - This paper describes a prototype audio-visual performance of a Ufactory Uarm Swift and a live musician. In this setting, the robotic arm was used as an AI agent to create a visual representation of a musical work in real-time. An A4 white canvas was gradually filled with a mixture of black, blue, red and yellow paints across the span of approximately eight minutes. The musician, performing on an acoustic violin, fitted with a custom built audio interface, performed multiple versions of an improvisatory work developed specifically for the prototype performance. The following sections discuss our technical approach to programming and implementing the Ufactory Uarm Swift as a painting arm, reflections of the musical process and propose future directions for this project.

KW - artwork

KW - audio

KW - human-robot interaction

KW - music

KW - painting

KW - sound

UR - http://www.scopus.com/inward/record.url?scp=85144616040&partnerID=8YFLogxK

U2 - 10.1145/3527188.3563913

DO - 10.1145/3527188.3563913

M3 - Conference contribution

AN - SCOPUS:85144616040

T3 - HAI 2022 - Proceedings of the 10th Conference on Human-Agent Interaction

SP - 253

EP - 255

BT - HAI 2022 - Proceedings of the 10th Conference on Human-Agent Interaction

PB - Association for Computing Machinery, Inc

T2 - 10th Conference on Human-Agent Interaction, HAI 2022

Y2 - 5 December 2022 through 8 December 2022

ER -

Robotic Arm Generative Painting Through Real-time Analysis of Music Performance

Abstract

Publication series

Conference

Access to Document

Other files and links

Fingerprint

Cite this