Repository logo
 
No Thumbnail Available
Publication

Interactive Musical Setting with Deep Learning and Object Recognition

Use this identifier to reference this record.
Name:Description:Size:Format: 
MC_Paper.pdf13.44 MBAdobe PDF Download

Advisor(s)

Abstract(s)

The SeMI - Interactive Musical Setting, explores the possibilities of joining machine learning, the physical and the sound world. In this context, a machine learning algorithm and model was used to identify physical objects through image processing. Each physical object is associated with a student’s produced musical texture that starts playing when the object is recognized by the device. This allows defining use cases in which students have to develop diverse although interrelated sound textures and combine them with a physical world, in both a fake orchestra, that reacts to people and objects in front of it, and mood rooms, for example. The application was developed for iPad and iPhone, using Swift programming language and the iOS operating system and used in the classes of the masters on Teaching of Musical Education in the Basic School.

Description

Keywords

Deep Learning Object Recognition Musical Setting Musical Textures Musical Education Research Subject Categories::SOCIAL SCIENCES::Social sciences::Education

Citation

Cardoso, Mário; Lopes, Rui Pedro (2020). Interactive Musical Setting with Deep Learning and Object Recognition. In Proceedings of the 12th International Conference on Computer Supported Education. Electronic Network: SCITEPRESS. p. 663-667. ISBN 978-989-758-417-6

Organizational Units

Journal Issue