허밍: DeepJ 구조를 이용한 이미지 기반 자동 작곡 기법 연구

Humming: Image Based Automatic Music Composition Using DeepJ Architecture

초록

Thanks to the competition of AlphaGo and Sedol Lee, machine learning has received world-wide attention and huge investments. The performance improvement of computing devices greatly contributed to big data processing and the development of neural networks. Artificial intelligence not only imitates human beings in many fields, but also seems to be better than human capabilities. Although humans’ creation is still considered to be better and higher, several artificial intelligences continue to challenge human creativity. The quality of some creative outcomes by AI is as good as the real ones produced by human beings. Sometimes they are not distinguishable, because the neural network has the competence to learn the common features contained in big data and copy them. In order to confirm whether artificial intelligence can express the inherent characteristics of different arts, this paper proposes a new neural network model called Humming. It is an experimental model that combines vgg16, which extracts image features, and DeepJ's architecture, which excels in creating various genres of music. A dataset produced by our experiment shows meaningful and valid results. Different results, however, are produced when the amount of data is increased. The neural network produced a similar pattern of music even though it was a different classification of images, which was not what we were aiming for. However, these new attempts may have explicit significance as a starting point for feature transfer that will be further studied.

키워드

Artificial IntelligenceMachine LearningNeural NetworkMusic Composition
제목
허밍: DeepJ 구조를 이용한 이미지 기반 자동 작곡 기법 연구
제목 (타언어)
Humming: Image Based Automatic Music Composition Using DeepJ Architecture
저자
김태헌정기철이인성
DOI
10.9717/kmms.2022.25.5.748
발행일
2022-05
저널명
멀티미디어학회논문지
25
5
페이지
748 ~ 756