Tag Archives: automatic transcription

New project on MIR & singing: CASAS

At my lab we are starting a new project where we integrate our expertise in singing voice processing and music information retrieval to generate tools for choir singers.

CASAS (Community-Assisted Singing Analysis and Synthesis) is a project funded by the Ministry of Economy and Competitiveness of the Spanish Government (TIN2015-70816-R), that started in  January 1st 2016 and will end in December 31st 2018.

https://i0.wp.com/mtg.upf.edu/system/files/imagecache/projects_tech_thumbs/projects/Logo.jpgHumans use singing to create identity, express emotion, tell stories, exercise creativity, and connect with each other while singing together. This is demonstrated by the large community of music singers active in choirs and the fact that vocal music makes up an important part of our cultural heritage. Currently, an increasing amount of music resources are becoming digital, and the Web has become an important tool for singers to discover and study music, as a feedback resource and as a way to share their singing performances. The CASAS project has two complementary goals:

  • The first one is to improve state-of-the-art technologies that assist singers in their musical practice. We research on algorithms for singing analysis and synthesis (ex: automatic transcription, description, synthesis, classification and visualization), following a user-centered perspective, and with the goal of making them more robust, scalable and musically meaningful.
  • The second one is to enhance current public-domain vocal music archives and create research data for our target music information retrieval (MIR) tasks. Our project put a special emphasis on choral repertoire in Catalan and Spanish.

We exploit our current methods for Music Information Retrieval and Singing Voice Processing, and we involve a community of singers that use our technologies and provide their evaluations, ground truth data and relevance feedback.

I did my first logo, which is inspired by choirs, audio & “houses”, which is the english translation of “casas”. It will be an amazing project!

Leave a comment

Filed under projects, research

CANTE: Open Algorithm, Code & Data for the Automatic Transcription of Flamenco Singing

Over the last months, several journal publications related to our research on flamenco & technology are finally online.

One of them is a work with my former PhD student, Nadine Kroher (who now moved to Universidad de Sevilla), on the automatic transcription of flamenco singing. Flamenco singing is really challenging in terms of computational modelling, given its ornamented character and variety, and we have designed a system for its automatic transcription, focusing on polyphonic recordings.

flamencoTranscriptionKroherGomez

The proposed system outperforms state of the art singing transcription systems with respect to voicing accuracy, onset detection, and overall performance when evaluated on flamenco singing datasets. We hope it think will be a contribution not only to flamenco research but to other singing styles.

You can read about our algorithm at the paper we published at IEEE TASP, where we present the method, strategies for evaluation and comparison with state of the art approaches. You can not only read, but actually try it, as we published an open source software for the algorithm, plus a music dataset for its comparative evaluation, cante2midi (I will talk about flamenco corpus in another post). All of this to foster research reproducibility and motivate people to work on flamenco music.

¡Olé!

 

 

 

Leave a comment

Filed under publications, research, software

Music Information Retrieval & Flamenco: Experiment on note segmentation

Current experiment (updated October 2015)

We are running an experiment on note segmentation in flamenco, in order to understand the mechanisms behind manual transcriptions and improve our automatic transcription methods.

You can help by doing this exercise where you will have to segment 10 short flamenco excerpts into notes (it requires less than 1 hour of your time), and you will have the chance to listen in detail to some flamenco singing.

About

My current research in music information retrieval also addresses flamenco music, specially flamenco singing. I am interested to understand and model with computing tools the way humans transcribe flamenco music in order to generate automatic transcriptions of flamenco performances. Transcriptions are useful for musical analysis in terms of scale, patterns and style. More info on the context of my research can be found at the COFLA web site.

Leave a comment

Filed under research

Computational Ethnomusicology and FMA (3rd IW on Folk Music Analysis)

Over the last few years, there has been an increasing interest in the study of music from different traditions from a computational perspective. Researchers with interests in this area have been meeting at the ISMIR conferences and communicate through an interest group in computational ethnomusicology, ethnocomp.

My interests started in 2008, with a study about how tonal features, extracted from music audio signals, can be useful to automatically organize music recordings from different traditions. It basically consisted on characterizing the scale by means of high-resolution HPCP features and combining these features with timbre and rhythm descriptors. As a result, we established some relationships between audio features and geography in our ISMIR2009 paper on Music and geography: content description of musical audio from different parts of the world. After that, I got interested in MIR and Flamenco music, and I have been working in a system for the automatic transcription of flamenco singing, thanks to the COFLA project. This is a challenging task, that will require a dedicated post!

ethnocomp has always been a small community, and two years ago we had the first event devoted to this research area, the first Folk Music Analysis (FMA) workshop that took place in Athens, Greece. Last year I had the chance of co-organizing the 2nd FMA in Seville, my home town, which was jointly organized with a conference on flamenco research. At the last ISMIR in Porto, we could see an increasing interest in this small field, and there was a large number of people attending the ethnocomp ‘dinner?. Moreover, at my research group, my boss Xavier Serra is leading an ERC grant dealing with MIR and traditional music, compmusic. I am very happy that this field gets more attention, and that we address the fact that all our technology has been designed for Western popular music. There is much work to do to develop culture-specific or culture-aware tools.

I then hope that this year’s FMA, which will take place in Amsterdam, will be a success! I am sure it will be a truly interdisciplinary event, gathering people from ethnomusicology, music performance and music information retrieval.

Topics include:
– Computational ethnomusicology
– Retrieval systems for non-western and folk musics
– New methods for music transcription
– Formalization of musical data
– Folk music classification systems
– Models of oral transmission of music
– Cognitive modelling of music
– Aesthetics and related philosophical issues
– Methodological issues
– Representational issues and models
– Audio and symbolic representations
– Formal and computational music analysis

Important dates:
3 February 2013: Deadline for abstract submissions
10 March 2013: Notification of acceptance/rejection of submissions
5 May 2013: Deadline for submission of revised abstracts or full papers
6 and 7 June: Workshop

Don’t miss it!!!!

Leave a comment

Filed under CFP, events, research

ISMIR 2012

Last week I attended my favorite conference, the International Society of Music Information Retrieval Conference. It took place in Porto, Portugal. I gave a presentation on our flamenco project. If you are interested, these are the slides.

It was a very intense conference, where I attended very nice presentations and I got many great ideas for future research. I specially enjoyed the last-minute demo session, which was something different to what I am used to.

Now, back to work!

Leave a comment

Filed under events, research