Elona Shatri

AI Researcher | Ethics Advocate | Music Technologist

The 6th International Workshop on Reading Music Systems 2024

The 6th International Workshop on Reading Music Systems (WoRMS) took place virtually, bringing together researchers and practitioners from across the globe to discuss the latest developments in Optical Music Recognition (OMR). This year's workshop featured three paper sessions, panels, and an insightful keynote by David Rizo, providing a comprehensive exploration of the state of OMR research and its real-world applications.

Keynote: Beyond Optical Music Recognition

David Rizo from the University of Alicante delivered the keynote, "Beyond Optical Music Recognition," reflecting on the recent advancements in OMR driven by deep learning techniques. He questioned whether the current research trajectory is adequate to fully address the complexities of OMR and explored the broader implications for creating end-user-centric systems. His presentation dissected the term "OMR" through case studies, providing a critical assessment of its evolution and future.

Highlights from the Paper Sessions

Session 1: Advancing OMR Models and Analysis

  • Can Multimodal Large Language Models Read Music Score Images? — Jorge Calvo-Zaragoza and collaborators explored the potential of multimodal language models in OMR, discussing their performance on music score images.
  • Sheet Music Transformer: End-to-End Full-Page OMR for Pianoform Sheet Music — Antonio Ríos-Vila and colleagues presented a Transformer-based pipeline for recognizing full-page piano sheet music, emphasizing scalability and efficiency.
  • Towards Sheet Music Information Retrieval Using Multitask Transformers — Antonio Ríos-Vila and team proposed a unified approach for sheet music retrieval, combining multiple OMR tasks into a multitask transformer framework.
  • Semantic Reconstruction of Sheet Music with Graph-Neural Networks — Guillaume de Lambertye and Alexander Pacha demonstrated how graph neural networks could semantically reconstruct sheet music, enabling more accurate music representation.
  • Staff Layout Analysis Using the YOLO Platform — Vojtěch Dvořák and collaborators presented a YOLO-based method for analyzing staff layouts, optimizing structural recognition in OMR.

Session 2: Expanding OMR Applications

  • On Designing a Representation for the Evaluation of OMR Systems — Pau Torras and colleagues proposed a novel representation for evaluating OMR performance, emphasizing its utility in benchmarking.
  • Enhanced User-Machine Interaction for Historical Sheet Music Retrieval — A. Menárguez Box and team introduced a user-machine interaction model for historical sheet music, leveraging musical notation for enhanced retrieval.
  • Enhancing Recognition of Historical Musical Pieces with Synthetic and Composed Images — M. Villarreal Ruiz and J. A. Sánchez explored the use of synthetic images to improve recognition accuracy for historical scores.
  • The CollabScore Project: From Optical Recognition to Multimodal Music Sources — Benoît Couasnon and collaborators discussed integrating optical and multimodal music sources into a unified platform for music analysis.
  • Semi-Automatic Annotation of Chinese Suzipu Notation — Tristan Repolusk and Eduardo Veas presented a component-based approach for annotating Suzipu notation, addressing unique challenges in Chinese music scores.

Session 3: Historical and Handwritten Music

  • OMR on Early Music Sources at the Bavarian State Library with MuRET — J. Umbreit and S. Schumann discussed automating and scaling OMR for early music sources using MuRET.
  • OMMR4all Revisited: A Semiautomatic Online Editor for Medieval Music Notations — Andreas Hartelt and Frank Puppe revisited their online editor for medieval music notations, enhancing usability and automation.
  • Enhancing Handwritten Music Sheet Datasets Using Generative Adversarial Networks (GANs) — K. R. Palavala and collaborators demonstrated how GANs could enrich handwritten music datasets for better OMR training.
  • Crafting Handwritten Notations: Towards Sheet Music Generation — N. Tirupati and team explored generative methods for creating handwritten sheet music, pushing the boundaries of synthetic data generation.