Before the Volksbildungsverein Wiesbaden was dissolved on February 15, 1936, the entire stock of the Volksbüchereien was transferred to the city of Wiesbaden in 1934, including a small collection of sheet music. The founding date for the music library (now the Wiesbaden Music Library) can be found in a report on its 50th anniversary: April 28, 1937. The collection in Rheinstraße, which at the time comprised around 1800 items of music, mainly included sheet music for piano, voice and piano scores."

The collection grew only slowly. It was not until 1953 that Dr. Wolfgang Sichardt, a musicologist and librarian, was appointed as a specialist for music in Schützenhofstraße, where the public and music libraries were still housed under one roof. He managed the collection until 1976 and catalogued around 9500 sheet music and 2600 non-fiction books during this time. As early as 1956, he began to build up a record collection, today the record archive of the music library. Under his management, the collection grew to a total of 15,250 media units.

The constant expansion required appropriate premises. In 1964, the music library moved into its own premises at Bierstadter Str. 1, separate from the public library.

After Uta Strobel took over the management in 1976, the next move to Humboldtstr. 6 took place in 1977. An exquisite music collection was presented on approx. 220 square meters in a classicist villa. The sheet music, which at that time could only be borrowed via a book card machine, was converted into a modern open-access collection; a lengthy task that was not completed until 1991.

To mark the 50th anniversary of the music library in 1987, Uta Strobel began to build up a CD collection. Today, visitors can choose from a stock of over 18,000 CDs. Once again, it was mainly space constraints that forced the library to move again in 1992, this time to Sonnenberger Str. 14, near the Kurhaus and the Hessian State Theater. On 600 square meters, music enthusiasts could find what they were looking for in a collection that had now grown to 47,000 media units. Officially, the new location was also seen as an interim solution. A further move was announced early on. In November 1999, the library moved to Schillerplatz 1-2, in the immediate vicinity of the Wiesbaden Music and Art School, the Wiesbaden Music Academy, the Cultural Office, the Education Authority and the Department of Culture, this time under the management of Claudia Monien (since 1995). From 2000 onwards, data acquisition of the collection began here, which lasted until summer 2005. Since then, library software has facilitated daily borrowing and research and also offers the interested public an Internet catalog service.

Today, the music library is an important point of contact for amateurs and professionals from all areas of music with a very well-developed stock of sheet music, non-fiction books and AV media as well as the record archive. The "Prima La Musica" music library support association has also made a significant contribution to this success since 1998.

In 2014, the music library moved into its new premises in the Mauritius Mediathek in Hochstättenstraße together with the Central Library of the Wiesbaden City Libraries and the Media Center.