The Sommerberg farm is probably one of the fortified farms that the Counts of Nassau built around Frauenstein to prevent the expansion of the now Mainz district. It is located on the edge of the Rhine Valley on a ridge to the west of the road between Wiesbaden-Frauenstein, Grauem Stein and Schlangenbad-Georgenborn.

The mountain was first mentioned as "der Sommerberg" in 1437 and was probably originally called Wolfsberg. In 1563, Johann Durchhenn is mentioned in the Frauenstein court register as a man of the Sommerberg farm, so a farmstead must have existed at this time. Further news comes from the 17th century: in 1639, the tenant at the time, Johann Scherer, complained that the vineyards were being affected by sheep grazing. Viticulture was an important source of income; there is evidence of several winegrowers on the Sommerberg farm from the 17th century. In 1816, the Sommerberg estate was incorporated into Frauenstein, which became part of Nassau in 1806.

The last Nassau leaseholder, Valentin Wintermeyer, bought the farm from the Nassau estate management and received it as his property. After a fire in 1843, the Sommerberg farm quickly changed hands until Count Paul von Hatzfeldt-Wildenburg acquired it in 1872. He gradually converted the estate into a palatial aristocratic residence and had Franz Heinrich Siesmayer create a landscaped park.

The Sommerberg estate comprises 52 hectares of land used for arable farming and dairy farming; fruit is also grown. Viticulture was abandoned in 1936. Confiscation after the war as an official residence for General Eisenhower was averted by the owners at the time, as the Sommerberg farm was classified as an economically important business. The residential building was heavily altered in the 1950s. The longitudinal building from 1810/20 with stepped gables has been preserved.

Sommerberg Castle is still privately owned.