The "Heidenmauer" was long regarded as part of a defensive structure. More recent interpretations, however, assume that it is part of a Roman aqueduct from the third century AD, which was used to channel water from the Taunus heights into the city.

The Roman Gate was built in 1902 as a covered wooden bridge when the historic wall was breached.

Copies of stone tablets from Roman times found in Wiesbaden are exhibited in the Roman Open-Air Museum next to the Roman Gate.