The 30-metre-tall sandstone formation seemed to be a safe place for people from prehistoric times.
The watch tower surrounded with moats was built in the middle ages to order by the Ronovec family. Its strategic position made it an active party during the wars with the Lusatian Six-Towns Alliance. It was not conquered until the defenders had been completely starved. The decay came from Swedish troops that during the Thirty Years War burnt the castle down. In the 17th century the remnants were donated to hermits. Emperor Joseph II ordered the hermits to leave; afterwards, the castle was deserted.
The locality is now used for candle-light summer Saturday concerts and occasional performances of historic fencing. There are several special events as well, such as exhibitions (Folk Sculpture in Sandstone and Hermits in northern Bohemia).