The castle could have been erected by king Casimir the Great or prince Władysław Opolczyk as a border watchtower. The first mention in the sources appears in 1389, when the castle chaplain is mentioned. Subsequent messages from 1416-1418 mention the burgrave. The first owner of Bąkowiec was Mikołaj Strzała. After him, the stronghold was acquired by the later camerarius of Kraków, Piotr Lis, then Jan from Sieciechowic and Mikołaj Morawiec from Konaszówka. From 1435, the castle belonged to Koziegłowy family. It is difficult to say when the building ceased to function as a defensive residence. Around 1927, the architect Witold Danielewicz Czeczott bought the hill with the ruins of the castle, and built his house using the castle walls.