At the turn of the 15th and 16th centuries, the castle was rebuilt for the first time. At that time, they built a new external fortification with a tower entrance gate and corner bastions, and a painting decoration of the royal hall was also created. In the first half of the 16th century, due to the threat from the Ottoman Empire, the Renaissance reconstruction of the chateau took place. From 1575, a permanent military garrison headed by Zvolen robes was based here. During the reconstruction, the building was added by another two floors with corner turrets and shooting ranges along the entire perimeter of the outer walls and a large shooting range for cannons on the north facade. However, the Turks never conquered Zvolen Castle or the city.
In the first half of the 17th century, a baroque reconstruction took place, during which the representational halls of the 1st floor were rebuilt into several smaller rooms. Other major changes were not made until the second half of the 18th century. Related to them were the reconstruction of a two-storey Gothic chapel, which covered almost all traces of its original medieval appearance.