These are ancient caves, dating back to 5th century and one of the most significant landmarks of the heritage of Vijayawada. Though a lot has been lost to ruins, the caves still hold religious and spiritual value as they house idols of Lord Nataraja and Lord Vinayaka amongst many more, a few cave temples and a shrine for Goddess Durga.
The carvings here also hold amongst themselves, a carving of Ardhanariswara, which is said to be the only one of its kind across the whole of South India.