Devotees who wish to visit this temple must go through a grueling climb of 424 high stone steps to reach the top of the hill, atop which lies this temple.
Two caves namely Brahmayoni and Matreoni are also situated on the hill along with an ancient temple of Astabhujadevi. Brahmayoni hill was the place where Buddha preached the fire-sermon to a thousand former fire worshipping ascetics and it is said that each ascetic became enlightened after hearing his teachings.