RajpuriCaves hold religions centrality, owing to the conviction that these were utilized for retribution and religious customs by Lord Kartikeya. Encompassed by numerous water kunds (lakes), these antiquated caverns are additionally accepted to have shielded the Pandavas amid their outcast. Owing to the conviction that the blessed Ganges likewise streams into these kunds, enthusiasts have a shower in these water bodies to cure different types of illnesses and disasters.

Most famous fascination of the caves is a temple of 'Ruler Kartikeya, child of Lord Shiva. Passage of the hole contains a few stone plates with engravings on them. Two conventional pictures of Nandi are spotted before the hollows.