The temple derives its name from Vaali, the monkey king from the Ramayana, who performed intense penance at this spot.