Like all strands of religion in Puttaparthi, this one too is tied is tied to Sai Baba. The mosque finds its roots to a incident when a number of accidents used to occur in the area and Sai Baba was asked for help, who asked them to dig at a specific spot, where they found a plate with Muslim inscriptions.
This led to the building of the mosque here, and with the plate installed inside, the accidents came to a rest.