Sources give the date of the mosque's original construction as either 628 CE (7 AH) or 635-636 CE. It was built by the Bani Abd al-Qays tribe, which lived there before and during the early Islamic period. This mosque is believed to be the first mosque built in Eastern Province and where the second Friday congregation prayer in Islam was offered, the first being held in the Prophet's Mosque in Medina. According to legend, when the Hajr Al-Aswad (Black Stone) was stolen from Mecca by the Qarmatians, it was kept in this mosque for nearly 22 years.
Before the 2007 restoration, most of the mosque's original structure had fallen apart, with only a small number of its arches surviving. These remains include two pointed keel arches from one arcade of the mosque and a part of the qibla wall consisting of three keel-arch niches, and probably dated to the 9th century AD. The central niche of the qibla wall is larger than the other two and acts as the mihrab, which projects from the outer side of the wall.
