Downtown Parish Church is located adjacent to the walls of the Roman Contra-Aquincum Fortress and the Elisabeth Bridge.

The earliest features of the church date back to the Romanesque period. In 1046, St. Gellért (Gerard), Bishop of Csanád, was buried there. 14th-century King Sigismund of Hungary initiated its reconstruction in Gothic style. During the reign of King Matthias, two additional lateral aisles were added. It was used as a mosque in Turkish times and a mihrab from this period is still visible in the south-eastern wall of the sanctuary.

When the Elisabeth Bridge was being rebuilt after destruction during World War II, the Communist government of Hungary sought to demolish the church, but the Church, through astute negotiation with the Communist authorities, managed to save this historic treasure.