In the spring of 1813, Father James Redmond arrived in the area with the hope of building a parish that covered Rockville and the surrounding areas. They chose this area because of its large community of Catholics. Also, the central location made it accessible to members from the surrounding area.
By 1817, they established a Georgian-style church with an adjacent cemetery for the local community. Father Redmond bought the church at only $400 and had to pay around $3000 to furnish and renovate the area properly. After completion, Father organized their first mass in St. Mary's Church on December 14, 1817.
Back then, the main building was 53-feet long 26-feet wide with the aisle. Then the church gradually witnesses upgrades in the infrastructure and décor. These include the stainless glass windows and the first station of the Cross. The makers printed the text on the Cross in four languages (i.e. English, German, Italian, and French). You can take it as a symbol of inclusivity and diversity that the church teaches parishioners to embody.
Apart from this, the cemetery is the burial ground of the famous author F. Scott Fitzgerald, and his wife, Zelda. This location bears significance to thousands of fans who visit the gravesite to commemorate their favorite literary figure.