The area of Ymittos was settled by refugees from Greek cities of Asia Minor after the uprooting of 1922. According to tradition, a local resident, Erifyli Marda, donated a tent to the community, which was erected on the site where the Church of Saints Peter and Paul stands today, in order to serve the religious needs of the faithful.
The parish was established in 1930, following a request by the residents to the Archdiocese of Athens. A provisional structure served as the first parish church until 1948, when the construction of the present imposing church began, based on designs by the architect Solon Kydoniatis. The initial funds for the construction were offered by the parishioner Panagiotis Papazoglou, while the remaining expenses were covered through fundraising efforts and donations from the faithful.