Since the second half of the seventeenth century there was a church of Peter and Paul on the territory of Yelets Monastery. However, it has changed location twice.
In 1676, at the expense of Count V. Dunin-Borkovsky, opposite to the Assumption Cathedral, the construction of the first refectory church of Saints Peter and Paul began to build. Initially, it was a small church, and during the seventeenth century in the northern direction, several buildings were added to the church, and during that time the structure took the form of a rectangle about 40 m long. There were large basements under the vault. In the nineteenth century Peter and Paul's church was moved to another building and a spiritual consistory was opened in the building of church. During the Second World War, the structure of the Consistory was badly damaged and then it was almost completely dismantled in the postwar years. Only one room survived, the remains of which can be seen today in the territory of the Yelets Monastery.
After the first church of Peter and Paul was closed in the mid-19th century, its throne was moved to another monastery building - the Bishops' Chambers, which is located in the south part of the Assumption Cathedral. Because of the construction in the eighteenth century the church has been rebuilt and it has acquired the trait of classicism. During the communist times, the church was at first used as a theater and then as a sports club. The Church of St. Peter and Paul, unlike the Assumption Cathedral, is a warm church, which is why the services are held mainly during the cold period.