Abstract: The article puts forward a new approach to the development of virtual reconstruction of historical and cultural heritage objects that is based on the advanced 3D modeling technologies and addresses the issues of historical urban science. Along with sociocultural significance and architectural importance of the lost cultural heritage objects (convent complex in this case) for virtual reconstruction tasks, an important criterion for their selection is the preservation rate of the source base. The article focuses on the use of virtual and augmented reality technologies in historical reconstruction tasks. As an additional opportunity to “plunge” into the historical past, the authors propose the creation of historical panoramas to use them in pads or smartphones. The article also studies the technology associated with the use of VR HMD. 3D modeling, digital sculpting, photogrammetry of monuments, layer projection technologies form an important part of methods used in this work. The article is the first in Russian historiography to address the practical use of virtual and augmented reality technologies to reconstruct the lost objects of the historical building system (by the example of Strastnoy Convent). The authors test the software module that validates / verifies the results of virtual reconstruction as well as enhances representation and visualization opportunities of these results. The authors simulate the augmented reality within the virtual reality and thus overcome limitations of AR.