Abstract

With the acceleration of urbanization, there are increasingly more high-rise buildings in cities. In turn, high-rise building collapse accidents occur frequently. The causes of the danger, in addition to the extremely severe stress, are predominantly due to the long-term role of unstable factors, resulting in an unrecoverable internal structure. Therefore, it is advisable to monitor the dynamic deformation of buildings to prevent accidents. However, there is no particularly mature application system on the market to enable this monitoring, so our research group has carried out a long-term research in this field. This paper introduces the design of a set of practical information systems by using information technology and the principle of close-range photogrammetry. The system used the photographing scale transformation-time baseline parallax (PST-TBP) method to analyse image data collected with a digital camera, implement close-range photogrammetry, and input the image data into a computer. A building deformation diagram is obtained using our own software. The associated deformation curve can clearly reproduce the building deformation trend to monitor the building health. We conducted many laboratory simulation experiments to verify the information system, and the verification results prove that this process is rigorous. To apply this information system to a real-life scenario as soon as possible, we further studied its application to high-rise buildings, improved the system by using data and experience obtained by monitoring the tallest local building, and achieved good results. Finally, combined with the development of current intelligent technology, directions for system improvement are explored.

1. Introduction

The process of urbanization is currently accelerating, city areas are expanding, and the population has increased rapidly. In addition, there are increasingly more high-rise buildings. However, the collapse of high-rise buildings is also frequent, and the hidden danger of these hazards has received increasingly more attention [13]. The causes of the danger, in addition to the extremely severe stress, are predominantly due to the long-term role of unstable factors, resulting in an unrecoverable internal structure, but the associated microdeformation processes are difficult to monitor [4, 5]. If we can obtain real-time deformation data from these buildings, then these data can be superimposed and compared, and we can clearly analyse whether the building is in a state of health. If the deformation is excessive or unrecoverable in an unhealthy state, collapse can be prevented in advance, which is a very effective method to avoid accidents [69].

The study of building deformation monitoring to ensure its safety has been started since the 1990s. In 2000, Luo et al.’s and other experiments verified that GNSS (Global Navigation Satellite System) could be used to monitor the low-frequency dynamic characteristics of high-rise buildings [10]. In 2006, Lee and others used digital cameras to monitor displacement and compared the results with those of a laser vibrator [11]. Chen Weihuan and others used a digital camera to monitor the dynamic displacement of Guangzhou new TV tower in real time in 2011, and compared with the dynamic displacement data measured by GNSS, it is basically consistent. In 2012, Kuang et al. used GNSS to monitor the dynamic response of high-rise buildings under typhoon loads and to monitor the dynamics of a high-rise building under construction in Hong Kong [12]. In 2018, a smart SHM system with 46 sensors at Shanghai World Financial Center (SWFC) in China is validated for the analysis of dynamic characteristic of high building by earthquake. And at the same time, Zhou utilized a tomography-based persistent scatterers interferometry monitoring the deformation performances of high-rise building, i.e., SWFC and JinMao Tower, in Shanghai Lujiazui Zone. The above scholars have done a lot of work in the field of high-level health monitoring, our scheme is different from them, and our monitoring of real-time instantaneous dynamic deformation has new research.

After years of research, our research group designed a set of information systems to combine information technology with digital photogrammetry. Digital photography [1315] can observe the structural deformation of buildings, and the combination of digital photography and information technology can make this technology faster and more efficient than the alternatives. Then, we verified the scientific foundation of this method by simulating and making various building models in the laboratory. Several basic experiments can prove that the method is efficient and scientific. In addition, we collected and monitored the instantaneous dynamic deformation image of buildings and draw the associated graph. To further apply the systems in practice, we need to study their practical application in a wide variety of buildings; our aim is thus to study the application of deformation monitoring information systems in high-rise buildings.

This paper briefly introduces the principle and workflow of one of the information systems and then describes a typical simulation experiment for scientific verification. It also focuses on how we can monitor the first tall building in Jinan, China and obtain first-hand data and experience of field monitoring and explains how to further improve the function of the information system in the process of overcoming various problems in real time and incorporate recent advancements in intelligent technology at the present stage. Finally, new improvements and development directions are put forward.

2. Construction of the Dynamic Deformation Monitoring Information System

2.1. Accuracy Assessment of Test Camera

The distortion of the camera in the photographic system plays a major role in influencing its measurement accuracy [1620]. Considering that the distortion error is linear near the central position of the images [21], we adopted a grid method [22] in the study to eliminate the distortion of the digital camera to improve the measurement accuracy. Figure 1 illustrates that the distortion error of the deformation point on the object moves from Position A (xA, zA) to Position A’ (xA′, zA′) in the camera’s view and that XAA′ and ZAA′ are the corresponding horizontal and vertical displacements of this deformation point, respectively.

After modifying the distortion of test camera, we used the direct linear transformation (DLT) method [23] to assess its measurement accuracy. The DLT method is shown as follows:where are the image plane coordinates of deformation points without errors, are the space coordinates of the corresponding deformation points, and are the functions of the exterior and interior parameters of test camera.

The spatial coordinates of the reference points and deformation points were measured by a total station in the laboratory. The DLT method was used to calculate the spatial coordinates of deformation points De0 and De1 based on the coordinates in Tables 1 and 2. Their differences were obtained by comparing the actual coordinates of De0 and De1 with their calculated coordinates (Table 3). The maximal and minimal measurement errors were 2 mm and 0 mm, respectively, with an average measurement error of 1 mm.

2.2. Monitoring Principle

The monitoring principle of the dynamic deformation monitoring information system (DDMIS) is time baseline parallax based on photographing scale transformation (PST-TBP) method. The PST-TBP method is detailed in [2427] and Figure 2 shows its schematic diagram. Part of the PST-TBP method is as follows.

In Figure 2(b), on the object plane, and of the corresponding deformation point arewhere m is the photographing scale on the reference plane, and are the horizontal and vertical deformation of deformation point on the object plane, and and are the horizontal and vertical parallax of the correspondence image point on the image plane. Note that there exist systematic errors in and .

Then, the corrected parallax of the corresponding deformation points is obtained:where () are the corrected parallax of deformation points in the coordinate system after the bary-centralization. () are the systematic error of the deformation point in the coordinate system after the bary-centralization, respectively.

Then, we obtain the corrected displacements of deformation points based on the control plane:where () are the corrected displacements on the reference plane of deformation points.

According to the photographing scale difference between the reference plane and the object plane, we got the actual deformation of the deformation points:where and are the actual spatial deformations on the object plane of deformation, , is the coefficient of the photographing scale transformation, and .

2.3. Accuracy Assessment of DDMIS in the Laboratory

Before test on the high building, the reliability of DDMIS should be investigated in the laboratory. We used a Sony-350 camera in this study to monitor the instantaneous deformation of a steel frame when it was impacted by a dumbbell. Table 4 shows the parameters of the Sony-350 camera. Figure 3(b) shows the test site. Points labeled as U0–U4 are deformation points. Points labeled as C0–C9 are reference points, which formed the reference plane. The test process and impact loads are detailed in [28].

After processing the images, we obtained the measurement accuracy of DDMIS. Table 5 shows that the average absolute accuracy and relative accuracy were 0.28 mm and 1.1‰, respectively. This suggests that DDMIS in this study can meet the accuracy requirements of high-rise buildings monitoring.

3. Field Experiment

This information system has achieved very good results through the simulation experiments of typical structures, but if we apply it to practice, we still have to overcome many difficulties. For example, the structure of the building itself, the photography scene environment, the changing weather during the image capture process, and the people and vehicles around the building should be investigated to further complete the DDMIS. Thus, this paper tried to use DDMIS to monitor high building.

3.1. Experiment Site Selection

We chose the main building of Hanyu Jingu, a tall building in Jinan, which is 339 meters high. It is also surrounded by other tall buildings, so it is impossible to set up cameras at close range to capture deformed images at the top of the tallest building.

After several days of peripheral research and coordination, the final image capture location was selected to be a nearby hill less than 200 meters above sea level; there is a manmade cement flat floor in front of the main building of Hanyu Jingu that is suitable for arranging cameras and reference signs.

3.2. Optimization and Design of the Field Schematic Diagram

Since the monitoring distance for this building is longer than that for the laboratory, this distance can fully meet the accuracy requirements for high-definition digital cameras at this stage. However, the arrangement of reference points and the selection of deformation points are difficult. To solve this problem, we improved the experimental principle. We use the image matching-time baseline parallax method to form a reference plane perpendicular to the photography direction by setting a stable reference point not far from the camera, as shown in Figure 4. In the data calculation, the follow-up image is matched with the reference picture, and then the parallax caused by external factors is eliminated.

3.3. Improvement of the Information System Workflow

Before the data collection, we also improved the workflow of the information system, integrating the field investigation and the preplan setting into the operation process of the information system. The improved scheme is as follows:(1)Site investigation: conduct an investigation of the building site, and then determine the basic information of the building structure, age, load, local terrain, and so on.(2)Monitoring point selection: according to the tall building structure and structural mechanics, in addition to other principles, confirm the important and requested monitoring points.(3)Camera arrangement and deviation correction: we arrange digital cameras in multiple directions and reconcile them before use in order to eliminate the effect of distortion difference, which solves the problem that the digital cameras have no internal or external coordinates.(4)Data acquisition: we use several digital cameras to collect high-resolution multiangle and omnidirectional building deformation images. We collect a large amount of photographical data to obtain a normal distribution confidence interval.(5)Computer software analysis: the advantage of digital cameras is that they can transmit digital signals; the photographs we take are transferred to the computer in the form of a digital signal. When analysing a large amount of data with our self-developed computer imaging analysis software, the main job is the content processing and deformation value calculation.(6)Content processing includes bitmap format conversion, reading reference point pixel position data, reading deformation point pixel position data, calculating the number of reference points, calculating the number of deformation points, and calculating the photograph scale coefficient.(7)The step of calculating the deformation value is as follows: coordinate centralization, centering the reference point pixel coordinates; calculating the correction coefficients of reference point inspection; finding the centralization coordinates of deformation points; finding the positive value of the parallax change of the deformation point; and finding the apparent difference after correction of the deformation point.(8)An analysis report of the monitoring results is issued on site. The entire solution process is completed in as fast as 15 minutes. The integration of internal and external operations is realized, and the efficiency and accuracy of monitoring are greatly improved over previous efforts.

In this paper, we use two cameras to obtain the deformation data. Then, we can verify the accuracy of DDMIS.

According to the improved schematic diagram, we set up the reference points C0, C1, C2, and C3, as shown in Figures 4(a) and 4(b). Because the tall building is very high, we cannot put our own design marks for deformation points on it, so we also improved the workflow of the information system. First, we take pictures of tall buildings and then look for marks from the building itself. These marks locations are as follows in pictures:(1)They have an exact intersection.(2)The point position has a high computer resolution. As Figures 4(a) and 4(b) show, the points we are looking for are U0, U1, and U2.

4. Data Analysis

Through data processing, the measurement accuracy of Cameras 1 and 2 (Tables 6 and 7) and deformation values of the deformation points (Tables 8 and 9) were obtained. In the test, the pixel displacements of the reference points were supposed to be zero in theory. However, their pixel displacements were not zero in DDMIS. As such, these values were deemed as the measurement accuracy of DDMIS. Table 6 shows the average measurement accuracy of Camera 1. Table 7 shows the average measurement accuracy of Camera 2. Moreover, Table 7 shows that the average displacements of C0–C3 were 1.17 pixels, 0.74 pixels, 0.59 pixels, and 0.28 pixels, respectively. Table 7 shows that the average displacements of C0–C3 were 1.16 pixels, 0.99 pixels, 0.34 pixels, and 0.54 pixels, respectively. The measurement accuracy of DDMIS reached subpixel in the field experiment. Thus, deformation values of the deformation points in Tables 8 and 9 were reliable.

In order to assess the high-rise buildings health situation on the test field, the deformation curves of the high building (Figures 48) were obtained in real time by DDMIS and they are useful to study the high-rise buildings dynamic properties.

In Figure 6, deformation points U0, U1, and U2 are in elastic deformation in X direction. The maximum deformation values of deformation points U0, U1, and U2 are 0.89 pixels (on Photo 5), 1.88 pixels (on Photo 10), and 2.17 pixels (on Photo 9), respectively. As we all know, the high-rise buildings are always shaking, and it shook violently with the increasing height along high-rise buildings. Thus, in X direction, the monitoring results are consistent with the vibration rule of high-rise buildings.

In Figure 5, deformation points U0, U1, and U2 are in elastic deformation in X direction. The maximum deformation values of deformation points U0, U1, and U2 are 1.79 pixels (on Photo 6), 2.70 pixels (on Photo 6), and 3.92 pixels (on Photo 6), respectively. Thus, in X direction, the monitoring results are also consistent with the vibration rule of high-rise buildings.

In Figure 7, deformation points U0, U1, and U2 are in elastic deformation in comprehensive direction. The maximum deformation values of deformation points U0, U1, and U2, are 1.10 pixels (on Photo 1), 1.91 pixels (on Photo 10), and 2.74 pixels (on Photo 1), respectively. Thus, in comprehensive direction, the monitoring results are also consistent with the vibration rule of high-rise buildings.

In Figure 4(a), deformation points U0, U1, and U2 are in elastic deformation in comprehensive direction. The maximum deformation values of deformation points U0, U1, and U2 are 2.05 pixels (on Photo 6), 2.84 pixels (on Photo 6), and 4.55 pixels (on Photo 6), respectively. Thus, in comprehensive direction, the monitoring results are also consistent with the vibration rule of high-rise buildings.

In Figure 4(b), the global deformation of Hanyu Jin’gu high-rise buildings is in elastic deformation in X direction. From Photo 1 to Photo 6, the shape of high-rise buildings changed from line to left semiparabola and parabola. From Photo 7 to Photo 10, the shape of high-rise buildings changed from left semiparabola to line and parabola. It is very different from the vibration rule of a flexible cantilever beam.

In Figure 8, the global deformation of Hanyu Jin’gu high-rise buildings is in elastic deformation in X direction. From Photo 1 to Photo 6, the shape of high-rise buildings changed from line to right semiparabola and line. From Photo 7 to Photo 10, the shape of high-rise buildings changed from line to parabola and right semiparabola. It is also very different from the vibration rule of a flexible cantilever beam.

According to the monitoring results, we found that the global deformation of Hanyu Jin’gu high-rise buildings is complex. Their dynamic properties are completely different from that of a low-rise building. This paper also provides technical support for mastering the dynamic characteristics of high-rise buildings and their real-time security early warning.

Note that it is impossible to monitor the high-rise buildings with high accuracy since the measurement distance is as far as 700 m, and digital camera pixels are limited. And we used two cameras to monitor Hanyu Jin’gu high-rise buildings for making the monitoring results reliable.

5. Conclusions

This study uses monocular digital photography based on the photographing scale transformation-time baseline parallax (PST-TBP) method, to monitor the instantaneous dynamic global deformation of a high-rise building in natural state. Two digital cameras were used to monitor the high-rise buildings to support each other. Deformation curves of the high-rise buildings were depicted by the dynamic deformation monitoring information system (DDMIS) to study the dynamic properties of the high-rise buildings. Through processing the image sequences of the high-rise buildings, the following conclusions are obtained:(1)The measurement accuracy of DDMIS reached subpixel in X and Z directions. From Camera 1, the average displacements of C0–C3 in X and Z directions were 0.80 and 0.85 pixels, 0.65 and 0.37 pixels, 0.22 and 0.55 pixels, and 0.06 and 0.27 pixels, respectively. From Camera 2, the average displacements of C0–C3 were 0.63 and 0.98 pixels, 0.21 and 0.97 pixels, 0.15 and 0.30 pixels, and 0.49 and 0.22 pixels, respectively.(2)Deformation points on the high-rise buildings are in elastic deformation in X and comprehensive direction. The high-rise buildings are always shaking, and it shook violently with the increasing height along high-rise buildings. The maximum deformation values of deformation point U2 in X and comprehensive direction are 3.92 and 4.55 pixels, respectively.(3)The global deformation of Hanyu Jin’gu high-rise buildings is complex, and their dynamic properties are completely different from that of a low-rise building. In natural state, the shape of Hanyu Jin’gu high-rise buildings changed back and forth from oblique line to semiparabola and parabola.

In conclusion, the Hanyu Jin’gu high-rise buildings were in good health at the time of testing. This study proves that DDMIS can depict the deformation trend curves of the high-rise buildings which are useful for studying the high-rise buildings dynamic properties. Moreover, the deformation trend curves of the high-rise buildings also can be used to assess the high-rise buildings health situation and warn the possible danger of the high-rise buildings. This information is essential for making decisions regarding the high-rise buildings health. This experiment also provides valuable experience for the on-site analysis of more types of buildings, and it also prompts the research group to further improve the safety deformation monitoring information system.

With the advent of the era of computer intelligence, many intelligent devices have appeared. For example, the clarity of digital cameras is improving, and it is also possible to connect to a wireless network to transmit the image capture information to a computer system in real time. The realization of this technology is conducive to real-time monitoring of the health status of buildings. At present, the functions of various intelligent handheld devices are becoming increasingly mature. A high-end smartphone or palmtop tablet already has its own image capture function comparable to a professional digital camera, and these smart devices themselves can run image processing software at high speed. For using such an intelligent device in the future, we recommend incorporating our building safety information system into application software running on smart devices to simplify the operation of this system. This technology can be applied to the health monitoring of various buildings at any time or place and provides a powerful guarantee for human health and safety.

Data Availability

The data used to support the findings of this study are available from the corresponding author upon request.

Disclosure

Chengxin Yu, Mingzhi Chen, and Guojian Zhang are the first, second, and third corresponding authors, respectively.

Conflicts of Interest

The authors declare that there are no conflicts of interest regarding the publication of this paper.

Acknowledgments

The authors gratefully acknowledge the financial support from the Science and Technology Project of Shandong Province of China (Grant no. 2010GZX20125).