Self-Super-Resolution of an MRI Image with Assistance of the DSTTD System

Vasanth Raj, P. T.; Vijayaraj, A.; Pradeep, K.; Debrah, Ebenezer Lartey

doi:https://doi.org/10.1155/2022/3376079

Journal of Healthcare Engineering

On this page

Abstract Introduction Results and Discussion Conclusion Data Availability Conflicts of Interest Acknowledgments References Copyright Related Articles

Research Article | Open Access

Volume 2022 | Article ID 3376079 | https://doi.org/10.1155/2022/3376079

Self-Super-Resolution of an MRI Image with Assistance of the DSTTD System

P. T. Vasanth Raj,¹A. Vijayaraj,²K. Pradeep,³and Ebenezer Lartey Debrah⁴

Academic Editor: Ayush Dogra

Received07 Sept 2022

Revised10 Nov 2022

Accepted12 Nov 2022

Published24 Nov 2022

Abstract

Motivation. In the modern world of information technology, the need for ensuring the safety of wireless transmissions while transiting through a given network is growing rapidly. The process of transmitting images via a wireless network is fraught with difficulty. There is a possibility that data may be corrupted while being transmitted, which would result in an image with low resolution. Both of these issues were investigated head-on in this research methodology using the aiding double space-time block coding (DSTTD) system and the self-super-resolution (SSR) method. Description. In recent times, medical image transmission over a wireless network has received a significant amount of attention, as a result of the sharing of medical images between patients and doctors. They would want to make sure that the image was sent in a risk-free and protected manner. Arnold cat map, often known as ACM, is a well-known and widely implemented method of image transmission encryption that has been in use for quite some time. At the receiver end, SSR is now being employed in order to view the transmitted medical image in the finest possible resolution. It is anticipated that in the near future, image transmission through wireless DSTTD will be technically feasible. This is performed in order to maximize the benefits that the system has to offer in terms of both spatial diversity and multiplexing as much as is possible. Conclusion. The SSR approach is used in order to represent the image in a document pertaining to human resources. ACM is used so that the image may be sent in a risk-free and protected way. The adoption of a DSTTD-based architecture for wireless communication is suggested. A comparison of the results is provided, and PSNR and SSIM values are detailed towards the results and discussion of the article.

1. Introduction

Image and video processing has piqued the interest of researchers in recent years. Transmission of images and transmitting in a secured manner have also drawn much attention. Transmittingwithout any delay, reducing the types of interference, increasing the number of antennas, increasing the transmission rate, etc. A space-time block code (STBC) plays a vital role in increasing the spatial diversity and multiplexing gain for wireless communication [1]. STBC with 2 transmitting antennas and one receiving antenna is a straightforward strategy for increasing transmit diversity [2]. STBC for orthogonal design is proposed for N-transmitting antennas. The maximum-likelihood decoding algorithm is used at the receiver to decouple the transmitted signal. It is a linear process. STBC is designed to achieve maximum diversity for given antennas. A signal is transmitted through the channel, which may not be known to the transmitter. Another technique for STBC is orthogonal STBC [3]. Full diversity is achieved in the Rayleigh fading channel. This was attained by making a partial feedback channel for the transmitter. To implement this, codebooks are designed and the precoding matrix is generated. A partial knowledge of the channel is given to the transmitter [4]. A comparison of both unknown and predetermined channel information is made, and the result clearly illustrates that the predetermined channel yields a better result.

Transmission will lead to pairwise error probabilities. A linear precoder is designed to suppress this error in the Rician fading channel [5]. To improve the performance further, double space-time transmit diversity (DSTTD) is acquainted. With this desirable, a tradeoff is attained between the diversity gain and spectral efficiency [6]. Interference will be there due to an increase in the antenna, which is mitigated with successive interference cancellation techniques. Interference cancellation plays a vital role in DSTTD. A new block nulling technique is proposed to mitigate the interference in DSTTD when the number of transmitting and receiving antennas gets increased [7]. DSTTD was proposed with spatial modulation [8] to upsurge spectral efficiency. Without widening the bandwidth of the given system, spatial modulation was realized and interchannel interference was reduced. In [9], enhanced spatially modulated DSTTD was introduced. By generating spatial constellation code words, spectral efficiency was amended. While transmitting data through wireless systems, security has to be well thought out [10]. For this purpose, encrypting data is obligatory. Arnold’s cat map (ACM) encryption algorithm is one among them. It follows a chaotic map approach for encrypting data. Watermarking-based encryption is carried out for encrypting. Novel algorithms for encrypting, compressing, and increasing robustness are proposed [11, 12].

In general, increasing an image’s resolution is carried out by a bicubic technique, which degrades the pixel quality of the image. Without affecting the quality of resolution and details, SR can be carried out with different types of SR techniques. In [13], neural network-based SR is proposed. In order to reconstruct an SR image from the given LR image, self-similarity patches have to be demoralized. With these patches, an SR image is constructed. However, techniques such as reconstruction-based algorithms will face the problems of unsuitable blur operators and ill-conditioned image data, which purely depend on low-resolution (LR) images [14–17]. Methods such as regularization-based SR will also fail when the total number of LR patches is restricted [18, 19].

The quality of image restoration for particular lesions has not been fully investigated for the vast majority of deep neural network (DNN)-based SR networks, which have only been evaluated using numerical metrics [13]. Here, we use DNNs to compare the diagnostic accuracy and image quality of several SR networks applied to brain MRI. DL-based SR techniques are considered to have achieved “state-of-the-art” performance [20]. The major motivation for the DNN architecture for SR came from difficulties encountered while attempting to resolve real images. Residual-based networks used in SR include VDSR, DRCN, DRRN, DLRRN [21], and a cross-domain heterogeneous network [22]. All of these systems have a common characteristic: a recursive topology. Autoencoder-based SR algorithms, which teach latent space representations from input LR images, have recently been proven to provide state-of-the-art performance with a reduced computational complexity [23]. An enhanced super-resolution group CNN (ESRGCNN) with a shallow architecture was presented by Andrew et al. [23] to extract more accurate low-frequency information by fusing deep and wide channel characteristics. Several more recent research studies, such as cascading residual network (CARN), CFSRCNN [24], and CADUF [25], leverage cascaded CNN architectures to provide coarse-to-fine techniques for single image SR. Cascaded and enhanced residual networks (CARNs) using many locally shared groups, enhanced residual networks (ERNs) extracting long-range spatial features, and multiscale blocks (MSBs) obtaining feature representations of input images at different scales were proposed by Lan et al. [26] to efficiently extract image features. Some examples of attention-based SR networks are the recurrent channel attention network (RCAN) [27], second order channel attention network (SoCAN) [28], and local and nonlocal attention for spatial feature extraction [29]. Deep learning-based intelligent ultrasound imaging is an important application in the field of intelligent medical care. Based on the industrial Internet of things (IIoT) technology, the authors in [30] proposed an automatic fetal standard plane recognition (FUSPR) model for the IIoT. Blockchain is a new technology architecture that enables secure decentralized storage systems [31]. Compared to traditional centralized models, blockchain-based decentralized models can solve trust-lacking problems. This also creates new opportunities and challenges for the future development of various industries. The authors in [32] suggested a mixed representation learning-based facial image super-resolution technique. Using diverse network topologies to reconstruct performance benefits may not only recover the texture features of major facial organs but also increase the network’s overall efficiency. The results of the face datasets reveal that the proposed approach has superior subjective and objective image quality than SOTA image SR techniques. The SR image reconstruction system employing an attention mechanism and feature map reconstructs color images at multiple scales [33]. The proposed model collects features from the original LR picture and adapts feature channel information using the feature map attention method.

The following are the main contributions in regard to this paper: (1) The DSTTD system is used for the purpose of wireless transmission. (2) ACM encryption is used to ensure that the image is sent over the network in a safe way. (3) The SSR technique is carried out on the receiver side in order to visualize the image in HR. It is possible to accommodate a large number of users at once for the purpose of image transmission with the assistance of DSTTD. Two STBCs are employed, which will significantly reduce the amount of interference that is caused by the users’ proximity to one another. The received image will be improved for the user by SSR so that data can be seen in an appropriate manner. Table 1 illustrates the list of symbols and notations.

2. Proposed Model

2.1. System Model

The structure of the system is shown in Figure 1, and the medical image is transmitted with transmitting antennas and receiving antennas after encrypting the image:isthe information transmitted by theuser, here

(a)

(b)

The output of the encoder is spread using a temporal frequency (TF) and domain (D) spreading sequence. The FD-spreading code [34] should be used:

Let be the length of the FD-spreading code:

It is assumed that :

is represented in the compact formula aswhere is the component matrix.

After that, a random interleaver is used to interleave the TFD spread sequence. As a result, the interleaved signal is represented as

is the component matrix. After two symbol duration transmission, the received component matrix will be . Throughout this section, the result for the transmitter and the receiver is discussed.

is the received matrix with a dimension of :

is the channel matrix and is expressed as follows:

is transmitted matrix and is expressed as follows:

is the noise component and is expressed as follows:

These are the transmitted symbols. The block nulling detection algorithm is used to detect symbols. Now, this will detect and mitigate the noise in the received symbols.

is the detected vector component. After rearrangement by the detection algorithm, the resultant vector is

Equation (12) is premultiplied with to obtain

We assume signal strengths as for the respective transmitted signals. Pretentiousthe strength of the signal, superior forandthanand. The superior signal is estimated by the maximum likelihood detection algorithm as follows:

Therefore, the first STBC unit is decoded. Sequentially, the second unit is accomplished by and :

In case, and are superior,

Here, we obtain

Following that, second STBC block units, which contain signals and , are recognized using the simple expression followed by

2.2. Self-Super-Resolution (SSR)

Let us consider a reconstructed HR image from the k space signal . In order to improve SNR and acquisition time, is bandlimited with the c axis. Vacant portions of k space are occupied with 0. This Fourier space is referred to as . The reconstructed image will have equivalent digital resolution but low spatial resolution in the c direction. The main aim is to restore HR from LR without any external training dataset. An input LR image with a resolution of is obtained in the xy plane, where , and it has isotropic resolution along with LR in the c axis. Axial slices with and sagittal slices with resolution are obtained. Interpolation is carried out to increase isotropic resolution, and zero padding is performed in k space through BSP. This technique will not provide high frequency information in Fourier space. To improve spatial resolution, a nonlinear model to estimate HR images and deep networks (EDSR [35, 36]) is used for training data. As discussed above, a training dataset is trained with input image LR. A 2D axial slice is denoted as , and the coronal slice and the sagittal slice are LR images. Blurred images from LR along the are obtained in both x and z directions. It can be denoted as . Blurred images and input images are used for training data. Axial slices of with a resolution of and axial slices of with a resolution of are obtained. Now, mapping from to the image, it can be mapped to and to estimate images and . To develop the SR model, the EDSR deep network is learned to transform from HR to SR result (Algorithm 1).

	Step 1: Input an MRI or CT scan image , where
	Step 2: Interpolation
	Step 3: Blur axial slice
	Step 4: LR and HR axial patches are extracted
	Step 5: Patches are sent to the EDSR model
	Step 6: Patches from LR is extracted and
	Step 7: Output from EDSR model and Patches are trained to extract and is the estimation of and
	Step 8: FBA is used to reconstruct from and

Now, the trained model is applied to coronal slices , and the obtained output is , which is an estimate of . By assembling each together, is obtained. This can be performed for also to generate to . Finally, FBA is used to reconstruct from and .

Initially, is blurred in the x-axis for . A data acquisition process is carried out using a low-pass filter on the k space signal . A function is multiplied on the a-axis with , which generates . will not have high frequency information on the a-axis. In the case of 3D MRI, a window function must be performed along the c axis in order to reconstruct the picture. Using a rotated version of the provided picture may help improve the amount of data used for training. Utilizing these data, EDSR is carried out and SSR has arrived. The picture that is being input is subjected to both upsampling and downsampling when it is processed by the EDSR framework. Since this makes use of SSR, data are collected from the same image. This is due to the fact that this makes use of SSR. The consequences of using our technology are much better in contrast to the more typical ways that are used.

3. Results and Discussion

The fact that the input is encrypted using the ACM encryption technique may be deduced from the output. Figures 2–4 illustrate iteration of the algorithm. At last, the original picture can be reconstructed from the encrypted one.

Now, in order to retrieve the SR image, the picture that was recovered is being converted to SSR. It is clear from Figures 5–7 that the value of the PSNR for the SSR is much greater than that of the bicubic technique. The data shown in Figure 8 indicate that when it comes to the transmission of encrypted pictures, DSTTD has a better BER than STBC.

The findings of our quantitative examination of our suggested technique are provided in Tables 2–5. In 16 slot batches, 106 adjustments were made to the model while it was being trained. The other parameters that were used in the reference models are still being used. Our models are assessed using a number of SOTA techniques, including DNN-SR [13], SRCNN [4], SR-AutoEncoder [12], and SRResNet [15]. The same number of pixels is disregarded while assessing PSNR on the y channel as scaled from the border. Testing and analysis were carried out using MATLAB tools. Tables 2 and 3 show the PSNR values for a scale size of x2 and x3. Tables 4 and 5 show SSIM with a scale size of x2 and x3. From that, it is observed that the proposed method outperforms SOTA techniques. Also shown are the findings from a comparative dataset. Compared to earlier techniques, our models are far better. Disparities become substantially more apparent when the self-ensemble model is finalized. The qualitative results are also provided in Figure 9. Figures 10–12 illustrate the comparison of DNN-SR [13], SRCNN [4], SR-AutoEncoder [12], SRResNet [15], and the proposed method. The suggested techniques effectively rebuild extremely detailed edges and textures of high-resolution photos while also producing aesthetically appealing high-resolution outputs.

4. Conclusion

The adoption of a DSTTD-based architecture for wireless communication is suggested in this study, and thatarchitecture is outlined in further depth. The primary goal of the use of the DSTTD formula is the enhancement of not only the spatial gain but also the diversity gain. ACM is used so that the image may be sent in a risk-free and protected way. The SSR approach is used in order to represent the picture in a document pertaining to human resources. A comparison of the results is provided based on PSNR and SSIM values. The significant amount of difference is seen in a better way when compared to SOTA techniques. The comparison of images with the SOTA is given, and the results show that the proposed technique can be used for both wireless communication and SSR. The figure illustrates the BER performance of DSTTD and STBC, respectively, in terms of difference in BER. DSTTD is superior to STBC due to the fact that it broadcasts using two STBC blocks rather than just one, which results in superior performance. In the future, polarization diversity can be included in the proposed method to improve diversity.

Data Availability

The data are available from the corresponding author upon reasonable request.

Conflicts of Interest

The authors declare that there are no conflicts of interest regarding the publication of this paper.

Acknowledgments

This work was partially supported by the Centre for System Design, Chennai Institute of Technology, Chennai, under grant number CIT/CSD/2022/006.

References

S. M. Alamouti, “A simple transmit diversity technique for wireless communications,” IEEE Journal on Selected Areas in Communications, vol. 16, no. 8, pp. 1451–1458, 1998.
View at: Publisher Site | Google Scholar
V. Tarokh, H. Jafarkhani, and A. R. Calderbank, “Space-time block codes from orthogonal designs,” IEEE Transactions on Information Theory, vol. 45, no. 5, pp. 1456–1467, 1999.
View at: Publisher Site | Google Scholar
D. J. Love and R. W. Heath, “Limited feedback unitary precoding for orthogonal space-time block codes,” IEEE Transactions on Signal Processing, vol. 53, no. 1, pp. 64–73, 2005.
View at: Publisher Site | Google Scholar
C. Shorten and T. M. Khoshgoftaar, “A survey on image data augmentation for deep learning,” Journal of Big Data, vol. 6, no. 1, p. 60, 2019.
View at: Publisher Site | Google Scholar
M. R. Bhatnagar and A. Hjørungnes, “Linear precoding of STBC over correlated ricean MIMO channels,” IEEE Transactions on Wireless Communications, vol. 9, no. 6, pp. 1832–1836, 2010.
View at: Publisher Site | Google Scholar
J. Zheng Wu, A. Gumaste, and C. Xiao, “Error Performance of Double Space Time Transmit Diversity System,” in Proceedings of the 2006 IEEE International Conference on Communications, Istanbul, Turkey, June 2006.
View at: Google Scholar
Y. Lee and H.-W. Shieh, “A simple layered space-time block nulling technique for DSTTD systems,” IEEE Communications Letters, vol. 15, no. 12, pp. 1323–1325, 2011.
View at: Publisher Site | Google Scholar
M. C. Park, D. S. Han, and B. G. Jo, “Double space-time transmit diversity with spatial modulation,” Electronics Letters, vol. 51, no. 25, pp. 2155-2156, 2015.
View at: Publisher Site | Google Scholar
M. T. Le, T. D. Nguyen, X. N. Tran, and V. D. Ngo, “On the combination of double space time transmit diversity with spatial modulation,” IEEE Transactions on Wireless Communications, vol. 17, no. 1, pp. 170–181, 2018.
View at: Publisher Site | Google Scholar
S. C. Lim and J. Joung, “Transmit antenna selection for space–time line code systems,” IEEE Transactions on Communications, vol. 69, no. 2, pp. 786–798, 2021.
View at: Google Scholar
O. Jane, H. G. Ilk, and E. Elbasi, “A Secure and Robust Watermarking Algorithm Based on the Combination of DWT, SVD, and LU Decomposition with Arnold’s Cat Map Approach,” in Proceedings of the 8th International Conference on Electrical and Electronics Engineering (ELECO), Bursa, Turkey, November 2013.
View at: Google Scholar
J. Andrew, T. Mhatesh, R. D. Sebastin et al., “Super-resolution reconstruction of brain magnetic resonance images via lightweight autoencoder,” Informatics in Medicine Unlocked, vol. 26, Article ID 100713, 2021.
View at: Publisher Site | Google Scholar
Y. Terada, T. Miyasaka, A. Nakao et al., “Clinical evaluation of super-resolution for brain MRI images based on generative adversarial networks,” Informatics in Medicine Unlocked, vol. 32, Article ID 101030, 2022.
View at: Publisher Site | Google Scholar
J. Sun, J. Zhu, and M. F. Tappen, “Context-constrained Hallucination for Image Super-resolution,” in Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition, San Francisco, CA, USA, June 2010.
View at: Google Scholar
C. Ledig, L. Theis, F. Huszar et al. et al., “Photo-realistic single image super-resolution using a generative adversarial network,” 2016, https://arxiv.org/abs/1609.04802.
View at: Google Scholar
R. C. Hardie, K. J. Barnard, and E. E. Armstrong, “Joint MAP registration and high-resolution image estimation using a sequence of undersampled images,” IEEE Transactions on Image Processing, vol. 6, no. 12, pp. 1621–1633, 1997.
View at: Publisher Site | Google Scholar
S. Baker and T. Kanade, “Limits on super-resolution and how to break them,” IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 24, no. 24, pp. 1167–1183, 2002.
View at: Publisher Site | Google Scholar
Z. Lin and H.-Y. Shum, “Fundamental limits of reconstruction-based superresolution algorithms under local translation,” IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 26, no. 1, pp. 83–97, 2004.
View at: Publisher Site | Google Scholar
A. Chakrabarti, A. N. Rajagopalan, and R. Chellappa, “Super-resolution of face images using kernel PCA-based prior,” IEEE Transactions on Multimedia, vol. 9, no. 4, pp. 888–892, 2007.
View at: Publisher Site | Google Scholar
Y. Li, B. Sixou, and F. Peyrin, “A Review of the deep learning methods for medical images super resolution problems,” IRBM, vol. 42, no. 2, pp. 120–133, 2021.
View at: Publisher Site | Google Scholar
C. Tan, L. Wang, and S. Cheng, “Image super-resolution via dual-level recurrent residual networks,” Sensors, vol. 22, no. 8, pp. 3058–58, 2022.
View at: Publisher Site | Google Scholar
L. Ji, Q. Zhu, Y. Zhang et al., “Cross-domain heterogeneous residual network for single image super-resolution,” Neural Networks, vol. 149, pp. 84–94, 2022.
View at: Publisher Site | Google Scholar
J. Andrew, T. S. R. Mhatesh, R. D. Sebastin et al., “Super-resolution reconstruction of brain magnetic resonance images via lightweight autoencoder,” Informatics in Medicine Unlocked, vol. 26, 2021.
View at: Google Scholar
C. Tian, Y. Xu, W. Zuo, B. Zhang, L. Fei, and C.-W. Lin, “Coarse-to-Fine CNN for image super- resolution,” IEEE Transactions on Multimedia, vol. 23, pp. 1489–1502, 2021.
View at: Publisher Site | Google Scholar
S. Lopez-Tapia and N. P. de la Blanca, “Fast and robust cascade model for multiple degradation single image super-resolution,” IEEE Transactions on Image Processing, vol. 30, pp. 4747–4759, 2021.
View at: Publisher Site | Google Scholar
R. Lan, L. Sun, Z. Liu et al., “Cascading and enhanced residual networks for accurate single-image super-resolution,” IEEE Transactions on Cybernetics, vol. 51, no. 1, pp. 115–125, 2021.
View at: Publisher Site | Google Scholar
Y. Zhang, K. Li, K. Li, L. Wang, B. Zhong, and Y. Fu, “Image super-resolution using very deep residual channel attention networks,” CoRR, vol. 1121, 2018.
View at: Google Scholar
T. Dai, J. Cai, Y. Zhang, S.-T. Xia, and L. Zhang, “Second-order attention network for single image super-resolution,” in Proceedings of the 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), pp. 11057–11066, Long Beach, CA, USA, June 2019.
View at: Google Scholar
S. Gao and X. Zhuang, “Multi-scale deep neural networks for real image super-resolution,” in Proceedings of the IEEE/CVF Conf. Comput. Vis. Pattern Recognit. Workshop CVPRW, Salt Lake City, UT, USA, June 2019.
View at: Google Scholar
B. Pu, K. Li, S. Li, and N. Zhu, “Automatic fetal ultrasound standard plane recognition based on deep learning and IIoT,” IEEE Transactions on Industrial Informatics, vol. 17, no. 11, pp. 7771–7780, 2021.
View at: Publisher Site | Google Scholar
J. Zhang, S. Zhong, T. Wang, H. C. Chao, and J. Wang, “Blockchain-based systems and applications: a survey,” Journal of Internet Technology, vol. 21, no. 1, pp. 1–14, 2020.
View at: Google Scholar
Y. Chen, V. Phonevilay, J. Tao et al., “The face image super-resolution algorithm based on combined representation learning,” Multimedia Tools and Applications, vol. 80, no. 20, pp. 30839–30861, 2021.
View at: Publisher Site | Google Scholar
Y. Chen, L. Liu, V. Phonevilay et al., “Image super-resolution reconstruction based on feature map attention mechanism,” Applied Intelligence, vol. 51, no. 7, pp. 4367–4380, 2021.
View at: Publisher Site | Google Scholar
L.-L. Yang and L.-C. Wang, “Zero-forcing and minimum mean square error multiuser detection in generalized multicarrier DSCDMA systems for cognitive radio,” EURASIP Journal on Wireless Communications and Networking, vol. 2008, no. 1, Article ID 541410, 2007.
View at: Publisher Site | Google Scholar
R. Timofte, E. Agustsson, L. Van Gool et al., “Ntire 2017 challenge on single image superresolution: methods and results,” in Proceedings of the 2017 IEEE Conference on Computer Vision and Pattern Recognition Workshops (CVPRW), pp. 1110–1121, IEEE, Honolulu, HI, USA, July 2017.
View at: Google Scholar
X. Li and Z. Chen, “Single image super-resolution reconstruction based on fusion of internal and external features,” Multimedia Tools and Applications, vol. 81, no. 2, pp. 1589–1605, 2022.
View at: Publisher Site | Google Scholar

Copyright

Copyright © 2022 P. T. Vasanth Raj et al. This is an open access article distributed under the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.

PDF Download Citation

Download other formats

Order printed copies

Views

218

Downloads

264

Citations