Research Article  Open Access
Linyuan Wang, Ailong Cai, Hanming Zhang, Bin Yan, Lei Li, Guoen Hu, "Distributed Reconstruction via Alternating Direction Method", Computational and Mathematical Methods in Medicine, vol. 2013, Article ID 418747, 7 pages, 2013. https://doi.org/10.1155/2013/418747
Distributed Reconstruction via Alternating Direction Method
Abstract
With the development of compressive sensing theory, image reconstruction from fewview projections has received considerable research attentions in the field of computed tomography (CT). Totalvariation (TV) based CT image reconstruction has been shown to be experimentally capable of producing accurate reconstructions from sparseview data. In this study, a distributed reconstruction algorithm based on TV minimization has been developed. This algorithm is very simple as it uses the alternating direction method. The proposed method can accelerate the alternating direction total variation minimization (ADTVM) algorithm without losing accuracy.
1. Introduction
Image reconstruction algorithms implemented in existing computed tomography (CT) scanners require projection data to be available in proportional space [1, 2]. However, in CT imaging of biological specimens, data collection at a large number of projection views may result in radiationinduced object deformation. Recently, methods based on the corresponding constrained total variation (TV) or norm minimization have been widely studied in reconstruction from sparseview data [3–9]. Sidky et al. [5] proposed the adaptive steepest descent projection onto convex sets (ASDPOCS) algorithm for CT image reconstruction. This method can realize exactimage reconstruction using fewer measurements. The alternating direction method (ADM) is an efficient approach for optimization problems. And the split BregmanTV method based on alternating Bregman iterative approach was proposed and converged well in [8] as a solution for sparseview CT reconstruction. A TV minimization iterative algorithm using the ADM based on augmented Lagrangian function was also proposed [10, 11]. Li et al. proposed a more robust and efficient algorithm nonmonotone alternating direction algorithm (NADA) [12] in 2012, which integrates alternating direction and nonmonotone line search. An alternating direction total variation minimization (ADTVM) algorithm for fewviews reconstruction [13] was developed inspired by the literature [10–12]. The augmented Lagrangian functionbased ADM is actually equivalent to the Bregman iterative method when the constraints are linear [14]. However, the expression in [13] is simpler than that in [8].
The CT image reconstruction problem is a largescale problem. The ADTVM algorithm [13] is not directly suitable for distributed implementation. Boyd et al. [15] argued that the alternating direction method of multipliers is well suited for distributed convex optimization, in particular, for largescale problems arising in statistics, machine learning, and other related areas. In this study, a distributed algorithm called distributed alternating direction total variation minimization (DisADTVM) is developed using ADM. The proposed algorithm is as simple as the ADTVM algorithm and can accelerate the latter without accuracy loss.
2. Method
The imaging model can be approximated using the following discrete linear system: where the vector has length , which is the number of measured projection rays; the vector has length , which is the number of expansion elements used in representing the object function; the system matrix is a pixeldriven projection operator.
Sparseviews projection data are not sufficient for exact reconstruction. The problem we consider in this study is illposed. To solve linear system (1), we use a regularization method with anisotropic TV minimization, as follows: where and denotes the differential operator along direction . In particular, and denote the horizontal and vertical differential operators, respectively, for twodimensional form. and are separated in along vertical direction as
We consider a variant of (3) as follows: where denotes in node and , , in node . Its corresponding augmented Lagrangian function is where is Lagrange multiplier and the parameters and are both used to balance the terms. The ADM is used to solve the problem that minimizes the augmented Lagrangian function; that is,
The final algorithm of DisADTVM can be expressed as where and can be computed in node and stands for the MoorePenrose pseudoinverse of matrix . Computing the pseudoinverse at each iteration is too costly to implement numerically, while we use NADA [12] to solve “subproblem” in (7).
The convergence analysis of ADTVM algorithm has been well analyzed in the literature [12], and the convergence proof of the distributed algorithms based on ADM can be found in [15, 16]. The iterative algorithms using the ADM based on augmented Lagrangian function decompose the optimization problem into some simple subproblems with closed form solution. Therefore, the algorithms are efficient and practical for the low cost in each iteration. The NADA algorithm enables taking full advantages of the lowcost minimization in “easy” direction and allows relatively quick and large steps in the “hard” direction. The distributed algorithms can distribute some computation to individual nodes; thereby, the algorithms reduce the running time through data distribution and computation. The proposed DisADTVM algorithm in this paper integrates above advantages and its derivation and implementation are as simple as the ADTVM algorithm.
3. Numerical Results
3.1. Simulation Studies
We perform numerical experiments to demonstrate and validate the proposed method for sparseview image reconstruction. Scanning and reconstruction parameters are listed in Table 1. Detector elements are equidistantly spaced at 0.127 mm.

The proposed method is compared with ASDPOCS algorithm [6] and the ADTVM algorithm [13], using the same parameters to validate their performance. Dual core is used in implementing the proposed distributed algorithm on two nodes.
In the experimental configuration, we use one detector for data acquisition by taking 36 angular samples evenly distributed over an angular range of 360°. The size of the phantom simulation is set as follows. Image size is 256 × 256 = 65536 voxels, and projection data size is 36 views, with 512 detectors or 18432 measured rays.
The images reconstructed from this set of data using the ASDPOCS algorithm, ADTVM algorithm, and the proposed distributed algorithm are shown in Figure 1. The profiles of these images along the central horizontal and vertical rows are presented in Figure 2. The number of iterations for the three algorithms is 1000 each. The parameters of ASDPOCS are same as those in [6]. The parameters in the ADTVM algorithm and the proposed distributed algorithm are both and .
(a) Phantom
(b) ASDPOCS
(c) ADTVM
(d) New method
(a)
(b)
(c)
(d)
(e)
(f)
We use the root mean squared error (RMSE) as a measure of the reconstruction error to demonstrate reconstruction accuracy quantitatively. The RMSE is defined as where and are the ideal phantom and the reconstruction, respectively, and is the total number of pixels in the image. The RMSEs of the reconstructions of the SheppLogan phantom are calculated. The results of the three methods are illustrated in Figure 3. Table 2 shows the RMSE of the reconstructions from the projection data above with the three algorithms. It is clear that the accuracy and effectivity of the ADTVM algorithm and the proposed distributed algorithm are both better than those of the ASDPOCS algorithm. This is due to the use of ADM and NADA algorithms. Moreover, we can see that the accuracies of the ADTVM algorithm and proposed distributed algorithm are both almost the same. This is because the derivation and implementation of distributed algorithm are very similar as the ADTVM algorithm.

The running time of the three algorithms is shown in Table 3 and Figure 4 for the phantom results in the aforementioned configuration. Timing is implemented based on the average of 10 computations. The speedup is approximately 1.4 on the average.

3.2. Reconstruction Using Real Data
We perform experiments to reconstruct a head model from real data to further validate the proposed algorithm. Scanning and reconstruction parameters are listed in Table 4. Detector elements are equidistantly spaced at 0.635 mm.

We reconstruct a axial slice for convenience. Images reconstructed using the ASDPOCS algorithm, the ADTVM algorithm, and the proposed distributed algorithm are shown in Figure 5. The numbers of iterations for the three algorithms are 200 and 1000, respectively. The experimental result suggests that ADTVM algorithm and the proposed distributed algorithm produce better reconstruction than ASDPOCS. Hence, the results of ADTVM algorithm and the proposed distributed algorithm are almost the same.
(a) ASDPOCS (200 iter)
(b) ADTVM (200 iter)
(c) New method (200 iter)
(d) ASDPOCS (1000 iter)
(e) ADTVM (1000 iter)
(f) New method (1000 iter)
The running time of the three algorithms is shown in Table 5 and Figure 6 for the reconstruction results in the aforementioned configuration. Timing is implemented based on the average of 10 computations. The speedup is approximately 1.4 on the average.

We use Amdahl’s law [17] to predict the theoretical maximum speedup as follows: where denotes the fraction of the algorithm which is strictly serial. In the ADTVM algorithm, is about 0.1, so the theoretical maximum speedup in two nodes is . The speedup in real experiments will be less than as the cost on communication exists in every iteration. The average speedup of the proposed distributed algorithm in all the experiments shows that the algorithm reduces the running time obviously.
All experiments are performed using C programming language under Visual Studio 2012 and OpenMP running on an AMAX Tesla workstation with Intel Xeon E5520 dualcore CPU 2.27 GHz and 24 GB memories. We partly refer to the MATLAB solver of “TVAL3” [11] for the implementation.
4. Conclusions
The DisADTVM algorithm is as simple as the ADTVM algorithm and can accelerate the latter without accuracy loss. The new algorithm is well suited for CT image sparseview reconstruction problem as a largescale problem. It is clear that the DisADTVM algorithm can be applied to other tomographic imaging modalities with linear system models. We will study the relationship between the performance and the number of nodes in a forthcoming paper.
Acknowledgments
This work was supported by the National High Technology Research and Development Program of China (863 Subject No. 2012AA011603) and the National Natural Science Foundation of China (no. 61372172).
References
 H. K. Tuy, “An inversion formula for conebeam reconstruction,” SIAM Journal on Applied Mathematics, vol. 43, no. 3, pp. 546–552, 1983. View at: Google Scholar
 B. D. Smith, “Image reconstruction form conebeam projections necessary and sufficient conditions and reconstruction methods,” IEEE Transactions on Medical Imaging, vol. 4, no. 1, pp. 14–25, 1985. View at: Google Scholar
 E. J. Candès, J. Romberg, and T. Tao, “Robust uncertainty principles: exact signal reconstruction from highly incomplete frequency information,” IEEE Transactions on Information Theory, vol. 52, no. 2, pp. 489–509, 2006. View at: Publisher Site  Google Scholar
 E. J. Candès, J. K. Romberg, and T. Tao, “Stable signal recovery from incomplete and inaccurate measurements,” Communications on Pure and Applied Mathematics, vol. 59, no. 8, pp. 1207–1223, 2006. View at: Publisher Site  Google Scholar
 E. Y. Sidky, C.M. Kao, and X. Pan, “Accurate image reconstruction from fewviews and limitedangle data in divergentbeam CT,” Journal of XRay Science and Technology, vol. 14, no. 2, pp. 119–139, 2006. View at: Google Scholar
 E. Y. Sidky and X. Pan, “Image reconstruction in circular conebeam computed tomography by constrained, totalvariation minimization,” Physics in Medicine and Biology, vol. 53, no. 17, pp. 4777–4807, 2008. View at: Publisher Site  Google Scholar
 L.Y. Wang, L. Li, B. Yan, C.S. Jiang, H.Y. Wang, and S.L. Bao, “An algorithm for computed tomography image reconstruction from limitedview projections,” Chinese Physics B, vol. 19, no. 8, Article ID 088106, 2010. View at: Publisher Site  Google Scholar
 B. Vandeghinste, B. Goossens, J. De Beenhouwer et al., “SplitBregmanbased sparseview CT reconstruction,” in Proceedings of the 11th International Conference on Fully 3D Image Reconstruction in Radiology and Nuclear Medicine, pp. 431–434, 2011. View at: Google Scholar
 X. Han, J. Bian, E. L. Ritman, E. Y. Sidky, and X. Pan, “Optimizationbased reconstruction of sparse images from fewview projections,” Physics in Medical and Biology, vol. 57, no. 16, pp. 5245–5273. View at: Google Scholar
 Y. Wang, J. Yang W Yin, and Y. Zhang, “A new alternating minimization algorithm for total variation image reconstruction,” SIAM Journal on Imaging Sciences, vol. 1, no. 3, pp. 948–951, 2008. View at: Google Scholar
 C. Li, An Efficient Algorithm for Total Variation Regularization with Applications to the Single Pixel Camera and Compressive Sensing, Rice University, Houston, Tex, USA, 2009.
 C. Li W Yin, H. Jiang, and Y. Zhang, “An efficient augmented Lagrangian method with application to total variation minimization,” Rice University CAAM Technical Report TR1213, 2012. View at: Google Scholar
 H. Zhang, L. Wang, B. Yan, L. Li, X. Xi, and L. Lu, “Image reconstruction based on totalvariation minimization and alternating direction method in linear scan computed tomography,” Chinese Physics B, vol. 22, no. 7, Article ID 078701, 2013. View at: Google Scholar
 S. Osher, W. Yin, and D. Goldfarb, “Bregman iterative algorithms for l1minimization to compressed sensing,” SIAM Journal on Imaging Sciences, vol. 1, no. 1, pp. 143–168, 2008. View at: Google Scholar
 S. Boyd, N. Parikh, E. Chu, B. Peleato, and J. Eckstein, “Distributed optimization and statistical learning via the alternating direction method of multipliers,” Foundations and Trends in Machine Learning, vol. 3, no. 1, pp. 1–122, 2010. View at: Publisher Site  Google Scholar
 Z. Peng, M. Yan, and W. Yin, “Parallel and distributed sparse optimization,” http://www.caam.rice.edu/~optimization/disparse/. View at: Google Scholar
 Wikipedia, “Amdahl's law,” http://en.wikipedia.org/wiki/Amdahl's_law. View at: Google Scholar
Copyright
Copyright © 2013 Linyuan Wang et al. This is an open access article distributed under the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.