Journal of Healthcare Engineering

Journal of Healthcare Engineering / 2019 / Article

Comment on “Assessing Effectiveness and Costs in Robot-Mediated Lower Limbs Rehabilitation: A Meta-Analysis and State of the Art”

  • Alberto Esquenazi |
  •  Article ID 7634965 |
  •  Published 28 Nov 2018
  • | View Article

Response to: Comment on “Assessing Effectiveness and Costs in Robot-Mediated Lower Limbs Rehabilitation: A Meta-Analysis and State of the Art”

  • Giorgio Carpino | Alessandra Pezzola | ... | Eugenio Guglielmelli |
  •  Article ID 9693801 |
  •  Published 24 Sep 2019

Letter to the Editor | Open Access

Volume 2019 |Article ID 9693801 | 2 pages |

Response to: Comment on “Assessing Effectiveness and Costs in Robot-Mediated Lower Limbs Rehabilitation: A Meta-Analysis and State of the Art”

Academic Editor: Maria Lindén
Received27 Jun 2019
Accepted04 Jul 2019
Published24 Sep 2019

The authors have analysed the comments by Alberto Esquenazi [1] on their article “Assessing Effectiveness and Costs in Robot-Mediated Lower Limbs Rehabilitation: A Meta-Analysis and State of the Art” [2]. The authors believe that the investigated topic, and assessment studies on medical devices generally, is a debated theme since the scientific evidence is sparse and the attempts to collect information are challenging. The need of the assessment for medical device is, however, crucial for supporting the decision-making process. The literature in the field of robotics introduced in the clinical procedures to help clinicians to perform their tasks is missing these types of assessment studies.

The replies to the comments on the article are given below.

Regarding the purchasing costs, the comments are agreeable, but it is important not to miss the aims of the study. Starting from a meta-analysis of robot-mediated lower limbs rehabilitation for stroke-affected patients, the core of the article is to evaluate the effectiveness of the robotic approach through the use of wearable robots or operational machines with respect to the conventional through a series of outcomes (including a cost-effectiveness analysis) with the final objective to set up some general guidelines for the decision maker for the choice of best procedure to follow for the motor rehabilitation. It is, thus, not appropriate to lessen the scope of the article to a comparison between the prices of the mentioned medical class of devices. In addition, the study is based on references and costs up to 2015 (the study was set up at the end of 2015; then, for delays in the finalization of the paper and in the review procedures of previously selected journals, it has been published in 2018). The costs of the devices were modified in these years, and the authors are happy to observe that there is a levelling of the device cost. This is the natural lifecycle of a medical device and, in general, of a product. In this new price configuration, comparing state-of-the-art wearable robots and state-of-the-art operational machines, the choice of the decision makers becomes more difficult, and this is the natural business competition between companies and, thus, the authors are not convinced that modifying the calculations in the article can bring to an added value with respect to its scope. In a year from now, for example, considering new data and new device coming from new studies, the costs of the device and probably the outcomes of the study itself will change again, while the methodology of the study will be the same in time.

On the number of human resources, they are calculated as the average from the data reported in the references included in the study. Regarding the other two articles cited by Esquenazi [3, 4], it is not clear if they fall in the same inclusion criteria described in Section 2.1 of the article [2]. If only the intensive training is considered, the number of necessary human resources goes up. This means that the difference between the costs calculated in the robotic therapy and in the conventional therapy decreases and, thus, the conclusion that the robotic therapy is more cost efficient with respect to the conventional therapy is even more verified. Furthermore, the study of Esquenazi et al. [4] is not reported in the article since it is posterior to the references analysed in the study, as already described above. In this case, where the number of human resources adopted for the operational machine-based therapy is higher than the one in the wearable robots therapy, it depends if [4] fits in the same inclusion criteria or not, as already stated.

Regarding the cost of the treadmill, for the conventional therapy the treadmill cost was not considered because the authors assumed that this device is generally already present in a rehabilitation structure and also because its cost was considered less than 1.000 €. Splitting this cost for the number of sessions, a marginal cost comes up.

Concerning the comment on the possibility for the robotic therapy to allow parallel sessions, thus increasing the amount of therapy sessions that a single therapist can provide, the authors agree on this comment; however, it much depends on the work management of the individual rehabilitation clinics. It seems that this is more of a suggestion to give to the decision maker than a hypothesis to put in the methodological flow of the study.

On the safety issues, the sentence is based on the evidence in Cenciarini and Dollar [5], but it also considers the study of Jarrassé et al. [6] on the upper limbs that was already cited in other studies by the authors, i.e., on the design of a nonanthropomorphic wearable robots for lower limbs [7]. The conclusion starts from the analysis of the outcome on the timing of the rehabilitation session and, as described in the article, in the case of wearable robots-mediated therapy, a considerable time is spent to set up the robot. This applies even more in the exoskeletons case, in general, since the risk to not properly set the device and create some misalignments between the robotic and human joints is high. Such misalignments can cause the exchange of unwanted interaction forces causing discomfort or even pain for the patient. This situation could be dangerous to the patient, as well as an obstacle to his/her movement; however, this is a rare occurrence in the case of operational machines. The countermeasures, hardware and software, introduced in the Lokomat system are very important to mitigate the abovementioned possible risks. With respect to operational machines and patients with severe impairments, the authors agree with the comment by Esquenazi, although this case seems to not meet the inclusion criteria of the study.

Regarding the update of the Cochrane review, the authors are aware of this but, as already stated, the study was drawn before 2017. Regarding the comment on 26 or 28 studies considered in the article, the motivation is that 2 of them (Kelley et al. [8] and van Nunen et al. [9]) are an update of two studies already considered in the 2013 version of the Cochrane. In this view, it seems that only one study (Calabrò et al. [10]) is not considered in the version 2017 of the Cochrane, and it is difficult for the authors to reply to this comment. We appreciate this doubt being raised and the opportunity to better explain this methodological aspect.

The authors hope to have replied in a clear way to the comments by Esquenazi highlighting the key points of the methodology applied to the study. Of course, things change over time and will change fast, but the authors hope to have setup guidelines for the decision makers in order to give them the tools to choose the best technology for the medical procedures at the time being.

Conflicts of Interest

The authors declare that there are no conflicts of interest regarding the publication of this paper.


  1. A. Esquenazi, “Comment on “Assessing effectiveness and costs in robot-mediated lower Limbs rehabilitation: a meta-analysis and state of the art”,” Journal of Healthcare Engineering, vol. 2018, Article ID 7634965, 3 pages, 2018. View at: Publisher Site | Google Scholar
  2. G. Carpino, A. Pezzola, M. Urbano, and E. Guglielmelli, “Assessing effectiveness and costs in robot-mediated lower Limbs rehabilitation: a meta-analysis and state of the art,” Journal of Healthcare Engineering, vol. 2018, Article ID 7492024, 9 pages, 2018. View at: Publisher Site | Google Scholar
  3. S. Morrison, “Financial feasibility of robotics in neurorehabilitation,” Topics in Spinal Cord Injury Rehabilitation, vol. 17, no. 1, pp. 77–81, 2011. View at: Publisher Site | Google Scholar
  4. A. Esquenazi, S. Lee, A. Wikoff, A. Packel, T. Toczylowski, and J. Feeley, “A comparison of locomotor therapy interventions: partial-body weight−supported treadmill, Lokomat, and G-EO training in people with traumatic brain injury,” PM&R, vol. 9, no. 9, pp. 839–846, 2017. View at: Publisher Site | Google Scholar
  5. M. Cenciarini and A. M. Dollar, “Biomechanical considerations in the design of lower limb exoskeletons,” in Proceedings of the IEEE International Conference on Rehabilitation Robotics ICORR, pp. 297–302, Zurich, Switzerland, July 2011. View at: Google Scholar
  6. N. Jarrassé, M. Tagliabue, J. V. G. Robertson et al., “A methodology to quantify alterations in human upper limb movement during co-manipulation with an exoskeleton,” IEEE Transactions on Neural Systems and Rehabilitation Engineering, vol. 18, no. 4, pp. 389–397, 2010. View at: Publisher Site | Google Scholar
  7. D. Accoto, F. Sergi, N. L. Tagliamonte, G. Carpino, A. Sudano, and E. Guglielmelli, “Robomorphism: a nonanthropomorphic wearable robot,” IEEE Robotics & Automation Magazine, vol. 21, no. 4, pp. 45–55, 2014. View at: Publisher Site | Google Scholar
  8. C. P. Kelley, J. Childress, C. Boake, and E. A. Noser, “Over-ground and robotic-assisted locomotor training in adults with chronic stroke: a blinded randomized clinical trial,” Disability and Rehabilitation: Assistive Technology, vol. 8, no. 2, pp. 161–168, 2013. View at: Publisher Site | Google Scholar
  9. M. P. M. van Nunen, K. H. L. Gerrits, M. Konijnenbelt, T. W. J. Janssen, and A. de Haan, “Recovery of walking ability using a robotic device in subacute stroke patients: a randomized controlled study,” Disability and Rehabilitation: Assistive Technology, vol. 10, no. 2, pp. 141–148, 2014. View at: Publisher Site | Google Scholar
  10. R. S. Calabrò, S. Reitano, A. Leo, R. De Luca, C. Melegari, and P. Bramanti, “Can robot-assisted movement training (Lokomat) improve functional recovery and psychological well-being in chronic stroke? Promising findings from a case study,” Functional Neurology, vol. 29, no. 2, pp. 139–141, 2014. View at: Google Scholar

Copyright © 2019 Giorgio Carpino et al. This is an open access article distributed under the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.

More related articles

455 Views | 228 Downloads | 0 Citations
 PDF  Download Citation  Citation
 Download other formatsMore
 Order printed copiesOrder

Related articles

We are committed to sharing findings related to COVID-19 as quickly and safely as possible. Any author submitting a COVID-19 paper should notify us at to ensure their research is fast-tracked and made available on a preprint server as soon as possible. We will be providing unlimited waivers of publication charges for accepted articles related to COVID-19. Sign up here as a reviewer to help fast-track new submissions.