Background <p>The effectiveness of rehabilitation aimed at improving the activities of daily living and physical functions may differ between hospitalized patients undergoing hemodialysis (HD) and not undergoing HD (non-HD). The aim of the present study was to compare the outcomes of rehabilitation between hospitalized HD and non-HD patients.</p> Methods <p>This was a retrospective cohort study of inpatients who underwent rehabilitation. We measured the rehabilitation time (min/day), length of hospital stay (days), and the Barthel index (BI). In addition, at the time of admission and discharge, grip strength, isometric knee extension strength, 10&#xa0;m walking speed, timed up and go test, and short physical performance battery were examined. The outcomes were then compared between the HD and non-HD groups.</p> Results <p>This study was made up of 902 patients (non-HD group: 765, HD group: 137). Our analysis revealed a lower rehabilitation time [43.3 (0.6) vs. 38.8 (1.2) min/day] and longer hospital stay [48.5 (0.5) vs. 58.1 (2.3) days] in the HD group as compared with the non-HD group (<i>p</i> &lt; 0.05). In addition, the 10&#xa0;m walking speed [0.75 (0.02) vs. 0.66 (0.03) m/s], timed up and go test [20.8 (0.7) vs. 24.3 (1.0) sec], and short physical performance battery [6.3 (0.6) vs. 4.7 (0.6) points] at discharge were also significantly lower in the HD group as compared with the non-HD group (<i>p</i> &lt; 0.05).</p> Conclusion <p>Rehabilitation efforts for HD patients need to be improved by securing more time for inpatient rehabilitation and promoting mobility function improvement for these patients.</p> Graphical abstract <p></p>