<?xml-model href='http://www.tei-c.org/release/xml/tei/custom/schema/relaxng/tei_all.rng' schematypens='http://relaxng.org/ns/structure/1.0'?><TEI xmlns="http://www.tei-c.org/ns/1.0">
	<teiHeader>
		<fileDesc>
			<titleStmt><title level='a'>Multi-Joint Leg Moment Estimation During Walking Using Thigh or Shank Angles</title></titleStmt>
			<publicationStmt>
				<publisher>IEEE</publisher>
				<date>01/01/2023</date>
			</publicationStmt>
			<sourceDesc>
				<bibl> 
					<idno type="par_id">10462226</idno>
					<idno type="doi">10.1109/TNSRE.2022.3217680</idno>
					<title level='j'>IEEE Transactions on Neural Systems and Rehabilitation Engineering</title>
<idno>1534-4320</idno>
<biblScope unit="volume">31</biblScope>
<biblScope unit="issue"></biblScope>					

					<author>Mahdy Eslamy</author><author>Mo Rastgaar</author>
				</bibl>
			</sourceDesc>
		</fileDesc>
		<profileDesc>
			<abstract><ab><![CDATA[To reinstate human-like locomotion by using robotic prosthetics, orthotics or exoskeletons, a main challenge is how to coordinate the motion of these devices with that of the biological limbs. One approach to overcome this challenge is to identify firstly the relationships that exist between the kinematics and kinetics of the lower extremity joints and limbs. In this work we aimed to continuously estimate sagittal plane ankle, knee and hip moments using shank or thigh angles. For this purpose, neural network and wavelets were used in a nonlinear auto-regressive model with exogenous inputs. This approach circumvented the need for switching rules or intermediate parameters.To assess the performance of the estimator, four case studies were developed. First, thigh angles (inputs) were used to estimate hip moments (outputs). Second, thigh angles were used to estimate knee moments. Third, ankle moments were estimated using thigh angles, and in the fourth case study, ankle moments were estimated using shank angles. Three different databases involving 106 subjects at different walking speeds were used to evaluate estimation quality. The testing procedure involved both inter-subject and intrasubject evaluations. The best estimation performance was observed when ankle moments were estimated from shank angles. The weakest estimation performance was observed when knee moments were estimated using thigh angles at 0.5 m/s. For this case, the estimation quality was much better at 1.5 m/s. Average RMS errors were 0.13 -0.15, 0.10 -0.13, and 0.09 -0.12 [Nm/kg] for hip, knee and ankle moments, respectively. Average mean absolute errors MAEs were 0.10 -0.11, 0.07 -0.10, and 0.06 -0.08 [Nm/kg] for hip, knee and ankle moments, respectively. Average correlation coefficients were 0.90 -0.98 and 0.98 -0.99 for hip and ankle moment estimations. The value for knee was comparable only at high speed (0.96 for 1.5 m/s), while it was less accurate at slow speed (0.71 for 0.5 m/s). In general, for all of the joints, the estimation accuracy was comparable with that of other studies, although one source of input was employed (either shank or thigh angle).]]></ab></abstract>
		</profileDesc>
	</teiHeader>
	<text><body xmlns="http://www.tei-c.org/ns/1.0" xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance" xmlns:xlink="http://www.w3.org/1999/xlink">
<div xmlns="http://www.tei-c.org/ns/1.0"><p>prosthetics, and exoskeletons <ref type="bibr">[1]</ref>, <ref type="bibr">[2]</ref>, <ref type="bibr">[3]</ref>, <ref type="bibr">[4]</ref>, and gait rehabilitation devices <ref type="bibr">[5]</ref>, <ref type="bibr">[6]</ref>, one approach is to create relationships between gait variables such as joints' kinetics and kinematics, muscular activities and/or ground reaction forces.</p><p>To estimate joints' moments, different algorithms have been suggested in which a wide range of inputs such as gait kinematics, kinetics, EMG (electromyography) signals, demographic (e.g., age and gender) and anthropometric (e.g., height and mass) information were used.</p><p>Some studies used impedance concept to express ankle and knee moments as a function of joint's angular positions and velocities multiplied by stiffness and damping gains <ref type="bibr">[2]</ref>, <ref type="bibr">[3]</ref>, <ref type="bibr">[4]</ref>, <ref type="bibr">[7]</ref>, <ref type="bibr">[8]</ref>, <ref type="bibr">[9]</ref>. These algorithms are sometimes used with finite-state machine approach, in which a gait cycle is segmented into different phases (states) (e.g., into four <ref type="bibr">[2]</ref>). For each state, stiffness and damping gains were determined piece-wise, first based on average human gait data, e.g., from <ref type="bibr">[10]</ref> and then tuned based on subject-specific experimental data. Next, the gains were obtained using a constrained least-squares optimization for each state <ref type="bibr">[2]</ref>. Both linear <ref type="bibr">[3]</ref> and nonlinear <ref type="bibr">[2]</ref>, <ref type="bibr">[11]</ref>, <ref type="bibr">[12]</ref> expressions were proposed to represent knee/ankle moments. In addition to the gait cycle segmentation, another requirement was defining some switching rules to transit between different gait phases.</p><p>To avoid gait cycle segmentation, the impedance approach was combined with other algorithms. In <ref type="bibr">[13]</ref>, LASSO regression (least absolute shrinkage and selection operator) was utilized to predict ankle, knee, and hip moments as a linear summation of stiffness and damping gains multiplied by joint angular positions and velocities, respectively. To estimate, e.g., ankle moment, the method however required ankle, knee and hip angles and angular velocities from both ipsi-and contra-lateral sides. In <ref type="bibr">[14]</ref>, in addition to angular and angular velocity terms, angular acceleration and gravity terms were included to estimate the hip moment. This approach was limited to a specific walking speed.</p><p>The phase plane approach was proposed in <ref type="bibr">[14]</ref> to continuously predict ankle motions during walking. The method required gait percents and walking speeds to estimate the corresponding motions. To estimate those parameters, shank angular velocities and angles were employed as inputs. Next, the corresponding ankle moments or angles were found out using a previously produced off-line look-up table. To predict different speeds, conditional if-then statements were also required. A Gaussian process regression algorithm was developed in <ref type="bibr">[15]</ref> to predict ankle moments for twenty-one subjects using shank angular positions and velocities. In that approach, This work is licensed under a Creative Commons Attribution 4.0 License. For more information, see <ref type="url">https://creativecommons.org/licenses/by/4.0/</ref> it was not necessary to predict speeds or gait percents. Instead, the inputs were directly mapped to the outputs without requiring those intermediate parameters.</p><p>In <ref type="bibr">[16]</ref>, hip angles together with thigh Euler angles were processed in an artificial neural network to estimate the corresponding gait percents. A cosine function (with gait percents as inputs) was then used to simplistically represent the hip moments. The work was later continued in <ref type="bibr">[17]</ref>, where two machine learning algorithms (extreme gradient boosting algorithm and a feed-forward neural network) were implemented to estimate subject-specific hip moments. To perform moment estimations, hip angles, gyroscopic data and six-axis acceleration from a thigh-mounted IMU were used. The study concluded that both methods had relatively similar estimation quality.</p><p>Electromyography (EMG) signals are the other types of the inputs used for moment estimation <ref type="bibr">[18]</ref>, <ref type="bibr">[19]</ref>, <ref type="bibr">[20]</ref>, <ref type="bibr">[21]</ref>. In <ref type="bibr">[22]</ref>, a neural network was utilized to estimate ankle moments for very slow to fast walking speeds. EMG signals obtained from five lower extremity muscles were used for this purpose. The study showed that EMG signals extracted from tibialis anterior, medial gastrocnemius and biceps femoris (combined) led to the lowest root mean square errors. On the other side, EMG signals from tibialis anterior and medial gastrocnemius (combined) led to very slightly less favorable results.</p><p>In <ref type="bibr">[23]</ref>, ground reaction forces together with EMG signals were used to continuously estimate ankle, knee and hip moments during walking. Performance of a wavelet neural network was compared with that of a feed forward neural network for four subjects. Results showed that the wavelet approach could predict joint moments with higher accuracy, however, the method required a high number of inputs (two ground reaction forces and eight EMG signals). Different studies reported that merging kinematics with EMG inputs can lead to better estimation accuracy in comparison to solely using EMG signals, <ref type="bibr">[24]</ref>, <ref type="bibr">[25]</ref>, <ref type="bibr">[26]</ref>, <ref type="bibr">[27]</ref>.</p><p>In addition to EMG and kinematics data, anthropometrics and demographics are also used as inputs to different algorithms. An artificial neural network with three layers was designed in <ref type="bibr">[28]</ref> to convert various inputs (kinematics, anthropometrics, demographics, electromyography) to the sagittal plane ankle, knee and hip moments during self-selected walking for nineteen healthy young subjects.</p><p>Interestingly, the study showed that using less inputs including only kinematics (joint angles, velocities and accelerations) and demographics (age and gender) led to a relatively similar estimation quality compared to using a complete set of the inputs. Furthermore, the study reported that the estimation performance using EMG plus demographics inputs was less accurate than the kinematics plus demographics inputs.</p><p>In <ref type="bibr">[29]</ref>, hip, knee and ankle angles together with gait velocity, subjects' height and weight, and foot, shank and thigh lengths were used to estimate lower extremity joints' moments. To do so, an artificial neural network was trained with inputs from twelve subjects walking from 0.8 to 2 m/s. The work was later continued in <ref type="bibr">[30]</ref>, in which the angular velocities and linear accelerations of the lower extremity limbs were used to estimate ankle, knee and hip moments during walking (only stance phase). The performance of two algorithms, a long short term memory neural network and a feed forward one was compared. Both approaches had relatively similar results.</p><p>A customized instrumented insole and a tissue force sensor were developed in <ref type="bibr">[31]</ref> to estimate ankle moments for six healthy subjects. An artificial neural network was developed to compare the estimated values with those obtained from an inverse dynamics procedure. The effects of different inputs (ankle angles, inputs from instrumented insole, Achilles tendon force) were investigated on the estimation results.</p><p>State estimation with minimal inputs is of interest in biomechanical gait analysis or designing control algorithms for assistive devices, <ref type="bibr">[22]</ref>, <ref type="bibr">[28]</ref>, <ref type="bibr">[32]</ref>, <ref type="bibr">[33]</ref>. This potentially leads to robotic assistive devices with less embedded sensors (and markers, in case of gait studies).</p><p>In this work, we focus on the estimation of the sagittal plane ankle, knee and hip moments using only thigh or shank angles, depending on the joint under investigation. The target is to estimate joint moments using minimal sensory information which can be potentially obtained from a lower limb proximally above a specific joint. For instance, when possible (e.g., for knee and ankle joints), estimation was performed using the lower limb's angle above the respective joint (thigh angle for knee moment estimation, or shank angle for ankle moment estimation). The reason is that we would like to develop a motion planner whose outputs are a function of relatively independent inputs. Obtaining inputs from a lower limb which is below a specific joint, will result in a motion planner whose inputs are directly influenced by the movement of the corresponding joint, and hence creates a paradoxical situation for the motion planner. Therefore, we used the logical hierarchy existing in the human body structure.</p><p>Furthermore, it was aimed to eliminate the need for speed or gait percent identification, switching rules or look-up tables. To achieve these targets, a nonlinear auto-regressive model was used in combination with wavelets and neural networks to estimate those variables.</p><p>We used this approach previously to estimate ankle and knee angles for several walking speeds <ref type="bibr">[34]</ref>. In this study, this algorithm is extended to multi-joint moment estimation for lower extremities. This helps us create a potential comprehensive and integrated controller and motion planner to be used in robotic prostheses or orthoses.</p><p>The human gait has periodic as well as variable nature. Similar to Fourier series, the wavelets theory <ref type="bibr">[35]</ref> expresses a function (a signal) as the sum of a series of weighted small waves called wavelets. The wavelets rise and decay through time, and therefore have a fundamental difference with basis functions used in Fourier series. Therefore, the wavelets can chase the changes of system response both in time and frequency domains <ref type="bibr">[36]</ref>, <ref type="bibr">[37]</ref>, <ref type="bibr">[38]</ref>, and as a result can describe a part of a function with a resolution corresponding to its scale. Further discussion is presented in the Methods section. </p></div>
<div xmlns="http://www.tei-c.org/ns/1.0"><head>II. METHODS</head><p>Shank or thigh angles were used to estimate sagittal plane ankle, knee and hip moments. For this purpose, three databases involving 106 subjects were used.</p><p>The first database was obtained from <ref type="bibr">[39]</ref>, in which twentyone subjects (1.73&#177;0.09 m, 70.9&#177;11.7 kg, 25.4&#177;2.7 yr) walked at slow, moderate and fast speeds (0.5, 1, and 1.5 m/s). The second database (publicly available) was obtained from <ref type="bibr">[40]</ref>, in which thirty-seven subjects walked at eight different (subject-specific) speeds (young adults (27.6&#177;4.4 yr, 171.1&#177;10.5 cm, 68.4&#177;12.2 kg) and older adults (62.7&#177;8.0 yr, 161.8&#177;9.5 cm, 66.9&#177;10.1 kg)). The third database (publicly available) was obtained from <ref type="bibr">[41]</ref>, in which forty-eight subjects walked at several speeds (6 -72 yr, 18.2 -110 kg, 116.6 -187.5 cm). In the second and third databases, each subject walked at self-selected speeds which were not necessarily similar to another participant's speeds. Therefore, unlike the first database, the participants were not required to walk at fixed specific speeds.</p><p>The definitions of thigh angle &#952; th , shank angle &#952; sh , hip moment M h , knee moment M k and ankle moment M a are shown in Fig. <ref type="figure">1</ref>. In Fig. <ref type="figure">2A-E</ref>, hip, knee and ankle moments as well as thigh and shank angles, are shown for twenty-one subjects together with their mean curves. The numerical values in Fig. <ref type="figure">2</ref> were obtained from <ref type="bibr">[39]</ref>.</p><p>To estimate joints' moments, a nonlinear autoregressive model with exogenous inputs (NARX) <ref type="bibr">[42]</ref> was developed. We previously used this modeling approach to estimate joints' angles for different speeds <ref type="bibr">[34]</ref>. The proposed model is comprised of the inputs, the estimator and the outputs Fig. <ref type="figure">3</ref>. The outputs are the estimated joints' moments &#375; (e.g., Mh ). In this algorithm, the inputs consist of the current and past values of the external inputs u (thigh or shank angles) and past values of the estimated outputs &#375; (hip/knee/ankle moments). The estimator f , creates a functional relationship between the outputs and the inputs. According to the above, we will have</p><p>The dimension d of the x is usually determined according to the problem to be solved <ref type="bibr">[25]</ref>, <ref type="bibr">[43]</ref>, <ref type="bibr">[44]</ref>, <ref type="bibr">[45]</ref>. Having the Fig. 3. The schematic view of the estimation algorithm, the figure shows the input at time instant k for the case x(k) = [&#375;(k -1), u(k), u(k -1)]. The estimator f(x(k)) then processes the input to produce the estimated outputs &#375;(k).</p><p>above definitions in mind, the estimation algorithm works as depicted in Fig. <ref type="figure">3</ref>.</p><p>To define estimator f , wavelets <ref type="bibr">[36]</ref>, <ref type="bibr">[37]</ref>, <ref type="bibr">[38]</ref> have been used. In general, to enhance the estimation quality, a summation of the wavelets in the form of a network is used <ref type="bibr">[46]</ref>, <ref type="bibr">[47]</ref>. The wavelets theory is similar to the Fourier series. The main difference is that wavelets can describe a function more accurately when its frequency changes with respect to time (which is common in human gait) or when singularities happen at some region of a function.</p><p>Wavelets theory converts a signal into small waves (i.e., the wavelets). Unlike basis functions of the Fourier series (sine and cosine functions), the basis function of the wavelets theory grow and decay through time. According to above, the estimator f can be written as f (x) = L i=1 &#969; i &#968; i (x). Different options exist for the basis function &#968;(x). In this study, the Gaussian derivatives family <ref type="bibr">[48]</ref> was selected which is usually used to study joints' motions <ref type="bibr">[49]</ref>, <ref type="bibr">[50]</ref>, <ref type="bibr">[51]</ref>, <ref type="bibr">[52]</ref>, <ref type="bibr">[53]</ref>. Therefore,</p><p>2 . In the above equations, L is the number of wavelets, x T denotes the transpose of x and d is the dimension of the input x <ref type="bibr">[35]</ref>, <ref type="bibr">[36]</ref>, <ref type="bibr">[37]</ref>, <ref type="bibr">[38]</ref>, <ref type="bibr">[48]</ref>.</p><p>The definition of f shows that wavelets can be combined with neural networks theory. The input of the network would be according to [x(k)], and the hidden layer of the network contains the wavelets-based basis functions together with the &#969; coefficients. Finally, the outputs are the estimated joints' moments. Further information about wavelets can be found in <ref type="bibr">[35]</ref>, <ref type="bibr">[36]</ref>, <ref type="bibr">[37]</ref>, <ref type="bibr">[46]</ref>, <ref type="bibr">[47]</ref>, <ref type="bibr">[48]</ref>, and <ref type="bibr">[38]</ref>. In addition, more details are provided in <ref type="bibr">[34]</ref>.</p><p>To estimate joint moments, four case studies were designed: 1) hip moments M h (estimated outputs &#375;) were estimated using thigh angles &#952; th (external inputs u), 2) knee moments M k were estimated using thigh angles, 3) ankle moments M a were estimated using thigh angles, and 4) ankle moments M a were estimated using shank angles &#952; sh .</p><p>To train and test the algorithm, different approaches were adopted to evaluate the performance. For the first database <ref type="bibr">[39]</ref>, the leave-one-subject-out cross validations was used. Therefore, for each case study explained above, the inputs from twenty participants were used for training. Next, the inputs from one remaining subject was used for testing. This procedure was carried out for each individual to estimate the corresponding joints' moments.</p><p>The participants in the second and third databases, walked at different speeds individually. For the second database <ref type="bibr">[40]</ref>, for each subject, data from three speeds were used for training, and data from the remaining five speeds of that subject were used for testing the estimation performance (intra-subject). For the third database <ref type="bibr">[41]</ref>, depending on the available data, for some subjects more than five speeds and for some less than five were used for testing the estimation performance (intra-subject).</p><p>According to Fig. <ref type="figure">3</ref>, the external input u is &#952; th or &#952; sh , and the estimated output &#375; is Mh , Mk or Ma , depending on the joint under study. The root mean square (RMS) errors, the mean absolute errors (MAEs), and the correlation coefficient <ref type="bibr">[19]</ref>, <ref type="bibr">[54]</ref>, <ref type="bibr">[55]</ref> were used to evaluate the estimation quality of the four case studies defined above.</p><p>In the formulas above, n is the number of the samples, M is the estimated moment, and M is the actual one. Since activation functions of the algorithm are of the wavelets form, it is a nonlinear auto-regressive model. In the linear version, f is expressed as a linear combination of the past and current external inputs and past outputs. This version would then be of the form f (x(k)) = a 0 u(k)+a 1 u(k-1) + . . . + b 1 &#375;(k -1) + . . ., in which a i 's and b i 's are scalar values. The estimation results of both linear and nonlinear versions are compared in this study (section III-A). (Subsection III-A) Comparison between the average RMS errors in nonlinear and linear models with respect to size of x(k). (A): knee moment estimations using thigh angles, and (B): ankle moment estimations using shank angles. The values are for the subjects of the first database <ref type="bibr">[39]</ref> at different speeds.</p><p>According to the definition of x(k), it can contain different components. It was of interest to keep the number of the components to a minimum level. Therefore, the performance of the estimator f was evaluated according to different components of x(k) (sections III-A and III-B) to find out the optimal size of x. To decouple the influence of the past estimations on the new ones, the inclusion of the past outputs in x(k) was avoided. Therefore, the estimation of the joints' moments got dependent only on the external inputs u originated from a lower limb (shank or thigh). Nevertheless, the impact of the inclusion of the past estimations on the performance of the algorithm is investigated later in this study. The results are discussed in the next section.</p></div>
<div xmlns="http://www.tei-c.org/ns/1.0"><head>III. RESULTS</head><p>A. Linear vs. Nonlinear Auto-Regressive Model Fig. <ref type="figure">4A</ref>-B compares the performance of a linear model vs. a nonlinear one. It shows the mean RMS errors of the knee and ankle moment estimations using thigh and shank angles, respectively. Those mean values are for the the participants of the first database <ref type="bibr">[39]</ref> at different speeds. Furthermore, the figure shows the variations of the RMS errors with respect to different sizes of input x(k).</p><p>Fig. <ref type="figure">4A-B</ref> shows that for all of the speeds, the RMS errors of the linear model were much higher than those of the corresponding nonlinear model (excluding x(k) = [u(k)]). According to the observed RMS errors, the non-linear model was preferred. Fig. <ref type="figure">4A</ref>-B also shows that the RMS errors in the non-linear model, tend to their minimums faster than the linear one. Fig. <ref type="figure">4</ref> shows that increasing the dimension of input x(k) does not necessarily lead to better estimation.</p></div>
<div xmlns="http://www.tei-c.org/ns/1.0"><head>B. Impact of the Input Size on the Estimation (in Nonlinear Model)</head><p>Fig. <ref type="figure">5A</ref>-D shows the variation of the average RMS errors of the nonlinear model with respect to different sizes of x(k). The average values are for the subjects of the first database <ref type="bibr">[39]</ref> at different speeds and according to the four case studies explained in the Methods section.</p><p>In Fig. <ref type="figure">5A</ref>, when x(k) = [u(k)] (i.e., size of x(k) is 1), the average RMS errors were high. The values declined considerably when x(k) = [u(k), u(k -1)], for all of the speeds. This trend is seen in sub-figures B to D as well. Fig. <ref type="figure">5A</ref> also shows that increasing the dimension of x(k) does not necessarily lead to a continuous decline of the average RMS errors. This is especially more visible in Fig. <ref type="figure">5B-D</ref>.</p><p>Therefore, using Fig. <ref type="figure">5A-D</ref>, the size of the x(k) was decided based on the trade-off (compromise) between complexity of x(k) (i.e., its size) and RMS errors at different speeds. Thus, for the first database <ref type="bibr">[39]</ref>, for case study 1 the size of x(k) was set to 5 (i.e., x(k) = [u(k), . . . , u(k -4)]), for case study 2 the size of x(k) was set to 3, for case study 3 the size of x(k) was set to 5, and for case study 4 the size of x(k) was set to 4. It should be noted that, for instance, for case study 1, Fig. <ref type="figure">5A</ref> shows that when size of x(k) is 10, the minimum results are obtained, however in comparison to the compromised input size (i.e., 5, as we discussed before), the differences were not very considerable. For this case, the RMSE decrease was 3.9%, 4.2%, and 5.2% for 0.5, 1 and 1.5 m/s, respectively (selected vs. minimum). According to the above, we decided to reach a compromise between computational costs due to the size of the input, and RMS errors. Furthermore, it was of interest to avoid the reliance of the current output to too many previous inputs, since it might result in improper response of the motorized prosthetics/orthotics in real-world applications. Therefore, we took into consideration a spectrum of objectives and their impacts/importance. This attitude was adopted throughout this work for each case study. For the second <ref type="bibr">[40]</ref> and third <ref type="bibr">[41]</ref> databases, the size of x(k) is reported at the corresponding Results subsections.</p><p>C. RMS Errors, MAEs and &#961; cc for First Database <ref type="bibr">[39]</ref> Fig. <ref type="figure">6</ref> shows the root mean square (RMS) errors (A), mean absolute errors (MAEs) (B), and &#961; cc values (C) for different subjects and speeds (first database <ref type="bibr">[39]</ref>). For better comparison, the results are also reported in Tab. I.</p><p>The cyan circles are for the first case study, where thigh angles &#952; th were used to estimate hip moments M h . The blue circles are for the second case study, where thigh angles &#952; th were used to estimate knee moments M k . The red circles show the results for the third case study, where thigh angles &#952; th were used to estimate ankle moments M a , and the green circles are for the fourth case study, where shank angles &#952; sh were used to estimate ankle moments M a . The black squares denote the mean values in each case study. All of the values mentioned in this subsection are for 0.5 m/s, 1 m/s and 1.5 m/s, respectively.</p><p>1) Estimating Hip Moment Using Thigh Angles: The average&#177;std RMS errors were 0.13&#177;0.05, 0.13&#177;0.05 and 0.15&#177;0.05 [Nm/kg] (0.5 m/s, 1 m/s and 1.5 m/s, respectively). The average mean absolute errors (MAEs) errors were 0.10&#177;0.04, 0.10&#177;0.04 and 0.11&#177;0.04 [Nm/kg]. The average &#961; cc were 0.90&#177;0.09, 0.97&#177;0.02 and 0.98&#177;0.01.</p><p>2) Estimating Knee Moment Using Thigh Angles: The average&#177;std RMS errors were 0.13&#177;0.05, 0.13&#177;0. <ref type="bibr">06</ref> and 0.13&#177;0.06 [Nm/kg]. The MAEs errors were 0.10&#177;0.04, 0.10&#177;0.05 and 0.09&#177;0.05 [Nm/kg]. The average &#961; cc were 0.71&#177;0.20, 0.90&#177;0.13 and 0.96&#177;0.03. 3) Estimating Ankle Moment Using Thigh Angles: The average RMS errors were 0.13&#177;0.05, 0.12&#177;0.04 and 0.10&#177;0.04 [Nm/kg]. The MAEs errors were 0.10&#177;0.04, 0.08&#177;0.02 and 0.07&#177;0.03 [Nm/kg]. The average &#961; cc were 0.96&#177;0.04, 0.98&#177;0.01 and 0.98&#177;0.01. 4) Estimating Ankle Moment Using Shank Angles: The average RMS errors were 0.12&#177;0.05, 0.10&#177;0.04 and 0.09&#177;0.03 [Nm/kg]. The MAEs errors were 0.08&#177;0.04, 0.07&#177;0.03 and 0.06&#177;0.02 [Nm/kg]. The average &#961; cc were 0.98&#177;0.02, 0.99&#177;0.01 and 0.99&#177;0.01.</p></div>
<div xmlns="http://www.tei-c.org/ns/1.0"><head>D. Ankle, Knee and Hip Moments: Estimated vs. Gait Data</head><p>Fig. <ref type="figure">7A</ref>-D compares the estimated ankle, knee and hip moments versus gait data for several speeds and subjects (related to the first database <ref type="bibr">[39]</ref>), according to the four case studies explained in the Methods section. Fig. <ref type="figure">7A</ref> (first column) is related to estimating the hip moment (case study 1). The second column (Fig. <ref type="figure">7B</ref>) is related to estimating the knee Fig. <ref type="figure">6</ref>. (Subsection III-C) The root mean square (RMS) errors (A), mean absolute errors (MAEs) (B) and &#961; cc (C) values for hip, knee and ankle moment estimations for different inputs (&#952; th or &#952; sh ), speeds and subjects (first database <ref type="bibr">[39]</ref>), according to the four case studies explained in the Methods section. For each case study the mean values are indicated by the black squares. Fig. <ref type="figure">7</ref>. (Subsection III-D) The estimated hip, knee and ankle moments vs. gait data for various speeds and subjects (first database <ref type="bibr">[39]</ref>), according to the four case studies explained in the Methods section.</p><p>moment (case study 2). The third column is related to the ankle moment estimations using thigh angles (case study 3), and the fourth column is related to the ankle moment estimations using shank angles (case study 4).</p><p>For the first database, since all of the participants performed experiments at specific speeds, it was possible for us to provide the figures (Fig. <ref type="figure">6</ref> and Fig. <ref type="figure">7</ref>) and the results, grouped based on the speeds.</p><p>TABLE I COMPARISON OF AVERAGE(&#177;STD) RMS ERRORS, MAES AND &#961; cc (DATABASE 1, SEE ALSO SUBSECTION III-C) 2</p><p>TABLE II COMPARISON OF AVERAGE(&#177;STD) RMS ERRORS, MAES AND &#961; cc (SEE ALSO SUBSECTION III-E &#178; III-F)</p><p>Unlike the first database, subjects in the second and third database did not perform experiments at specific speeds, but rather the speeds were different for each participant. As a result, for these databases the results are not reported according to the speeds and it was not possible for us to show the curves in one figure, similar to what we did in Fig. <ref type="figure">7</ref>. Therefore, in the following subsections, for each quality measure (RMS errors, MAEs, &#961; cc ), the mean of all of the subjects and all of the speeds are reported instead (Tab. II).</p></div>
<div xmlns="http://www.tei-c.org/ns/1.0"><head>E. RMS Errors, MAEs and &#961; cc for Second Database [40] 1) Estimating Hip Moment Using Thigh Angles:</head><p>The average&#177;std RMS errors, MAEs and &#961; cc were 0.13&#177;0.03 [Nm/kg], 0.09&#177;0.02 [Nm/kg] and 0.94&#177;0.03, respectively. The size of x(k) was 5, i.e., x(k) = [u(k), . . . , u(k -4)].</p></div>
<div xmlns="http://www.tei-c.org/ns/1.0"><head>2) Estimating Knee Moment Using Thigh Angles:</head><p>The average&#177;std RMS errors, MAEs and &#961; cc were 0.13&#177;0.04 [Nm/kg], 0.09&#177;0.02 [Nm/kg] and 0.82&#177;0.12, respectively. The size of x(k) was 3.</p></div>
<div xmlns="http://www.tei-c.org/ns/1.0"><head>3) Estimating Ankle Moment Using Thigh Angles:</head><p>The average&#177;std RMS errors, MAEs and &#961; cc were 0.12&#177;0.06 [Nm/kg], 0.08&#177;0.03 [Nm/kg] and 0.97&#177;0.04, respectively. The size of was 3.</p></div>
<div xmlns="http://www.tei-c.org/ns/1.0"><head>4) Estimating Ankle Moment Using Shank Angles:</head><p>The average&#177;std errors, MAEs and &#961; cc were 0.15&#177;0.05 [Nm/kg], 0.10&#177;0.02 [Nm/kg] and 0.95&#177;0.03, respectively. The size of x(k) was 2.</p><p>F. RMS Errors, MAEs and &#961; cc for Third Database <ref type="bibr">[41]</ref> 1) Estimating Hip Moment Using Thigh Angles:</p><p>The average&#177;std RMS errors, MAEs and &#961; cc were 0.10&#177;0.03 [Nm/kg], 0.07&#177;0.02 [Nm/kg] and 0.94&#177;0.04, respectively. The size of x(k) was 4.</p></div>
<div xmlns="http://www.tei-c.org/ns/1.0"><head>2) Estimating Knee Moment Using Thigh Angles:</head><p>The average&#177;std RMS errors, MAEs and &#961; cc were 0.11&#177;0.03 [Nm/kg], 0.07&#177;0.02 [Nm/kg] and 0.80&#177;0.09, respectively. The size of x(k) was 3.</p></div>
<div xmlns="http://www.tei-c.org/ns/1.0"><head>3) Estimating Ankle Moment Using Thigh Angles:</head><p>The average&#177;std RMS errors, MAEs and &#961; cc were 0.10&#177;0.03 [Nm/kg], 0.07&#177;0.02 [Nm/kg] and 0.97&#177;0.02, respectively. The size of x(k) was 3.</p></div>
<div xmlns="http://www.tei-c.org/ns/1.0"><head>4) Estimating Ankle Moment Using Shank Angles:</head><p>The average&#177;std RMS errors, MAEs and &#961; cc were 0.11&#177;0.03 [Nm/kg], 0.07&#177;0.02 [Nm/kg] and 0.97&#177;0.01, respectively. The size of x(k) was 3. In order to better compare the results of these two databases with database 1 (Tab. I), the outcomes are also reported in Tab. II.</p></div>
<div xmlns="http://www.tei-c.org/ns/1.0"><head>IV. DISCUSSIONS &amp; CONCLUSION</head><p>Thigh and shank angles, were used to estimate ankle, knee and hip moments in this work. Several case studies were investigated and the results were reported.</p><p>Comparing the &#961; cc results related to the three databases (Tabs. I, II), we see some similarities between the outcomes obtained in III-C, III-E, III-F. The best results were achieved when estimating ankle moments using thigh or shank angles. The second best results were related to the hip moment estimations, and the third place belongs to knee moment estimations. This trend is commonly observable in all three databases as reported in Tabs. I and II. The weakest estimation performance was observed when knee moments were estimated using thigh angles at 0.5 m/s in Tab. I. In this case, the estimation quality was much better at 1.5 m/s.</p><p>According to the results seen in subsection III-C, Figs. <ref type="figure">6</ref> and <ref type="figure">7</ref>, and Tab. I, in general, the estimation quality was lower for lower speeds. For hip and knee joints, the differences are more obvious. For ankle joint, however, the differences are very slight either for thigh or shank inputs. The lower estimation quality for the knee joint is also reported in <ref type="bibr">[28]</ref> and <ref type="bibr">[56]</ref>. One possible explanation could be that lower walking speed has less energy efficiency in comparison to normal walking <ref type="bibr">[57]</ref>. This might possibly be linked to the relationship between kinematics and kinetics of this joint at lower speeds. This may come into more attention when we see that for this joint the input source and method was the same, however performance was better at higher speeds. On the</p><p>TABLE III COMPARISON OF THIS STUDY WITH DIFFERENT STUDIES (SEE ALSO SECTION IV FOR MORE INFORMATION)</p><p>other side, the results of the ankle joint are not supporting the above where even for lower speed, good results were obtained. Nevertheless, if and how kinetics, kinematics, and gait energetics could be correlated and impact the estimation accuracy requires further in-depth investigations. Another explanation could be that the number of input sources or type of the inputs, or even the processing algorithm was not suitable for that specific speed. The results might get improved if, e.g., the inputs were combined with angular velocities and/or EMG signals. However, Tab. III shows that even with high number of inputs, some studies have reported the lowest R 2 values for this joint <ref type="bibr">[28]</ref>, <ref type="bibr">[56]</ref>. Furthermore, in <ref type="bibr">[15]</ref> we showed that a Gaussian process regression fed only by shank angles or only angular velocities did not lead to acceptable ankle moment estimation, however in this study shank angles were sufficient using the proposed algorithm. The above discussions can form starting points for further investigations.</p><p>The performance of the estimator was investigated as well when past estimated outputs [y(k -1), y(k -2), . . .] were included in the input x(k) (see Fig. <ref type="figure">3</ref>). Here, the results are reported for two case studies with data from the second database <ref type="bibr">[40]</ref>. The average values are the mean of all of the subjects and speeds. For hip moment estimations using thigh angles, when x(k) = [u(k), . . . , u(k -4), y(k -1)], the average RMS errors, MAEs and &#961; cc were 0.35 Nm/kg, 0.29 Nm/kg, and 0.87, respectively. In this case, further investigation showed that when x(k) = [u(k), . . . , u(k -4), y(k -1), y(k -2)], the average values were 0.18, 0.13, and 0.91, respectively. For ankle moment estimations using shank angles, when x(k) = [u(k), . . . , u(k -4), y(k -1)], the average RMS errors, MAEs and &#961; cc were 0.43 Nm/kg, 0.28 Nm/kg, and 0.78, respectively.</p><p>Compared with the results seen in subsections III-E.1 and III-E.4 (where past outputs of y were not included), the inclusion of the previous outputs y in the x(k) does not necessarily lead to better estimation performance. This point can potentially reduce the computation time required by the algorithm.</p><p>The impact of different training approaches on the estimation quality was investigated as well. Here the results are reported for two case studies when hip moments were estimated using thigh angles. Using first database <ref type="bibr">[39]</ref>, in the first case study, the inputs from the first two lowest speeds were used for training, and the input from all of the speeds was used for testing. The average&#177;std RMS errors were 0.12&#177;0.05, 0.13&#177;0.05 and 0.25&#177;0.10 [Nm/kg]. For MAEs the values were 0.14&#177;0.06, 0.08&#177;0.03, 0.11&#177;0.04 [Nm/kg] and for &#961; cc the values were 0.92&#177;0.07, 0.97&#177;0.02, 0.91&#177;0.05, for 0.5, 1 and 1.5 m/s respectively.</p><p>Next, for the second case study, inputs from the lowest and highest speeds were used for training, and the input from all of the speeds was used for testing. The average&#177;std RMS errors were 0.12&#177;0.05, 0.14&#177;0.05 and 0.15&#177;0.05 [Nm/kg], the average&#177;std MAEs were 0.15&#177;0.07, 0.09&#177;0.03, 0.07&#177;0.02 [Nm/kg] and the average&#177;std &#961; cc were 0.90&#177;0.09, 0.96&#177;0.03, 0.98&#177;0.01, for 0.5, 1 and 1.5 m/s respectively.</p><p>A similar procedure was done for the second database <ref type="bibr">[40]</ref> as well as the third one. At first, the input from the first two lowest speeds was used for training, and the input from the remaining six speeds was used for testing. The average&#177;std RMS errors, MAEs and &#961; cc were 0.26&#177;0.05 [Nm/kg], 0.19&#177;0.04 [Nm/kg] and 0.80&#177;0.09, respectively (average of all of the subjects and all of the speeds).</p><p>Next, the input from the lowest and highest speeds was used for training, and the input from the remaining six speeds was used for testing. The average&#177;std RMS errors, MAEs and &#961; cc were 0.19&#177;0.07 [Nm/kg], 0.14&#177;0.05 [Nm/kg] and 0.90&#177;0.05, respectively.</p><p>Similarly, for the third database <ref type="bibr">[41]</ref>, in the first case, the average&#177;std RMS errors, MAEs and &#961; cc were 0.17&#177;0.09 [Nm/kg], 0.13&#177;0.06 [Nm/kg] and 0.88&#177;0.07, respectively (average of all of the subjects and all of the speeds). For the second case, the average&#177;std RMS errors, MAEs and &#961; cc were 0.14&#177;0.10 [Nm/kg], 0.11&#177;0.08 [Nm/kg] and 0.89&#177;0.11, respectively (average of all of the subjects and all of the speeds).</p><p>According to the results obtained, the estimation performance was better (in some cases slightly) in interpolation (second case study) than extrapolation (first case study). This finding can be potentially used for planning relatively efficient and less time-consuming training procedures. In this regard, at first the data at the lower and upper boundary conditions can be used for training, and then the estimation quality of the algorithm can be evaluated. Next, the results can be compared with those of a full-data training.</p><p>This finding was similar to what we saw in our previous studies, in which the estimation results for interpolation approach and for full-data training were relatively similar <ref type="bibr">[34]</ref>, <ref type="bibr">[58]</ref>. Further future studies can better reveal the pros and cons of such a training approach for various locomotion modes.</p><p>A number of studies have suggested different methods to estimate ankle, knee or hip moments. In those works, different algorithms and inputs were proposed and used, and the approaches were verified on different number of participants. Tab. III presents a summary of the results obtained from several studies in this regard. It also compares them with the results obtained in this study. The table shows that both mechanical (kinetics, kinematics) and EMG signals were used to estimate the moments, depending on the algorithm. Furthermore, biometric data such as age and height were used in a number of studies as well, e.g., <ref type="bibr">[28]</ref>, <ref type="bibr">[29]</ref>. In this work, we used one source of input for each case study (shank angles or thigh see Methods section). The table shows the obtained results are comparable to different studies. Interestingly, a part of our findings was similar to what other researchers have reported in different studies. For instance, <ref type="bibr">[28]</ref>, <ref type="bibr">[56]</ref>, reported better R 2 results for ankle and hip joints in comparison to knee joint. The results reported by <ref type="bibr">[30]</ref>, show much better results for the knee joint, however, they have benefited from eighteen different signals into their algorithm. We reached a relatively similar result at higher speed (1.5 m/s), using only one input signal. Study <ref type="bibr">[17]</ref> reports relatively better results for the hip joint in comparison to ours, however the number of the inputs are considerably higher than our work. Furthermore, the number of the studied participants is much less than this study. The table also shows that the vast majority of the studies have used mechanical or EMG signals.</p><p>In addition to the above, our study has a main difference with some of the studies above. As an example, <ref type="bibr">[31]</ref> uses the ankle angle to estimate the ankle moment. Although this method is very useful for human gait studies, it is not appropriate for controlling a foot prosthesis, because in this situation there is no biological limb whose inputs could be used into the controller. Our method, in contrary, proposes to use a lower limb above the specific joint, and therefore avoids this problem. This is one of the fundamental differences between our approach and the approaches used by most of the studies in Tab. III. In addition, since the motion of the lower limbs is mainly governed by the central nervous system, the inputs originating from them would result in a more robust and reliable motion planner.</p><p>This work aimed to create connection between the motion of shank or thigh and the moments of ankle, knee and hip. A main challenge in design of smart exoskeletons, orthoses or prostheses is developing a controller that can generate human-like motions at the joints level. The generated motions should be in line with those of the remaining biological limbs. The estimation approach presented in this work can be potentially used in designing high-level controllers and motion planners for orthotics, exoskeletons, prosthetics, and humanoids. The inputs to the algorithm can be obtained from thigh-or shank-mounted IMUs (inertial measurement units) which is a common approach in this field, e.g., see <ref type="bibr">[1]</ref>, <ref type="bibr">[60]</ref>. Next, the inputs are fed into the motion planner to estimate the joint moment corresponding to the lower limb angle. Using a laptop equipped with 16 GB RAM and Intel Core i7 CPU, the computation time was less than 1 msec for a one-to-one estimation. This time is relatively good enough considering the working condition of current orthotic/prosthetic devices (e.g., 1 kHz in <ref type="bibr">[6]</ref> and <ref type="bibr">[60]</ref>). When a desired estimated value is generated, using e.g., a PD controller, a corresponding error signal is produced. Next, using controller gains, appropriate command signal can be sent to the actuator (motor). In this way, the actuator operation will be a function of the lower limb motion.</p><p>The proposed method is specially useful when a device is equipped with springs. Since in this situation the motion of the joint gets decoupled from the motion of the actuator (motor), having information about the required moment (force) will be vital in order to estimate the desired position of the actuator. In this case, the current study can be combined with our previous study presented in <ref type="bibr">[34]</ref>, in order to estimate the corresponding position of the actuator. Further information on how to use moment and angle estimation in order to estimate the corresponding actuator position can be found in <ref type="bibr">[57]</ref>.</p><p>In this work, able-bodied gait data was used to analyze the estimation results. One logical approach in designing motion planners for assistive devices is to identify the rules or the relationships latent in healthy human locomotion. These relationships can act as a target frame and possibly gold standard for the behavior of a powered prosthetic or orthotic device. The performance of these devices can then be tailored to meet individual requirements. Therefore, to create a target frame for device's performance, decoding the latent relationships in average able-bodied human gait is a necessary pre-requisite. In this study, we showed that relationships exist between the motions of a limb and the moment generated in a (corresponding) joint. The identified relationships can be used as potential guidelines to bring and keep the performance of a prosthesis or orthosis within a biomechanically logical region (in terms of kinematics and kinetics).</p><p>In case of the amputees, those input data should inevitably come from the remaining lower limbs. One logical thinking is that if the inputs from this population are similar to those of able-bodied participants we used in this study, the corresponding outputs should be in a similar region. Therefore, we decided to compare the similarities between the amputee inputs and able-bodied inputs. To do so, transfemoral amputee data released publicly by <ref type="bibr">[61]</ref> was used. Next, thigh angles were extracted by a Matlab program and compared with the average able-bodied subjects obtained from the first database <ref type="bibr">[39]</ref>. The results showed that for slow, moderate and fast walking speeds, the correlation coefficients were 0.93 -0.99, 0.95 -0.99, and 0.93 -0.98 for ten amputees (23 -65 yrs old) <ref type="bibr">[34]</ref>. These values show that the inputs from the two groups have sufficient correspondence. Therefore, for these amputees, thigh angles can be potentially used to estimate the corresponding required ankle or knee moments if a robotic prosthesis is going to be used. Since the number of the amputees were limited, further clinical experiments with bigger groups of amputees would be required to analyze and compare more thoroughly the similarities and differences of the inputs.</p><p>In this study, sagittal plane joints' moments were estimated during walking gait. In order to have a more comprehensive algorithm, one direction of the future work can be to investigate the functionality of the presented estimation method for other locomotion types such as descending or ascending the slopes or stairs. In addition, the work can be continued to investigate the estimation performance for other anatomical planes.</p></div></body>
		</text>
</TEI>
