3D ground reaction force (GRF) estimation during walking is important for gait and inverse dynamics analyses. Recent studies have estimated 3D GRF based on kinematics measured from optical or inertial motion capture systems without force plate measurement. A neural network (NN) could be used to estimate ground reaction forces. The NN network approach based on segment kinematics requires the selection of optimal inputs, including kinematics type and segments. This study aimed to select optimal input kinematics for implementing an NN for each foot’s GRF estimation. A two-stage NN consisting of a temporal convolution network for gait phase detection and a gated recurrent unit network was developed for GRF estimation. To implement the NN, we conducted level/inclined walking and level running on a force-sensing treadmill, collecting datasets from seven male participants across eight experimental conditions. Results of the input selection process indicated that the center of mass acceleration among six kinematics types and trunk, pelvis, thighs, and shanks among 15 individual segments showed the highest correlations with GRFs. Among four segment combinations, the combination of trunk, thighs, and shanks demonstrated the best performance (root mean squared errors: 0.28, 0.16, and 1.15 N/kg for anterior-posterior, medial-lateral, and vertical components, respectively).
Estimating energy expenditure is essential in monitoring the intensity of physical activity and health status. Energy expenditure can be estimated based on wearable sensors such as inertial measurement unit (IMU). While a variety of methods have been developed to estimate energy expenditure during day-to-day activities, their performances have not been thoroughly evaluated under walking conditions according to various speeds and inclines. This study investigated IMU-based neural network models for energy expenditure estimation under various walking conditions and comparatively analyzed their performances in terms of sensor attachment locations and training/testing datasets. In this study, two neural network models were selected based on a previous study (Slade et al., 2019): (M1) a multilayer perceptron using sensor signals during each gait cycle, and (M2) a recurrent neural network using sensor signal sequences of a fixed window size. The results revealed the following: (i) the performance of the foot attachment model was the best among the five sensor attachment locations (0.89 W/kg for M1 and 1.14 W/kg for M2); and (ii) although the performance of M1 was superior to that of M2, M1 requires accurate gait detection for data segmentation by each stride, which hinders the usefulness of M2.
Citations
Citations to this article as recorded by
Development of a Novel Ventilation Estimation Model Based on Convolutional Neural Network (CNN) Jeongyeon Chu, Jaehyon Baik, Kangsu Jeong, Seungwon Jung, Youngjin Park, Hosu Lee Journal of Korea Robotics Society.2025; 20(1): 138. CrossRef
Recently, the estimation of joint kinetics such as joint force and moment using wearable inertial sensors has received great attention in biomechanics. Generally, the joint force and moment are calculated though inverse dynamics using segment kinematic data, ground reaction force, and moment. However, this approach has problems such as estimation error of kinematic data and soft tissue artifacts, which can lead to inaccuracy of joint forces and moments in inverse dynamics. This study aimed to apply a recurrent neural network (RNN) instead of inverse dynamics to joint force and moment estimation. The proposed RNN could receive signals from inertial sensors and force plate as input vector and output lower extremity joints forces and moments. As the proposed method does not depend on inverse dynamics, it is independent of the inaccuracy problem of the conventional method. Experimental results showed that the estimation performance of hip joint moment of the proposed RNN was improved by 66.4% compared to that of the inverse dynamics-based method.
Inertial measurement unit (IMU)-based 3D joint angle estimation have a wide range of important applications, among them, in gait analysis and exoskeleton robot control. Conventionally, the joint angle was determined via the estimation of 3D orientation of each body segment using 9-axis IMUs including 3-axis magnetometers. However, a magnetometer is limited by magnetic disturbance in the vicinity of the sensor, which highly affects the accuracy of the joint angle. Accordingly, this study aims to estimate the joint angle using the 6-axis IMU signals composed of a 3-axis accelerometer and a 3-axis gyroscope without a magnetometer. This paper proposes a recurrent neural network (RNN) model, which indirectly utilizes the joint kinematic constraint and thus estimates joint angles based on 6-axis IMUs without using a magnetometer signal. The performance of the proposed model was validated for a mechanical joint and human elbow joint, under magnetically disturbed environments. Experimental results showed that the proposed RNN approach outperformed the conventional approach based on a Kalman filter (KF), i.e., RNN 3.48° vs. KF 10.01° for the mechanical joint and RNN 7.39° vs. KF 21.27° for the elbow joint.
Relative position estimation between body segments is one essential process for inertial sensor-based human motion analysis. Conventionally, the relative position was calculated through a constant segment to joint (S2J) vector and the orientation of the segment, assuming that the segment was rigid. However, the S2J vector is deformed by soft tissue artifact (STA) of the segment. In a previous study, in order to handle the above problem, Lee and Lee proposed the relative position estimation method using time-varying S2J vectors based on inertial sensor signals. Here, time-varying S2J vectors were determined through the joint flexion angle using regression. However, it was not appropriate to consider only the flexion angle as a deformation-related variable. In addition, regression has limitations in considering complex joint motion. This paper proposed artificial neural network models to compensate for the STA by considering all three-axis motion of the joint. A verification test was conducted for lower body segments. Experimental results showed that the proposed method was superior to the previous method. For pelvis-to-foot relative position estimation, averaged root mean squared error of the previous method was 17.38 mm, while that of the proposed method was 12.71 mm.
Citations
Citations to this article as recorded by
Wearable Inertial Sensors-based Joint Kinetics Estimation of Lower Extremity Using a Recurrent Neural Network Ji Seok Choi, Chang June Lee, Jung Keun Lee Journal of the Korean Society for Precision Engineering.2023; 40(8): 655. CrossRef
One of the problems in inverse dynamics calculation for the inertial measurement unit (IMU)-based joint force and torque estimation is the amplified signal noises of segment kinematic data mainly due to the differentiation procedure and segmental soft tissue artifacts. In order to deal with this problem, appropriate filtering methods are often recommended for signal enhancement. Conventionally, a low-pass filter (LPF) is widely used for the kinematic data. However, the zero-phase LPF requires post-processing, while the real-time LPF causes an unignorable time lag. For this reason, it is inappropriate to use the LPF for real-time joint torque estimation. This paper proposes a Kalman filter (KF) for inverse dynamics of IMUbased joint torque estimation in real time without any time lag, while utilizing the smoothing capability of the KF. Experimental results showed that the proposed KF outperformed a real-time LPF in the estimation accuracy of hip joint force and torque during jogging on the spot by 100 and 29%, respectively. Although the proposed KF requires the process of adjusting covariance according to the dynamic conditions, it can be expected to improve the estimation performance in the field where joint force and torque need to be estimated in real time.
Citations
Citations to this article as recorded by
Wearable Inertial Sensors-based Joint Kinetics Estimation of Lower Extremity Using a Recurrent Neural Network Ji Seok Choi, Chang June Lee, Jung Keun Lee Journal of the Korean Society for Precision Engineering.2023; 40(8): 655. CrossRef
Estimation of the relative position between the body segments is an important task in inertial sensor-based human motion tracking. Conventionally, the relative position is determined using orientations and constant segment vectors that connect from segment to joint center, based on the assumption that the segments are rigid. However, the human body segments are non-rigid, which leads to an inaccurate relative position estimation. This paper proposes a relative position estimation method based on inertial sensor signals, considering the non-rigidity of the human bodies. Considering that the effects of non-rigidity are highly correlated with a specific variable, the proposed method uses time-varying segment vectors determined by the specific physical variable, instead of using constant segment vectors. Verification test results for an upper-body model demonstrates the superiority of the proposed method over the conventional method: The averaged root mean square error of the sternum-to-forearm estimation from the conventional method was 34.19 ㎜, while the value from the proposed method was 16.67 ㎜.
Citations
Citations to this article as recorded by
Wearable Inertial Sensors-based Joint Kinetics Estimation of Lower Extremity Using a Recurrent Neural Network Ji Seok Choi, Chang June Lee, Jung Keun Lee Journal of the Korean Society for Precision Engineering.2023; 40(8): 655. CrossRef
Ergonomic guidelines for the design interfaces of additive modules for manual wheelchairs: sagittal plane Bartosz Wieczorek, Mateusz Kukla, Łukasz Warguła, Marcin Giedrowicz Scientific Reports.2023;[Epub] CrossRef
Effects of the Selection of Deformation-related Variables on Accuracy in Relative Position Estimation via Time-varying Segment-to-Joint Vectors Chang June Lee, Jung Keun Lee JOURNAL OF SENSOR SCIENCE AND TECHNOLOGY.2022; 31(3): 156. CrossRef
Application of Artificial Neural Network for Compensation of Soft Tissue Artifacts in Inertial Sensor-Based Relative Position Estimation Ji Seok Choi, Jung Keun Lee Journal of the Korean Society for Precision Engineering.2022; 39(3): 233. CrossRef
In the case of dynamic sports activities such as skiing and sprints, it is difficult to apply optical motion capture systems because of measurement volume limitation. Alternatively, the use of inertial measurement unit (IMU) as a motion sensor has gained attention. This paper proposes a drift reduction method in the IMU-based joint angle estimation for dynamic motion-involved sports applications. To resolve the problem of conventional IMU-based methods significantly reducing performance under highly dynamic conditions, the proposed method applies a correction method using joint constraint. The proposed method is the complementary filter based on the previous drift reduction technique using the joint constraint, but performs in real time. The proposed method was validated by comparing the estimation accuracy with conventional methods under various dynamic conditions. The results showed that the proposed method was superior to the methods that did not use the constraint. While the proposed method was 0.19° less accurate than the non-realtime method of the reference, it is more practical due to its realtime correction capability.
Citations
Citations to this article as recorded by
Wearable Inertial Sensors-based Joint Kinetics Estimation of Lower Extremity Using a Recurrent Neural Network Ji Seok Choi, Chang June Lee, Jung Keun Lee Journal of the Korean Society for Precision Engineering.2023; 40(8): 655. CrossRef
A Recurrent Neural Network for 3D Joint Angle Estimation based on Six-axis IMUs but without a Magnetometer Chang June Lee, Woo Jae Kim, Jung Keun Lee Journal of the Korean Society for Precision Engineering.2023; 40(4): 301. CrossRef
Motion capture and evaluation system of football special teaching in colleges and universities based on deep learning Xiaohui Yin, C. Chandru Vignesh, Thanjai Vadivel International Journal of System Assurance Engineering and Management.2022; 13(6): 3092. CrossRef
With regard to 3D orientation estimation based on IMMU (Inertial Magnetic Measurement Unit) signals, the yaw estimation accuracy may be significantly degraded as a result of magnetic distortions. Consequently, several yaw estimation Kalman filters (KFs) possessing distortion compensation mechanisms have been proposed. However, majority of the conventional methods fail to effectively curb inaccuracies due to distortion when magnetic fields are extremely distorted. In this paper, we propose a new KF projecting a kinematic constraint to minimize yaw estimation errors induced by magnetic distortions. After the measurement update using magnetometer signals, the proposed method additionally corrects the yaw estimation through projection of a kinematic constraint on a conventional unconstrained KF. Experimental results show that the proposed KF outperformed the conventional KF by approximately 52-67%.
Displacement estimation based on inertial sensor signals is usually performed in aid of global positioning systems or barometers. However, due to low accuracy estimation capabilities of such aiding sensors, inertial sensor-based displacement estimation is difficult to achieve high accuracy. This paper will show that it is possible to determine the vertical displacement of a link connected by a joint with higher accuracy while only using the inertial sensor. The proposed method utilizes a predetermined position vector from the joint center to the sensor and link orientation. By combining the joint constraint, accuracy of the orientation estimation is ensured even in highly dynamic conditions, and thus, the vertical displacement estimation with high accuracy can be achieved. Experimental results show that the proposed method outperformed the method by fusing inertial sensor and barometer signals as well as the method using inertial sensor signals only without constraint combination.
Previous studies on joint angle estimation have been restricted to slow-speed level walking conditions, even though slope walking and running elicit unique biomechanical characteristics. Measurements were mostly based on an optical motion capture system despite in-the-lab limitation of measurement technique. The contribution of this study is twofold: (i) to propose a joint angle estimation method by applying a state-of-the-art parallel Kalman filter based on an inertial measurement unit (IMU) that can overcome in-the-lab limitation, and (ii) to demonstrate its application to level walking condition as well as slope walking and running conditions to fill a gap in joint kinematics literature. In particular, this study focuses on knee flexion/extension and ankle dorsiflexion/plantarflexion angles at various speed variations. The parallel Kalman filter applied in the proposed method can compensate external acceleration through Markov-chain-based acceleration modeling, that may enhance joint estimation performance in high speed walking conditions. To validate the proposed estimation method, an optical motion capture system was used as reference. In addition, patterns for each condition were investigated to identify and evaluate presence of classifying features.
Citations
Citations to this article as recorded by
Evaluating Sparse Inertial Measurement Unit Configurations for Inferring Treadmill Running Motion Mackenzie N. Pitts, Megan R. Ebers, Cristine E. Agresta, Katherine M. Steele Sensors.2025; 25(7): 2105. CrossRef
Consistency Is Key: A Secondary Analysis of Wearable Motion Sensor Accuracy Measuring Knee Angles Across Activities of Daily Living Before and After Knee Arthroplasty Robert C. Marchand, Kelly B. Taylor, Emily C. Kaczynski, Skye Richards, Jayson B. Hutchinson, Shayan Khodabakhsh, Ryan M. Chapman Sensors.2025; 25(13): 3942. CrossRef
달리기 속도에 따른 관성 측정 장비(IMU)의 신뢰도 분석 지혁 강, 재원 강, 석훈 윤 The Korean Journal of Physical Education.2024; 63(5): 493. CrossRef
Comparison of Concurrent and Asynchronous Running Kinematics and Kinetics From Marker-Based and Markerless Motion Capture Under Varying Clothing Conditions Robert M. Kanko, Jereme B. Outerleys, Elise K. Laende, W. Scott Selbie, Kevin J. Deluzio Journal of Applied Biomechanics.2024; 40(2): 129. CrossRef
Development of Gait Measurement System Combined with IMU and Loadcell Insole: A Pilot Study Jeong-Woo Seo, Junggil Kim, Seulgi Lee, Gyerae Tack, Jin-Seung Choi Journal of the Korean Society for Precision Engineering.2022; 39(9): 657. CrossRef
Validity and repeatability of a new inertial measurement unit system for gait analysis on kinematic parameters: Comparison with an optoelectronic system Elodie Piche, Marine Guilbot, Frédéric Chorin, Olivier Guerin, Raphaël Zory, Pauline Gerus Measurement.2022; 198: 111442. CrossRef
Application of Artificial Neural Network for Compensation of Soft Tissue Artifacts in Inertial Sensor-Based Relative Position Estimation Ji Seok Choi, Jung Keun Lee Journal of the Korean Society for Precision Engineering.2022; 39(3): 233. CrossRef
Recreating the Motion Trajectory of a System of Articulated Rigid Bodies on the Basis of Incomplete Measurement Information and Unsupervised Learning Bartłomiej Nalepa, Magdalena Pawlyta, Mateusz Janiak, Agnieszka Szczęsna, Aleksander Gwiazda, Konrad Wojciechowski Sensors.2022; 22(6): 2198. CrossRef
Development of a Low-Cost Open-Source Measurement System for Joint Angle Estimation Túlio Fernandes de Almeida, Edgard Morya, Abner Cardoso Rodrigues, André Felipe Oliveira de Azevedo Dantas Sensors.2021; 21(19): 6477. CrossRef
Drift Reduction in IMU-based Joint Angle Estimation for Dynamic Motion-Involved Sports Applications Jung Keun Lee, Chang June Lee Journal of the Korean Society for Precision Engineering.2020; 37(7): 539. CrossRef
Relative Position Estimation using Kalman Filter Based on Inertial Sensor Signals Considering Soft Tissue Artifacts of Human Body Segments Chang June Lee, Jung Keun Lee JOURNAL OF SENSOR SCIENCE AND TECHNOLOGY.2020; 29(4): 237. CrossRef
Kinematic Constraint-Projected Kalman Filter to Minimize Yaw Estimation Errors Induced by Magnetic Distortions Tae Hyeong Jeon, Jung Keun Lee Journal of the Korean Society for Precision Engineering.2019; 36(7): 659. CrossRef
Three-axis magnetometers are widely used in various fields requiring azimuth information. However, accuracy of azimuth estimation based on magnetometer signals may be degraded because of errors such as offset, scale factor, nonorthogonality, hard-iron distortion, and soft-iron distortion. Recently, several ellipsoid-fitting calibration techniques have been proposed and have received much attention. However, comparative analysis of calibration accuracies between these techniques has not been conducted. This study compared and analyzed performance of four ellipsoid-fitting magnetometer calibration techniques such as the linear least square method, the two-step algorithm, and two different nonlinear least square methods. Our analysis and experimental results reveal superiority of the linear least square method compared to other methods in terms of calibration accuracy as well as ease of use in practice.
Citations
Citations to this article as recorded by
Real-time estimation of roll angles by magnetometer based on two-step adaptive Kalman filter Xiaofen Dong, Guoguang Chen, Xiaoli Tian, Xiaolong Yan Measurement.2022; 198: 111349. CrossRef
Dynamic Accuracy Improvement of a MEMS AHRS for Small UAVs Min-Shik Roh, Beom-Soo Kang International Journal of Precision Engineering and Manufacturing.2018; 19(10): 1457. CrossRef