While the availability of low-cost micro electro-mechanical systems (MEMS) accelerometers, gyroscopes, and magnetometers initially seemed to promise the possibility of using them to easily track the position and orientation of virtually any object that they could be attached to, this promise has not yet been fulfilled. Navigation-grade accelerometers and gyroscopes have long been the basis for tracking ships and aircraft, but the signals from low-cost MEMS accelerometers and gyroscopes are still orders of magnitude poorer in quality (e.g., bias stability). Therefore, the applications of MEMS inertial measurement units (IMUs), containing tri-axial accelerometers and gyroscopes, are currently not as extensive as they were expected to be. Even the addition of MEMS tri-axial magnetometers, to conform magnetic, angular rate, and gravity (MARG) sensor modules, has not fully overcome the challenges involved in using these modules for long-term orientation estimation, which would be of great benefit for the tracking of human–computer hand-held controllers or tracking of Internet-Of-Things (IoT) devices. Here, we present an algorithm, GMVDμK (or simply GMVDK), that aims at taking full advantage of all the signals available from a MARG module to robustly estimate its orientation, while preventing damaging overcorrections, within the context of a human–computer interaction application. Through experimental comparison, we show that GMVDK is more robust to magnetic disturbances than three other MARG orientation estimation algorithms in representative trials. 
                        more » 
                        « less   
                    
                            
                            Benchmarking Dataset of Signals from a Commercial MEMS Magnetic–Angular Rate–Gravity (MARG) Sensor Manipulated in Regions with and without Geomagnetic Distortion
                        
                    
    
            In this paper, we present the FIU MARG Dataset (FIUMARGDB) of signals from the tri-axial accelerometer, gyroscope, and magnetometer contained in a low-cost miniature magnetic–angular rate–gravity (MARG) sensor module (also known as magnetic inertial measurement unit, MIMU) for the evaluation of MARG orientation estimation algorithms. The dataset contains 30 files resulting from different volunteer subjects executing manipulations of the MARG in areas with and without magnetic distortion. Each file also contains reference (“ground truth”) MARG orientations (as quaternions) determined by an optical motion capture system during the recording of the MARG signals. The creation of FIUMARGDB responds to the increasing need for the objective comparison of the performance of MARG orientation estimation algorithms, using the same inputs (accelerometer, gyroscope, and magnetometer signals) recorded under varied circumstances, as MARG modules hold great promise for human motion tracking applications. This dataset specifically addresses the need to study and manage the degradation of orientation estimates that occur when MARGs operate in regions with known magnetic field distortions. To our knowledge, no other dataset with these characteristics is currently available. FIUMARGDB can be accessed through the URL indicated in the conclusions section. It is our hope that the availability of this dataset will lead to the development of orientation estimation algorithms that are more resilient to magnetic distortions, for the benefit of fields as diverse as human–computer interaction, kinesiology, motor rehabilitation, etc. 
        more » 
        « less   
        
    
                            - Award ID(s):
- 1920182
- PAR ID:
- 10458491
- Date Published:
- Journal Name:
- Sensors
- Volume:
- 23
- Issue:
- 8
- ISSN:
- 1424-8220
- Page Range / eLocation ID:
- 3786
- Format(s):
- Medium: X
- Sponsoring Org:
- National Science Foundation
More Like this
- 
            
- 
            This work presents an integrated solution for head orientation estimation, which is a critical component for applications of virtual and augmented reality systems. The proposed solution builds upon the measurements from the inertial sensors and magnetometer added to an instrumented helmet, and an orientation estimation algorithm is developed to mitigate the effect of bias introduced by noise in the gyroscope signal. Convolutional Neural Network (CNN) techniques are introduced to develop a dynamic orientation estimation algorithm with a structure motivated by complementary filters and trained on data collected to represent a wide range of head motion profiles. The proposed orientation estimation method is evaluated experimentally and compared to both learning and non-learning-based orientation estimation algorithms found in the literature for comparable applications. Test results support the advantage of the proposed CNN-based solution, particularly for motion profiles with high acceleration disturbance that are characteristic of head motion.more » « less
- 
            M. Kurosu and A. Hashizume (Ed.)There is increasing interest in using low-cost and lightweight Micro Electro-Mechanical System (MEMS) modules containing tri-axial accelerometers, gyroscopes and magnetometers for tracking the motion of segments of the human body. We are specifically interested in using these devices, called “Magnetic, Angular-Rate and Gravity” (“MARG”) modules, to develop an instrumented glove, assigning one of these MARG modules to monitor the (absolute) 3-D orientation of each of the proximal and middle phalanges of the fingers of a computer user. This would provide real-time monitoring of the hand gestures of the user, enabling non-vision gesture recognition approaches that do not degrade with lineof- sight disruptions or longer distance from the cameras. However, orientation estimation from low-cost MEMS MARG modules has shown to degrade in areas where the geomagnetic field is distorted by the presence of ferromagnetic objects (which are common in contemporary environments). This paper describes the continued evolution of our algorithm to obtain robust MARG orientation estimates, even in magnetically distorted environments. In particular, the paper describes a new self-contained version of the algorithm, i.e., one requiring no information from external devices, in contrast to the previous versions. Keywords: MARG module · Orientation Estimation · Magnetic Disturbancemore » « less
- 
            Estimating the position of the bucket or tool on an agricultural/construction vehicle is becoming increasingly important to enable operator assistance such as automation of repetitive movements. Such end-effector position estimation is normally done through measurement of individual actuator’s movements inside kinematic linkage mechanisms that move the end-effectors. This paper develops an alternate inertial measurement unit (IMU) based end-effector position estimation system that offers significant advantages of low cost and easy installation. An IMU located on a rotating linkage in a mechanism is used to estimate the angular motion of the linkage. Key challenges arise from the fact that the accelerometer signals of the IMU experience significant disturbances from dynamic accelerations and from vehicle and terrain-induced vibrations. First, an adaptive feedforward algorithm is used to remove the influence of vibrations on the accelerometer signals. Then a nonlinear observer is utilized to combine accelerometer and gyroscope signals and reject the influence of vehicle accelerations. Experimental results are presented from a laboratory test rig and preliminary experimental results from a full-scale tracked skid steer loader vehicle. The results show that an accuracy better than 1 degree in linkage orientation estimation is achieved in the presence of vibration disturbances.more » « less
- 
            Occupancy detection helps enable various emerging smart environment applications ranging from opportunistic HVAC (heating, ventilation, and air-conditioning) control, effective meeting management, healthy social gathering, and public event planning and organization. Ubiquitous availability of smartphones and wearable sensors with the users for almost 24 hours helps revitalize a multitude of novel applications. The inbuilt microphone sensor in smartphones plays as an inevitable enabler to help detect the number of people conversing with each other in an event or gathering. A large number of other sensors such as accelerometer and gyroscope help count the number of people based on other signals such as locomotive motion. In this work, we propose multimodal data fusion and deep learning approach relying on the smartphone’s microphone and accelerometer sensors to estimate occupancy. We first demonstrate a novel speaker estimation algorithm for people counting and extend the proposed model using deep nets for handling large-scale fluid scenarios with unlabeled acoustic signals. We augment our occupancy detection model with a magnetometer-dependent fingerprinting-based localization scheme to assimilate the volume of location-specific gathering. We also propose crowdsourcing techniques to annotate the semantic location of the occupant. We evaluate our approach in different contexts: conversational, silence, and mixed scenarios in the presence of 10 people. Our experimental results on real-life data traces in natural settings show that our cross-modal approach can achieve approximately 0.53 error count distance for occupancy detection accuracy on average.more » « less
 An official website of the United States government
An official website of the United States government 
				
			 
					 
					
 
                                    