More Like this

1. Deep Visual Gravity Vector Detection for Unmanned Aircraft Attitude Estimation

   Ellingson, Gary J.; Wingate, David; and McLain, Tim (September 2017, IEEE/RSJ International Conference on Intelligent Robots and Systems)

   This paper demonstrates a feasible method for using a deep neural network as a sensor to estimate the attitude of a flying vehicle using only flight video. A dataset of still images and associated gravity vectors was collected and used to perform supervised learning. The network builds on a previously trained network and was trained to be able to approximate the attitude of the camera with an average error of about 8 degrees. Flight test video was recorded and processed with a relatively simple visual odometry method. The aircraft attitude is then estimated with the visual odometry as the state propagation and network providing the attitude measurement in an extended Kalman filter. Results show that the proposed method of having the neural network provide a gravity vector attitude measurement from the flight imagery reduces the standard deviation of the attitude error by approximately 12 times compared to a baseline approach. 

   more » « less
2. Efficient Neural Hybrid System Learning and Interpretable Transition System Abstraction for Dynamical Systems

   https://doi.org/10.1115/1.4066516  

   Yang, Yejiang; Mo, Zihao; Xiang, Weiming (January 2025, ASME Letters in Dynamic Systems and Control)

   Abstract This article proposes a neural network hybrid modeling framework for dynamics learning to promote an interpretable, computationally efficient method of dynamics learning and system identification. First, a low-level model is trained to learn the system dynamics, which utilizes multiple simple neural networks to approximate the local dynamics generated from data-driven partitions. Then, based on the low-level model, a high-level model is trained to abstract the low-level neural hybrid system model into a transition system that allows computational tree logic (CTL) verification to promote model’s ability to handle human interaction and verification efficiency. 

   more » « less
3. Efficient approximation of deep ReLU networks for functions on low dimensional manifolds

   Chen, Minshuo; Jiang, Haomin; Liao, Wenjing; Zhao, Tuo (December 2019, Conference on Neural Information Processing Systems)

   Deep neural networks have revolutionized many real world applications, due to their flexibility in data fitting and accurate predictions for unseen data. A line of research reveals that neural networks can approximate certain classes of functions with an arbitrary accuracy, while the size of the network scales exponentially with respect to the data dimension. Empirical results, however, suggest that networks of moderate size already yield appealing performance. To explain such a gap, a common belief is that many data sets exhibit low dimensional structures, and can be modeled as samples near a low dimensional manifold. In this paper, we prove that neural networks can efficiently approximate functions supported on low dimensional manifolds. The network size scales exponentially in the approximation error, with an exponent depending on the intrinsic dimension of the data and the smoothness of the function. Our result shows that exploiting low dimensional data structures can greatly enhance the efficiency in function approximation by neural networks. We also implement a sub-network that assigns input data to their corresponding local neighborhoods, which may be of independent interest. 

   more » « less
4. Efficient Approximation of Deep ReLU Networks for Functions on Low Dimensional Manifolds

   Chen, Minshuo; Jiang, Haoming; Liao, Wenjing; Zhao, Tuo (December 2019, Advances in Neural Information Processing Systems)

   Deep neural networks have revolutionized many real world applications, due to their flexibility in data fitting and accurate predictions for unseen data. A line of research reveals that neural networks can approximate certain classes of functions with an arbitrary accuracy, while the size of the network scales exponentially with respect to the data dimension. Empirical results, however, suggest that networks of moderate size already yield appealing performance. To explain such a gap, a common belief is that many data sets exhibit low dimensional structures, and can be modeled as samples near a low dimensional manifold. In this paper, we prove that neural networks can efficiently approximate functions supported on low dimensional manifolds. The network size scales exponentially in the approximation error, with an exponent depending on the intrinsic dimension of the data and the smoothness of the function. Our result shows that exploiting low dimensional data structures can greatly enhance the efficiency in function approximation by neural networks. We also implement a sub-network that assigns input data to their corresponding local neighborhoods, which may be of independent interest. 

   more » « less
5. Efficient approximation of deep ReLU networks for functions on low dimensional manifolds

   Chen, Minshuo; Jiang, Haoming; Liao, Wenjing; Zhao, Tuo (December 2019, Conference on Neural Information Processing Systems)

   Deep neural networks have revolutionized many real world applications, due to their flexibility in data fitting and accurate predictions for unseen data. A line of research reveals that neural networks can approximate certain classes of functions with an arbitrary accuracy, while the size of the network scales exponentially with respect to the data dimension. Empirical results, however, suggest that networks of moderate size already yield appealing performance. To explain such a gap, a common belief is that many data sets exhibit low dimensional structures, and can be modeled as samples near a low dimensional manifold. In this paper, we prove that neural networks can efficiently approximate functions supported on low dimensional manifolds. The network size scales exponentially in the approximation error, with an exponent depending on the intrinsic dimension of the data and the smoothness of the function. Our result shows that exploiting low dimensional data structures can greatly enhance the efficiency in function approximation by neural networks. We also implement a sub-network that assigns input data to their corresponding local neighborhoods, which may be of independent interest. 

   more » « less