Results 1 - 10
of
55
An application of reinforcement learning to aerobatic helicopter flight
- In Advances in Neural Information Processing Systems 19
, 2007
"... Autonomous helicopter flight is widely regarded to be a highly challenging control problem. This paper presents the first successful autonomous completion on a real RC helicopter of the following four aerobatic maneuvers: forward flip and sideways roll at low speed, tail-in funnel, and nose-in funne ..."
Abstract
-
Cited by 129 (10 self)
- Add to MetaCart
(Show Context)
Autonomous helicopter flight is widely regarded to be a highly challenging control problem. This paper presents the first successful autonomous completion on a real RC helicopter of the following four aerobatic maneuvers: forward flip and sideways roll at low speed, tail-in funnel, and nose-in funnel. Our experimental results significantly extend the state of the art in autonomous helicopter flight. We used the following approach: First we had a pilot fly the helicopter to help us find a helicopter dynamics model and a reward (cost) function. Then we used a reinforcement learning (optimal control) algorithm to find a controller that is optimized for the resulting model and reward function. More specifically, we used differential dynamic programming (DDP), an extension of the linear quadratic regulator (LQR). 1
Autonomous helicopter aerobatics through apprenticeship learning
- International Journal of Robotics Research
"... Autonomous helicopter flight is widely regarded to be a highly challenging control problem. Despite this fact, human experts can reliably fly helicopters through a wide range of maneuvers, including aerobatic maneuvers at the edge of the helicopter’s capabilities. We present apprenticeship learning ..."
Abstract
-
Cited by 64 (5 self)
- Add to MetaCart
Autonomous helicopter flight is widely regarded to be a highly challenging control problem. Despite this fact, human experts can reliably fly helicopters through a wide range of maneuvers, including aerobatic maneuvers at the edge of the helicopter’s capabilities. We present apprenticeship learning algorithms, which leverage expert demonstrations to efficiently learn good controllers for tasks being demonstrated by an expert. These apprenticeship learning algorithms have enabled us to significantly extend the state of the art in autonomous helicopter aerobatics. Our experimental results include the first autonomous execution of a wide range of maneuvers, including but not limited to in-place flips, in-place rolls, loops and hurricanes, and even auto-rotation landings, chaos and tic-tocs, which only exceptional human pilots can perform. Our results also include complete airshows, which require autonomous transitions between many of these maneuvers. Our controllers perform as well as, and often even better than, our expert pilot.
Optic flow regulation: the key to aircraft automatic guidance
- ROBOTICS AND AUTONOMOUS SYSTEMS 177–194
, 2005
"... We have developed a visually based autopilot which is able to make an air vehicle automatically take off, cruise and land, while reacting appropriately to wind disturbances (head wind and tail wind). This autopilot consists of a visual control system that adjusts the thrust so as to keep the downwar ..."
Abstract
-
Cited by 41 (12 self)
- Add to MetaCart
We have developed a visually based autopilot which is able to make an air vehicle automatically take off, cruise and land, while reacting appropriately to wind disturbances (head wind and tail wind). This autopilot consists of a visual control system that adjusts the thrust so as to keep the downward optic flow (OF) at a constant value. This autopilot is therefore based on an optic flow regulation loop. It makes use of a sensor, which is known as an elementary motion detector (EMD). The functional structure of this EMD was inspired by that of the housefly, which was previously investigated at our Laboratory by performing electrophysiological recordings while applying optical microstimuli to single photoreceptor cells of the insect’s compound eye. We built a proof-of-concept, tethered rotorcraft that circles indoors over an environment composed of contrasting features randomly arranged on the floor. The autopilot, which we have called OCTAVE (Optic flow based Control sysTem for Aerial VEhicles), enables this miniature (100 g) rotorcraft to carry out complex tasks such as ground avoidance and terrain following, to control risky maneuvers such as automatic take off and automatic landing, and to respond appropriately to wind disturbances. A single visuomotor control loop suffices to perform all these reputedly demanding tasks. As the electronic processing system required is extremely light-weight (only a few grams), it can be mounted on-board micro-air vehicles (MAVs) as well as larger unmanned air vehicles (UAVs) or even submarines and autonomous underwater vehicles (AUVs). But the OCTAVE autopilot could also provide guidance and/or warning signals to prevent the pilots of manned aircraft from colliding with shallow terrain, for example.
Complementary filter design on the special orthogonal group SO(3
- Institute of Electrical and Electronic Engineers
, 2005
"... Abstract — This paper considers the problem of obtaining high quality pose estimation (position and orientation) from a combination of low cost sensors, such as an inertial mea-surement unit and vision sensor. A non-linear complementary filter is proposed that evolves on the Special Euclidean Group ..."
Abstract
-
Cited by 40 (12 self)
- Add to MetaCart
(Show Context)
Abstract — This paper considers the problem of obtaining high quality pose estimation (position and orientation) from a combination of low cost sensors, such as an inertial mea-surement unit and vision sensor. A non-linear complementary filter is proposed that evolves on the Special Euclidean Group SE(3). Exponential stability of the filter is proved. Simulation results are presented to illustrate simplicity and demonstrate the performance of the proposed approach. Experimental results reinforce the convergence of the filter.
Learning vehicular dynamics with application to modeling helicopters
- Proceedings of NIPS 18
, 2006
"... We consider the problem of modeling a helicopter’s dynamics based on state-action trajectories collected from it. The contribution of this pa-per is two-fold. First, we consider the linear models such as learned by CIFER (the industry standard in helicopter identification), and show that the linear ..."
Abstract
-
Cited by 39 (9 self)
- Add to MetaCart
(Show Context)
We consider the problem of modeling a helicopter’s dynamics based on state-action trajectories collected from it. The contribution of this pa-per is two-fold. First, we consider the linear models such as learned by CIFER (the industry standard in helicopter identification), and show that the linear parameterization makes certain properties of dynamical sys-tems, such as inertia, fundamentally difficult to capture. We propose an alternative, acceleration based, parameterization that does not suffer from this deficiency, and that can be learned as efficiently from data. Second, a Markov decision process model of a helicopter’s dynamics would explic-itly model only the one-step transitions, but we are often interested in a model’s predictive performance over longer timescales. In this paper, we present an efficient algorithm for (approximately) minimizing the pre-diction error over long time scales. We present empirical results on two different helicopters. Although this work was motivated by the problem of modeling helicopters, the ideas presented here are general, and can be applied to modeling large classes of vehicular dynamics. 1
Vision-Aided Inertial Navigation for Flight Control
- Journal of Aerospace Computing, Information, and Communication
, 2005
"... Many onboard navigation systems use the Global Positioning System to bound the errors that result from integrating inertial sensors over time. Global Positioning System information, however, is not always accessible since it relies on external satellite signals. To this end, a vision sensor is explo ..."
Abstract
-
Cited by 37 (2 self)
- Add to MetaCart
Many onboard navigation systems use the Global Positioning System to bound the errors that result from integrating inertial sensors over time. Global Positioning System information, however, is not always accessible since it relies on external satellite signals. To this end, a vision sensor is explored as an alternative for inertial navigation in the context of an Extended Kalman Filter used in the closed-loop control of an unmanned aerial vehicle. The filter employs an onboard image processor that uses camera images to provide information about the size and position of a known target, thereby allowing the flight computer to derive the target’s pose. Assuming that the position and orientation of the target are known a priori, vehicle position and attitude can be determined from the fusion of this information with inertial and heading measurements. Simulation and flight test results verify filter performance in the closed-loop control of an unmanned rotorcraft. Nomenclature Fi = {xi, yi, zi} Inertial reference frame Fb = {xb, yb, zb} Body reference frame Fc = {xc, yc, zc} Camera reference frame
Attitude estimation on SO(3) based on direct inertial measurements”,
- Proceedings of the 2006 IEEE International Conference on Robotics and Automation,
, 2006
"... Abstract-This paper considers the question of obtaining high quality attitude estimates from typical low cost inertial measurement units for applications in control of unmanned aerial vehicles. A nonlinear complementary filter exploiting the structure of Special Orthogonal Group S0(3) is proposed. ..."
Abstract
-
Cited by 30 (7 self)
- Add to MetaCart
(Show Context)
Abstract-This paper considers the question of obtaining high quality attitude estimates from typical low cost inertial measurement units for applications in control of unmanned aerial vehicles. A nonlinear complementary filter exploiting the structure of Special Orthogonal Group S0(3) is proposed. The filter is expressed explicitly in terms of direct and untreated measurements. For a typical low cost inertial measurement where two inertial direction are measured (gravity and magnetic field), it is shown that the filter is well conditioned. If only a single direction is available (typically the gravity) associated with gyros measurements, it is shown that the full gyros bias vector is correctly estimated and that the estimated orientation converges to a set consistent with the measurements. Experimental results, conducted on a the HoverEye c UAV, demonstrate the efficiency of the proposed filter.
Apprenticeship learning for helicopter control
- Communications of the ACM
"... doi:10.1145/1538788.1538812 Autonomous helicopter flight is widely regarded to be a highly challenging control problem. As helicopters are highly unstable and exhibit complicated dynamical behavior, it is particularly difficult to design controllers that achieve high performance over a broad flight ..."
Abstract
-
Cited by 28 (0 self)
- Add to MetaCart
doi:10.1145/1538788.1538812 Autonomous helicopter flight is widely regarded to be a highly challenging control problem. As helicopters are highly unstable and exhibit complicated dynamical behavior, it is particularly difficult to design controllers that achieve high performance over a broad flight regime. While these aircraft are notoriously difficult to control, there are expert human pilots who are nonetheless capable of demonstrating a wide variety of maneuvers, including aerobatic maneuvers at the edge of the helicopter’s performance envelope. In this paper, we present algorithms for modeling and control that leverage these demonstrations to build high-performance control systems for autonomous helicopters. More specifically, we detail our experiences with the Stanford Autonomous Helicopter, which is now capable of extreme aerobatic flight meeting or exceeding the performance of our own expert pilot. 1.
A complementary filter for attitude estimation of a fixed-wing UA
- in IEEE/RSJ International Conference on Intelligent Robots and Systems
, 2008
"... Abstract — This paper considers the question of using a non-linear complementary filter for attitude estimation of fixed-wing unmanned aerial vehicle (UAV) given only measurements from a low-cost inertial measurement unit. A nonlinear complementary filter is proposed that combines accelerometer outp ..."
Abstract
-
Cited by 25 (0 self)
- Add to MetaCart
(Show Context)
Abstract — This paper considers the question of using a non-linear complementary filter for attitude estimation of fixed-wing unmanned aerial vehicle (UAV) given only measurements from a low-cost inertial measurement unit. A nonlinear complementary filter is proposed that combines accelerometer output for low frequency attitude estimation with integrated gyrometer output for high frequency estimation. The raw accelerometer output includes a component for the airframe acceleration, that occurs primarily as the aircraft turns, as well as the gravitational acceleration that is required for the filter. The airframe ac-celeration is estimated using a simple centripetal force model (based on additional airspeed measurements), augmented by a first order dynamic model for angle-of-attack, and used to obtain estimates of the gravitational direction independent of the airplane manoeuvres. Experimental results are provided on a real-world data set and the performance of the filter is evaluated against the output from a full GPS/INS that was available for the data set. I.
P.: Image processing algorithms for UAV ”sense and avoid
- In: Robotics and Automation, 2006. ICRA 2006. Proceedings 2006 IEEE International Conference on
, 2006
"... Abstract – This research is investigating the feasibility of using computer vision to provide a level of situational awareness suitable for the task of UAV “sense and avoid. ” This term is used to describe the capability of a UAV to detect airborne traffic and respond with appropriate avoidance mane ..."
Abstract
-
Cited by 20 (4 self)
- Add to MetaCart
(Show Context)
Abstract – This research is investigating the feasibility of using computer vision to provide a level of situational awareness suitable for the task of UAV “sense and avoid. ” This term is used to describe the capability of a UAV to detect airborne traffic and respond with appropriate avoidance maneuvers in order to maintain minimum separation distances. As reflected in regulatory requirements such as FAA Order 7610.4, this capability must demonstrate a level of performance which meets or exceeds that of an equivalent human pilot. Presented in this paper is a comparison of two initial image processing algorithms that have been designed to detect small, point-like features (potentially corresponding to distant, collision-course aircraft) from image streams, and a discussion of their detection performance in processing a real-life collision scenario. This performance is compared against the stated benchmark of equivalent human performance, specifically the measured detection times of an alerted human observer. The two algorithms were used to process a series of image streams featuring real collision-course aircraft against a variety of daytime backgrounds. Preliminary analysis of this data set has yielded encouraging results, achieving first detection times at distances of approximately 6.5km (3.5nmi), which are 35-40% greater than those of the alerted human observer. Comparisons were also drawn between the two separate detection algorithms, and have demonstrated that a new approach designed to increase resilience to image noise achieves a lower rate of false alarms, particularly in tests featuring more sensitive detection thresholds. Index Terms – collision avoidance, UAV, computer vision, target detection, sense and avoid