Dissertations / Theses on the topic 'GPS-Denied navigation'

Thesis: S.M., Massachusetts Institute of Technology, Department of Aeronautics and Astronautics, 2018
Cataloged from PDF version of thesis.
Includes bibliographical references (pages 113-117).
In the past few decades, GPS has become the dominant source of precision navigation and is often required for many modern systems to operate. However, recent exposure of GPS vulnerabilities have called into question its overall resiliency and shown necessity for robust alternatives. Precision celestial navigation using Draper's Skymark technique can be used to replace GPS. However, these systems rely on prior position knowledge for system initialization. In GPS-denied scenarios, prior position knowledge may not be available or trustworthy. Similarly, other GPS-denied navigation techniques such as landmark navigation or vision-aided navigation can be difficult when there is limited prior position information. Therefore, the Multiple Hypothesis Positioning algorithm is developed in this thesis to provide robust positioning in GPS-denied navigation scenarios where little or no prior position knowledge is available.
The proposed robust positioning algorithm makes use of Multiple Hypothesis Tracking techniques to develop an object identification and observer positioning framework. The Multiple Hypothesis Positioning framework is developed broadly in this thesis to encompass multiple applications of the proposed algorithm. The Multiple Hypothesis Positioning framework is applied to two separate applications including a Lost-at-Sea positioning algorithm and a Lost-in-a-Forest positioning algorithm. The Lost-at-Sea application serves as an initialization process for Draper's Skymark technique in situations where no prior position knowledge is available. The Lost-in-a-Forest positioning algorithm uses pattern matching techniques to identify trees near an observer and compare these locally observed trees to a global map of all tree locations. The pattern matching techniques are combined with the Multiple Hypothesis Positioning framework to determine the observer's global position.
Both applications were tested in robust Monte Carlo simulations with positive results. Overall, the proposed Multiple Hypothesis Positioning algorithm and framework prove effective tools for robust positioning in GPS-denied navigation applications where prior position information is unavailable.
"The material included in this thesis was funded through internal research and development funds from the Charles Stark Draper Laboratories. This research is this thesis was supported by the Draper Education Office and the Draper Fellowship Program"--Page 5.
by Patrick Joseph O'Shea.
S.M.
S.M. Massachusetts Institute of Technology, Department of Aeronautics and Astronautics

Includes bibliographical references.
This dissertation addresses the autonomous localisation and navigation problem in the context of an underground mining environment. This kind of environment has little or no features as well as no access to GPS or stationary towers, which are usually used for navigation. In addition dust and debris may hinder optical methods for ranging. This study looks at the feasibility of using randomly distributed RFID tags to autonomously navigate in this environment. Clustering of observed tags are used for localisation, subsequently value iteration is used to navigate to a defined goal. Results are presented, concluding that it is feasible to localise and navigate using only RFID tags, in simulation. Localisation feasibility is also confirmed by experimental measurements.

Traditionally, the task of determining aircraft position and attitude for automatic control has been handled by the combination of an inertial measurement unit (IMU) with a Global Positioning System (GPS) receiver. In this configuration, accelerations and angular rates from the IMU can be integrated forward in time, and position updates from the GPS can be used to bound the errors that result from this integration. However, reliance on the reception of GPS signals places artificial constraints on aircraft such as small unmanned aerial vehicles (UAVs) that are otherwise physically capable of operation in indoor, cluttered, or adversarial environments. Therefore, this work investigates methods for incorporating a monocular vision sensor into a standard avionics suite. Vision sensors possess the potential to extract information about the surrounding environment and determine the locations of features or points of interest. Having mapped out landmarks in an unknown environment, subsequent observations by the vision sensor can in turn be used to resolve aircraft position and orientation while continuing to map out new features. An extended Kalman filter framework for performing the tasks of vision-based mapping and navigation is presented. Feature points are detected in each image using a Harris corner detector, and these feature measurements are corresponded from frame to frame using a statistical Z-test. When GPS is available, sequential observations of a single landmark point allow the point's location in inertial space to be estimated. When GPS is not available, landmarks that have been sufficiently triangulated can be used for estimating vehicle position and attitude. Simulation and real-time flight test results for vision-based mapping and navigation are presented to demonstrate feasibility in real-time applications. These methods are then integrated into a practical framework for flight in GPS-denied environments and verified through the autonomous flight of a UAV during a loss-of-GPS scenario. The methodology is also extended to the application of vehicles equipped with stereo vision systems. This framework enables aircraft capable of hovering in place to maintain a bounded pose estimate indefinitely without drift during a GPS outage.

Location information is vital for any type of aircraft and even more crucial for Unmanned Aerial Systems (UAS). GPS is a readily available solution but signals can easily be jammed or lost. In this thesis, radar is explored as a backup system for self-localization when GPS signals are not available. The method proposed requires that an area be pre mapped by collecting radar data with known latitude and longitude coordinates. New radar data is then collected and compared to previously stored values. Channel matrices are stored at each point and are used as the basis for location comparisons. Various methods of matrix comparison are used and both simulation as well as experimental results are shown. The main results of this thesis show that position can be determined using channel matrices if the sensor is within a certain radius of previously stored locations. This radius is on the order of a wavelength or less. Using correlation matrix comparisons the radius of localization is broadened. A novel method using multiple channel and multiple frequency data proves to be successful and determines the position of an octorotor UAS with a mean position error of less than three meters. The design of a low-cost, compact, and light-weight FMCW radar for two applications is also presented. The first application is a novel radar based positioning system that utilizes multiple channel and multiple frequency information to determine position. The second application is a UAS sense and avoid system using a monopulse configuration. Without connectors or antennas, the radar weighs 45.7 grams, is 7.5 cm x 5 cm x 3 cm in size, and costs less than $100 when built in quantities of 100 or more (excludes antennas and connectors). It is tested using delay lines and corner reflectors and accurately determines the distance to close range targets.

Micro air vehicles have recently gained popularity due to their potential as autonomous systems. Their future impact, however, will depend in part on how well they can navigate in GPS-denied and GPS-degraded environments. In response to this need, this dissertation investigates a potential solution for GPS-denied operations called relative navigation. The method utilizes keyframe-to-keyframe odometry estimates and their covariances in a global back end that represents the global state as a pose graph. The back end is able to effectively represent nonlinear uncertainties and incorporate opportunistic global constraints. The GPS-denied research community has, for the most part, neglected to consider fixed-wing aircraft. This dissertation enables fixed-wing aircraft to utilize relative navigation by accounting for their sensing requirements. The development of an odometry-like, front-end, EKF-based estimator that utilizes only a monocular camera and an inertial measurement unit is presented. The filter uses the measurement model of the multi-state-constraint Kalman filter and regularly performs relative resets in coordination with keyframe declarations. In addition to the front-end development, a method is provided to account for front-end velocity bias in the back-end optimization. Finally a method is presented for enabling multiple vehicles to improve navigational accuracy by cooperatively sharing information. Modifications to the relative navigation architecture are presented that enable decentralized, cooperative operations amidst temporary communication dropouts. The proposed framework also includes the ability to incorporate inter-vehicle measurements and utilizes a new concept called the coordinated reset, which is necessary for optimizing the cooperative odometry and improving localization. Each contribution is demonstrated through simulation and/or hardware flight testing. Simulation and Monte-Carlo testing is used to show the expected quality of the results. Hardware flight-test results show the front-end estimator performance, several back-end optimization examples, and cooperative GPS-denied operations.

Unmanned aerial vehicle technology is rapidly maturing. In recent years, the sight of hobbyist aircraft has become more common. Corporations and governments are also interested in using drone aircraft for applications such as package delivery, surveillance and communications. These autonomous UAV technologies demand robust systems that perform under any circumstances. Many UAV applications rely on GPS to obtain information about their location and velocity. However, the GPS system has known vulnerabilities, including environmental signal degradation, terrestrial or solar weather, or malicious attacks such as GPS spoofing. These conditions occur with enough frequency to cause concern. Without a GPS signal, the state estimation in many autopilots quickly degrades. In the absence of a reliable backup navigation scheme, this loss of state will cause the aircraft to drift off course, and in many cases the aircraft will lose power or crash. While no single approach can solve all of the issues with GPS signal degradation, individual events can be addressed and solved. In this thesis, we present a system which will return an aircraft to its launch point upon the loss of GPS. This functionality is advantageous because it allows recovery of the UAV in circumstances which the lack of GPS information would make difficult. The system presented in this thesis accomplishes the return of the aircraft by means of onboard visual navigation, which removes the dependence of the aircraft on external sensors and systems. The system presented here uses an downward-facing onboard camera and computer to capture a string of overlapping images (keyframes) of the ground as the aircraft travels on its outbound journey. When a signal is received, the aircraft switches into return-to-home mode. The system uses the homography matrix and other vision processing techniques to produce information about the location of the current keyframe relative to the aircraft. This information is used to navigate the aircraft to the location of each saved keyframe in reverse order. As each keyframe is reached, the system programmatically loads the next target keyframe. By following the chain of keyframes in reverse, the system reaches the launch location. Contributions in this thesis include the return-to-home visual flight system for UAVs, which has been tested in simulation and with flight tests. Features of this system include methods for determining new keyframes and switching keyframes on the inbound flight, extracting data between images, and flight navigation based on this information. This system is a piece of the wider GPS-denied framework under development in the BYU MAGICC lab.

Finding lost persons, collecting information in disturbed communities, efficiently traversing urban areas after a blast or similar catastrophic events have motivated researchers to develop intelligent sensor frameworks to aid law enforcement, first responders, and military personnel with situational awareness. This dissertation consists of a two-part framework for providing situational awareness using both acoustic ground sensors and aerial sensing modalities. Ground sensors in the field of data-driven detection and classification approaches typically rely on computationally expensive inputs such as image or video-based methods [6, 91]. However, the information given by an acoustic signal offers several advantages, such as low computational needs and possible classification of occluded events including gunshots or explosions. Once an event is identified, responding to real-time events in urban areas is difficult using an Unmanned Aerial Vehicle (UAV) especially when GPS is unreliable due to coverage blackouts and/or GPS degradation [10]. Furthermore, if it is possible to deploy multiple in-situ static intelligent acoustic autonomous sensors that can identify anomalous sounds given context, then the sensors can communicate with an autonomous UAV that can navigate in a GPS-denied urban environment for investigation of the event; this could offer several advantages for time-critical and precise, localized response information necessary for life-saving decision-making. Thus, in order to implement a complete intelligent sensor framework, the need for both an intelligent static ground acoustic autonomous unattended sensors (AAUS) and improvements to GPS-degraded localization has become apparent for applications such as anomaly detection, public safety, as well as intelligence surveillance and reconnaissance (ISR) operations. Distributed AAUS networks could provide end-users with near real-time actionable information for large urban environments with limited resources. Complete ISR mission profiles require a UAV to fly in GPS challenging or denied environments such as natural or urban canyons, at least in a part of a mission. This dissertation addresses, 1) the development of intelligent sensor framework through the development of a static ground AAUS capable of machine learning for audio feature classification and 2) GPS impaired localization through a formal framework for trajectory-based flight navigation for unmanned aircraft systems (UAS) operating BVLOS in low-altitude urban airspace. Our AAUS sensor method utilizes monophonic sound event detection in which the sensor detects, records, and classifies each event utilizing supervised machine learning techniques [90]. We propose a simulated framework to enhance the performance of localization in GPS-denied environments. We do this by using a new representation of 3D geospatial data using planar features that efficiently capture the amount of information required for sensor-based GPS navigation in obstacle-rich environments. The results from this dissertation would impact both military and civilian areas of research with the ability to react to events and navigate in an urban environment.
Doctor of Philosophy
Emergency scenarios such as missing persons or catastrophic events in urban areas require first responders to gain situational awareness motivating researchers to investigate intelligent sensor frameworks that utilize drones for observation prompting questions such as: How can responders detect and classify acoustic anomalies using unattended sensors? and How do they remotely navigate in GPS-denied urban environments using drones to potentially investigate such an event? This dissertation addresses the first question through the development of intelligent WSN systems that can provide time-critical and precise, localized environmental information necessary for decision-making. At Virginia Tech, we have developed a static ground Acoustic Autonomous Unattended Sensor (AAUS) capable of machine learning for audio feature classification. The prior arts of intelligent AAUS and network architectures do not account for network failure, jamming capabilities, or remote scenarios in which cellular data wifi coverage are unavailable [78, 90]. Lacking a framework for such scenarios illuminates vulnerability in operational integrity for proposed solutions in homeland security applications. We address this through data ferrying, a communication method in which a mobile node, such as a drone, physically carries data as it moves through the environment to communicate with other sensor nodes on the ground. When examining the second question of navigation/investigation, concerns of safety arise in urban areas regarding drones due to GPS signal loss which is one of the first problems that can occur when a drone flies into a city (such as New York City). If this happens, potential crashes, injury and damage to property are imminent because the drone does not know where it is in space. In these GPS-denied situations traditional methods use point clouds (a set of data points in space (X,Y,Z) representing a 3D object [107]) constructed from laser radar scanners (often seen in a Microsoft Xbox Kinect sensor) to find itself. The main drawback from using methods such as these is the accumulation of error and computational complexity of large data-sets such as New York City. An advantage of cities is that they are largely flat; thus, if you can represent a building with a plane instead of 10,000 points, you can greatly reduce your data and improve algorithm performance. This dissertation addresses both the needs of an intelligent sensor framework through the development of a static ground AAUS capable of machine learning for audio feature classification as well as GPS-impaired localization through a formal framework for trajectory-based flight navigation for UAS operating BVLOS in low altitude urban and suburban environments.

The use of multirotor UAVs to map GPS-degraded environments is useful for many purposes ranging from routine structural inspections to post-disaster exploration to search for survivors and evaluate structural integrity. Multirotor UAVs are able to reach many areas that humans and other robots cannot safely access. Because of their relatively short operational flight time compared to other robotic applications, using multiple UAVs to collaboratively map these environments can streamline the mapping process significantly. This research focuses on four primary areas regarding autonomous mapping and navigation with multiple UAVs in complex unknown or partially unknown GPS-denied environments: The first area is the high-level coverage path planning necessary to successfully map these environments with multiple agents. The second area is the lower-level reactive path planning that enables autonomous navigation through complex, unknown environments. Third, is the estimation framework that enables autonomous flight without the use of GPS or other global position sensors. Lastly, it focuses on the mapping framework to build a single dense 3D map of these environments with multiple agents flying simultaneously.

Aquatic robots, such as Autonomous Underwater Vehicles (AUVs), play a major role in the study of ocean processes that require long-term sampling efforts and commonly perform navigation via dead-reckoning using an accelerometer, a magnetometer, a compass, an IMU and a depth sensor for feedback. However, these instruments are subjected to large drift, leading to unbounded uncertainty in location. Moreover, the spatio-temporal dynamics of the ocean environment, coupled with limited communication capabilities, make navigation and localization difficult, especially in coastal regions where the majority of interesting phenomena occur. To add to this, the interesting features are themselves spatio-temporally dynamic, and effective sampling requires a good understanding of vehicle localization relative to the sampled feature. Therefore, our work is motivated by the desire to enable intelligent data collection of complex dynamics and processes that occur in coastal ocean environments to further our understanding and prediction capabilities. The study originated from the need to localize and navigate aquatic robots in a GPS-denied environment and examine the role of the spatio-temporal dynamics of the ocean into the localization and navigation processes. The methods and techniques needed range from the data collection to the localization and navigation algorithms used on-board of the aquatic vehicles. The focus of this work is to develop algorithms for localization and navigation of AUVs in GPS-denied environments. We developed an Augmented terrain-based framework that incorporates physical science data, i.e., temperature, salinity, pH, etc., to enhance the topographic map that the vehicle uses to navigate. In this navigation scheme, the bathymetric data are combined with the physical science data to enrich the uniqueness of the underlying terrain map and increase the accuracy of underwater localization. Another technique developed in this work addresses the problem of tracking an underwater vehicle when the GPS signal suddenly becomes unavailable. The methods include the whitening of the data to reveal the true statistical distance between datapoints and also incorporates physical science data to enhance the topographic map. Simulations were performed at Lake Nighthorse, Colorado, USA, between April 25th and May 2nd 2018 and at Big Fisherman's Cove, Santa Catalina Island, California, USA, on July 13th and July 14th 2016. Different missions were executed on different environments (snow, rain and the presence of plumes). Results showed that these two methodologies for localization and tracking work for reference maps that had been recorded within a week and the accuracy on the average error in localization can be compared to the errors found when using GPS if the time in which the observations were taken are the same period of the day (morning, afternoon or night). The whitening of the data had positive results when compared to localizing without whitening.

This thesis discusses topics relevant to indoor unmanned quadrotor navigation and control. These topics include: quadrotor modeling, sensor modeling, quadrotor parameter estimation, sensor calibration, quadrotor state estimation using onboard sensors, and cooperative GPS navigation. Modeling the quadrotor, sensor modeling, and parameter estimation are essential components for quadrotor navigation and control. This thesis investigates prior work and organizes a wide variety of models and calibration methods that enable indoor unmanned quadrotor flight. Quadrotor parameter estimation using a particle filter is a contribution that extends current research in the area. This contribution is novel in that it applies the particle filter specifically to quadrotor parameter estimation as opposed to quadrotor state estimation. The advantages and disadvantages of such an approach are explained. Quadrotor state estimation using onboard sensors and without the aid of GPS is also discussed, as well as quadrotor pose estimation using the Extended Kalman Filter with an inertial measurement unit and simulated 3D camera updates. This is done using two measurement updates: one from the inertial measurement unit and one from the simulated 3D camera. Finally, we demonstrate that when GPS lock cannot be obtained by an unmanned vehicle individually. A group of cooperative robots with pose estimates to one anther can exploit partial GPS information to improve global position estimates for individuals in the group. This method is advantageous for robots that need to navigate in environments where signals from GPS satellites are partially obscured or jammed.

Prior to the wide deployment of robotic systems, they must be able to navigate autonomously. These systems cannot rely on good weather or daytime navigation and they must also be able to navigate in unknown environments. All of this must take place without human interaction. A majority of modern autonomous systems rely on GPS for position estimation. While GPS solutions are readily available, GPS is often lost and may even be jammed. To this end, a significant amount of research has focused on GPS-denied navigation. Many GPS-denied solutions rely on known environmental features for navigation. Others use vision sensors, which often perform poorly at high altitudes and are limited in poor weather. In contrast, radar systems accurately measure range at high and low altitudes. Additionally, these systems remain unaffected by inclimate weather. This dissertation develops the use of radar odometry for GPS-denied navigation. Using the range progression of unknown environmental features, the aircraft's motion is estimated. Results are presented for both simulated and real radar data. In Chapter 2 a greedy radar odometry algorithm is presented. It uses the Hough transform to identify the range progression of ground point-scatterers. A global nearest neighbor approach is implemented to perform data association. Assuming a piece-wise constant heading assumption, as the aircraft passes pairs of scatterers, the location of the scatterers are triangulated, and the motion of the aircraft is estimated. Real flight data is used to validate the approach. Simulated flight data explores the robustness of the approach when the heading assumption is violated. Chapter 3 explores a more robust radar odometry technique, where the relatively constant heading assumption is removed. This chapter uses the recursive-random sample consensus (R-RANSAC) Algorithm to identify, associate, and track the point scatterers. Using the measured ranges to the tracked scatterers, an extended Kalman filter (EKF) iteratively estimates the aircraft's position in addition to the relative locations of each reflector. Real flight data is used to validate the accuracy of this approach. Chapter 4 performs observability analysis of a range-only sensor. An observable, radar odometry approach is proposed. It improves the previous approaches by adding a more robust R-RANSAC above ground level (AGL) tracking algorithm to further improve the navigational accuracy. Real flight results are presented, comparing this approach to the techniques presented in previous chapters.

Micro aerial vehicles and other autonomous systems have the potential to truly transform life as we know it, however much of the potential of autonomous systems remains unrealized because reliable navigation is still an unsolved problem with significant challenges. This dissertation presents solutions to many aspects of autonomous navigation. First, it presents ROSflight, a software and hardware architure that allows for rapid prototyping and experimentation of autonomy algorithms on MAVs with lightweight, efficient flight control. Next, this dissertation presents improvments to the state-of-the-art in optimal control of quadrotors by utilizing the error-state formulation frequently utilized in state estimation. It is shown that performing optimal control directly over the error-state results in a vastly more computationally efficient system than competing methods while also dealing with the non-vector rotation components of the state in a principled way. In addition, real-time robust flight planning is considered with a method to navigate cluttered, potentially unknown scenarios with real-time obstacle avoidance. Robust state estimation is a critical component to reliable operation, and this dissertation focuses on improving the robustness of visual-inertial state estimation in a filtering framework by extending the state-of-the-art to include better modeling and sensor fusion. Further, this dissertation takes concepts from the visual-inertial estimation community and applies it to tightly-coupled GNSS, visual-inertial state estimation. This method is shown to demonstrate significantly more reliable state estimation than visual-inertial or GNSS-inertial state estimation alone in a hardware experiment through a GNSS-GNSS denied transition flying under a building and back out into open sky. Finally, this dissertation explores a novel method to combine measurements from multiple agents into a coherent map. Traditional approaches to this problem attempt to solve for the position of multiple agents at specific times in their trajectories. This dissertation instead attempts to solve this problem in a relative context, resulting in a much more robust approach that is able to handle much greater intial error than traditional approaches.

Ground robotic vehicles are used in many different applications. Many of these uses include tele-operation of the robot. This allows the robot to be deployed in locations that are too difficult or are unsafe for human access. The ability of a ground robot to autonomously navigate to a desired location without a-priori map information and without using GPS would allow robotic vehicles to be used in many of these situations and would free the operator to focus on other more important tasks. The purpose of this research is to develop algorithms that enable a ground robot to autonomously navigate to a user-selected location. The goal is selected from a video feed from the robot and the robot drives to the goal location while avoiding obstacles. The method uses a monocular camera for measuring the locations of the goal and landmarks. The method is validated in simulation and through experiments on an iRobot Packbot platform. A novel goal-based robocentric mapping algorithm is derived in Chapter 3. This map is created using an extended Kalman filter (EKF) by tracking the position of the goal along with other available landmarks surrounding the robot as it drives towards the goal. The mapping is robocentric, meaning that the map is a local map created in the robot-body frame. A unique state definition of the goal states and additional landmarks is presented that improves the estimate of the goal location. An improved 3D model is derived and used to allow the robot to drive on non-flat terrain while calculating the position of the goal and other landmarks. The observability and consistency of the proposed method are shown in Chapter 4. The visual tracking algorithm is explained in Chapter 5. This tracker is used with the EKF to improve tracking performance and to allow the objects to be tracked even after leaving the camera field of view for significant periods of time. This problem presents a difficult challenge for visual tracking because of the drastic change in size of the goal object as the robot approaches the goal. The tracking method is validated through experiments in real-world scenarios. The method of planning and control is derived in Chapter 6. A Model Predictive Control (MPC) formulation is designed that explicitly handles the sensor constraints of a monocular camera that is rigidly mounted to the vehicle. The MPC uses an observability-based cost function to drive the robot along a path that minimizes the position error of the goal in the robot-body frame. The MPC algorithm also avoids obstacles while driving to the goal. The conditions are explained that guarantee the robot will arrive within some specified distance of the goal. The entire system is implemented on an iRobot Packbot and experiments are conducted and presented in Chapter 7. The methods described in this work are shown to work on actual hardware allowing the robot to arrive at a user-selected goal in real-world scenarios.

Autonomous flight in unstructured, confined, and unknown GPS-denied environments is a challenging problem. Solutions could be tremendously beneficial for scenarios that require information about areas that are difficult to access and that present a great amount of risk. The goal of this research is to develop a new framework that enables improved solutions to this problem and to validate the approach with experiments using a hardware prototype. In Chapter 2 we examine the consequences and practical aspects of using an improved dynamic model for multirotor state estimation, using only IMU measurements. The improved model correctly explains the measurements available from the accelerometers on a multirotor. We provide hardware results demonstrating the improved attitude, velocity and even position estimates that can be achieved through the use of this model. We propose a new architecture to simplify some of the challenges that constrain GPS-denied aerial flight in Chapter 3. At the core, the approach combines visual graph-SLAM with a multiplicative extended Kalman filter (MEKF). More importantly, we depart from the common practice of estimating global states and instead keep the position and yaw states of the MEKF relative to the current node in the map. This relative navigation approach provides a tremendous benefit compared to maintaining estimates with respect to a single global coordinate frame. We discuss the architecture of this new system and provide important details for each component. We verify the approach with goal-directed autonomous flight-test results. The MEKF is the basis of the new relative navigation approach and is detailed in Chapter 4. We derive the relative filter and show how the states must be augmented and marginalized each time a new node is declared. The relative estimation approach is verified using hardware flight test results accompanied by comparisons to motion capture truth. Additionally, flight results with estimates in the control loop are provided. We believe that the relative, vision-based framework described in this work is an important step in furthering the capabilities of indoor aerial navigation in confined, unknown environments. Current approaches incur challenging problems by requiring globally referenced states. Utilizinga relative approach allows more flexibility as the critical, real-time processes of localization and control do not depend on computationally-demanding optimization and loop-closure processes.

This thesis presents a real-time autonomous guidance and control method for a quadrotor in a GPS-denied environment. The quadrotor autonomously seeks a destination while it avoids obstacles whose shape and position are initially unknown. We implement the obstacle avoidance and destination seeking methods using off-the-shelf sensors, including a vision-sensing camera. The vision-sensing camera detects the positions of points on the surface of obstacles. We use this obstacle position data and a potential-field method to generate velocity commands. We present a backstepping controller that uses the velocity commands to generate the quadrotor's control inputs. In indoor experiments, we demonstrate that the guidance and control methods provide the quadrotor with sufficient autonomy to fly point to point, while avoiding obstacles.

Unmanned vehicles are increasingly common in our world today. Self-driving ground vehicles and unmanned aerial vehicles (UAVs) such as quadcopters have become the fastest growing area of automated vehicles research. These systems use three main processes to autonomously travel from one location to another: guidance, navigation, and controls (GNC). Guidance refers to the process of determining a desired path of travel or trajectory, affecting velocities and orientations. Examples of guidance activities include path planning and obstacle avoidance. Effective guidance decisions require knowledge of one’s current location. Navigation systems typically answer questions such as: “Where am I? What is my orientation? How fast am I going?” Finally, the process is tied together when controls are implemented. Controls use navigation estimates (e.g., “Where I am now?”) and the desired trajectory from guidance processes (e.g., “Where do I want to be?”) to control the moving parts of the system to accomplish relevant goals. Navigation in autonomous vehicles involves intelligently combining information from several sensors to produce accurate state estimations. To date, global positioning systems(GPS) occupy a crucial place in most navigation systems. However, GPS is not universally reliable. Even when available, GPS can be easily spoofed or jammed, rendering it useless. Thus, navigation within GPS-denied environments is an area of deep interest in both military and civilian applications. Image-aided inertial navigation is an alternative navigational solution in GPS-denied environments. One form of image-aided navigation measures the bearing from the vehicle to a feature or landmark of known location using a single lens imager, such as a camera, to deduce information about the vehicle’s position and attitude. This work uncovers and explores several of the impacts of trajectories and land mark distributions on the navigation information gained from this type of aiding measurement. To do so, a modular system model and extended Kalman filter (EKF) are described and implemented. A quadrotor system model is first presented. This model is implemented and then used to produce sensor data for several trajectories of varying shape, altitude, and landmark density. Next, navigation data is produced by running the sensor data through an EKF. The data is plotted and examined to determine effects of each variable. These effects are then explained. Finally, an equation describing the quantity of information in each measurement is derived and related to the patterns seen in the data. The resulting equation is then used to explain selected patterns in the data. Other uses of this equation are presented, including applications to path planning and landmark placement.

Most micro air vehicles rely heavily on reliable GPS measurements for proper estimation and control, and therefore struggle in GPS-degraded environments. When GPS is not available, the global position and heading of the vehicle is unobservable. This dissertation establishes the theoretical and practical advantages of a relative navigation framework for MAV navigation in GPS-degraded environments. This dissertation explores how the consistency, accuracy, and stability of current navigation approaches degrade during prolonged GPS dropout and in the presence of heading uncertainty. Relative navigation (RN) is presented as an alternative approach that maintains observability by working with respect to a local coordinate frame. RN is compared with several current estimation approaches in a simulation environment and in hardware experiments. While still subject to global drift, RN is shown to produce consistent state estimates and stable control. Estimating relative states requires unique modifications to current estimation approaches. This dissertation further provides a tutorial exposition of the relative multiplicative extended Kalman filter, presenting how to properly ensure observable state estimation while maintaining consistency. The filter is derived using both inertial and body-fixed state definitions and dynamics. Finally, this dissertation presents a series of prolonged flight tests, demonstrating the effectiveness of the relative navigation approach for autonomous GPS-degraded MAV navigation in varied, unknown environments. The system is shown to utilize a variety of vision sensors, work indoors and outdoors, run in real-time with onboard processing, and not require special tuning for particular sensors or environments. Despite leveraging off-the-shelf sensors and algorithms, the flight tests demonstrate stable front-end performance with low drift. The flight tests also demonstrate the onboard generation of a globally consistent, metric, and localized map by identifying and incorporating loop-closure constraints and intermittent GPS measurements. With this map, mission objectives are shown to be autonomously completed.

The design of a low cost electronically steered array feed (ESAF) is implemented and tested. The ESAF demonstrated satellite tracking capabilities over four degrees. The system was compared to a commercial low-noise block downconverter (LNBF) and was able to receive the signal over a wider angle than the commercial system. Its signal-to-noise ratio (SNR) performance was poor, but a proof of concept for a low cost ESAF used for tracking is demonstrated. Two compact low profile dual circularly polarized (CP) reflector feed antenna designs are also analyzed. One of the designs is a passive antenna dipole array over an electromagnetic band gap (EBG) surface. It demonstrated high isolation between ports for orthogonal polarizations while also achieving quality dual CP performance. Simulations and measurements are shown for this antenna. The other antenna was a microstrip cross antenna. This antenna demonstrated high gain and quality CP but had a large side lobe and low isolation between ports. A global positioning system (GPS) denied multiple input multiple output (MIMO) radar for unmanned aerial vehicles (UAVs) is simulated and tested in a physical optics scattering model. This model is developed and tested by comparing simulated and analytical results. The radar uses channel matrices generated from the MIMO antenna system. The channel matrices are then used to generate correlation matrices. A matrix distance between actively received correlation matrices to stored correlation matrices is used to estimate the position of the UAV. Simulations demonstrate the ability of the radar algorithm to determine its position when flying along a previously mapped path.

In this dissertation we present advances in developing an autonomous air vehicle capable of navigating through unknown, indoor environments. The problem imposes stringent limits on the computational power available onboard the vehicle, but the environment necessitates using 3D sensors such as stereo or RGB-D cameras whose data requires significant processing. We address the problem by proposing and developing key elements of a relative navigation scheme that moves as many processing tasks as possible out of the time-critical functions needed to maintain flight. We present in Chapter 2 analysis and results for an improved multirotor helicopter state estimator. The filter generates more accurate estimates by using an improved dynamic model for the vehicle and by properly accounting for the correlations that exist in the uncertainty during state propagation. As a result, the filter can rely more heavily on frequent and easy to process measurements from gyroscopes and accelerometers, making it more robust to error in the processing intensive information received from the exteroceptive sensors. In Chapter 3 we present BERT, a novel approach to map optimization. The goal of map optimization is to produce an accurate global map of the environment by refining the relative pose transformation estimates generated by the real-time navigation system. We develop BERT to jointly optimize the global poses and relative transformations. BERT exploits properties of independence and conditional independence to allow new information to efficiently flow through the network of transformations. We show that BERT achieves the same final solution as a leading iterative optimization algorithm. However, BERT delivers noticeably better intermediate results for the relative transformation estimates. The improved intermediate results, along with more readily available covariance estimates, make BERT especially applicable to our problem where computational resources are limited. We conclude in Chapter 4 with analysis and results that extend BERT beyond the simple example of Chapter 3. We identify important structure in the network of transformations and address challenges arising in more general map optimization problems. We demonstrate results from several variations of the algorithm and conclude the dissertation with a roadmap for future work.

Guided airdrop parafoil systems depend on GPS for localization and landing. In some scenarios, GPS may be unreliable (jammed, spoofed, or disabled), or unavailable (indoor, or extraterrestrial environments). In the context of guided parafoils, landing locations for each system must be pre-programmed manually with global coordinates, which may be inaccurate or outdated, and offer no in-flight adaptability. Parafoil systems in particular have constrained motion, communication, and on-board computation and storage capabilities, and must operate in harsh conditions. These constraints necessitate a comprehensive approach to address the fundamental limitations of these systems when GPS cannot be used reliably. A novel and minimalist approach to visual navigation and multi-agent communication using semantic machine learning classification and geometric constraints is introduced. This approach enables localization and landing site identification for multiple communicating parafoil systems deployed in GPS-denied environments.

碩士
國立成功大學
測量及空間資訊學系碩博士班
98
Taiwan is known for its dense population and the averaged ratio between the numbers of land vehicle and person reaches four, which means that people in Taiwan depends heavily on the transportation. In fact, traffic jam happens every day and becomes a nightmare to the people who live in the city. Therefore, a robust land vehicular navigation system that can provide the reliable geographic information could solve this problem effectively. Global Positioning System (GPS) / Inertial Navigation System (INS) integrated systems are developed to be the major sensors of the navigation system for coming decades because of the stable output and the high accuracy in open-sky condition. However, an integrated navigation system can work under GPS denied environments, it also has some critical problems including the cost of inertial sensors and the time length during the GPS blockages. Therefore, in this study, a modified Map Matching (MM) algorithm is embedded to current INS/GPS fusion algorithm for enhancing the sustainability and accuracy of INS/GPS integration systems, besides, a cascade MM is also implemented to restrict the results obtained from the fusion system to keep the position of the vehicle being on the road. In principal, the proposed system is suitable for display and augmentation of real-time vehicular navigation system. To validate the performance of the proposed MM embedded GPS/INS integration algorithm, two field tests were conducted in Kaohsiung and Tainan. The results indicate the proposed algorithms are able to improve the accuracy of positioning in GPS denied environments significantly with the use of two IMU/GPS integrated systems either in DGPS mode or SPP mode. The averaged improvement of the proposed algorithms exceeds 60% in terms of positioning accuracy and stability with the use of a low cost IMU integrated land vehicular navigation system. Consequently, the modified loosely coupled GPS/INS integration scheme with map derived positions can provide the most consistent navigation solutions with sufficient sustainability.

abstract: The exponential rise in unmanned aerial vehicles has necessitated the need for accurate pose estimation under any extreme conditions. Visual Odometry (VO) is the estimation of position and orientation of a vehicle based on analysis of a sequence of images captured from a camera mounted on it. VO offers a cheap and relatively accurate alternative to conventional odometry techniques like wheel odometry, inertial measurement systems and global positioning system (GPS). This thesis implements and analyzes the performance of a two camera based VO called Stereo based visual odometry (SVO) in presence of various deterrent factors like shadows, extremely bright outdoors, wet conditions etc... To allow the implementation of VO on any generic vehicle, a discussion on porting of the VO algorithm to android handsets is presented too. The SVO is implemented in three steps. In the first step, a dense disparity map for a scene is computed. To achieve this we utilize sum of absolute differences technique for stereo matching on rectified and pre-filtered stereo frames. Epipolar geometry is used to simplify the matching problem. The second step involves feature detection and temporal matching. Feature detection is carried out by Harris corner detector. These features are matched between two consecutive frames using the Lucas-Kanade feature tracker. The 3D co-ordinates of these matched set of features are computed from the disparity map obtained from the first step and are mapped into each other by a translation and a rotation. The rotation and translation is computed using least squares minimization with the aid of Singular Value Decomposition. Random Sample Consensus (RANSAC) is used for outlier detection. This comprises the third step. The accuracy of the algorithm is quantified based on the final position error, which is the difference between the final position computed by the SVO algorithm and the final ground truth position as obtained from the GPS. The SVO showed an error of around 1% under normal conditions for a path length of 60 m and around 3% in bright conditions for a path length of 130 m. The algorithm suffered in presence of shadows and vibrations, with errors of around 15% and path lengths of 20 m and 100 m respectively.
Dissertation/Thesis
M.S. Electrical Engineering 2010

Civil engineering structures must provide an adequate and safe performance during their time of service, and the owners of these structures must have a reliable inspection strategy to ensure time-dependent damage does not become excessive. Visual inspection is the first step in every structural inspection; however, many elements in the majority of structures are difficult to access and require specialized personal and equipment. In an attempt to reduce the risk of the inspector and the cost of additional equipment, the use of Unmanned Aircraft Systems (UAS) has been increasing in the last years. The absence of standards and regulations regarding the use of UAS in inspection of structures has allowed the market to widely advertise Unmanned Aerial Vehicles (UAV) without protocols or qualifications that prove their effectiveness, leaving the owners of the structures to solely rely on claims of the vendors before deciding which technology suits their particular inspection needs. Focusing primarily on bridge inspection, this research aimed to address the lack of performance-based evaluation and standards for UAS, developing a validation criterion to evaluate a given UAS based on a repeatable test that resembles typical conditions in a structure.

Current applications of UAS in inspection of structures along with its advantages and limitations were studied to determine the current status of UAS technologies. A maximum typical rotor-tip-to-rotor-tip distance of an UAV was determined based on typical UAVs used in bridge inspection, and two main parameters were found to be relevant when flying close to structures: proximity effects in the UAV and availability of visual line of sight. Distances where proximity effects are relevant were determined based on several field inspections and flights close to structures. In addition, the use of supplementary technologies such as Global Positioning System (GPS) and Inertial Measurement Units (IMU) was studied to understand their effect during inspection.

Following the analysis, the author introduces the idea of a series of obstacles and elements inside an enclosed space that resemble components of bridge structures to be inspected using UAVs, allowing repeatability of the test by controlling outside parameters such as lighting condition, wind, precipitation, temperature, and GPS signal. Using distances based on proximity effects, maximum typical rotor-tip-to-rotor-tip distance, and a gallery of bridges and situations when flying close to bridge structures, a final arrangement of elements is presented as the evaluation chamber. Components inside the evaluation chamber include both “real” steel and concrete specimens as well as those intended to simulate various geometric configurations on which other features are mounted. Pictures of damages of steel and concrete elements have been placed in the internal faces of the obstacles that can be assessed either in real-time flight or in post-processing work. A detailed comparison between the objectives of this research project and the results obtained by the evaluation chamber was performed using visual evaluation and resolution charts for the images obtained, the availability of visual line of sight during the test, and the absence of GPS signal.

From the comparison and analysis conducted and based on satisfactory flight results as images obtained during flights, the evaluation chamber is concluded to be a repeatable and reliable tool to apply to any UAS prior to inspect bridges and other structures, and the author recommends to refrain from conducting an inspection if the UAS does not comply with the minimum requirements presented in this research work. Additionally, this research provided a clearer understanding of the general phenomenon presented when UAVs approach structures and attempts to fill the gap of knowledge regarding minimum requirements and criterion for the use of UAS technologies in inspection of structures.