Autonomous Mapping With an AUV: An Approach for Ground
Truthing of Remote Sensing Data

Andrew A. Bennett
MIT Sea Grant College Program
Underwater Vehicles Laboratory
Room E38-300, 292 Main St.
Cambridge, MA 02139 USA

Dr. John J. Leonard
MIT Department of Ocean Engineering
Room 5-422, 77 Massachusetts Ave.
Cambridge, MA 02139


Abstract ‹ Satellites and other earth observation systems (EOSs) can image large portions of the ocean surface at one time. However, they cannot ascertain much about the underlying structure, nor can they perform in situ analysis. Autonomous underwater vehicles (AUVs) have the capability to perform such analyses and to explore the full structure of the water column, but their speed and energy limitations suggest that careful mission planning on the part of the operators is needed to effectively utilize their capabilities. By combining these two platforms, the amount of useful information gathered by the AUV is greatly increased, thereby increasing the total value of the combined EOS/AUV dataset. This paper discusses the relative strengths and weaknesses of the two systems and methods of combining them. We show in simulation that an AUV directed by an a priori dataset can gather more detailed information about an object of interest per unit of time than one which is not so directed.



I. INTRODUCTION &;BACKGROUND

Autonomous underwater vehicles (AUVs) offer the potential to significantly increase our access to the world's oceans for scientific, environmental and industrial purposes. Expensive and time-consuming tasks such as environmental monitoring, marine habitat observation and oil pipeline inspection are but a few of the myriad possibilities which AUVs have the potential to perform cheaply and easily. An additional exciting arena is the use of AUVs in conjunction with data acquired by earth observation systems for ground truthing[1,2] and data enhancement. While such earth observation systems (EOSs) have the ability to generate large scale, synoptic views of the ocean surface, in general they cannot provide detailed observations of small areas[3] and cannot observe the full three-dimensional nature of the ocean. Also, ground-truthing and calibration of satellite data requires that measurements be made by monitors on-site during the observation period. This can be costly in time, and labor, especially at sea. AUVs offer the possibility of gathering such information in a far less costly manner [4, 7].

II. EARTH OBSERVATION SYSTEMS

Earth observation systems, such as satellites and high altitude research aircraft, have the ability to gather data over large areas in a very short period of time, thereby obtaining an overview not available to in-water systems. They can carry a variety of sensors: infrared, microwave, visible-light, magnetic field and radar altimeter systems being the most common. Of particular interest to us are thermal, visible light and radar-altimeter systems.

Thermal imaging systems can observe the surface temperature of the water, revealing thermal mixing phenomena such as snowmelt running into the sea and gulf stream eddies. Visible-light phenomena, such as an algae bloom or sediment runoff from shore, are revealed to the EOSs as changes in the albedo of the imaged area at selected frequency bands (Figures 1 and 2). Some events, such as anomalous high reflectance patches near Bermuda, occur over a large area in a short period of time just after major storms [5]. These events pass before research vessels can be safely dispatched to the area of interest. Finally, radar altimeter systems coupled with accurate orbital navigation data can reveal detailed information about wave heights and the presence of mesoscale topography such as seamounts or the mid-ocean ridge, but cannot give us information about the details of bathymetric structures.

All of the sensor systems described depend upon use of the electromagnetic spectrum. Because sea water is effectively opaque[6], ocean imaging by EOS systems is generally restricted to the top few meters (or tens of meters), leaving the three-dimensional nature of the ocean unknown (Fig. 3a). This lack of information is further compounded by the low resolution of remote sensing data, which is determined by the imaging platform, its location, dynamics and the spectral range of the sensors. With the exception of military-grade spy satellites, typical visual light observation image resolutions vary from 1 to 120 meters, according to the altitude of the system, the operational bandwidth of the sensor, its velocity and its data capture rate (Table 1).


Algae bloom aroud Tazmania
Figure 1. Patterns of phytoplankton concentrations around the island of Tasmania. Image acquired by the CZCS on 27 November 1981.

Closeup of Eddy near Tazmania
Figure 2. Closeup of eddy outlined in white. Pixel resolution is 1 km.
Figs. 1 &;2 courtesy of NASA SeaWiFS


III. AUTONOMOUS UNDERWATER VEHICLES

AUVs are capable of gathering detailed information about a specific area of ocean, but are by their nature limited in the speed at which they can travel and geographic data they can gather in a given time period. Their on-board sensors are capable of chemical analysis, detecting dissolved oxygen, measuring salinity and temperature anywhere in the water column and taking water samples for further study.

Unlike moored sensors or fixed ground stations, AUVs can be redirected to locate, track, and sample the water column or feature of interest anywhere that is needed. However, their typically low operating speeds and limited battery capacity means that efficient data collection strategies are very important. This motivates research into the problems of adaptive sampling and search strategies, which has been investigated by Bellingham and Willcox[7] and Burien et al[8], among others.

On other occasions the AUV may be sent out to investigate some sort of dynamic phenomena whose characteristics may not be well known or predictable in advance. Such situations might be a thermal front or a chemical spill. In these cases the AUV is assigned to locate and map a dynamic feature in order to characterize its microscale structure. For example: "Which is correct, Fig. 3b, Fig. 3c or neither?" This dynamic phenomena may also be poorly characterized in advance, requiring that one or more of the feature's characteristics be determined while the vehicle is in transit or in situ. Examples of this might be determining what change in temperature constitutes a front or what change in turbidity constitutes the edge of a spill.

To direct the vehicles intelligently, we need some idea of what the greater structure of the phenomena of interest looks like, where the phenomena is actually manifesting itself and what are its characteristic features. EOSs are designed to produce this kind of information.


Four possible scenarios
Figure .a-d. A satellite image only provides surface information.
The underlying structure of the water column is unknown without in situ observations.


TABLE I
RESOLUTIONS OF A SELECTION OF IMAGING PLATFORMS

SystemTypical Image Resolution
visible light
Landsat (Thematic Mapper)60 Meters
Landsat (Multispectral Scanner)120 Meters
SPOT1-2 Meters
IR/Thermal
NOAA IR System900 Meters
NASA/AVHRR11-14 km
Hybrid
NASA ER2/AVIRIS Airborne System11 Meters



IV. COMBINING BOTH SYSTEMS

EOSs and AUVs have complementary capabilities. In the case of ground-truthing, the AUV measurements can be compared to the remote observation data, allowing us to verify or improve instrument calibration and measure atmospheric effects.

In the case of directed sensing or rapid-response systems the remote sensing data can be used to determine when an event of interest is occurring, where it is taking place and what the characteristic features are. The AUV is then dispatched to the appropriate area, armed with the latest information, for a closer look. Upon arriving, the AUV then proceeds to measure the phenomena in detail, confirming and/or calibrating the remote sensor measurements as well as augmenting those measurements with additional data not otherwise obtainable. In our simple example, we might find that while our model predicted Fig. 3c, the vehicle actually discovers a structure resembling 3d.

For example, a satellite observes an interesting phenomenon from orbit and transmits the imaging data to a ground station (perhaps the plankton bloom in Figure 1). On the ground an operator notes the phenomenon, its location when observed and its characteristics. Information about the characteristics of the phenomenon (relative phytoplankton concentration, estimated thermal ranges, etc.) and a region where the phenomenon is estimated to be are then transmitted to a waiting AUV [9].

The AUV then proceeds to the survey area and begins to search for the phenomenon. The vehicle maps it out in detail, taking measurements and water samples as desired. Upon completion the vehicle returns to base or surfaces for pickup and data download.

Because earth observation systems are large, expensive to use and difficult to get time on, we have chosen to perform our first tests in simulation. However, we wish to use as much real data as possible in our experiments to preserve realism. Also, because we would like to test multiple strategies both in simulation and in the field, we would like to use a dataset which allows us to move easily from simulation to field tests. For these reasons we have chosen to represent our feature of interest with a low resolution bathymetric map. A bathymetric feature is repeatable and, since it is based on a real bathymetric dataset, strategies which prove successful in simulation can be verified in the field.



V. AN EXAMPLE:
TRENCH MAPPING IN THE CHARLES RIVER BASIN

To this end we are simulating autonomous trench mapping in the Charles River Basin near MIT. In our tests, a prominent 10 meter-deep trench dredged into the riverbed serves as our "oceanographic feature" for which a more detailed map is desired (Fig. 4). The a priori hypothetical satellite image is represented by a coarse (approx. 20 meter resolution) bathymetric map of the river (Fig. 5). In a typical response situation, there may be a delay in the response due to the data processing time of the EOS system. Because of this, we assume that the map, while correct in basic structure, may be wrong as to the specifics, such as the exact location of the feature at the time of AUV deployment. The mission of the AUV is to locate and obtain a detailed map of the phenomenon; in this case the bathymetry of the river-bed, with a particular focus on the trench.

There are several issues being investigated by this study. Among them are:

€What (and how much) a priori information does the AUV need to perform its function?

€How to characterize the feature of interest?

€How will the AUV extract the feature from the incoming sensory data?

€How to determine where to go next based on the information already obtained?

In this example, the vehicle has been assigned a search zone (the dark-line box) and sent in to investigate and map the feature, using two different strategies. The first mission (Fig. 6) employs a simple "lawnmower" search strategy. In this simple search, the vehicle merely traverses the search zone until the area is searched or until the mission timer expires. The second mission uses a reactive approach (Fig. 7). Here the AUV uses the a priori data obtained from the EOS to make an estimate of where to start the search and what some characteristics of the feature are. The vehicle then proceeds to locate and map the feature in detail, turning back to re-acquire the feature every time it passes outside of the feature.

The key difference between the two missions is the amount of useful data gathered in a given amount of time and/or using a specific amount of energy. The mission of Fig. 6 ran for 100 minutes, while Fig. 7 was only half that at 50 minutes. The path of the search in Fig. 7 also shows that the bulk of the active mission time was spent gathering useful data in the feature. In other words, given the restricted energy supply of an AUV, the vehicle gathered more useful data per watt expended in Fig. 7 than in Fig. 6. Clearly the a priori information provided by the EOS proved to be of value to the AUV.



VI. CONCLUSION

In this paper we have shown in simulation that the use of EOSs to direct AUV data gathering missions greatly increases the amount of useful data per unit time (or power). Thus, by combining the strengths of two data collection systems ­ autonomous underwater vehicles and earth observation systems ­ a larger, more complete picture of the world's oceans may be obtained. Satellites and airborne systems, with their ability to get the "big picture," can be used to direct one or more AUVs to an area of interest to get the details on what is happening in that spot. AUVs, with their ability to directly sample the water and to go to any point in the water column, can be used to verify the airborne/orbital observations, supply more detailed data about an area or object, and establish the three-dimensional nature hinted at by the surface observations.

In the future, it is hoped that enlarged fleets of such vehicles will allow a truly three-dimensional "snapshot" of a portion of the ocean to be taken for the first time: an EOS observer overhead taking in the surface characteristics of a feature while multiple AUVs (and perhaps surface vessels as well) gather complementary data simultaneously with it.



ACKNOWLEDGEMENTS

Special thanks are due to Drs. J. G. Bellingham and J. W. Bales for their insight and helpful discussions. The work described here was supported by the MIT Sea Grant College Program (grant number NA46-RG-0434) and the NASA Student Fellowship Program (NASA contract NGT-30232).


NETWORK RESOURCES

For more information about remote sensing and AUVs, try the following web sites:

The EOS Homepage
The SEAWiFS Homepage
Gulf of Maine Sea Surface Temperature Data
MIT Sea Grant Home Page
Florida Atlantic University
WHOI Deep Submergence Group



REFERENCES

1. Bennett, A., Verification and Enhancement of Satellite Observation Data Using Autonomous Underwater Vehicles," NASA Global Change Fellowship Program Ref.3843-GC94-0231, 1994.

2. Costello, D. K., Carder, K. L. And Smith, S. M., "Unmanned Underwater Vehicles as Platforms for Optical Oceanography in Coastal Waters," AGU Proceedings, 1996

3. Szekielda, K. H., Satellite Monitoring of the Earth, Wiley Interscience, 1988, pp.125-128.

4. Bellingham, J. G., et al, "A Second Generation Survey AUV," AUV 95 Proceedings, IEEE 1995, pp. 148-155.

5. Acker, J. G., personal communication.

6. Jackson, J.D., Classical Electrodynamics, 2nd ed., John Wiley &;Sons, 1975, pp. 291.

7. Bellingham, J. G., Willcox, J. S, "Optimizing AUV Oceanographic Surveys," AUV 96 Proceedings, IEEE 1996, pp. 391-398.

8. Burian, E., Yoerger, D., Bradley, A., Singh, H., "Gradient Search with Autonomous Underwater Vehicles Using Scalar Measurements," AUV 96 Proceedings, IEEE 1996, pp. 86-98.

9. Curtin, T. B., Bellingham, J. B., Catipovic, J., Webb, D., "Autonomous Oceanographic Sampling Networks," MITSG 94-16J, MIT Sea Grant, 1994.


Altimeter data from Charles River
Figure 4. Actual altimeter data from the Charles River basin. In this mission the vehicle turned around shortly after crossing the trench. Note the dramatic change in depth at the trench.

Low resolution bathymetric map of the Charles River basin
Figure 5. Simulated satellite image for tests. This is a low-resolution bathymetric map of the Charles River basin, Cambridge, MA.

Figure of lawnmover style search
Figure 6. Track of an AUV performing a simple "lawnmower" search of the same region.
Mission length is 6000 seconds.

Figure of reactive search
Figure 7. Track of an AUV which reactively samples the phenomenon of interest (here, a trench in the riverbed). Mission length is 3000 seconds.