Mercury: A Distributed Metadata Management, Data Discovery and Access System
Bruce
E
Wilson, Oak Ridge National Laboratory, wilsonbe@ornl.gov
(Presenting)
Giri
Palanisamy, Oak Ridge National Laboratory, palanisamyg@ornl.gov
Ranjeet
Devarakonda, Oak Ridge National Laboratory, devarakondar@ornl.gov
James
W
Green, Information International Associates, on contract to Oak Ridge National Laboratory, jgreen@iiaweb.com
Mercury is a federated metadata harvesting, search and retrieval tool based on both open source and software developed at Oak Ridge National Laboratory. It was originally developed for NASA, and the Mercury development consortium now includes funding from NASA, USGS, and DOE. A major new version of Mercury was developed during 2007. This new version provides orders of magnitude improvements in search speed, support for additional metadata formats, integration with Google Maps for spatial queries, support for RSS delivery of search results, among other features. Mercury provides a single portal to information contained in disparate data management systems. It collects metadata and key data from contributing project servers distributed around the world and builds a centralized index. The Mercury search interfaces then allow the users to perform simple, fielded, spatial and temporal searches across these metadata sources. This centralized repository of metadata with distributed data sources provides extremely fast search results to the user, while allowing data providers to advertise the availability of their data and maintain complete control and ownership of that data.
The new Mercury system is based on a Service Oriented Architecture and supports various services such as Thesaurus Service, Gazetteer Web Service and UDDI Directory Services. This system also provides various search services including: RSS, Geo-RSS, OpenSearch, Web Services and Portlets, integrated shopping cart to order datasets from various data centers (ORNL DAAC, NSIDC) and integrated visualization tools. Other features include: Filtering and dynamic sorting of search results, book-markable search results, save, retrieve, and modify search criteria. Recent tests of the underlying search engine (which uses the open-source Lucene and SOLR tools) have demonstrated very rapid searches of 10,000,000+ records on a single commodity server hardware platform, which is encouraging for future expansions of Mercury use.
NASA Carbon Cycle & Ecosystems Active Awards Represented by this Poster: