[XML4Lib] Web search engines: full-text searching of our digital holdings

[Deridder, Jody L]

As most of you are well aware, databases (and other
dynamically-generated html pages) are part of the Deep Web, inaccessible
to web search engines without special assistance.

 

I'm seeking the best method to bring our digital library holdings to
light for full-text indexing in major search engines.  While the OAI
searching is a huge improvement, we find that inadequate for our finding
aids and TEI offerings.

 

For those of you who have already traveled this path, would you be
willing to tell me what you did, and the pros, cons and outcome of your
choices?

 

The primary methods I'm considering at the moment are creating sitemaps
versus making static copies of each dynamically-generated web page of
interest.  

If you know of other methods besides these, I'd be grateful if you would
share them with me.

 

Please email responses off-list:  jo at utk.edu

 

Thank you!

 

Jody DeRidder

Digital Library Center

University of Tennessee

 

~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
~~~~~~~
 
 "Do all you can with what you have in the time you have in the place
you are."
                                                         --Nkosi Johnson
 
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
~~~~~~~

 

-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://lists.webjunction.org/wjlists/xml4lib/attachments/20070403/9e3808d5/attachment.htm