Links
http://themechat.com/LinkXtor.html
Get links from any page on the World Wide Web automatically! Just type the URL of the page you want to extract links from and LinkXtor will get the links for you! Choose the links you want to keep and they will automatically be saved to a fully customizable links page. Or, if you have SSI, you can use the SSI command to put the links into any page on your site.
Price: Freeware
Review It
Rate It
Bookmark It
http://www.macurious.com/spider/
This search engine software is an essential tool for webmasters who are looking for an automated crawler to build a search engine on their web site. This CGI script will crawls and extract data from your local web directory as well as remote sites.
Price: $250.00
Review It
Rate It
Bookmark It
http://www.network-design.net/madengine.html
Madengine reads a list of admin-configureable URLs, gets these urls via the web into temp files, and removes most html tags, then adds the info to a database file for that page. When madengine is queried, it returns a list of LINES from those pages that match the query string, along with a linked url for the page that match is from. This gives the user of madengine a better idea how their query string is used in context, rather than just a raw match. Madengine DOES NOT follow or index URLS contained within the preconfigured list...they must be added by the administrator.
Price: Freeware
Review It
Rate It
Bookmark It
http://www.mimanet.com/scripts/rss_fetcher.html
This script will fetch My Netscape type RSS files from a remote site, format them as HTML and store the HTML in a file on your site. You can use this to display headlines from other sites. Many sites use this file format and it is a great way to exchange headlines between sites. Some places where you can go to look for sites with RSS files you can use are Userland, xmlTree, and in the My Netscape network.
Price: Freeware
Review It
Rate It
Bookmark It
http://www.cgiconnection.com/cgi-bin/cgi-con/system.cgi?area=scripts&docs=4900
Search any web site URL or search engine, Extracts all e-mail addresses from links, Specify maximum number of links and e-mails to search for, Automatic removal of duplicate links and e-mails, Download links and e-mails as they are being searched, Realtime processing ensures you get new links and e-mails every time you use Web Extractor, Add or remove your own search engines, directories, or any othe URL.
Price: $399.95/Free for Members
Review It
Rate It
Bookmark It
http://www.utilmind.com/scripts/webthief.html
WebThief is an extremely easy to use script intended for grabbing files and pages from World Wide Web via HTTP protocol. The WebThief works with httpget.lib library, which supplyed with this package. To receive data from the web, you should specify just usual url address of file or web page.
Price: $25/$69
Review It
Rate It
Bookmark It