Madengine reads a list of admin-configureable URLs, gets these urls via the web into temp files, and removes most html tags, then adds the info to a database file for that page. When madengine is queried, it returns a list of LINES from those pages that match the query string, along with a linked url for the page that match is from. This gives the user of madengine a better idea how their query string is used in context, rather than just a raw match. Madengine DOES NOT follow or index URLS contained within the preconfigured list...they must be added by the administrator. |