BotSpot has been updated!
Go to http://www.botspot.com to find what you need

Best of the Bots
Documents Delivered to Your Door
By Don Barker

Don Barker, Columnist What would the Internet be like if interesting documents sought you out instead of you hunting for them down? Intelligent agents have long held the promise of reducing information overload on the Net by delivering personalized information based on your preferences. However, the reality is that most applications have been limited to very narrow topics, such as entertainment-oriented subjects like books, music, and movies. WiseWire, from the corporation of the same name, is changing all that with system capable of adapting to any topic and letting them find you.

Documents can find you in one of two basic ways, either as a Community Directory or Personal Wire. A Community Directory (or guide) provides documents based on group interests.  For instance, Lycos integrates WiseWires intelligent agent technology within its infrastructure to offer a collection of Web Guides (Community Directories).

Figure 1 shows the Space/Sci-Fi guide at Lycos. Each Web Guide leads to a prioritized list of links about a specific topic. As an example, the guide for Mystery Science Theater 3000 includes links to instructions on how to build bots. These bots aren't software agents but replicas of fictitious robots, like Tom Servo and Crow T. Robot, that appear on the TV show Mystery Science Theater 3000. These cute  mechanical men help keep Mike Nelson, the hero of the show, sane by making witty remarks during the endless series of terrible science fiction movies Mike is forced to watch.

The content and priority of information in the Web Guides at Lycos are based on community opinion. Visitors are encouraged to use a simple three button rating bar to indicate how well they liked a particular page in a guide. User preferences then are processed by WiseWire's unique collaborative-filtering and learning agents to shape and rank the content within these community directories.

In addition to community directories, documents can find you through your own Personal Wires.  To Personalize a Wire, first select a Community Wire (Directory). Although Lycos doesn't yet have Personal Wires, the technology is available at the WiseWire's Research & Development site. WiseWire also provides a search feature to help you locate Wires that closely match your interests.

Once you locate a Community Wire with the type of content you want, say artificial intelligence, click the Personalize Button in the upper right corner of the screen. A list of options appear that let you tailor the content in the Wire to meet your specific needs. When you finish, click the Personalize Wire Button, at the bottom of the form, to add the Community Wire to your list of Personal Wires. The Personalized Wire will reappear with a new Guide this Topic Button in the upper left corner, as shown Figure 2. This button leads to form for entering keywords and source hints, which will further narrow the scope of documents that the Personalized Wire will show you.

WiseWire uses a combination content-filters, collaborative-filters, and learning agents to deliver interesting documents to you. This patent-pending process is illustrated in Figure 3. In order to accommodate millions of documents and users, this process relies on a Filter Server Network, which consists of a cluster of Windows NT servers arranged into six functional layers. Since the servers use TCP/IP to communicate, they can, theoretically, be located in separate geographic locations.

WiseWire receives millions of documents each day, including Web pages, newsgroup postings, and premium sources like Reuters, Associated Press, Business Wire, PRNews, SortsTicker, and much more. In the first stage (or layer), the system uses content-based filtering to recognize key conceptual material, including multimedia, and encode it. As shown in Figure 3, learning agents continually fine tune and monitor the system at every stage.

The encoded representations from the first stage are passed to the prescreening layer, where documents that don't fall into areas of interest are sifted out. In the third stage, the remaining documents are distributed into broad categorizes. The fourth layer ranks each document based on group interest in a particular Wire.

In the fifth stage, the stream of documents are filtered based on the interests of each individual within a specific area. The final layer in the Filter Server Network uses a collaborative filter to match highly rated documents with the people most interested in receiving them. WiseWire's amazing pattern recognition capabilities also play a crucial role in making it possible for the system to process the ever growing amounts of information on the Internet in real time. By predicting the value of new documents coming into the system, the collaborative filter vastly reduces the time it takes for individual documents to find interested users.

According to Ken Lang, the founder of WiseWire and a doctoral candidate studying machine learning and artificial intelligence at Carnegie Mellon University, the "...biggest accomplishment we made in the transition from Carnegie Mellon to [a commercial site] was [developing] something that could scale up to say a hundred million people."

With this kind of power and capabilities, it's little wonder that all kinds of companies are rushing to license WiseWire technology. Everyone from financial publications and pharmaceuticals to virtual communities and retailers are signing up. So, if you are looking for a way to mine the "jewels" buried in the wastelands of cyberspace, maybe it's time to check out some wisdom on the wire.

 WiseWire
 Lycos

 Newsbots

 Classification Direct Internet Access: http://www.newsbots.com/

 Return to "Best of the Bots" main page