1. The greatest strength of the FAQs is how they answer questions that are
not new. So if they don't get indexed the second they change, the
resulting attraction of indexing the whole set of them will not be
diminished much to the search site operators and users.
2. One root of the problem, as you said, is the brute force way you are
synchronizing with rtfm.mit.edu. Aren't there ftp daemons which do a
reasonable job of incremental mirroring? Then again, this probably means
changing server configuration at rtfm.mit.edu. Not to be assumed.
3. On the other hand, the indexing engines have a gazillion people yelling
"Hey, look a' me!" as it is. If they had accelerated processing, it would
probably command a price. Unless you are assured that notifying them of
changes in FAQ documents as opposed to run of the mill web pages will in
fact bring accelerated processing, you might better leave things as they
are and not invest a lot in little return.
Al
[
Usenet Hypertext FAQ Archive |
Search Mail Archive |
Authors |
Usenet
]
[
1993 |
1994 |
1995 |
1996 |
1997
]
© Copyright The Internet FAQ Consortium, 1997
All rights reserved