Looking for a software/script.....

Fyrflygrl · 10-09-2003, 11:37 AM

Help!

I need a software or script (and have NO idea what you'd call it) that searches an entire site for a keyword or set of keywords.....

Any ideas?

Fyrflygrl

wsjb78 · 10-09-2003, 11:47 AM

Search Function built into Internet Explorer or do you need an automated thing?

Fyrflygrl · 10-09-2003, 02:50 PM

I need an automated thing... something that will search every page of the site, without having to load each page individually...

I've never heard of such a thing.. but haven't looked for it or needed it until now....

Thanks!

Fyrflygrl!

wsjb78 · 10-09-2003, 03:58 PM

Well, in order to search every page you must know where every page is and it must load them...
You'd need to follow all links first to get each html document and then search each one.... that can be done.

Fyrflygrl · 10-09-2003, 04:16 PM

Well, I've figured out this much with a friend's help, and I'll share it just in case it could help someone else: You can use google to search a site for any particular keyword, like this:

keyword site:domainname.com

The only problem with this: some of the pages of the site may be excluded from search by the robots.txt file .... so I'm still stumped for a solution to do this more 'automatically'...

Another thing I've found that says it will search keywords in a site is a site download software called Teleport Pro... we'll see how it pans out

THANKS!

Fyrflygrl!

modF · 10-10-2003, 03:01 PM

You could put soemthing together to follow the links on a site then just grep/strpos for the matching terms.