Kingwood Underground
the heart and soul of our Kingwood, Texas family
Login - Create Account - Help
Clean out your garage on Kingwood bookoo! Or find local garage sales on Yard Sale Search.com
KU Live!

Anyone know anything about web bots?

who's talking here?

Donkey Hodie 2
WatchOut 1
Ogre13 6
Butterbean 1
The Master 3

     » send to friend     » save in my favorites     » flag dangerous topic flag as a dangerous topic

Ogre13 --- 12 years ago -

I'm wanting to do a search of the net for articles and links on the subject of human trafficking in Texas for my final Thesis for my Masters degree.

I haven't used any sort of bot in probably twenty years (and then it was for pron - oh I had the best collection evah!).

Any recommendations before I start researching the topic? 

Donkey Hodie --- 12 years ago -

Use google scholar. 

Butterbean --- 12 years ago -

If I had a recommendation, it would be to try all the different search engines available. They really are a bit different.

I was doing a research piece a couple of years ago, and was pleasantly surprised, one or two pages deep in the results. Some of the engines will bring up other theses, some won't.

Accessing cities public records might be a help, but that sometimes requires coughing up a little money for an assistant.

Good luck. 

The Master --- 12 years ago -

What they said above. No need for web bots. Google has plenty of tools to get you the info you need. Could even use an RSS feed.

https://support.google.com/news/answer/59255?hl=en

Reserve web bots for fun things, like simulating a religious preacher on KU (jl). 

Ogre13 --- 12 years ago -

Use google scholar.

I'm sure I will, but what I'm looking for is a program to automatically search using parameters I set up and collate the pages into a report.

I have access to JSTOR, and to the American Historical Society's library as well, so Google Scholar will likely be redundant anyway.

Fortunately, I have access to the Houston Police Dept. through my contacts, and I might be able to get access to the HCSO as well through a former boss who is a reserve deputy. So that will help with live data.

I may even go into the field if I can.

But I want a web crawler to compile articles related to Human Trafficking in Texas for me to use as examples.

As I've not used one in two decades, I was just wondering if anyone out there used one they could recommend. 

Ogre13 --- 12 years ago -

Reserve web bots for fun things, like simulating a religious preacher on KU (jl).

Glad to see I'm not the only one who thinks he's a Turing Test. 

Ogre13 --- 12 years ago -

Oh, and good idea about the RSS feed. Thanks. 

Donkey Hodie --- 12 years ago -

Why use a web bot? Why reinvent google?

Seriously, spend your time learning how to use google's advanced search functions. It will be a better time investment. 

The Master --- 12 years ago -

Ogre, here ya go.

http://www.google.com/alerts


set it up to send search results to an email account on a trigger (as it happens).

if that's not enough, could also use web spider or something similar. 

Ogre13 --- 12 years ago -

spend your time learning how to use google's advanced search functions.

Don't think y'all understand how much I'll be needing. You use a bot to do the work AUTOMATICALLY. It finds and then pulls down the information for you so you don't have to do it manually.

I'm talking about hundreds if not thousands of pages that I'm needing.

I need to write a small book. I may have thirty - fifty pages of sources. The example on the school's website has 40 pages of sources. Right now I have half that.

I have Google alerts set up. BUT, I also want HISTORICAL documents, not just current.

web spider

That's what I'm looking for. Any idea which one's the best? 

WatchOut --- 12 years ago -

Reserve web bots for fun things, like simulating a religious preacher on KU (jl).


You left out the T. Stimulating. 

The Master --- 12 years ago -

You left out the T. Stimulating.?

me no comprende. 

Ogre13 --- 12 years ago -

T. Stimulating.?

?Que? 

page 1
Login to add your comments!

see more discussions about...


Online now:
hit counters

Terms of Service - Privacy Policy - Ice Box

Kingwood Underground