74Views6Replies

Author Options:

Is there a software that can compile all the answer guides here into pdf manuals, or a directory of related questions? Answered

I read in NYT that there was this Professor who made some software that threaded the web, compiled the related facts, and made its own how to or reference manuals.

Discussions

0
None
seandogue

9 years ago

There have been programs for doing this for at least 15 years and if I recall correctly, the first crawler I saw was far before that, sometime in 1988-89. Would not be surprised if it predates. Much of the original functionality has been made obsolete by the changes made to the internet made on the behalf of business. The programs were first envisioned and written when the internet was still a place dominated by academic concerns rather than making money and many of the programs were written from the perspective of a research and free exchange of information rather than for limiting information to those who can afford to pay for it. As to who wrote the first one, I can't say off hand and am far too lazy to research (not to mention that credit for origination is for many ideas as dubious as PRO is to a persons' PROfessional qualifications in answering a question) . IMO and IME, it was probably a graduate student with too much time on his or her hands and way too much information to gather for his or her project, although I would not doubt that it is officially ascribed to a professor (and he or she may not have been a professor at the time it was written). A large majority of commerically oriented websites have "protective" features that block the use of these programs for obvious reasons, so their popularity has dwindled, although there are still sites that allow their free use.

0
None
kevinhannanseandogue

Answer 9 years ago

I understood its development has been driven by the Internet porn industry which accounts for 80% of Internet traffic (if you believe the hype). Porn magnates wanted a way to rip off photos quick, both to augment their own stocks as well as to see which of their own photos were being pirated... To this day, the absolute cutting edge of software design is driven by those employed by the porn websites (research verified by many sources). I digress, but you can see how this is related... it's nice to have a bit of background! ttfn!

0
None
frollard

9 years ago

In that case, yes, it exists - it was made by some NYT professor :P I've never heard of anything that complex. Good idea for a submission "related answers" I always wanted when you ask a question, before you publish it says "do any of these answer your question?", then offer up a bunch of related questions answers, and ibles.

0
None
kevinhannanfrollard

Answer 9 years ago

I always wanted when you ask a question, before you publish it says "do any of these answer your question?", then offer up a bunch of related questions answers, and ibles.

I Agree Totally - but human nature being what it is (lazy) ; most won't bother and still ask their q and expect a link to their answer...sheeeeesh!

0
None
frollardkevinhannan

Answer 9 years ago

when really searching the list of 'tags' that it asks for when you publish your question - gives the 'related' links that I usually use to answer people's ible based questions.

0
None
kevinhannan

9 years ago

I have software that allows me to do this. It's about 3 or 4 years old. It basically copies the whole website, incl file and directories and then manipulates the database query and outputs it in a number of formats. In total it is 2 pieces of software; the website grabber, the db manipulator and the output. However, I don't do this, because it is against what the kind, generous guys here at 'ibles work for. I've never believed in biting the hand that feeds - if I could pay to upgrade my subs here I would but I can't so you have my heartfelt thanks.