New search engine

jasong · 2006-08-21, 16:09

I'm sorry if this is considered spam, but I since this is a DC forum, I figured this would be a good place to report on a DC project called Majestic-12(not to be confused with the government project).

Majestic-12 is a search engine run by a guy who, among other things, is sick of search engines who mostly have spam as their "Most Popular" links. He believes he can make a bigger, better search engine with bigger, better results. He spends a lot of time working on the search engine technology, improving and tweaking it.

What does this have to do with Distributed Computing, you may ask. Well in order to collect results, he borrows the bandwidth of users by having them download a program, which downloads web links, looking for new or changed content. That content is compressed(on my computer, it uses about 6 hours of cpu time in about a 24-hour period, 2.8GHz pentium-d) and uploaded to him, while the computer continues to do "research."

You can set the upload and download limit to anything you want, and if you have, say, a 100GB download limit in a month, you could set the Majestic-12 app to only use, say, 50GB in a month.

If you're interested, the link is here.

garo · 2006-08-24, 17:09

A word of caution here. There is no guaranteee that the results will not be used for profit. So if you want to contribute your CPU, disk space and bandwidth for someone else's profit. go right ahead.

2006-08-21, 16:09	#1
jasong "Jason Goatcher" Mar 2005 3×7×167 Posts	New search engine I'm sorry if this is considered spam, but I since this is a DC forum, I figured this would be a good place to report on a DC project called Majestic-12(not to be confused with the government project). Majestic-12 is a search engine run by a guy who, among other things, is sick of search engines who mostly have spam as their "Most Popular" links. He believes he can make a bigger, better search engine with bigger, better results. He spends a lot of time working on the search engine technology, improving and tweaking it. What does this have to do with Distributed Computing, you may ask. Well in order to collect results, he borrows the bandwidth of users by having them download a program, which downloads web links, looking for new or changed content. That content is compressed(on my computer, it uses about 6 hours of cpu time in about a 24-hour period, 2.8GHz pentium-d) and uploaded to him, while the computer continues to do "research." You can set the upload and download limit to anything you want, and if you have, say, a 100GB download limit in a month, you could set the Majestic-12 app to only use, say, 50GB in a month. If you're interested, the link is here.

Similar Threads
Thread	Thread Starter	Forum	Replies	Last Post
Math rendering engine	Xyzzy	Math	69	2018-12-01 03:29
Google Compute Engine	GP2	Cloud Computing	32	2018-01-23 02:16
New math rendering engine	Xyzzy	Math	68	2015-12-21 00:40
An opportunity for search engine optimisation	fivemack	Aliquot Sequences	6	2015-11-17 20:31
Search engine feedback requested.	Xyzzy	Forum Feedback	2	2007-05-28 04:22

2006-08-24, 17:09	#2
garo Aug 2002 Termonfeckin, IE 2²×691 Posts	A word of caution here. There is no guaranteee that the results will not be used for profit. So if you want to contribute your CPU, disk space and bandwidth for someone else's profit. go right ahead.