Comments on: Advances in Crawling the Web http://www.semclubhouse.com/advances-in-crawling-the-web/ Wed, 28 Jul 2010 00:45:36 +0000 hourly 1 http://wordpress.org/?v=3.0 By: silver http://www.semclubhouse.com/advances-in-crawling-the-web/comment-page-1/#comment-627 silver Sun, 13 Sep 2009 22:58:57 +0000 http://www.semclubhouse.com/advances-in-crawling-the-web.html#comment-627 Hi, Lee - Google places a higher priority on websites which have more inbound links and which have a longer reputation with them. It sounds like you may've just launched your site, in which case you have some groundwork you need to do to get on Google's priority list. Imagine if you were launching a new business storefront - customers won't come during the first few days if you don't promote it. So, what have you been doing to promote your site? Have you issued any press releases? Invited any bloggers to drop by and comment? Have you provided any incentives like signups for free giveaways if someone visits your site and signs up? Hired a firm to promote you? Endsum: You will need some inbound links. Establishing a brand new site is one of the hardest of online marketing tasks. Hi, Lee – Google places a higher priority on websites which have more inbound links and which have a longer reputation with them.

It sounds like you may’ve just launched your site, in which case you have some groundwork you need to do to get on Google’s priority list.

Imagine if you were launching a new business storefront – customers won’t come during the first few days if you don’t promote it.

So, what have you been doing to promote your site? Have you issued any press releases? Invited any bloggers to drop by and comment? Have you provided any incentives like signups for free giveaways if someone visits your site and signs up? Hired a firm to promote you?

Endsum: You will need some inbound links. Establishing a brand new site is one of the hardest of online marketing tasks.

]]> By: lee http://www.semclubhouse.com/advances-in-crawling-the-web/comment-page-1/#comment-626 lee Fri, 11 Sep 2009 21:48:41 +0000 http://www.semclubhouse.com/advances-in-crawling-the-web.html#comment-626 hi i have been waiting for google and bing to index my blog www.diyanswerdirect.com/blog for two weeks now and am getting very frustrated with them. aswell as iam still waiting for them to update my site www.diyanswerdirect.com. My question is when do they update and how can i get them to crawl or spider my site. hi i have been waiting for google and bing to index my blog http://www.diyanswerdirect.com/blog for two weeks now and am getting very frustrated with them. aswell as iam still waiting for them to update my site http://www.diyanswerdirect.com. My question is when do they update and how can i get them to crawl or spider my site.

]]> By: Links of the Week March 7th, 2008 | .eduGuru http://www.semclubhouse.com/advances-in-crawling-the-web/comment-page-1/#comment-64 Links of the Week March 7th, 2008 | .eduGuru Fri, 07 Mar 2008 16:38:40 +0000 http://www.semclubhouse.com/advances-in-crawling-the-web.html#comment-64 [...] Advances in Crawling the Web - There are 3 major parts to what a search engine does. What are some of the problems facing crawling programs? [...] [...] Advances in Crawling the Web – There are 3 major parts to what a search engine does. What are some of the problems facing crawling programs? [...]

]]> By: Bill http://www.semclubhouse.com/advances-in-crawling-the-web/comment-page-1/#comment-63 Bill Tue, 04 Mar 2008 15:13:31 +0000 http://www.semclubhouse.com/advances-in-crawling-the-web.html#comment-63 You're welcome, James. Funny, taking down your own site. Guess it was a good thing that it wasn't someone elses. Thanks for sharing that story. I like the old usenet posts which talk about the early days of crawlers, and people trying to figure out why others were spending so much time grabbing pages from their sites. There are a lot of elements to what makes a search engine work that go on behind the scenes, so it's great when someone provides as much depth and detail as the Texas A&M researchers did in their paper. You’re welcome, James.

Funny, taking down your own site. Guess it was a good thing that it wasn’t someone elses. Thanks for sharing that story. I like the old usenet posts which talk about the early days of crawlers, and people trying to figure out why others were spending so much time grabbing pages from their sites.

There are a lot of elements to what makes a search engine work that go on behind the scenes, so it’s great when someone provides as much depth and detail as the Texas A&M researchers did in their paper.

]]> By: James http://www.semclubhouse.com/advances-in-crawling-the-web/comment-page-1/#comment-62 James Mon, 03 Mar 2008 14:12:59 +0000 http://www.semclubhouse.com/advances-in-crawling-the-web.html#comment-62 I built myself a simple crawler and learnt most of this along the way... The problems you com up against are really interesting. I like the politeness one....for my first attempt I took down my own site by using multi-curl....ha ha ahh the lessons we learn. Nice article, thanks.... I built myself a simple crawler and learnt most of this along the way… The problems you com up against are really interesting.
I like the politeness one….for my first attempt I took down my own site by using multi-curl….ha ha ahh the lessons we learn.

Nice article, thanks….

]]>