If you don’t fully understand what this is about and haven’t heard about the news, there you go: Google Discontinues the Nexus One

Wondering what PubSubHubbub is? Check out these posts:

WordPress Makes A Big PuSH To Speed Up 10.5 Million Blogs

Google Index to Go Real Time

PubSubHubbub on Wikipedia

Source: GMail Blog

I read a post about 80Legs today on Mashable and the only words that came to my mind when I read the article was “they’re changing the game”. They are. Here’s what they do:

80Legs is a service platform for web crawling and processing web content. We put over 50,000 computers to work for you to deliver exceptional crawling performance at incredibly low costs. Our service is easy to use and completely customizable, so you can crawl and process web content however you want, whenever you want.

To summarize: you get your very own web crawler at a more than affordable price: 2.00$ / million pages crawled.

Why it’s game changing

Web crawling is a very complex and expensive process: crawling a web page, extracting content and scale the process to million of pages is far from being trivial and cheap. You not only need to build your crawler or use an existing one, you must have the infrastructure in place to support it all.

Now, anybody willing to build a niche search engine, extract specific information from a series of websites or build any web app involving crawling the Web at a large scale can do it at an affordable cost, without much technical knowledge.

It’s not 80Legs that’s game-changing, it’s the whole concept of democratizing web crawling and giving a chance to anybody with a great idea but without the money or the technical skills, to just make it happen.

It’s similar to blogging: it’s not about the platform you use (WordPress, blogger, TypePad, etc), it’s the fact that anybody can now have a voice and have an impact. Platforms die, ideas don’t.

It’s dead simple

I don’t want to talk too much about 80Legs because I haven’t really tested it (except creating an account and playing around) and I don’t like talking about stuff I haven’t tested, but it really looks dead simple. The process may look simple, but yet it seems to offer some decent advanced features.

I won’t go too much into details, but it allows a lot of customization so you can extract the information you want. Of course, you will need some technical knowledge if you want to use the crawled data and build a web app around it, but the hard part involving scaling issues is covered by a tool like 80Legs.

Spam is now more affordable than ever

As much as I’m enthusiast about democratizing Web crawling, there’s a huge downside: spam and content scrapping is now more affordable than ever. It’s an easy way for amateur spammers to build email lists by crawling websites and extracting email addresses. I’m sure we can find dozen of other spamming issues, but I much prefer to focus on the positive aspects.

Overall, the concept is extremely interesting and anybody willing to build a web app involving web crawling should be looking into this.

That’s right, big G was asking for my mobile phone number to verify the new email. I was kinda surprised honestly. You know, Google already has a lot of information on me and probably already have my mobile phone number somewhere, but I just feel it’s information I shouldn’t have to share for a free email address. Then, I asked myself: “Let’s say I don’t have a mobile phone, can I still create a gmail account?”.

No phone, ask a friend

The process is not flexible at all. If you don’t have a mobile phone, you’re screwed, ask a friend:

If you’d like to sign up for a Gmail address, you need to have a mobile phone that has text-messaging capabilities.
If you don’t have a phone, you may want to ask a friend if you can use his or her number to receive a code.

What’s going on big G?

We’re Google, of course we store your mobile number

Google will use your phone number to send an invitation code in a text message to your phone. In doing so, we store each phone number to make sure it is used to create a limited number of accounts.

Your number will also be associated with your account to avoid unnecessary future verifications for other Google services.  For more information, please review the Gmail Privacy Policy: http://mail.google.com/mail/help/privacy.html. In accordance with this policy, your number will never be sold or shared for marketing purposes without your permission, nor will we contact you using this number without your express permission.

Your country is not available, ask a friend

There are a number of countries and carriers for which we don’t provide service because of varying limitations. If possible, you may want to try a friend’s phone on another carrier.

Can it get less flexible?

I don’t think so. I mean, you have to admit the limitations and conditions are a little crazy for creating a free email address. But, if it happens to you and don’t want to give your phone number, go through the process again, you might not have to verify by SMS. That’s what happened to me: I just started over and everything went fine. So, I don’t know exactly what triggers this SMS verification process, but it’s annoying.

I’m all about building communities, authenticity and transparency, but why are we always putting social media efforts and SEO appart? Why do people say: “I don’t care about SEO, I prefer to spend time building a community”? Both can go together.

I would never advise someone to write an article solely for search engines, but why not think about the fact that Google, Yahoo and Bing will index your content? I mean, your content is going to get indexed anyway, so having search engines in mind when you write content isn’t a bad thing for extra visibility. Having search engines in mind doesn’t mean writing keywords stuffed articles, it just means paying extra attention to basic SEO.

Then you know what? You can still build that community and benefit from some search engine traffic.

SEO

SEO is usually the biggest concern when changing a domain name because most people think this will lead to losing all their backlinks. While it is not the best decision ever SEOwise, there is some techniques you can use to make sure you don’t lose your existing PR and backlinks. Fortunately for us, Google published some guidelines for moving a website:

• Test the move process by moving the contents of one directory or subdomain first. Then use a 301 Redirect to permanently redirect those pages on your old site to your new site. This tells Google and other search engines that your site has permanently moved.

• Once this is complete, check to see that the pages on your new site are appearing in Google’s search results. When you’re satisfied that the move is working correctly, you can move your entire site. Don’t do a blanket redirect directing all traffic from your old site to your new home page. This will avoid 404 errors, but it’s not a good user experience. A page-to-page redirect (where each page on the old site gets redirected to the corresponding page on the new site) is more work, but gives your users a consistent and transparent experience. If there won’t be a 1:1 match between pages on your old and new site, try to make sure that every page on your old site is at least redirected to a new page with similar content.

• If you’re changing your domain because of site rebranding or redesign, you might want to think about doing this in two phases: first, move your site; and second, launch your redesign. This manages the amount of change your users see at any stage in the process, and can make the process seem smoother. Keeping the variables to a minimum also makes it easier to troubleshoot unexpected behavior.

• Check both external and internal links to pages on your site. Ideally, you should contact the webmaster of each site that links to yours and ask them to update the links to point to the page on your new domain. If this isn’t practical, make sure that all pages with incoming links are redirected to your new site. You should also check internal links within your old site, and update them to point to your new domain. Once your content is in place on your new server, use a link checker like Xenu to make sure you don’t have broken legacy links on your site. This is especially important if your original content included absolute links (like www.example.com/cooking/recipes/chocolatecake.html) instead of relative links (like …/recipes/chocolatecake.html).

• To prevent confusion, it’s best to make sure you retain control of your old site domain for at least 180 days.

• Add your new site to your Webmaster Tools account, and verify your ownership of it. Then create and submit a Sitemap listing the URLs on your new site. This tells Google that your content is now available on your new site, and that we should go and crawl it.

• Finally, keep both your new and old site verified in Webmaster Tools, and review crawl errors regularly to make sure that the 301s from the old site are working properly, and that the new site isn’t showing unwanted 404 errors.

From my personal experience, within a month or two, you should recover your PR and the Google Index should be updated. So yes, expect some bad days especially within the first 2 weeks. Redirecting all your content to your new website using a 301 redirect is really the key, as it will tell Google the page has permanently moved and the new page should be considered as the original source from now on.

A nice side effect of using anchor text in the ranking algorithm Google uses is that you will continue to rank for your old name on Google. Even if the name is completely different, the links with your old website name now points to your new website because of the 301 redirect which mean you will most likely rank for that your old keywords.

A negative side effect that I can see from a SEO point of view is if you were targeting a specific geographic location with a particular TLD (.co.uk for example) and switched to a .com. If you don’t have enough backlinks from the country you are targetting and now don’t have a proper TLD for that country, you might disappear from the results for this country. So, be careful if you target a specific market or region.

Another negative impact that can happen is if you redirect your old domain to a subfolder of the new domain. Let’s say you are redirecting your established pizza.com domain to xyz.com/services/pizza. This might not help your rankings but honestly, it has nothing with moving the website, it’s a pure SEO issue: root domains tend to rank better than subfolders.

Backlinks

This is related to SEO, but backlinks are probably the biggest SEO concern for most people, so let’s make a new section for that. It is important to note that when using a permanent 301 redirect, all backlinks will now link to your new domain. If you look at Yahoo Site Explorer and  don’t see your old backlinks, it is absolutely normal, they will never appear for your new domain. They still exist, but Yahoo Site explorer doesn’t update with 301 redirects: it’s a bit dumb and only look for backlinks linking directly to your domain name. So, don’t panic, they’re still there and still giving you PageRank juice. Maybe not for the right keywords anymore though…

Branding and RSS Subscribers

To me, the biggest issue has always been branding and RSS Subscribers. I feel I’ve always made the right decision, but changing a brand’s name is never a good idea. People know you under a certain name and all of a sudden you’re someone else. Imagine if Wal-Mart decided to change their name, this would certainly impact their brand. Well, this is no different for a website, even if it’s on a much smaller scale. But you know, as long as changing  your name is a long term decision, it’s a good decision.

Another important aspect to consider is if the site you are moving is a blog and you have to change the RSS Feed address. If you can keep the same address do it as it will avoid you a lot of pain. Services like FeedBurner usually offer a 30 days redirect to the new feed address, but you will lose some subscribers in the process as not all of them will take the time to update their feed reader. You can also see it as a way to keep only your interested readers.

Conclusion

As you see, moving a site to another domain isn’t as bad as it seems from a SEO point of view, but could hurt your brand. I’m sure you can find quite a lot of horror stories out there and I can imagine it can be quite a nightmare when moving a website with a million of pages indexed (delicious for example), but for most people I feel it’s not that bad.