SmoothSpan Blog

For Executives, Entrepreneurs, and other Digerati who need to know about SaaS and Web 2.0.

Social Graph Search Engines, Part 3

Posted by Bob Warfield on August 27, 2007

I’ve inadvertantly stumbled on a topic that’s getting tremendous attention, so I wanted to sum up my thoughts here before moving on.

Let’s start with Robert Scoble’s post, Why Mahalo, TechMeme, and Facebook are going to kick Google’s butt in four years.  Scoble’s proposition, which he communicates well in three videos, is that by using the Social Graph, we can dramatically reduce SEO Spam in search results.  The source of the Spam is that Google’s current PageRank algorithm is just too easy to game.  You simply need the right keywords together with as many sites linking to the page with the keywords as possible.   That combination does not guarantee a human will see anything of value on the resulting page.  With a Social Graph Search, you will weigh in human judgement about the quality of the page.  You do this by considering factors such as:

-  Did someone from your Trust Fabric (i.e. your social network) write the page?

-  Was it written or linked to by people who you know share similar interests because of the social graph?

And so on.  It’s a good idea, and I had already modified my own search habits to take advantage of a less grandiose form of this by choosing to search blogs before doing a general Internet-wide Google.

If you read through the comments on Scoble’s post, there seem to be two big issues with this proposition.  First, its simply very hard to get over the idea that Google is huge, omnipotent, and can simply tweak their algorithms to adopt a Social Graph Search approach.  Second, there is a lot of doubt about the feasibility of human augmented search.

Let’s start with the feasibility of human augmented search.  I think people are looking at it too literally.  Perhaps companies like Mahalo are also in the camp of being too literal.  If we have to wait for humans to laboriously research each topic and select the best links in some systematic way, I agree that sounds painful.  Not only that, but it seems like its been done.  Isn’t that what About.com did?  I’ve landed on their site only rarely and never found it to be helpful.  But look at it another way.  I do a lot of research on the web, and there’s nothing better than hitting pay dirt by finding someone list of bookmarks are a link to the seminal article that started some new idea.  Today, I find these things by tracking through blogs, and its a lot faster than tracking through Google.  Couldn’t that be automated?

So in a nutshell, my argument about feasibility is that there are already structures in the Web that are mostly Spam-free that can be tapped into to deliver improved search.  The blogosphere is one such.  I can already see an objection:  won’t the SEO’s just shift their attention to polluting these new information watering holes with their Spam?  Perhaps, but many of them are more amenable to Spam defenses because they’re not just randomly selected web pages.  Let me give you an example.  Let’s say we’re going to harness bookmarks in the blogosphere, for example.  Let’s have the human editorial staff simply identify a core nucleus of trusted blogs by reading them.  We’ll take blogs like Scobleizer, TechCrunch, and Mashable.  Let’s tag pages on those sites with a “Bob” Rank (because hey, the Page Rank is named after Larry Page!).  The BobRank for pages our editorial staff have validated is infinite (in Computer Science, that means its a really big number, like 1 billion).  Every link on a 1 billion BobRank page gets a rank of 1 billion minus 1.  Links on those pages are 1 billion minus 1 minus 1.  And so on.  The BobRank is telling us how far away from objectively validated acceptibility a page is.

We can envision many embellishments.  For example, we can augment the BobRank with a FriendRank.  Have my friends in my Social Graph written or bookmarked the page?  Well then up the BobRank by 1 million.  Have their friends?  Up it by 1 million minus 1.  And once again, we have a super Page Rank-style algorithm where all the people in the Social Graph are helping out.

How do we efficiently gather and process all this information?  That brings me to the first objection, that Google is so big it can just do this itself.  That’s very true, BTW.  But it doesn’t mean everyone else has to lose out.  The rest of the AltSearch community simply need a Queen from which to launch Swarm Competition.  I’ve already mentioned how this could be done around Yahoo.  Let’s revisit in light of the Social Graph-based strategy how Yahoo can jump about 2 generations ahead.

First, Yahoo owns enough properties (such as del.icio.us) that they have Social Graphs out the wazoo to analyze and create a “Jerry” Rank (they certainly won’t call it the “Bob” Rank, doh!).  But secondly, they can open up their world and leverage the AltSearch community of something like 1,000 different search startups.  My proposal was that they turn search itself into a Social Network.  They can do that by leveraging all these social graphs, by releasing their own open Identity and Trust Fabric (e.g. Social Graph) apis that their partners must share to participate, and they can make available their web crawling data and massively parallel horsepower via Hadoop.

Okay, we see how Yahoo benefits.  Big hype value.  Big news value.  Promulgating a key open standard for Identity and Trust Fabric.  Leveraging everyone else’s social graphs to improve their search and generally creating network effects that haven’t been seen since eBay rolled up the auction world.  How do the partners benefit?

To continue the idea of building a Search Engine around a Social Network, what else do social networks have?  Widgeits!  Look how excited everyone got about Facebook Widgets!  Yahoo can bestow on their partners the ability to create search widgets.  People in the Search Network get to choose which widgets they like.  From a UI standpoint, it might not be too different from how Microsoft shows different search views in Tafiti.  Remember the little ring with the icons?  Or it could be a cleaner textier Google, sorry, definitely it would be a Yahoo-style list.  What’s on the list is determined by what widgets you signed up for, but Yahoo will also give you a basic set for general purposes.

To this we also add feeds, photos, and all the rest of the stuff that makes up a Social Network.

Still think someone can’t get there with a decent start?  This vision is my bet for what search engines look like in a couple of years, as well as an example of something I’ll talk more about:

Any web offering can be turned into a Social Network, and there are huge Competitive Advantages to doing so.

Submit to Digg | Submit to Del.icio.us | Submit to StumbleUpon

About these ads

5 Responses to “Social Graph Search Engines, Part 3”

  1. jofarnold said

    Hi Rob,
    I found your insightful post via a BlogNation post… which in turn was recommended me by the Blog Friends facebook application. That very fact is, in my highly biased opinion (I am COO of i-together.com, the company behind Blog Friends), proof that the social search can work very well indeed.

    There are two main reasons it works so well:
    1) your social network contextualizes the keywords – so in my case the keyword “social” usually comes up with “social media” sites because most of my Facebook friends are web techies
    2) the spam element is non-existent; I would not expect my close friends to spam me and thus, by extension, not their friends-of-friends and so on.

    Give it a try and tell me what you think – either by friending me on facebook or in the app’s forum. I am sure you’ll like it.

    Jof
    COO – i-together Ltd.

  2. assetbar said

    I really enjoyed your post, but what Yahoo needs is not big hype or news value in promulgating open standards. They need to deliver better search results for their users.

    The trouble is, they can’t have techcrunch give a Tafiti style review (i.e. interesting idea, but doesn’t work as well as google)

    Although Robert doesn’t have the right solution, per se, he’s IS accurately signaling distress with Google’s deal with the devil: better natural search results would cut billions off their Adwords revenues.

    I think that Yahoo or anyone who would beat Google need to start the innovation with something OTHER than search, first. Get that social graph in place, and start adding lots applications. As you say:

    Any web offering can be turned into a Social Network, and there are huge Competitive Advantages to doing so.

    After you are, say, newly useful for reading and sharing with your friends (and have the right technical underpinnings–a different problem), then you can add search as another application that is socialized.

    At least, that’s how I see it though my biased eyes. :)

    And as for i-together: I tried to join on FB, but that didn’t work. Do you have website version that I can go to directly?

  3. assetbar said

    I really enjoyed your post, but what Yahoo needs is not big hype or news value in promulgating open standards. They need to deliver better search results for their users.

    The trouble is, they can’t have techcrunch give a Tafiti style review (i.e. interesting idea, but doesn’t work as well as google)

    Although Robert doesn’t have the right solution, per se, he’s IS accurately signaling distress with Google’s deal with the devil: better natural search results would cut billions off their Adwords revenues.

    I think that Yahoo or anyone who would beat Google need to start the innovation with something OTHER than search, first. Get that social graph in place, and start adding lots applications. As you say:

    Any web offering can be turned into a Social Network, and there are huge Competitive Advantages to doing so.

    After you are, say, newly useful for reading and sharing with your friends (and have the right technical underpinnings–a different problem), then you can add search as another application that is socialized.

    At least, that’s how I see it though my biased eyes. :)

    And as for i-together: I tried to join on FB, but that didn’t work. Do you have website version that I can go to directly?

  4. smoothspan said

    Assetbar, thanks for commenting. The real point about Yahoo is that their properties constitute enough critical mass to be a Social Network when all is considered. They aren’t the only ones, but they are big enough to make a difference on a scale that matters. This is not to say that there isn’t a lot more Yahoo could do to be a better Social Network and a better Search Engine. But what I am saying is that a way for them to do that is to quit trying to do everything themselves and instead create a situation where others who have valuable contributions can help them succeed and be rewarded for it.

    Cheers!

    BW

  5. With all due respect Google is not that easy to game… that was the idea behind Google giving value to relevant incoming links that act as a voting tool… “a rate my site” hot or not type of deal…. the problem with that is that an SEO expert would be able to create that relevancy by creating content and incoming links… and if it ceases to be the case and social bookmarking in any of its forms becomes the norm thank trust me that marketers will turn their attention that way… oh and that is different than spamming… but I think that as long as it is a free for all environment without any “rules” it will remain a vibrant place, a huge market of free information with treats, snake charmers, fortune tellers, and pick pockets. :)

Leave a Reply

Please log in using one of these methods to post your comment:

WordPress.com Logo

You are commenting using your WordPress.com account. Log Out / Change )

Twitter picture

You are commenting using your Twitter account. Log Out / Change )

Facebook photo

You are commenting using your Facebook account. Log Out / Change )

Google+ photo

You are commenting using your Google+ account. Log Out / Change )

Connecting to %s

 
Follow

Get every new post delivered to your Inbox.

Join 313 other followers

%d bloggers like this: