I played around with Mog yesterday - a music based social network that tracks what you play etc, lets you connect with people, blogs - all the usual kind of stuff. Some of the coverage:c|net, zdnet, Red Herring.
Underwhelming. As a reasonably long-term last.fm subscriber, I'm not sure what mog has that would make me want to move. Let's see:
- Track what I'm playing ? Got that.
- Blogs, yup;
- forums - covered;
- tagging, likewise;
- networks - whether explicit or emergent - also there.
Anyway - not a chance I'll move away from last.fm to mog. Tom Coates sums it up aptly:
"It's got some attention because it was linked to from BoingBoing, but I have to be honest, at first glance it looks a lot like a crappy last.fm - a site that they completely haven't acknowledged in most of their press"
[tags]last.fm, music, collaborative, mog, audioscrobbler[/tags]
And then, like a 40 watt bulb flickering to life I had an epiphany. Given that calculating the ROI of the squishy stuff is really really really hard, and generally it's the squishy stuff that's the most important (more engagement, better communication, accelerated innovation, more reuse of existing information, talent retention, productivity increase, etc), then why not use a tool that seems ideally geared towards arriving at a close approximation of reality without needing or being able to measure directly? I am, of course, talking about crowd wisdom.
Here's how it could work:
-
Implement your hard-to-measure-the-ROI-of initiative (for example, redesign your intranet to be more usable, or implement social bookmarking, or an internal blogosphere, or whatever)
-
Set up a mechanism to aggregate the wisdom of the crowd - maybe a prediction market (although aren't they usually associated with events that have a measurable outcome such as "Who will be the next President", "Who will win the World Cup, etc" ?). Maybe all that's needed is a simple survey asking people how much they thought had been saved, or how much extra revenue earned.
-
Add and divide, and obtain average. I'm sure there are plenty of slightly more rigorous statistical techniques here for processing the numbers (eg throwing away outliers, etc), but essentially, that's it.
-
The hard part is now trying to work out whether that number bears any actual resemblance to reality - but maybe that's easier to judge when there's a number in front of you.
I admit that this doesn't let you know the ROI up front (would that be worthwhile, asking employees to predict the ROI before implementing ? Is that too complicated a question to ask ?), but it might give you some justification of impact.
What do you think ? Stupid idea, or just impractical ?
[tags]ROI, measurement, fuzzy, squishy, metrics, aggregation, crowdwisdom, wisdomofcrowds, predictionmarkets[/tags]

Recent Comments