Checking out frogmetrics.com and thinking it is really cool, but reminds me...
How many times have you seen a survey with the answer being from 1-10 or 1-5 stars? Every time I come across one of these I always wonder how in the world they aggregate these responses in a meaningful way. A very level person will answer most things close to the center (every thing is a 4-6) where a excitable personality tends to hit the extremes. They both likely meant the same thing by their feedback. The same thing goes with netflix movie rankings for example, and then they try and give me recommendations based off of what other users felt. Problem being is that the level heads and the excited are all mixed in together.
So is there a way you could get a sense of what personality they are to help classifier their answers? What if you asked a single question somewhere in the survey that was a "primer" question. Something that has a decent emotional response, like how would winning 100 dollars make you feel 1-10?
Monday, August 18, 2008
Subscribe to:
Post Comments (Atom)
3 comments:
I like it! I think you could do a similar think if you had numerous ratings from the user. If they average an extreme rating (not an actual average, more like if they average a lot of 5's and 1's) you consider them one type and if not you consider them the other.
Okay, I am a bit embarrassed to admit it, but I remember this question being posed for hotornot.com. Basically I think they kept track of a users responses as a whole, so the "excitable" crowd would score on the upper and lower extremes, and the "average" would score in the middle. I believe they took the range of each individual user and mashed it up to get some sense of a real rating...
If you have many responses from a user (like the netflix example) then you guys are right, you could probably do better through normalization. I think priming would still be useful in a situation like frogmetrics where you only ask say 2 or 3 questions for each shopper.
Post a Comment