Posts Tagged ‘most comments’

  • Mon, Feb 21 2011

    It’s been about a week since we announced that we’ll be overhauling the Product Evaluation system, and I wanted to give a quick update on steps we’ve taken so far.

    1) More Wild Cards Please. In our Friday meeting, we evaluated not one, not two, but THREE wild card submissions, along with the top five community scored ideas. We’ll be using more discretion in the ideas that undergo deep-dive staff analysis over the next few months.

    2) Playing Around With Sorts. You’ll notice that we’ve removed the ability to sort by Most Comments in the evaluations we just launched. We’re not yet sure if this change is permanent, and we’ll be playing around with filtering and sorting options over the next several weeks. Please let us know what you think.

    3) Voting Behavior Survey. We’re developing a set of questions about voting behavior to get a sense for how individual community members navigate the eval process. Keep an eye out for it early this week.

    We continue to be fully open to ideas and suggestions. We want to improve, so don’t stop telling us where you think we can do better!

  • Mon, Jan 3 2011

    New year, new commitment to getting our product evaluation process right!

    Starting with this week’s evals, we will no longer be counting ideator comments in our “Most Comments” sorting algorithm.

    We made this change after many community members expressed concerns that “comment padding” — the practice of flooding an idea with unnecessary comments to boost comment counts — was messing with our ability to bubble the best ideas to the top.

    We still think that comment counts are a good way to measure buzz around an idea, but we also want to make sure it’s not used as a tool for manipulation. All comments, including those by the ideator, will still be counted, but only non-ideator comments will be factored into the “Most Comments” sort. We’re hoping this will result in a fairer, more honest product evaluation process.

    This certainly isn’t the end of improvements, so please keep your feedback coming on our support forum! We’re as eager as you are to make our evaluation process the best it can be.