437Views37Replies

# Star Rating System Implemented

Instructables can now be rated on a 5-star rating scale. So instead of saying that you like an Instructable, you can now say just how much you like it! Some fancy mathematical formulas were used to convert the previous ratings to the new scale, providing the scores that you see now. These formulas will be getting tweaked as we get some kinks out of the system and fine tune the results, but all of the new ratings will be saved for more accurate results in the future. So for now, go out and use the stars to more accurately rate new and older Instructables! More ratings will help fine tune future searches and encourage more people to post better Instructables.

## Discussions

Very cool!

It seems kinda buggy... found s bunch that says 1 or so ratings, but when you click on They like It, it shows a bunch of names...

Yeah, seems like, for now, the "fancy mathematical formulas" are still a little simplistic. For example, about half the instructables currently have a rating of 8.0 (4 stars),

regardless of how many + votes it got. That seems to indicate that each + simply got translates to a 4-star rating. Unfortunately, that means that a new instructable with a single 5-star vote would get ranked higher than an old favorite with 300 + votes...Most voting schemes like this use something called a

Bayesian estimator, which essentially down-weights options with fewer votes, even if they were high votes. That way, 300 + votes would get ranked ahead of 10 + votes, and 10 + votes should get ranked higher than one 5-star vote.Rating systems are a fairly active area of research - mainly due to their increasing use on the web. Imdb, for example has been using Bayesian estimators and various other tricks for a while, to rank movies based on user votes (there's big money in encouraging or

discouragingpeople to go see movies).Bayesian Rating - how to implement a weighted rating system

Internet Movie Database - Ranking

What does true Bayesian estimate mean in connection with the IMDb Top 250 ratings?

Right now the system is simplistic, it's true, as the new system hasn't been completely rolled out yet. There are a lot of 8s if you look around right now. As you guessed, the final system will be Bayesian. Averages get calculated a the end of each day.

One thing I noticed--if you made an instructable before the "-" minus button was removed, those negative ratings are averaged in. Those 'ibles all have somewhat less than an "eight" rating. More recent projects, of course, couldn't be down rated, and received the "eight" ...

Hmm - yes, it does look that way. Those ratings would have to be recalibrated separately. Best thing we can do right now, is to go back and re-rate the older instructables you're interested in, using the 5-star system. The more statistics available to compare the +/- votes, the + votes and the 5-star votes, the better the instructables crew can weight those old votes to be consistent with the new rating system. For example, instead of simply mapping all + votes to 4 stars, and all - votes to 1 star, you can map them to specific values, chosen such that the average rating (or distribution of ratings) based on +/- votes is the same as based on +-only votes, and the same as based on 5-star votes. That way, no instructables are penalized (on average) for having been published during the +/- era. For example, for the +-only era, you could set the value of a + vote equal to the average 5-star rating. You could even do this on a per-instructable basis, at least for those where you have enough + votes and 5-star votes. For the +/- era, you can calculate the total number of + and - votes, and set their value equal to the corresponding percentile of the 5-star votes. For example, if there are 25% - votes and 75% + votes, you would set the value of a - vote equal to the average of the bottom 25% of 5-star votes, and the value of a + vote equal to the top 75% of 5-star votes.

i think this rating system is a lot better than the previous one but i agree with Patrik about the translating problem. also, can you change the score so that it will only show 2 or 3 decimals?

I'm sure that'll get fixed asap, as fungus said -

nobodywants to see that many digits! :-DNope. It'll be cut down to just 2 digits soon.

2 digits after the decimal place, that is

thank you very much :D

1. The main difference that I see between this and the old system is that the old system showed

how many people like it,and the new one shows "how much the average person likes it." Also, there is no zero rating, so this is more like 0-4.5 than 0-5.2. What happened to They Like It? I haven't seen it recently, even before the rating system change. I assume that anyone who rates above 2.5 is going to get on the list? What about a list of people who have the instructable in their favorites?

Also, there is no zero rating, so this is more like 0-4.5 than 0-5.The one star means that the ible still there to rate, that the author actually wrote something, even if it is still only deserving of one star.

Also, it doesn't matter if the top rating is 4.5, it's still the highest rating. It doesn't necessarily mean perfect or 100%, but it's the highest rating you can give it.

The rating system goes like this I guess:

1: Dog feces.

2: Poor.

3: Good/average.

4: Pretty good.

5: Awesome.

Actually, the rating system - officially - goes like this: 0.5: Worthless 1: Poor 1.5: Some Flaws 2: Almost Average 2.5: Average 3: Above Average 3.5: Good 4: Very Good 4.5: Oustanding 5: Best Ever

Whoops. I hadn't moused over the stars.

Oh. They Like It has moved. I was looking for it in the wrong place.

nah, jk jk i did think about it sometimes though

yeah, my idea came alive!

I liked the old one better!

I saw the star system, and I have abused it already!

_{Imagine what she'd have said with any lower score... :-/}Who will be the first to get a rating of pi ? LOL

Very Cool!

I think this is better, but it makes my instructables look bad, I mean like 5.75 stars... I was happier with +8 or something like that

Interesting, only problem is one of mine has an obscene number of decimals, It's got 7 or so ratings so the number is going to be that way, interesting addition, I like it alot, only needs a little fine tunign as you said, surely you can add code to simply display the first digits or decimals, then use the most accurate formula for ratings, i know calculators have a way of doing this with their finite digit area so it must be doable...

I'm a bit confused how as to how "They Like It" will work now....

If you give an 'ible a poor rating,

half a starfor instance, does that add you to the "like it" category?Or is "they like it" weighted also?

good point

Cool! That's a really good idea!

It's definitely a cool system. I can't wait to see how it turns out for the future.

I saw one instructable with a rating of 7.2375340358. They should round ratings to the nearest tenth or something. Great idea though!

That'll be fixed.

Kudos - another great idea from the HQ.

_{Y'all should move more often. ;)}Sweet! I love this idea!

This will indeed make it easier for us to "rate" how well we like things...it may make contests a bit more of a challenge for you all though as far as calculating how well something is liked.

.5

That's awesome!!! I as going to suggest it myself!

Oh wow, you can give 1 1/2 and such!!! This is great!

Oh wow, very good idea! This is

muchbetter than the old +1 -1 thing!!!!!