230Views35Replies

Author Options:

Pro Instructables Ratings Answered

I was going through my bookmarks today, and clicked this one (no longer works):
www.instructables.com/tag/type:user/pro:true/
However, it did lead me to this:
www.instructables.com/tag/type-id/pro-true/
So I collected the same data I've done previously, here's how Pro & non-Pro compare:

Instructables by Pro users are generally higher-rated than those by non-Pro users, and few have bad-ratings.
There are reasons for this.
> Instructables staff are Pro users, they set high standards.
> People who pay and post tend to be more serious about what they publish.
> Staff and paid users tend to have been here longer and posted more content in line with the above.
> Younger users with less experience, fewer tools & less money find it harder to pay for Pro membership.

What you may read from these statistics (if you wish) is that as a Pro member, 3.1-3.6 is an average rating.

(Chart shows % Instructables in each rating band, for rated Pro ~3100, rated non-Pro ~28000)
Notice how the lines have similar shapes, just skewed in opposite directions.
The main reason I thought this might be of interest is the lumpiness of the distribution shows better like this - I'm still seeing waves / ripples...

35 Replies

user
mikeasaurus (author)2009-12-24

Though there is a formula to produce an instructable rating, I wouldn't look too deeply into the ratings as they can augmented by someone who doesn't like the person and gives the project a bad rating. Bear in mind the inverse of this is true as well. (...and could also hold true for certain cliques or themes of projects as well)


 

Select as Best AnswerUndo Best Answer

user
Grathio (author)mikeasaurus2009-12-26
(...and could also hold true for certain cliques or themes of projects as well)
After seeing the interesting end of year stats for the Knex users (something like half the "Most Commented" were K'nex but none of the "Higest rated" were) it made me curious about some of these subcultures.  

To support you data it looks like 15 of the top 50 highest rated were by Pro members.

(Thought the single person who appears most on that list seems to have a small but dedicated fanbase.  Or something.)

I'm not sure what I'm saying, but every single one of a certain users's 'Ibles has 4.0+ rating it gets my attention.  When you have 29 5 star ratings for an Instructable with less than 1000 views something unusual continues to  happen.

Select as Best AnswerUndo Best Answer

user
killerjackalope (author)Grathio2010-06-03

Some of my lower viewed instructables have significantly higher ratings, due to the nature of the content... Though highest rated of mine makes no sense at first glance but I think the subject of the 'ible is a big factor, younger audiences appreciate or dislike instructables one smaller points and tend to rate much higher or lower. They don't always look at an 'ible on the whole though this isn't true of many of the young veterans... 

Select as Best AnswerUndo Best Answer

user
lemonie (author)Grathio2009-12-26

Some of this is down to what you do and do not post. If one has an eye for "popular" they can restrict themselves to popular, be careful and score highly.

What you do have in these charts are people who might have been Pro members or stayed "not", but have long since gone.

L


Select as Best AnswerUndo Best Answer

user

Oh man, my life is not improved by knowing this. Although I suspected that cliques existed....

Select as Best AnswerUndo Best Answer

user
Jayefuu (author)mikeasaurus2009-12-26

Ha ha. That last sentence was very diplomatically phrased.

Select as Best AnswerUndo Best Answer

user
lemonie (author)mikeasaurus2009-12-24

Oh yes, certainly true.

L

Select as Best AnswerUndo Best Answer

user
BrittLiv (author)2010-06-03

"Younger users with less experience, fewer tools & less money find it harder to pay for Pro membership."

actually those are my favorite Instructables, I love it if someone has a brilliant idea and can realize it without needing much....

Select as Best AnswerUndo Best Answer

user
lemonie (author)BrittLiv2010-06-03

The phrase is offered as an explanation as to the difference. I too like where someone has shown initiative and done something great, but not very "pretty".

L

Select as Best AnswerUndo Best Answer

user
Goodhart (author)BrittLiv2010-06-03
Yes, I agree.  I am thinking about starting a series of ibles that start with the simplest ideas and move to the complex, using only household items (including, building a radio, resistors, capacitors, diodes, etc.  from scratch).
 

Select as Best AnswerUndo Best Answer

user
egbertfitzwilly (author)2010-01-09

I don't think its any more complicated than motivation. Anyone who is motivated enough to fork out the cash or win the contest is obviously interested in doing high quality work while a lot of free members are just screwing around, or are kids.

Select as Best AnswerUndo Best Answer

user
lemonie (author)egbertfitzwilly2010-01-10

The motivational part sums up a lot in one word. The lumpy-distribution interests me.

L

Select as Best AnswerUndo Best Answer

user
egbertfitzwilly (author)lemonie2010-01-10

Maybe we should have a "Sucks" banner similar to featured......

Select as Best AnswerUndo Best Answer

user
lemonie (author)egbertfitzwilly2010-01-10

That's an amusing idea, you'd need to assemble a "Sucks Team" to co-ordinate that though...

L

Select as Best AnswerUndo Best Answer

user
Kiteman (author)2010-01-10

A thought about the double-bumps.

For both goups, the main spike is the main population.

The smaller hump on the non-pros is the "noobs" - just joined, desperate to post something and get known.

For the pros, the other bump is that group who care more about what they post.  Pro members are more likely to spend weeks or more on producing a really outstanding project.

Just a thought.

Select as Best AnswerUndo Best Answer

user
LinemenOwn (author)2010-01-04

could it be that because of pro memberships being offered as prizes to contests that the best publishers are being rewarded with pro-memberships?

Select as Best AnswerUndo Best Answer

user
lemonie (author)LinemenOwn2010-01-04

Statistically insignificant. 3,000+ paid members.

L

Select as Best AnswerUndo Best Answer

user
Zaphod Beeblebrox (author)2010-01-01

that is extremely interesting!

Select as Best AnswerUndo Best Answer

user
=SMART= (author)2009-12-23
user
lemonie (author)=SMART=2009-12-23

It's the lumps that interest me. If your data is from a grouping that better fits the system (in how it's supposed to work) - you see the "curve" better. I see ripples like a stone has been dropped at 3.0.

L

Select as Best AnswerUndo Best Answer

user
frollard (author)lemonie2009-12-23

That's the 'theres only been 1-3 votes on this ible' stone.  big splash.

Select as Best AnswerUndo Best Answer

user
lemonie (author)frollard2009-12-23

Yes, that splash is still there, but do you see the ripples? It should be smoother, but there s that uneveness....

L

Select as Best AnswerUndo Best Answer

user
NachoMahma (author)lemonie2009-12-24

.  You're dealing with real-world data, which is seldom pretty without a little massaging.

Select as Best AnswerUndo Best Answer

user
Lithium Rain (author)NachoMahma2009-12-24

I could go for a massage...

Select as Best AnswerUndo Best Answer

user
Goodhart (author)Lithium Rain2009-12-25
I'm sorry, I didn't mean to imply anything with my last post (below)
 

Select as Best AnswerUndo Best Answer

user
Lithium Rain (author)Goodhart2009-12-25

Of course not! I know you better than that. :)

Select as Best AnswerUndo Best Answer

user
Goodhart (author)Lithium Rain2009-12-24
Shoulders and neck?  My wife likes when I do that for her too.
 

Select as Best AnswerUndo Best Answer

user
Jayefuu (author)2009-12-24

That's pretty cool. Did it take you a long time to collect the data?

Select as Best AnswerUndo Best Answer

user
lemonie (author)Jayefuu2009-12-24

Not really, just a lot of clicking. If you (i.e. me) did it once, it's a lot easier to hit the right spots next time.

L

Select as Best AnswerUndo Best Answer

user
Jayefuu (author)lemonie2009-12-24

Let me know if you need a Perl script for it next time =]

Select as Best AnswerUndo Best Answer

user
lemonie (author)Jayefuu2009-12-24

You could probably do it better. Can you export rating data for all Instructables into .tsv or similar?

L

Select as Best AnswerUndo Best Answer

user
Jayefuu (author)lemonie2009-12-24

Data for ALL instructables? I wouldn't want to sit here and watch a script go through all million or so instructables, that would be painful. I can strip data from pages though, what ones did you look at? And I can export as csv, tsv or even an excel file if you prefer, with formatting etc.

If you were to tell me what you did or what you wanted done, I could make it faster and more repeatable if that helps.

Select as Best AnswerUndo Best Answer

user
lemonie (author)Jayefuu2009-12-24

There's only ~31,000, just pulling the rating data for each. It's going to be a pain to do I think, because you'd probably have to pullout a list of pages, then query each of them. Upon reflection, I see that I was stating an ideal rather than seriously expecting to get it.

L

Select as Best AnswerUndo Best Answer

user
Jayefuu (author)lemonie2009-12-24

Hmmm. IT's the page loads that are slow, I think they do something to restrict the page loads per IP to stop bots slowing down the site.

200 pages take about 10 minutes to fetch wit the last perl script I wrote, I can't imagine it is my script that is slow, more likely the server taking its time returning the data for repeat requests. (I made that up, it could be a load of rubbish)

Is there a way to access lists of ibles with their ratings all on one page, like when you view your "You" section, that would cut down the page views by a factor of the number of ibles per page (25?).

Anyway... if there's something I can do to make the way you did it before more repeatable or easier, let me know, I'm sure you didn't look at 31,000 when you did it ;)

Select as Best AnswerUndo Best Answer