236Views35Replies

Author Options:

Pro Instructables Ratings Answered

I was going through my bookmarks today, and clicked this one (no longer works):
www.instructables.com/tag/type:user/pro:true/
However, it did lead me to this:
www.instructables.com/tag/type-id/pro-true/
So I collected the same data I've done previously, here's how Pro & non-Pro compare:

Instructables by Pro users are generally higher-rated than those by non-Pro users, and few have bad-ratings.
There are reasons for this.
> Instructables staff are Pro users, they set high standards.
> People who pay and post tend to be more serious about what they publish.
> Staff and paid users tend to have been here longer and posted more content in line with the above.
> Younger users with less experience, fewer tools & less money find it harder to pay for Pro membership.

What you may read from these statistics (if you wish) is that as a Pro member, 3.1-3.6 is an average rating.

(Chart shows % Instructables in each rating band, for rated Pro ~3100, rated non-Pro ~28000)
Notice how the lines have similar shapes, just skewed in opposite directions.
The main reason I thought this might be of interest is the lumpiness of the distribution shows better like this - I'm still seeing waves / ripples...

Discussions

0
None
mikeasaurus

8 years ago

Though there is a formula to produce an instructable rating, I wouldn't look too deeply into the ratings as they can augmented by someone who doesn't like the person and gives the project a bad rating. Bear in mind the inverse of this is true as well. (...and could also hold true for certain cliques or themes of projects as well)


 

0
None
Grathiomikeasaurus

Reply 8 years ago

(...and could also hold true for certain cliques or themes of projects as well)
After seeing the interesting end of year stats for the Knex users (something like half the "Most Commented" were K'nex but none of the "Higest rated" were) it made me curious about some of these subcultures.  

To support you data it looks like 15 of the top 50 highest rated were by Pro members.

(Thought the single person who appears most on that list seems to have a small but dedicated fanbase.  Or something.)

I'm not sure what I'm saying, but every single one of a certain users's 'Ibles has 4.0+ rating it gets my attention.  When you have 29 5 star ratings for an Instructable with less than 1000 views something unusual continues to  happen.

0
None
killerjackalopeGrathio

Reply 8 years ago

Some of my lower viewed instructables have significantly higher ratings, due to the nature of the content... Though highest rated of mine makes no sense at first glance but I think the subject of the 'ible is a big factor, younger audiences appreciate or dislike instructables one smaller points and tend to rate much higher or lower. They don't always look at an 'ible on the whole though this isn't true of many of the young veterans... 

0
None
lemonieGrathio

Reply 8 years ago

Some of this is down to what you do and do not post. If one has an eye for "popular" they can restrict themselves to popular, be careful and score highly.

What you do have in these charts are people who might have been Pro members or stayed "not", but have long since gone.

L


0
None
egbertfitzwillymikeasaurus

Reply 8 years ago

Oh man, my life is not improved by knowing this. Although I suspected that cliques existed....

0
None
Jayefuumikeasaurus

Reply 8 years ago

Ha ha. That last sentence was very diplomatically phrased.

0
None
BrittLiv

8 years ago

"Younger users with less experience, fewer tools & less money find it harder to pay for Pro membership."

actually those are my favorite Instructables, I love it if someone has a brilliant idea and can realize it without needing much....

0
None
lemonieBrittLiv

Reply 8 years ago

The phrase is offered as an explanation as to the difference. I too like where someone has shown initiative and done something great, but not very "pretty".

L

0
None
GoodhartBrittLiv

Reply 8 years ago

Yes, I agree.  I am thinking about starting a series of ibles that start with the simplest ideas and move to the complex, using only household items (including, building a radio, resistors, capacitors, diodes, etc.  from scratch).
 
0
None
egbertfitzwilly

8 years ago

I don't think its any more complicated than motivation. Anyone who is motivated enough to fork out the cash or win the contest is obviously interested in doing high quality work while a lot of free members are just screwing around, or are kids.

0
None
lemonieegbertfitzwilly

Reply 8 years ago

The motivational part sums up a lot in one word. The lumpy-distribution interests me.

L

0
None
egbertfitzwillylemonie

Reply 8 years ago

Maybe we should have a "Sucks" banner similar to featured......

0
None
lemonieegbertfitzwilly

Reply 8 years ago

That's an amusing idea, you'd need to assemble a "Sucks Team" to co-ordinate that though...

L

0
None
Kiteman

8 years ago

A thought about the double-bumps.

For both goups, the main spike is the main population.

The smaller hump on the non-pros is the "noobs" - just joined, desperate to post something and get known.

For the pros, the other bump is that group who care more about what they post.  Pro members are more likely to spend weeks or more on producing a really outstanding project.

Just a thought.

0
None
LinemenOwn

8 years ago

could it be that because of pro memberships being offered as prizes to contests that the best publishers are being rewarded with pro-memberships?

0
None
lemonieLinemenOwn

Reply 8 years ago

Statistically insignificant. 3,000+ paid members.

L

0
None
=SMART=

8 years ago

Interesting ! :)

0
None
lemonie=SMART=

Reply 8 years ago

It's the lumps that interest me. If your data is from a grouping that better fits the system (in how it's supposed to work) - you see the "curve" better. I see ripples like a stone has been dropped at 3.0.

L

0
None
frollardlemonie

Reply 8 years ago

That's the 'theres only been 1-3 votes on this ible' stone.  big splash.

0
None
lemoniefrollard

Reply 8 years ago

Yes, that splash is still there, but do you see the ripples? It should be smoother, but there s that uneveness....

L

0
None
NachoMahmalemonie

Reply 8 years ago

.  You're dealing with real-world data, which is seldom pretty without a little massaging.

0
None
GoodhartLithium Rain

Reply 8 years ago

I'm sorry, I didn't mean to imply anything with my last post (below)
 
0
None
GoodhartLithium Rain

Reply 8 years ago

Shoulders and neck?  My wife likes when I do that for her too.
 
0
None
Jayefuu

8 years ago

That's pretty cool. Did it take you a long time to collect the data?

0
None
lemonieJayefuu

Reply 8 years ago

Not really, just a lot of clicking. If you (i.e. me) did it once, it's a lot easier to hit the right spots next time.

L

0
None
Jayefuulemonie

Reply 8 years ago

Let me know if you need a Perl script for it next time =]

0
None
lemonieJayefuu

Reply 8 years ago

You could probably do it better. Can you export rating data for all Instructables into .tsv or similar?

L

0
None
Jayefuulemonie

Reply 8 years ago

Data for ALL instructables? I wouldn't want to sit here and watch a script go through all million or so instructables, that would be painful. I can strip data from pages though, what ones did you look at? And I can export as csv, tsv or even an excel file if you prefer, with formatting etc.

If you were to tell me what you did or what you wanted done, I could make it faster and more repeatable if that helps.

0
None
lemonieJayefuu

Reply 8 years ago

There's only ~31,000, just pulling the rating data for each. It's going to be a pain to do I think, because you'd probably have to pullout a list of pages, then query each of them. Upon reflection, I see that I was stating an ideal rather than seriously expecting to get it.

L

0
None
Jayefuulemonie

Reply 8 years ago

Hmmm. IT's the page loads that are slow, I think they do something to restrict the page loads per IP to stop bots slowing down the site.

200 pages take about 10 minutes to fetch wit the last perl script I wrote, I can't imagine it is my script that is slow, more likely the server taking its time returning the data for repeat requests. (I made that up, it could be a load of rubbish)

Is there a way to access lists of ibles with their ratings all on one page, like when you view your "You" section, that would cut down the page views by a factor of the number of ibles per page (25?).

Anyway... if there's something I can do to make the way you did it before more repeatable or easier, let me know, I'm sure you didn't look at 31,000 when you did it ;)