loading
At this point you have been asked by the Instructables staff to help judge a contest.  You may be a professional outside of the Instructables community, prolific author, or a past contest winner.

Your input as a judge is invaluable to the Instructable community and helps us to run the best contests on the internet.

This Instructable focuses of two parts of the judging process:
1. How to create and submit your judging ballot.
2. Understanding the judging criteria to make an informed decision on how to rate a project.


***NOTE: the images in this Instructable are not from a real contest.  They are all Instructables I (carleyy) made.  I will use them as examples in STEP 6 as a mock judging experience.

Step 1: Look for PM

Now that you have been asked by our staff to help judge keep an eye out for a message in your inbox with further judging instructions.

Once you've received a PM letting you know judging has started, you can head to the contest page to see the ballot!

Step 2: Add Projects to Ballot

Add all of the finalists you would like to judge onto the "Ballot" by clicking the "Add to Ballot" button below the photo of the project.  You know the project will be added to the ballot because it will appear on the right side of the screen.

Please note that some contests will include enough finalists to result in a second page of projects, so make sure to scroll down to the bottom and check that you've added everything!

See STEP 5 "Common Judging Questions" for information about how many entries you should judge.

Step 3: Score Project and Save

Follow these instructions for rating the finalists and saving your scores.

1. Check Out Entries: Click on the entry titles to open them and read through. Pro tip: it's best to right click and open them in a new tab!

2. Rate Finalists 1-9: We use Range Voting. To rate each project drag the cursor below the project on the ballot to rate the project 1-9. You must move cursor - until you move it you will be giving the project a score of 0. If you would like to rate the project a 5, drag the cursor away and back to 5 so the vote counts. You can find the judging requirements in STEP 4.
 
9 = amazing mind blowing project that best satisfies the judging requirements.  You may decide the project excels in one of the judging requirements more than another.
.
.
5 = the project may vaguely satisfy the judging requirements, or it may only satisfy 1-2 of the judging requirements.
.
.
1 = yuck! Doesn't satisfy any of the judging requirements.


3. Scores are automatically saved: Once you've added an instructable to the ballot and scored it, it's safe!

What matters for the judging is the status of your ballot when judging closes. You can come back later to do more or change your scores. Just make sure to save your ballot so it gets counted.

Step 4: Judging Requirements

Judges should use the following criteria when judging each finalist.  It is not meant to be used as a rubric, but more of a guideline to critically evaluate and compare contest finalists. As the judge you decide if an Instructable adheres to the judging criteria and how to apply the criteria to the specific contest you are judging.

Subject:
Project best represents the theme of the contest. This is very important, because a project may be extremely creative and well documented (and the most ingenious project of the finalists), but if it doesn't best fit in line with the theme it should be strictly penalized.

Clarity:
Explanations and directions are coherent and intelligible.  The order of instructions should make sense so someone could follow along and duplicate the project. It doesn't need to be written for every skill level, but should be accessible by the audience that uses the technology or skill implemented in the project.

Ingenuity and Creativity:
The project implements a clever or unique design. Project explores an area of study that is not well documented or presents a solution to a problem that is not well defined. A stand out project doesn't have to re-invent the wheel, but need to have an element of uniqueness that sets it apart from similar types of projects. The project presents a practical solution that may not otherwise be apparent.

Quality of Presentation:
Projects should be broken into easily understod steps (or stages/processes for Photo and Video).  There should be an appropriate amount of text describing each step completely (the feature checklist hits this very well.) All pictures, diagrams, and sketches to be the author's own, original work. Where this is not possible, steps should be taken to minimize amount of other people's documentation - and always with their permission.  Visually the project pictures should accurately represent the project and be easily understood by readers who may not be familiar with the concept.

Execution of the Instructable
Intro image fits and explains the project. The narrative should engage and educate the reader, and complex areas of discussion should have enough detail and external links to guide the reader through your project and onto further reading if required. The entire project should be understood by someone not intamately familiar with the material. The tone should aim to educate and entertain.

Step 5: Common Judging Questions

How many projects should I judge?
You do not have to judge all the finalists, but it is good practice to do so.  If you only judge your favorite entries with high scores and leave the rest off the ballot it doesn't recognize entries in the middle of the pack.  Those entries may be deserving of second place or runner up prizes, but may get pushed to the bottom of the list.

For best results, judge all the projects against the judging requirements and against each other for the optimal winner outcome.


What happens if I don't give a project a score?
By leaving a project off the ballot you are NOT giving it a 0. When you don't vote for a project it doesn't register any score in the database. Only giving a project a value of 1-9 will affect a change.


Step-by-Step Instructables vs. Photo Instructables vs. Video Instructables
If the contest allows all types of Instructables to enter how do you judge one type against another? As long as you are judging entries against the judging requirements this shouldn't be too hard.

Projects like recipes sometimes don't make sense in the step-by-step layout and it may be perfectly acceptable as a photo Instructable.

Step 6: Example Judging Process

Here is a mock judging process for a Holiday Gifts Contest.

Keep in mind, this is MY PERSPECTIVE as a judge and how I judge entries against the judging requirements.  Every judge is different and interprets the judging requirements differently.  This is why we have at least 10 judges in every contest.

There is an element of "wow, awesome" that is nearly impossible to define, but is clearly visible when you see it.  Such ingenuity may compensate for slight weaknesses in presentation

San Francisco Neighborhood Wood Wall Map - 5
This project gets its points for subject and ingenuity/creativity.  It is great that the project includes a file which is really the bulk of the project. However, it really needs more instruction for the build of the project. It looks more complicated than just printing the file 

Woodcut Silhouette Portrait - 8
This project works perfectly as a gift.  It has a great story behind it and is a unique idea.  Although the project doesn't give instructions for manipulating the photo, it links to a tutorial - no need to re-explain these steps if there is a great tutorial that exists elsewhere. I knocked it down a point because the last step doesn't throughly explain the gluing process.

Suitcase Picnic Table - 9
This project hits all the criteria spot on. It would make a fantastic gift for any family member or friend. It is a new spin on suitcase repurposing - I haven't seen anything like it.  It is broken down into appropriate steps and every step is explained in great detail.  It is obvious that the project actually works and has been used. 

Fish Skeleton Earrings - 3
These earrings would make a great gift for almost any lady, and it's wonderful that the files for lasercutting them are included. Because they're lasercut, though, there's not too much in the way of documentation. While the presentation is good and the pictures are clear, it's not as comprehensive as most. The project is also not the most original - fish bone earrings have been around for quite a while now!

Custom Wood Clothing Hanger - 6
This is a clever and original idea that would make a great gift for expecting parents or for people you know that just love clothes. The files for lasercutting have been included (three different ones!) and the photos are great. While this project suffers from the same lack of documentation like the fish skeleton earrings, it gets higher marks thanks to it's originality and the fact that it can be easily customized.

Fringe Necktie - 4
This project gets points for documentation. However, in the first step it says it is based on an item that already exists - thus not very creative.  Its also a very generic gift (especially compared to the other gifts on this list).  Some of the pictures are blurry.

Step 7: Guides for Writing a Great Instructable

Here are some helpful resources for writing a great instructable and evaluating projects.

If you are interested in judging a contest go here.

<p>I want to judge tech.</p>
<p>I want to judge tech.</p>
<p>Exciting! </p>
<p>Really Helpful. Thank you!</p>
<p>I have a question.IF theres a really really good project,example:the pi laptop(thats entered in the contest).But i also do know it is not a new project.What score should i give him/her then?</p>
<p>Is it fair and/or allowed to judge your own Instructable in a competition. Just wondering.</p>
<p>You are only asked to judge contests you are not entered in. So, unless you have two accounts, you would not judge your own.</p>
<p>Well for me at least, I was chosen to judge a competition that I had entered. I did receive a runner up prize but I did not include myself in my ballot. If the rules have changed now then thats good but it was something that happened to me.</p>
<p>I was asked to serve as a judge a couple of times, but never for contests in which I had entries. I would think entrants would not be asked to serve as judges. </p>
<p>yes but be honest with yourself.</p>
<p>I don't know, however I do not think that it fair to vote for yourself. Hope this helps :)</p>
Thanks m8. I guess it is just an unwritten rule.
how do I make sure my ballot is saved so it gets counted when the judging closes?
<p>thanks guys :) </p>
This is a great guide for beginners, helped me out a lot. Thanks!!
<p>can you judge more than one contests at a time if your asked to?</p>
<p>wow. exciting!</p>
<p>..Then I clicked on the link &quot;go <a href="https://www.instructables.com/community/Call-for-contest-judges/" style="">here</a>&quot;, it openned another instructables with another link &quot;<a href="https://www.instructables.com/id/How-to-Judge-a-Contest/" style="">You can find out more about judging a contest here.</a>&quot; and 'round we go...<br>What am I missing here? </p>
<p>First time judge contest ...this well be fun..just send a email when,were,time and ill be there lol.</p><p>thank you</p>
<p>If I have an Instructable in the 2x4 contest can I still judge the contest?</p>
<p>This would be my first timer to judge the contest :)</p>
Thanks. I'm judging my first contest now. And now I know how!
<p>Nice guide. Thanks.</p>
<p>When I judge a contest I either judge all or none.</p><p>I will also take away a point if someone says, &quot;Vote for me.&quot;</p>
<p>&quot;Vote for me!&quot;</p>
<p>lol, yeah. It's sort of annoying when someone says that.</p>
<p>lucky I didn't do it... Phew.</p>
<p>Ah, so I'm not the only one who finds that a little irritating. I wondered, because so many people say it. I even put it in the text of one of my entries once, at the very end, because it seemed like everyone was doing it. But then I just didn't feel right about it and I took it out. </p>
<p>How do you save your ballot?</p>
<p>is someone not allowed to vote for an instructable in a contest until they've published atleast one instructable?</p>
<p>You do have to have an account. However, as I recall when asking my friends to vote for my entries way back when, they were able to log in with Facebook.</p>
<p>Anyone can vote in a contest</p>
<p>Are there any requirements for being a judge? (Like how you can qualify)</p>
<p>Wow, pretty impressive. Hope everyone judges accourdingly</p>
<p>Please elucidate. you say the scores are saved automatically, but next paragraph says to be sure to save your ballot so it will be counted. </p>
<p>I would love to judge a contest. I have plenty of experience following instructables, but have only uploaded one, which was not great, but /i knew it was not great!</p>
This is very helpful. It will help while making future 'ibles because it shows exactly how they are judged. Thanks for illuminating :) <br> <br>How long does it usually take to announce the winners after the entry window has closed?
<p>It normally takes 1-2 weeks, depending on the contest. I try really hard to always announce them about a week after, but sometimes things can get slowed down if we're working with a big sponsor or the contest gets tons of entries and needs a longer judging period. :)</p>
This is very helpful. It will help while making future 'ibles because it shows exactly how they are judged. Thanks for illuminating :) <br> <br>How long does it usually take to announce the winners after the entry window has closed?
Yeah this guide underscores the deep problems with the judging system. Range voting is weak and arguably a lazy man's version of something like scorecard voting. So much to add to my instructable about instructables after having just judged a contest using this... Was illuminating.
So what makes the finals is determined solely by popular vote?
Nope! Normally that will only account for half at most. We try our best to scour all the entries for finalists, not just those who end up at the top because of votes. :D
This is great for us wondering how the judging process works once the finalists are picked. But what I (and others I am sure) are very curious about is the process of getting from all entrants down to those finalists... <br> <br>I know votes count for part of it but I have seen finalists with very low page views (and by extrapolation probably lower votes) than projects with 10's of thousands of hits that do not make the finals. The &quot;legal-ese&quot; usually states that 49% are chosen by votes and the rest by the judges. But on large contests with ~500 entries how is that 51% chosen and how many judges does it take for this daunting task? <br> <br>Just curious :-)
This varies a lot! Sometimes it's just a couple of folks picking the winners, sometimes it's the whole editorial team fighting over it. Sometimes employees of the company sponsoring the contest get involved too. <br /> <br />Everyone on staff has a different thing they look for when it comes to finalists, so we've always got something to talk about. ;) <br /> <br />On average, it normally takes 2-3 days to pick finalists.
A short &quot;Hello&quot; to the instructables team <br>Thank for this help. It is an honour to me for beeing asked to judge. And so I read this instructable very carefully and it helped me very much to understand quite a bit more about the contest and its rules. <br>Cheers, <br>Yours Aeon Junophor........ now judging:-)))
Thank you for this. I would like to add that it would be most helpful if the theme and rules of the contest were posted at the top of each page of ballots to be able to refer to. That way something that does not meet the rules can be quickly 'ruled out' instead of spending time reading the whole 'ible in depth.
It's my opinion that &quot;...something that does not meet the rules ...&quot; should never get past the contest moderator in the first place.<br> <br> Maybe it's just me (and my pet peeve) but too many entries are<strong> not</strong> <em>Ibles</em>, in any true sense. &nbsp;Often, &nbsp;the author basicly says &quot;I made this!&quot; and provides a few pics, but no succinct DIY information.<br> <br> We're all here to learn... not just fawn over finished projects (as spectacular as they may be) with no &quot;how-to&quot; information.<br> <br> <br> <br> <br> <br>
There is no moderator. It's about how many votes they get. In the past some 'ibles with 100's of votes got into the contest and they were dreck - they got in (and it may still happen) because of the votes.... maybe the votes came from friends, family, aliens... I don't know. But what makes you think there is a moderator, as this would be news to me.
Possibly the protocol has changed since you last entered a contest, Ninzer?
Oh yes, of course there is a 'moderator to get into the contest' but there is no moderator of what gets into the finalist part. Yes, it's been a long time since I entered a contest, but I do judge them as often as I am able (it takes a long time, hours...)

About This Instructable

17,256views

63favorites

License:

Bio: Former Instructables employee CHECK OUT MY WORK www.carleyjacobson.com
More by Carleyy:Easter Makerspace Contest 2015 MakeyMakey Build Night (January 2015) 
Add instructable to: