How to Judge a Contest

35,547

108

27

Introduction: How to Judge a Contest

About: Former Instructables employee CHECK OUT MY WORK www.carleyjacobson.com

At this point you have been asked by the Instructables staff to help judge a contest. You may be a professional outside of the Instructables community, prolific author, or a past contest winner.

Your input as a judge is invaluable to the Instructable community and helps us to run the best contests on the internet.

This Instructable focuses of two parts of the judging process:
1. How to create and submit your judging ballot.
2. Understanding the judging criteria to make an informed decision on how to rate a project.

***NOTE: the images in this Instructable are not from a real contest. They are all Instructables made by Instructables admin.

Step 1: Look for PM

Now that you have been asked by our staff to help judge keep an eye out for a message in your inbox with further judging instructions.

Once you've received a PM letting you know judging has started, you can head to the contest page to see the ballot!

Step 2: Add Projects to Ballot

Add all of the finalists you would like to judge onto the "Ballot" by clicking the "Add to Ballot" button below the photo of the project.

See STEP 5 "Common Judging Questions" for information about how many entries you should judge.

Step 3: Score Project and Save

Follow these instructions for rating the finalists and saving your scores.

1. Check Out Entries: Click on the entry titles to open them and read through. Pro tip: it's best to right click and open them in a new tab!

2. Rate Finalists 0-9: We use Range Voting. To rate each project drag the cursor below the project on the ballot to rate the project 0-9. You must move the cursor - until you move it you will be giving the project a score of 0. If you would like to rate the project a 5, drag the cursor away and back to 5 so the vote counts. You can find the judging requirements in STEP 4.

9 = amazing mind blowing project that best satisfies the judging requirements. You may decide the project excels in one of the judging requirements more than another.
.
.
5 = the project may vaguely satisfy the judging requirements, or it may only satisfy 1-2 of the judging requirements.
.
.
0 = Doesn't satisfy any of the judging requirements.

3. Scores are automatically saved: Once you've added an instructable to the ballot and scored it, it's safe!

What matters for the judging is the status of your ballot when judging closes. You can come back later to do more or change your scores. Just make sure to save your ballot so it gets counted.

Step 4: Judging Requirements

Judges should use the following criteria when judging each finalist. It is not meant to be used as a rubric, but more of a guideline to critically evaluate and compare contest finalists. As the judge you decide if an Instructable adheres to the judging criteria and how to apply the criteria to the specific contest you are judging.

Subject:
Project best represents the theme of the contest. This is very important, because a project may be extremely creative and well documented (and the most ingenious project of the finalists), but if it doesn't best fit in line with the theme it should be strictly penalized.

Clarity:
Explanations and directions are coherent and intelligible. The order of instructions should make sense so someone could follow along and duplicate the project. It doesn't need to be written for every skill level, but should be accessible by the audience that uses the technology or skill implemented in the project.

Ingenuity and Creativity:
The project implements a clever and creative design. Project explores an area of study that is not well documented or presents a solution to a problem that is not well defined. A stand out project doesn't have to re-invent the wheel, but it benefits to have an element of uniqueness that sets it apart from similar types of projects. The project presents a practical solution that may not otherwise be apparent.

Quality of Presentation:
Projects should be broken into easily understood steps (or stages/processes for Photo and Video). There should be an appropriate amount of text describing each step completely (the feature checklist hits this very well.) All pictures, diagrams, and sketches should ideally be the author's own work. Visually the project pictures should accurately represent the project and be easily understood by readers who may not be familiar with the concept.

Execution of the Instructable
Intro image fits and explains the project. The narrative should engage and educate the reader, and complex areas of discussion should have enough detail and external links to guide the reader through your project and onto further reading if required. The entire project should be understood by someone not intimately familiar with the material. The tone should aim to educate and entertain.

Step 5: Common Judging Questions

How many projects should I judge?
You do not have to judge all the finalists, but it is good practice to do so. If you only judge your favorite entries with high scores and leave the rest off the ballot it doesn't recognize entries in the middle of the pack. Those entries may be deserving of second place or runner up prizes, but may get pushed to the bottom of the list.

For best results, judge all the projects against the judging requirements and against each other for the optimal winner outcome.

What happens if I don't give a project a score?
By leaving a project off the ballot you are NOT giving it a 0. When you don't vote for a project it doesn't register any score in the database. Only giving a project a value of 0-9 will affect a change.

What do I need to do in a contest that has Judges' Prizes?
Simple answer: nothing! Judge every entry as you would normally. Staff keep track of entries that are eligible for a Judges' Prize and will assign them accordingly after all judge scores are tallied.

Step 6: Example Judging Process

Here is a mock judging process for a Holiday Gifts Contest.

Keep in mind, this is MY PERSPECTIVE as a judge and how I judge entries against the judging requirements. Every judge is different and interprets the judging requirements differently. This is why we have at least 10 judges in every contest.

There is an element of "wow, awesome" that is nearly impossible to define, but is clearly visible when you see it. Such ingenuity may compensate for slight weaknesses in presentation

San Francisco Neighborhood Wood Wall Map - 5
This project gets its points for subject and ingenuity/creativity. It is great that the project includes a file which is really the bulk of the project. However, it really needs more instruction for the build of the project. It looks more complicated than just printing the file

Woodcut Silhouette Portrait - 8
This project works perfectly as a gift. It has a great story behind it and is a unique idea. Although the project doesn't give instructions for manipulating the photo, it links to a tutorial - no need to re-explain these steps if there is a great tutorial that exists elsewhere. I knocked it down a point because the last step doesn't throughly explain the gluing process.

Suitcase Picnic Table - 9
This project hits all the criteria spot on. It would make a fantastic gift for any family member or friend. It is a new spin on suitcase repurposing - I haven't seen anything like it. It is broken down into appropriate steps and every step is explained in great detail. It is obvious that the project actually works and has been used.

Fish Skeleton Earrings - 3
These earrings would make a great gift for almost any lady, and it's wonderful that the files for lasercutting them are included. Because they're lasercut, though, there's not too much in the way of documentation. While the presentation is good and the pictures are clear, it's not as comprehensive as most. The project is also not the most creative - fish bone earrings have been around for quite a while now!

Custom Wood Clothing Hanger - 6
This is a clever and unique idea that would make a great gift for expecting parents or for people you know that just love clothes. The files for lasercutting have been included (three different ones!) and the photos are great. While this project suffers from the same lack of documentation like the fish skeleton earrings, it gets higher marks thanks to being clever and the fact that it can be easily customized.

Fringe Necktie - 4
This project gets points for documentation. However, in the first step it says it is based on an item that already exists - thus not very creative. Its also a very generic gift (especially compared to the other gifts on this list). Some of the pictures are blurry.

Step 7: Guides for Writing a Great Instructable

Check out jessy ratfink's How to Write an Instructable Class!

You can also check out our Help Center to learn more about the site and our Featuring Guidelines.

Be the First to Share

    Recommendations

    • Tiny Things Speed Challenge

      Tiny Things Speed Challenge
    • Laser Challenge

      Laser Challenge
    • Paint Challenge

      Paint Challenge

    27 Comments

    0
    Maria Ravandiel
    Maria Ravandiel

    6 months ago

    I'd give this instructive a high mark! ;) Very clear!! thanks so much for the instructions: I was a little confused about how I should help judge contests

    0
    ShadowRoch
    ShadowRoch

    5 years ago

    Really Helpful. Thank you!

    0
    SalikW
    SalikW

    5 years ago

    thanks guys :)

    0
    muthucool
    muthucool

    5 years ago

    This is a great guide for beginners, helped me out a lot. Thanks!!

    0
    DoggyMANIA6105
    DoggyMANIA6105

    5 years ago

    can you judge more than one contests at a time if your asked to?

    0
    psychomiriam
    psychomiriam

    5 years ago

    First time judge contest ...this well be fun..just send a email when,were,time and ill be there lol.

    thank you

    0
    KelvinA7
    KelvinA7

    5 years ago

    This would be my first timer to judge the contest :)

    0
    KristinM5
    KristinM5

    5 years ago

    Thanks. I'm judging my first contest now. And now I know how!

    0
    Mineteep
    Mineteep

    6 years ago

    No, juges are not always staff. Im a juge and not a staff you will get a email saying that the instructables staff saying thay want you to juge a contest :).

    0
    amandabestor
    amandabestor

    7 years ago on Introduction

    Are there any requirements for being a judge? (Like how you can qualify)

    0
    shazni
    shazni

    7 years ago on Introduction

    Wow, pretty impressive. Hope everyone judges accourdingly

    0
    heathbar64
    heathbar64

    7 years ago on Introduction

    Please elucidate. you say the scores are saved automatically, but next paragraph says to be sure to save your ballot so it will be counted.

    0
    darman12
    darman12

    8 years ago on Introduction

    This is very helpful. It will help while making future 'ibles because it shows exactly how they are judged. Thanks for illuminating :)

    How long does it usually take to announce the winners after the entry window has closed?

    0
    jessyratfink
    jessyratfink

    Reply 7 years ago on Introduction

    It normally takes 1-2 weeks, depending on the contest. I try really hard to always announce them about a week after, but sometimes things can get slowed down if we're working with a big sponsor or the contest gets tons of entries and needs a longer judging period. :)

    0
    falk
    falk

    8 years ago on Introduction

    So what makes the finals is determined solely by popular vote?

    0
    jessyratfink
    jessyratfink

    Reply 8 years ago on Introduction

    Nope! Normally that will only account for half at most. We try our best to scour all the entries for finalists, not just those who end up at the top because of votes. :D

    0
    vanweb
    vanweb

    8 years ago on Introduction

    This is great for us wondering how the judging process works once the finalists are picked. But what I (and others I am sure) are very curious about is the process of getting from all entrants down to those finalists...

    I know votes count for part of it but I have seen finalists with very low page views (and by extrapolation probably lower votes) than projects with 10's of thousands of hits that do not make the finals. The "legal-ese" usually states that 49% are chosen by votes and the rest by the judges. But on large contests with ~500 entries how is that 51% chosen and how many judges does it take for this daunting task?

    Just curious :-)

    0
    jessyratfink
    jessyratfink

    Reply 8 years ago on Introduction

    This varies a lot! Sometimes it's just a couple of folks picking the winners, sometimes it's the whole editorial team fighting over it. Sometimes employees of the company sponsoring the contest get involved too.

    Everyone on staff has a different thing they look for when it comes to finalists, so we've always got something to talk about. ;)

    On average, it normally takes 2-3 days to pick finalists.