Skip to content
Menu

Set up a programming question

Updated November 13, 2026

A programming question asks the candidate to write code in the browser. Skillmeter runs it against your test cases and scores it automatically. Programming questions are included in the Growth and Scale plans and in the free trial.

Create the question

  1. In the test editor, click Add question and choose Programming.

  2. Write the task in Question. Say what the program reads from standard input and what it must print.

  3. Under Languages candidates can use, choose one or more languages. Candidates pick one of them in the editor.

  4. Optionally, add Starter code for each language, for example a function signature or the code that reads the input.

  5. Add Visible examples: an input, the expected output and an optional explanation. Candidates see them with the task.

  6. Add Hidden test cases: for each one, an Input (stdin), the Expected output (stdout) and a Weight. Give edge cases and performance cases their own test cases, so the score shows how far the solution goes.

  7. Choose how output is compared: Ignore trailing whitespace (recommended) or Exactly.

  8. Set the points and save.

How it’s scored

The score is the weighted share of the hidden test cases the code passes. With three test cases weighted 1, 1 and 2, passing the first two earns half the points.

Hidden test cases never reach the candidate’s browser, so they can’t be read from the page.

When code quality matters as well as correctness, turn on Also ask a reviewer. The automatic score is kept, and the answer is flagged for a colleague to review. See Reviewing and scoring answers.

Tips

  • Turn on Desktop required in Test settings: writing code on a phone is hard.
  • Test your own solution with Preview before you invite anyone.
  • The languages, time limits and memory limits are listed in the programming tests FAQ.

Back to the knowledge base