Here is a deliberately flawed item that any experienced reviewer would send straight back to its writer, and it shows what remote assessment developer jobs actually demand. Read it the way a weak but test-wise ninth grader would:
Which of the following is a renewable source of energy?
- A. Coal
- B. Natural gas
- C. Solar power, which is constantly replenished by sunlight and will not run out
- D. Crude oil
Advertisement
The student who knows nothing about energy still picks C. It is twice the length of the other three options; it is the only one with a qualifying clause, and "replenished" and "will not run out" quietly restate the word "renewable" from the stem. The three distractors are also all fossil fuels, so they cluster together and the odd one out announces itself. That is four separate clues in one item, and catching them before a student ever sees it is most of this job.
What remote assessment developer jobs involve in edtech
An assessment developer writes and revises the questions that go into tests: multiple-choice items, constructed-response tasks, and the scoring rubrics that go with them. In edtech, that feeds practice platforms, benchmark tests, and certification exams. You also build test blueprints, import finished items into an item bank in QTI format, and sit down with psychometricians to read field-test statistics and decide which items to retire. For the record: full-time, open worldwide, $80,000 USD per year.
The next six sections follow one item from an empty blueprint cell to its field-test numbers.
Slot 14 on the blueprint
Nothing gets written until the blueprint says it should. A blueprint is the table that tells you, for a given form, how many items cover each standard, at what cognitive level, and in which format. Say it calls for eight items on Standard 7.RP.2, two of them at the "analyze" level, one constructed-response. Slot 14 is one of those analyze-level multiple-choice items. Before drafting, check the bank so you don't write a fifth near-copy of an existing question. You build blueprints like this yourself, too.
Stem first, key second
A good stem poses a complete problem. Cover the options with your hand: if a capable student could not answer it from the stem alone, the stem is too vague. Keep stems positive where possible; "Which is NOT..." mostly measures careful reading.
The key must be correct and defensibly the only correct answer. Write it at the same length and grammatical shape as the options it will sit beside. That single habit would have fixed the solar power item above.
Three wrong answers that earn their place
This is often the hardest part. A distractor should be wrong for a reason a real student would fall for. For the proportional reasoning item, that might be the answer you get by adding instead of multiplying, or by inverting the ratio. Each distractor maps to a known misconception, so a teacher looking at the response data learns why a student missed it.
Common problems in drafts: "all of the above," absurd options, and overlapping options where two are technically right. For constructed-response items, the equivalent is a rubric where two scorers can reliably tell a 2 from a 3.
Editorial and bias review
Once drafted, the item moves through a review workflow. Content reviewers check accuracy and alignment. Editors check style and reading load against the program's guide. A bias and sensitivity panel then asks whether the context disadvantages any group: a word problem about ski lift tickets assumes a lot about a student's life. You revise, respond to every comment, and resubmit.
Deadlines in this kind of work are firm. Item writing often runs in batches tied to a form's build schedule, so a cycle might, for example, give you two weeks to draft a set, a few days to turn around reviewer comments, and a fixed lock date after which nothing changes.
Into the item bank as QTI
Approved items get entered into the item bank, usually as QTI (Question and Test Interoperability) packages so they move cleanly between authoring systems and test delivery platforms. You attach metadata: standard code, depth of knowledge, key, rationale for each distractor, accessibility notes, word count. A mislabeled standard code can put an item on the wrong form for years, which is why attention to detail appears in the qualifications.
Field testing and the statistics that come back
New items are usually embedded unscored in live forms so real students answer them. Then the psychometricians send back the numbers, and you read them together. The p-value tells you the proportion who answered correctly; a value of 0.95 on an item meant to be hard says something went wrong. The point-biserial correlation tells you whether stronger students chose the key more often than weaker ones. Distractor analysis shows how many picked each wrong option. A distractor chosen by almost nobody is not doing its job; one chosen more often by high scorers than the key may mean the key is arguable. DIF flags show whether comparable students from different groups performed differently.
From there, the team accepts the item, sends it back for revision, or retires it.
Teachers, item writers and the psychometrics bonus
The assessment developer job description here asks for a degree in education, a content subject or measurement, plus three or more years of writing test items or teaching. Graduate coursework in psychometrics is valued, and for good reason: a course in classical test theory and item response theory makes those statistics meetings much shorter. Core assessment-developer skills include item-writing guidelines, blueprints, bias review, QTI item-bank tools, and sharp editing.
Teachers are well placed to make the switch. You already write quizzes and know which misconceptions return every year. What needs work is writing to a style guide and accepting data that says a question you liked is weak. If you are a teacher wondering how to become an assessment developer, a university measurement class works as an assessment developer course, and published item writing guides help. No particular assessment developer certification is required.
The line between measuring and teaching
An instructional designer builds the learning: modules, activities, sequence. An assessment developer measures whether learning happened and answers to item statistics and alignment reviews. They often collaborate, but their daily work differs.
The $80,000 salary, stated once
For this listing, the assessment developer salary is $80,000 USD per year, paid for full-time work. Like most assessment developer jobs remote worldwide, the role is open to applicants anywhere. Any other assessment developer salary you see quoted belongs to that employer's offer, not this one.
A sample-item portfolio worth attaching
Many hiring teams in this field ask for samples or set a writing test. Pick two standards in your subject and prepare:
- Four multiple-choice items with a one-line rationale for every distractor, naming the misconception it targets.
- One constructed-response task with a full rubric and two annotated sample responses at different score points.
- A before-and-after page showing a flawed item (like the solar one above) and your revision.
- A short mini-blueprint table showing how your items would sit on a form.
Three years of item writing or teaching puts this post above beginner level. If you are looking at entry-level remote assessment developer jobs or assessment developer jobs with no experience elsewhere, a portfolio like this plus classroom experience is still strong evidence. On your assessment developer resume, list subjects, grade bands, item types, and review panels. Common assessment developer interview questions ask you to critique an item live or explain a low point-biserial.
On AI item generation: drafting tools already produce exactly the clued, lopsided options in the solar item, which raises the value of people who can review and fix them.
Who hires item writers, and what to send
Testing and certification providers, K-12 assessment vendors, publishers of learning materials, credentialing bodies, and edtech platforms with practice or quiz products recruit item writers through testing and certification. Like other assessment developer work-from-home jobs, it makes sense to include your resume, the portfolio, and a note on which subjects and grade levels you write for. You will not pay anything to apply, and a "processing fee" request is the mark of a scam. Remote assessment developer jobs hiring now can close quickly, so send a complete application the first time.
