Skip to main content

Review a Pilot before Expanding Use

Recompute a pilot result including review time, then document evidence, owners and conditions for a rollout decision.

Covers Claude: draft, ChatGPT: draft and Grok: draft

Draft steps have not been checked through a complete tool run. Not covered means this tutorial provides no instructions for that tool; it is not a claim that the tool lacks the capability.

What changed since this was written
  1. Check the actual account and model before starting a pilot

    The May review replaced dated OpenAI model and plan advice with current documentation links. Old model names in an article do not establish present availability.

    Recommended action: Record your account plan, model, tools and data settings. Test with made-up material, and confirm separately what API access and charges your project needs.

    Sources: OpenAI models, ChatGPT pricing, GPT-5.5 in ChatGPT, Responses API migration, OpenAI tools guide, Code Interpreter tool

Before a pilot, define the task, acceptance checks, approved environment, timing method and stop conditions. Compare like-for-like work and include correction and review time. Use the synthetic records below to prepare a decision note; these figures are not evidence of product performance.

Paste readable source text into your approved Claude conversation. Keep document IDs with the excerpts; later discussion is not part of the original evidence. Claude

Prompt to use with the required inputs

Synthetic timing records, minutes: task A end-to-end baseline 10; AI drafting 7; human checking/correction 3. Task B end-to-end baseline 12; AI drafting 8; human checking/correction 4. No approval record, control-test results or rollout conditions are supplied.

Using only these records, return baseline, drafting, checking, assisted total and difference for each task and the totals. Identify missing measurement information and do not extrapolate two tasks to the firm. Draft a decision record with evidence, unresolved questions, responsible owners, approver, conditions and stop/rollback trigger. Leave unsupplied entries unresolved; do not approve or enable rollout.

Synthetic worked example and correction

Illustrative result: baseline 22 minutes; drafting 15; checking 7; assisted total 22; recorded time saving zero. A claim of seven minutes saved omits checking and must be corrected. Compare every number with the packet. The reviewer requests control evidence and names owners before any expansion decision; this exercise does not change account settings.

Checks before use

  • Recompute task A as 7 + 3 = 10 minutes and task B as 8 + 4 = 12. Baseline and assisted totals are both 22 minutes; the recorded saving is zero, with no extrapolation to other tasks.
  • Keep missing approval, control-test evidence, owners and rollout conditions visibly unresolved. Check how incidents were detected and recorded before using an absence of reports to support a decision.

Next step

Use the linked task page for the same procedure on an approved record set. Keep the original records in the approved system; confirm unresolved information with the responsible person before any external action.

Design a Legal Review Workflow

Claude · ChatGPT · Grok Bot

You did this right if

  • Recompute task A as 7 + 3 = 10 minutes and task B as 8 + 4 = 12. Baseline and assisted totals are both 22 minutes; the recorded saving is zero, with no extrapolation to other tasks.
  • Keep missing approval, control-test evidence, owners and rollout conditions visibly unresolved. Check how incidents were detected and recorded before using an absence of reports to support a decision.

Check your understanding

Answer before opening each one. If an answer surprises you, re-read the section it came from.

  1. No incident was reported. Does that establish that wider use is safe?

    Show answer

    No. Check how incidents were detected and recorded, the tested scope and unresolved controls. Missing evidence is not a successful control test.