# Questions-first workshop experiment: retained evidence

Token & Taste, 16 October 2026. Synthetic scenario; no real participants or private paperwork.

A answered an incomplete brief directly. B asked five questions. C used B’s questions and the answer bank frozen before A. D received the same useful answer-bank facts up front and answered without a question step. D was run on 15 October, three days after A–C. The comparison is qualitative and post hoc, with one output per final path.

All runs used Codex CLI with model `gpt-5.6-sol` in fresh sessions. The CLI did not expose a controllable temperature setting. These outputs do not measure workshop outcomes or establish that questions independently improve quality.

## Condition A input

```text
You are doing one standalone writing task. Use no tools. Return only the requested deliverable.

Plan a small community workshop about using AI to organize household paperwork. Provide a concise outline with activities and a take-home item.
Complete the outline immediately. State assumptions where necessary.
```

## Condition A raw output

```text
## Plan

**Workshop:** AI for Household Paperwork
**Length:** 75 minutes | **Group:** 8–15 adults

**Assumptions:** Participants bring a phone or laptop and sample documents with sensitive details removed. No prior AI experience is required.

**Goals**

- Organize bills, receipts, warranties, and household records.
- Create clear file names and folder structures.
- Use AI safely without sharing personal or financial information.

**Activities**

1. **Welcome and safety basics — 10 min**
   Identify information that should never be entered into public AI tools.

2. **Paperwork sorting exercise — 15 min**
   Sort sample documents into “keep,” “act,” “archive,” and “shred.”

3. **AI prompt demonstration — 15 min**
   Turn a generic document list into suggested categories, file names, and retention reminders.

4. **Build a household system — 25 min**
   Participants create a folder structure and monthly paperwork checklist using fictional or redacted examples.

5. **Review and questions — 10 min**
   Share systems, troubleshoot prompts, and confirm privacy practices.

**Take-home item**

A one-page “Household Paperwork Starter Kit” containing:

- A recommended folder structure
- Safe sample AI prompts
- A monthly checklist
- A sensitive-information redaction guide

## Changes

Created the requested workshop outline; no files changed.

## Verification

Confirmed the outline includes activities, timing, assumptions, safety guidance, and a take-home item.

## Risks/Rollback + Next Step

Main risk: participants may expose sensitive data. Require fictional or fully redacted documents throughout. Next step: prepare sample paperwork and print the starter kit.
```

## Condition B input

```text
You are doing one standalone writing task. Use no tools. Return only the requested deliverable.

Plan a small community workshop about using AI to organize household paperwork. Provide a concise outline with activities and a take-home item.
Before producing the outline, ask the five questions whose answers would most materially improve it. Return only the five questions.
```

## Condition B raw output

```text
1. Who is the workshop for, and how comfortable are they with AI and digital tools?

2. How long will the workshop be, and approximately how many people will attend?

3. What devices, internet access, and AI tools will participants have available?

4. Which paperwork tasks matter most—scanning, naming files, summarizing documents, tracking deadlines, budgeting, or something else?

5. What privacy or accessibility needs should the workshop and take-home item address?
```

## Condition C input

```text
You are doing one standalone writing task. Use no tools. Return only the requested deliverable.

Plan a small community workshop about using AI to organize household paperwork. Provide a concise outline with activities and a take-home item. The questions below were asked in a prior independent run. Use the predefined answers; do not invent missing facts. State remaining assumptions.

Exact questions:
1. Who is the workshop for, and how comfortable are they with AI and digital tools?

2. How long will the workshop be, and approximately how many people will attend?

3. What devices, internet access, and AI tools will participants have available?

4. Which paperwork tasks matter most—scanning, naming files, summarizing documents, tracking deadlines, budgeting, or something else?

5. What privacy or accessibility needs should the workshop and take-home item address?

Answers frozen before any run:
1. Eight adults with mixed digital confidence; most use a phone rather than a laptop.
2. 45 minutes in a library room; eight attendees.
3. A projector is available. No participant accounts are required. Internet availability and specific AI tool are not stated.
4. Demonstrate sorting a fictional set of bills and letters into a simple action list. Do not upload real private documents.
5. Do not give legal or financial advice. Verify dates and amounts against originals. Specific accessibility accommodations were not supplied.
Additional frozen success criterion: each person leaves with a paper checklist for trying the method on the fictional sample and can name one decision AI must not make for them.
```

## Condition C raw output

```text
1) Plan

**Goal:** Run a 45-minute library workshop for eight adults with mixed digital confidence, showing how AI can turn fictional household bills and letters into a simple action list.

**Success criteria:**

- Participants complete the method using fictional documents only.
- Each person leaves with a paper checklist.
- Each person can name one decision AI must not make for them.
- Participants understand that dates and amounts must be checked against originals.

**Workshop outline:**

- **0–5 minutes — Welcome and boundaries**
  - Explain what AI can and cannot do.
  - Rule: never upload real private documents during the workshop.
  - AI does not provide legal or financial advice or make final decisions.

- **5–12 minutes — Facilitator demonstration**
  - Project a fictional set of bills and letters.
  - Show a prepared AI interaction that identifies document type, due date, amount, and possible next action.

- **12–27 minutes — Sorting activity**
  - In pairs, participants sort paper samples into: **Act now**, **Review later**, and **File**.
  - Pairs create a short action list, then compare it with the AI-generated version.

- **27–37 minutes — Accuracy check**
  - Participants verify every date and amount against the fictional originals.
  - Discuss mistakes, uncertainty, and what to do when AI output conflicts with a document.

- **37–43 minutes — Human-decision activity**
  - Each participant names one decision AI must not make, such as whether to pay, dispute, ignore, or sign something.

- **43–45 minutes — Wrap-up**
  - Distribute the take-home checklist and briefly review it.

2) Changes

**Take-home item: one-page paper checklist**

1. Use copies or fictional documents while learning.
2. Remove or hide personal information before using any AI tool.
3. Sort documents into **Act now**, **Review later**, and **File**.
4. Ask AI to draft an action list—not make decisions.
5. Check every name, date, amount, and deadline against the original.
6. Mark anything unclear for human review.
7. Seek qualified help for legal or financial questions.
8. Decide personally what action to take.

3) Verification

At the end, confirm that every participant:

- Has completed the checklist on the fictional sample.
- Can explain why AI output must be checked.
- Can name one decision AI must not make for them.

4) Risks/Rollback + Next step

**Remaining assumptions:**

- Because internet availability and the AI tool are unspecified, the facilitator will use prepared screenshots or printed AI output; live access is optional.
- Activities will be phone-friendly but completed primarily with paper materials.
- No specific accessibility accommodations are assumed; materials should use plain language, large readable type, high contrast, and verbal explanation where practical.
```

## Condition D input

```text
You are doing one standalone writing task. Use no tools. Return only the requested deliverable.

Plan a small community workshop about using AI to organize household paperwork. Provide a concise outline with activities and a take-home item.

All available task information is supplied upfront:
- Audience: eight adults with mixed digital confidence; most use a phone rather than a laptop.
- Format and duration: 45 minutes in a library room; projector available, no participant accounts required.
- Scope: demonstrate sorting a fictional set of bills and letters into a simple action list. Do not upload real private documents.
- Safety: no legal or financial advice; show when to verify dates and amounts against originals.
- Success: each person leaves with a paper checklist for trying the method on their own fictional sample, and can name one thing AI must not decide for them.

Complete the outline immediately. Do not ask clarifying questions. State remaining assumptions where necessary.
```

## Condition D raw output

```text
1) Plan

**Workshop: “AI as a Paperwork Sorting Assistant” — 45 minutes**

**Assumptions:** The facilitator has prepared fictional bills and letters, an account-free AI demonstration, and printed checklists. Participants work in pairs, so no devices are required.

- **0–5 min — Welcome and boundaries**
  - Explain the goal: turn fictional paperwork into a simple action list.
  - Ground rules: never upload private documents; AI does not provide legal or financial advice or make decisions for you.

- **5–10 min — Introduce the method**
  - Demonstrate four categories: **Act**, **Check**, **File**, and **Discard**.
  - Show the desired action-list fields: document, action, due date, amount, and “needs verification.”

- **10–20 min — Projected demonstration**
  - Review a fictional bill and letter with the group.
  - Enter only fictional text into AI and ask it to sort the items and draft an action list.
  - Compare every date and amount with the fictional originals, correcting any errors.

- **20–32 min — Paired sorting activity**
  - Give each pair a small fictional paperwork set.
  - Participants sort it into the four categories and write an action list.
  - Invite pairs to identify anything unclear or requiring human judgment.

- **32–39 min — Compare with AI**
  - Demonstrate AI’s suggested list for the same sample.
  - Discuss differences, omissions, and invented details.
  - Reinforce: AI may organize information, but people decide whether to pay, respond, discard, dispute, or seek qualified help.

- **39–43 min — Safety check**
  - Each participant names one thing AI must not decide for them.
  - Examples: whether a charge is valid, whether to ignore a letter, or whether legal or financial action is appropriate.

- **43–45 min — Take-home handoff**
  - Distribute and briefly review the paper checklist.

2) Changes

**Take-home item: “Paperwork-to-Action Checklist”**

- Use fictional or fully anonymized samples while learning.
- Remove names, addresses, account numbers, barcodes, and other identifiers.
- Sort each item: **Act / Check / File / Discard**.
- Ask AI to suggest: item type, possible action, date, amount, and questions.
- Compare all dates and amounts with the original.
- Mark missing or uncertain information.
- Make the final decision yourself.
- Seek a qualified person when legal or financial guidance is needed.
- Never upload real private documents to an unapproved AI service.

3) Verification

Success check before participants leave:

- Each person has the printed checklist.
- Each person has completed an action list from fictional paperwork.
- Each person can name one decision AI must not make for them.

4) Risks/Rollback + Next step

- **Risk:** Participants may trust an inaccurate summary. **Mitigation:** Require checking dates and amounts against originals.
- **Risk:** Participants may later upload private paperwork. **Mitigation:** Repeat the privacy rule during the opening, demonstration, and handout.
- **If the demonstration fails:** Use a preprinted fictional AI response and complete the comparison activity offline.
- **Next step:** Participants practice at home using a new fictional sample before applying the method to sensitive paperwork.
```
