AI Deliberator
Guides
How to use AI DeliberatorView all 58 guides

Getting started

Evaluate and export a Council runHow to ask a better decision questionHow to choose models for an AI councilRun your first AI councilUse the Consideration MapContinue a decision with follow-up questionsEstimate and control LLM costs

Everyday decisions

Use an AI council for a career changeEvaluate a leadership role or promotionThink through a relationship decisionDecide whether to move to a new cityCompare degrees, certificates, and education optionsAnalyze a major purchaseUse live evidence mode

Work and teams

Use deliberation for a business strategy decisionSupport a hiring decision responsiblyPrioritize a product roadmapRun a decision pre-mortemMap a stakeholder disagreementAnalyze a policy proposal

Research design

Duplicate and pilot an experimentDesign an LLM deliberation experimentDefine outcomes and dependent variablesConfigure experimental conditions and independent variablesCompare deliberation with homogeneous reconsiderationBuild an independent model ensembleUse randomization, replications, and compute matching

Participant studies

Build a participant interaction studyDesign pre- and post-interaction questionnairesChoose Likert, slider, and questionnaire formatsAdd attention, manipulation, and exposure checksAnalyze and export participant-study resultsBuild a composable experiment timelineMeasure human–AI advice relianceAdd process tracing and cognitive tasksRun a human deliberation conditionBuild a human–AI hybrid deliberation chainRun a text, image, or video stimulus experimentRun a learning and tutoring experimentPlan a powered participant studyMonitor recruitment, cost, and attrition

Behavioral games

Design a behavioral economics gameRun a Dictator GameRun an Ultimatum GameRun a Trust or Investment GameRun a Prisoner’s DilemmaRun a Public Goods GameRun a Stag Hunt GameConfigure game payoffs, incentives, and feedbackManage private game links, consent, and completion

Benchmarks and results

Select benchmark questions and subsetsRun MMLU-Pro in AI DeliberatorRun PolicyBench for public-policy reasoningRun CogToM for social cognitionCreate and read 95% confidence-interval plotsCollaborate and preserve a reproducible experiment recordAnalyze sentiment and quantitative text metricsCompare two Council runs
Workspace

Practical field guide

Make better use of a council of AI models.

Learn how to frame decisions, configure deliberation, control cost, design experiments, run benchmarks, and interpret results. These 58 guides explain both what to do and what not to infer.

01

Getting started

From the first question through follow-ups, maps, model choice, and cost controls.

02

Everyday decisions

Concrete ways to widen the decision space around consequential personal choices.

03

Work and teams

Structured analysis for strategy, hiring, roadmaps, risk, disagreement, and policy.

04

Research design

Turn model discussions into explicit, matched, and reproducible experimental conditions.

05

Participant studies

Measure how deliberative, non-deliberative, human, and hybrid interactions affect people.

Build a participant interaction study

Randomly assign people to deliberative or non-deliberative AI interactions and measure what changes afterward.

Read guide →
Design pre- and post-interaction questionnaires

Measure baseline beliefs and later outcomes without losing the transcript or confusing participants at the transition.

Read guide →
Choose Likert, slider, and questionnaire formats

Match response controls to the construct being measured and produce outputs that remain interpretable.

Read guide →
Add attention, manipulation, and exposure checks

Distinguish whether participants received, noticed, and understood the assigned interaction without hiding exclusions.

Read guide →
Analyze and export participant-study results

Use complete summaries and structured exports for outcomes, change scores, checks, assignments, and transcripts.

Read guide →
Build a composable experiment timeline

Arrange consent, baseline measurement, stimuli, assigned interaction, process tasks, final outcomes, and debriefing in a clear participant journey.

Read guide →
Measure human–AI advice reliance

Measure whether people retain or revise an answer after solo AI, council, hybrid, or human advice.

Read guide →
Add process tracing and cognitive tasks

Collect interpretable timing and task-performance diagnostics without invasive surveillance.

Read guide →
Run a human deliberation condition

Insert live human contributors into an experimental conversation and compare human deliberation with AI conditions.

Read guide →
Build a human–AI hybrid deliberation chain

Place one or more people between model turns to study mixed human–AI reasoning and influence.

Read guide →
Run a text, image, or video stimulus experiment

Show participants standardized communication material before assigning solo-AI, council, human–AI, or human interaction conditions.

Read guide →
Run a learning and tutoring experiment

Compare solo, Council, human, human–AI, scripted-feedback, and no-tutor conditions using immediate, transfer, and delayed learning outcomes.

Read guide →
Plan a powered participant study

Use measurement packs, a transparent sample-size approximation, a pre-launch audit, and a machine-readable variable codebook.

Read guide →
Monitor recruitment, cost, and attrition

Use the experiment activity dashboard to detect drop-off, failed calls, retention loss, and budget pressure while a study is live.

Read guide →
06

Behavioral games

Configure classic strategic games for human, model, and mixed groups with auditable payoffs.

07

Benchmarks and results

Choose datasets, preserve provenance, score outcomes, visualize uncertainty, and share the record.