Practical field guide
Make better use of a council of AI models.
Learn how to frame decisions, configure deliberation, control cost, design experiments, run benchmarks, and interpret results. These 58 guides explain both what to do and what not to infer.
Getting started
From the first question through follow-ups, maps, model choice, and cost controls.
Rate a completed decision, record how it affected your thinking, and download an auditable report.
Read guide →How to ask a better decision questionTurn a vague concern into a concrete question that an AI council can analyze from several perspectives.
Read guide →How to choose models for an AI councilSelect a useful mix of OpenAI, Gemini, Claude, Grok, and DeepSeek models without adding diversity for its own sake.
Read guide →Run your first AI councilA practical walkthrough from entering a question to reading the synthesis and token receipt.
Read guide →Use the Consideration MapRead distinct considerations, supporting evidence, materiality, disagreement, and verification status after a council run.
Read guide →Continue a decision with follow-up questionsUpdate a council recommendation when you learn new facts without starting the reasoning from scratch.
Read guide →Estimate and control LLM costsUnderstand free estimates, prepaid credits, retry-aware reservations, final token charges, and result release.
Read guide →Everyday decisions
Concrete ways to widen the decision space around consequential personal choices.
Analyze compensation, meaning, advancement, commute, risk, family effects, and reversibility before changing jobs.
Read guide →Evaluate a leadership role or promotionUse deliberation to weigh authority, compensation, service burden, politics, staff quality, and long-term career effects.
Read guide →Think through a relationship decisionOrganize emotions, recurring patterns, needs, safety, repair attempts, and future compatibility without pretending AI replaces human support.
Read guide →Decide whether to move to a new cityCompare work, housing, commute, community, family, climate, schools, and reversibility in a relocation decision.
Read guide →Compare degrees, certificates, and education optionsEvaluate educational choices using career value, learning goals, debt, time, completion risk, and alternative paths.
Read guide →Analyze a major purchaseUse a council to test affordability, alternatives, total ownership cost, timing, and downside risk before a major purchase.
Read guide →Use live evidence modeAsk the Council to retrieve current sources before deliberating and preserve the source list with the run.
Read guide →Work and teams
Structured analysis for strategy, hiring, roadmaps, risk, disagreement, and policy.
Compare strategic options using objectives, evidence, capabilities, competitors, implementation constraints, and explicit uncertainty.
Read guide →Support a hiring decision responsiblyStructure job-related evidence and tradeoffs while keeping humans accountable and avoiding sensitive or protected information.
Read guide →Prioritize a product roadmapCompare product initiatives using customer value, evidence, effort, strategic fit, risk, and sequencing dependencies.
Read guide →Run a decision pre-mortemAsk an AI council to imagine a failed plan, identify plausible causes, and convert them into mitigations and stop rules.
Read guide →Map a stakeholder disagreementUse models to represent competing positions, uncover shared assumptions, and identify evidence that could move a dispute.
Read guide →Analyze a policy proposalExamine policy goals, mechanisms, affected groups, implementation, evidence, unintended effects, and alternatives.
Read guide →Research design
Turn model discussions into explicit, matched, and reproducible experimental conditions.
Copy a complete design safely, test one benchmark item end to end, and scale only after the path passes.
Read guide →Design an LLM deliberation experimentMove from an interesting council demonstration to a reproducible comparison with explicit conditions and outcomes.
Read guide →Define outcomes and dependent variablesUse the Outcome Builder to define what will be measured, when, at what unit, and with which scoring rule.
Read guide →Configure experimental conditions and independent variablesControl model rosters, turns, information sharing, order, roles, prompts, parameters, aggregation, and failure handling.
Read guide →Compare deliberation with homogeneous reconsiderationDesign the key comparison between models exchanging information and repeated same-model reasoning under matched exposure.
Read guide →Build an independent model ensembleCollect several model answers without peer exposure, then aggregate them by vote, confidence, judge, or no aggregation.
Read guide →Use randomization, replications, and compute matchingSet assignment units, reproducible seeds, repeated trials, blocking, and fair compute constraints across conditions.
Read guide →Participant studies
Measure how deliberative, non-deliberative, human, and hybrid interactions affect people.
Randomly assign people to deliberative or non-deliberative AI interactions and measure what changes afterward.
Read guide →Design pre- and post-interaction questionnairesMeasure baseline beliefs and later outcomes without losing the transcript or confusing participants at the transition.
Read guide →Choose Likert, slider, and questionnaire formatsMatch response controls to the construct being measured and produce outputs that remain interpretable.
Read guide →Add attention, manipulation, and exposure checksDistinguish whether participants received, noticed, and understood the assigned interaction without hiding exclusions.
Read guide →Analyze and export participant-study resultsUse complete summaries and structured exports for outcomes, change scores, checks, assignments, and transcripts.
Read guide →Build a composable experiment timelineArrange consent, baseline measurement, stimuli, assigned interaction, process tasks, final outcomes, and debriefing in a clear participant journey.
Read guide →Measure human–AI advice relianceMeasure whether people retain or revise an answer after solo AI, council, hybrid, or human advice.
Read guide →Add process tracing and cognitive tasksCollect interpretable timing and task-performance diagnostics without invasive surveillance.
Read guide →Run a human deliberation conditionInsert live human contributors into an experimental conversation and compare human deliberation with AI conditions.
Read guide →Build a human–AI hybrid deliberation chainPlace one or more people between model turns to study mixed human–AI reasoning and influence.
Read guide →Run a text, image, or video stimulus experimentShow participants standardized communication material before assigning solo-AI, council, human–AI, or human interaction conditions.
Read guide →Run a learning and tutoring experimentCompare solo, Council, human, human–AI, scripted-feedback, and no-tutor conditions using immediate, transfer, and delayed learning outcomes.
Read guide →Plan a powered participant studyUse measurement packs, a transparent sample-size approximation, a pre-launch audit, and a machine-readable variable codebook.
Read guide →Monitor recruitment, cost, and attritionUse the experiment activity dashboard to detect drop-off, failed calls, retention loss, and budget pressure while a study is live.
Read guide →Behavioral games
Configure classic strategic games for human, model, and mixed groups with auditable payoffs.
Configure established strategic-interaction games for human, model, and mixed groups with auditable payoffs.
Read guide →Run a Dictator GameStudy unilateral allocation choices between human or model players with explicit endowments and recipients.
Read guide →Run an Ultimatum GameStudy offers and acceptance decisions when rejection eliminates the proposed split.
Read guide →Run a Trust or Investment GameMeasure investment and return behavior after a transferred amount is multiplied.
Read guide →Run a Prisoner’s DilemmaCompare cooperation and defection under a payoff matrix that preserves the game’s strategic ordering.
Read guide →Run a Public Goods GameStudy contributions to a shared pool among two to eight human, model, or mixed participants.
Read guide →Run a Stag Hunt GameStudy coordination between a high-value joint outcome and a safer individual action.
Read guide →Configure game payoffs, incentives, and feedbackSet experimental units, dollar displays, payoff parameters, repeated rounds, and information visibility without changing the intended mechanism accidentally.
Read guide →Manage private game links, consent, and completionDistribute one-time seat links safely, record consent, monitor progress, and handle incomplete sessions responsibly.
Read guide →Benchmarks and results
Choose datasets, preserve provenance, score outcomes, visualize uncertainty, and share the record.
Choose item counts, categories, reasoning levels, jurisdictions, sampling methods, and seeds without changing source questions.
Read guide →Run MMLU-Pro in AI DeliberatorUse MMLU-Pro categories to test difficult multiple-choice reasoning under controlled council conditions.
Read guide →Run PolicyBench for public-policy reasoningStudy policy understanding and application using the preserved U.S. PolicyBench configuration and structured facets.
Read guide →Run CogToM for social cognitionTest beliefs, intentions, emotions, knowledge states, deception, and perspective-taking with canonical or five-variant scoring.
Read guide →Create and read 95% confidence-interval plotsTurn selected outcomes into editable whisker plots and interpret estimates, uncertainty, titles, notes, and labels responsibly.
Read guide →Collaborate and preserve a reproducible experiment recordInvite collaborators, keep owner billing intact, lock manifests, preserve source revisions, and retain an auditable run history.
Read guide →Analyze sentiment and quantitative text metricsCompare human and model language using automatic VADER sentiment and transparent descriptive counts.
Read guide →Compare two Council runsPlace two released answers, consideration maps, disagreements, token totals, and costs side by side without another model call.
Read guide →