Skip to content

Add seeded Text LLM sampling - #9451

Open
JPPhoto wants to merge 1 commit into
invoke-ai:mainfrom
JPPhoto:add-seed-to-text-llm-nodes
Open

Add seeded Text LLM sampling#9451
JPPhoto wants to merge 1 commit into
invoke-ai:mainfrom
JPPhoto:add-seed-to-text-llm-nodes

Conversation

@JPPhoto

@JPPhoto JPPhoto commented Aug 3, 2026

Copy link
Copy Markdown
Collaborator

Summary

Adds controlled seeded sampling to the Text LLM and Text LLM with System Prompt Preset nodes.

  • Exposes a validated seed input and bumps both nodes to version 1.1.0.
  • Uses invocation-local generators to prevent concurrent requests from interfering with each other's RNG state.
  • Preserves varied Expand Prompt results by selecting a fresh seed per request.
  • Documents seed behavior and reproducibility boundaries.

Related Issues / Discussions

Discord.

QA Instructions

  1. Run:
    pytest -n auto --no-cov tests/backend/text_llm tests/app/invocations/test_text_llm_with_preset.py
  2. Confirm all tests pass.
  3. Run the same Text LLM node twice with identical inputs and seed; confirm identical output on the same platform.
  4. Change the seed; confirm sampling can produce different output.
  5. Run concurrent seeded CPU sampling; confirm each request matches its isolated sequence.

Merge Plan

Checklist

  • The PR has a short but descriptive title, suitable for a changelog
  • Tests added / updated (if applicable)
  • ❗Changes to a redux slice have a corresponding migration
  • Documentation added / updated (if applicable)
  • Updated What's New copy (if doing a release after this PR)

@github-actions github-actions Bot added api python PRs that change python files invocations PRs that change invocations backend PRs that change backend files frontend PRs that change frontend files python-tests PRs that change python tests docs PRs that change docs labels Aug 3, 2026
@JPPhoto
JPPhoto force-pushed the add-seed-to-text-llm-nodes branch 3 times, most recently from 98a5a14 to 380663b Compare August 3, 2026 17:52
@JPPhoto JPPhoto moved this to 6.14.1: Bug fixes to 6.14.0 in Invoke - Community Roadmap Aug 3, 2026
@JPPhoto JPPhoto added 6.14.0 and removed 6.14.1 labels Aug 4, 2026
@JPPhoto JPPhoto moved this from 6.14.1: Bug fixes to 6.14.0 to 6.14.x Theme: USER EXPERIENCE in Invoke - Community Roadmap Aug 4, 2026
@JPPhoto
JPPhoto force-pushed the add-seed-to-text-llm-nodes branch 2 times, most recently from c46eb2b to 07a5af3 Compare August 5, 2026 16:20
@JPPhoto
JPPhoto force-pushed the add-seed-to-text-llm-nodes branch from 07a5af3 to b294a7f Compare August 5, 2026 17:48
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

6.14 Nice-to-Have 6.14.0 api backend PRs that change backend files docs PRs that change docs frontend PRs that change frontend files invocations PRs that change invocations python PRs that change python files python-tests PRs that change python tests

Projects

Status: 6.14.x Theme: USER EXPERIENCE

Development

Successfully merging this pull request may close these issues.

2 participants