Skip to content

vale-ai-tells: caveat that AJ's 16x drift signal is animacy-inflated - #1952

Closed
benbalter wants to merge 1 commit into
mainfrom
vale-ai-tells-aj-animacy-caveat
Closed

vale-ai-tells: caveat that AJ's 16x drift signal is animacy-inflated#1952
benbalter wants to merge 1 commit into
mainfrom
vale-ai-tells-aj-animacy-caveat

Conversation

@benbalter

Copy link
Copy Markdown
Owner

Docs-only note in the advisory .vale-ai-tells.ini — no rule behavior changes.

A 2026-08 re-analysis (same vale-ai-tells instrument, run on the Open and Async book with finer per-era baseline buckets: 2010-13 / 14-16 / 17-18 / 19-21) turned up two things worth recording against this config's calibration:

  1. The kept-ON top drift signal, AnthropomorphicJustification (16×), is inflated by subject animacy. The rule fires on human/collective subjects ("the people doing the work", "deserve credit", "the team earns") — not anthropomorphism at all — mixed in with the genuine inanimate tell ("the spec pays for itself"). On the book, splitting the matches by subject cut it from 6.7× whole-rule to ~2.4× on the inanimate-only subset. The note recommends re-measuring the 16× on the inanimate subset before trusting it as the headline signal.
  2. FigurativeFalls / FigurativeIdioms confirmed as revived early-2010s habits — the full decade shows ~0.11/1k in 2010-13 (higher than 2026), fading to 0 by 2017. Corroborates this config's existing NB, and suggests preferring the four per-era buckets over the 2019-22-vs-2026 split for future calibration.

Nothing filed upstream to tbhb/vale-ai-tells — the one package-level FP I hit (AnthropomorphicCognition "a platform and want") is already handled here via the existing disable.

🤖 Generated with Claude Code

Re-analysis (same instrument, run on the Open & Async book with finer per-era
buckets) found the kept-ON top signal, AnthropomorphicJustification, conflates
human/collective subjects ("the people doing the work", "deserve credit") with
the real inanimate tell. On the book, splitting by subject cut it from 6.7x
whole-rule to ~2.4x inanimate-only. Adds a note to re-measure the 16x on the
inanimate subset before trusting it, plus per-era corroboration that
FigurativeFalls/Idioms are revived early-2010s habits (0.11/1k in 2010-13).

Docs-only: comments in the advisory config; no rule behavior changes.

Co-Authored-By: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
@benbalter benbalter closed this Aug 18, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant