Repository navigation
Write what Every's Vibe Checks say the team used into dated history - #12
Draft
kieranklaassen wants to merge 4 commits into
Draft
kieranklaassen wants to merge 4 commits into
kieranklaassen wants to merge 4 commits into
Conversation
config/vibe_checks.yml records, per team member, the ranked picks a Vibe Check quoted them using, dated to the article. VibeChecks::Import writes them as `vibe_check` entry_changes on every deploy, replacing only its own rows, so "What we used before" reaches back to 2025. Each snapshot holds until the next one, the member's own first change in the kind, or 90 days, and a closing batch then empties the slots so history still replays to the member's picks. Closing rows stay out of stories. Older models the articles name are added to the catalog as `retired`: created hidden, out of the pickers, and counted by the number-one history. Co-Authored-By: Claude Opus 5.5 (1M context) <noreply@anthropic.com> Claude-Session: https://claude.ai/code/session_01FDZZBdXgTcm2Mwsbj9tk9j
Co-Authored-By: Claude Opus 5.5 (1M context) <noreply@anthropic.com> Claude-Session: https://claude.ai/code/session_01FDZZBdXgTcm2Mwsbj9tk9j
…ts failure is not fatal Co-Authored-By: Claude Opus 5.5 (1M context) <noreply@anthropic.com> Claude-Session: https://claude.ai/code/session_01FDZZBdXgTcm2Mwsbj9tk9j
Read with a subscriber's access: 22 snapshots for Dan, Kieran, Katie, Naveen, and first entries for Nityesh, Alex and Danny. Adds Opus 4, Opus 4.1, GPT-5, GPT-4.5, o3, o4-mini and Factory's Droid as retired items. Co-Authored-By: Claude Opus 5.5 (1M context) <noreply@anthropic.com>
Collaborator
Author
|
Two checks are red on d9a046a, and neither comes from this PR's diff (the last commit only touches
Generated by Claude Code |
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Requested by Kieran · project thread
Before: a member's history started on the day they first ranked in Toolbox, so "What we used before" had nothing from before this month.
After: what Every's Vibe Checks quoted Kieran, Dan, Katie, Naveen and Mike using is in their dated history, back to March 2025. The coding kind's number one now reads Codex (Oct 2025), Claude Code with Opus 4.5 (Nov), Codex with GPT-5.3 Codex, then GPT-5.4 and GPT-5.5, Claude Code with Fable 5.1 (Sep 1), and Claude Code with Opus 5.5 (Sep 22).
The data is
config/vibe_checks.yml: one snapshot per person, kind and article, with the quote it rests on and anotewherever it reads more into the quote than it says (usually the tool when only a model is named). It was read from all 52 articles at every.to/vibe-check. The paywalled parts of older articles were read with a subscriber's access, which added 22 snapshots (including first entries for Nityesh, Alex and Danny) and the retired items Opus 4, Opus 4.1, GPT-5, GPT-4.5, o3, o4-mini and Factory's Droid.How
VibeChecks::Importruns on every deploy afterCatalog::Sync(and asbin/rails toolbox:import_vibe_checks). It deletes and rewrites only its ownvibe_checkrows, never entries or suggestions. It finds verified@every.tomembers by email, else by name, and skips people who haven't signed up yet.details.closingand left out of stories.retired. They are created hidden, stay out of pickers, andNumberOneHistorynow counts hidden items (anything not pending).Audience#counted). A member with no picks yet has rows but doesn't appear in the eras.Tests:
test/services/vibe_checks/import_test.rbcovers batches, the stale gap, stopping at the member's own first change, idempotence, name matching, stories, a three-person era with a retired model, and that the shipped file resolves against the catalog. The full Ruby suite passed locally on a copy of the repo; after the paywalled additions, the import and catalog tests pass (43 runs).🤖 Generated with Claude Code
https://claude.ai/code/session_01FDZZBdXgTcm2Mwsbj9tk9j
Generated by Claude Code