Case Ledger

Results move a lot from one repository and language to the next. Each table lists every pull request in the test set with a one-line summary of the bug, its severity, and whether each reviewer flagged it. Every tool name opens that tool’s run, and every mark opens the pull request itself.

Which reviewer is right for you depends on what you weigh. Some wrote fuller summaries, some returned in under a minute, some simply stayed quieter. Read the cases that look like your stack and your tolerance for noise.

Flagged = a line-level comment sitting on the faulty code that explains the impact. A passing mention in the summary does not count.

Pull request / bug Severity Mezzotint Plateworks Halftone Baren Deckle

Speed up pagination for high-volume audit logs

Imports a cursor paginator that no longer exists

High

Evict from the span buffer during insert

Negative offset lets the cursor skip page boundaries

Critical

Support upsampled error counts

A sample rate of 0.0 is falsy and silently skipped

Low

Harden the single sign-on callback

Null reference when the session state is missing

Critical

Self-serve bulk delete for session replays

Breaking change to the error response shape

Critical

Health monitoring for the multiprocess buffer

Metric tagged ‘shard’ on one path and ‘shards’ on another

Medium

Cross-system issue synchronisation

Shared mutable default on the timestamp field

Medium

Reorganise incident and occurrence creation

Reads a stale config value instead of the refreshed one

High

Queue-backed parallelism for background workers

Shutdown exception is swallowed and never re-raised

High

Emit occurrences from the stateful detector

Handler body is a bare pass statement

High
Total flagged 8/10 4/10 3/10 4/10 1/10