$ the-wire · showcase
nnsight 0.8.0 cuts import time, adds a left-padding fix
By RepoJournal · Filed · About Interpretability · Composed from the cited sources · methodology
nnsight's v0.8.0 trims roughly six seconds off importing the library and corrects position_ids for left-padded batches, the two changes operators of the toolkit will actually feel.
v0.8.0 ndif-team/nnsight
Model classes are now lazy-loaded, which the release notes measure as a drop from 7.6s to 1.6s for "import nnsight", so short scripts and notebook cells stop paying the full model-import cost before they do any work. The same release derives position_ids from the mask for left-padded batches, fixing generation on batched inputs where padding had been shifting positions.
Dev ndif-team/nnsight
A dev-branch cut that landed on top of the v0.8.0 line; nothing in the entry names behavior changes you would adopt as an operator.
Merge pull request #772 from ndif-team/dev ndif-team/nnsight
The merge that folded the dev branch (including the v0.8.0 work) into the mainline, so the release is now what a normal install tracks.
Action items