The Wire · Showcase
KERNELS REFACTOR CLEANS UP LOADING PATH, TOKENIZERS KILLS DEPENDABOT NOISE
By RepoJournal · Filed · About Hugging Face
Hugging Face is untangling kernel loading internals across multiple repos while simultaneously eliminating 50% of its Dependabot burden through surgical dependency cleanup.
Danieldk shipped a two-part kernel loading refactor [1][2] that consolidates overlapping functions, removes obsolete hash validation, and makes `install_kernel` the canonical entry point for kernel discovery. The work moves Hub-related logic into a dedicated `hf_hub` module and strips implicit environment variable handling out of core functions [3], reducing cognitive load on reviewers across commits and PRs spanning 12 commits and 14 PRs total this period. Meanwhile, Arthur Zucker's tokenizers cleanup took a different angle: deleting the stale `unstable_wasm` example directory [6] eliminates 41 of 82 total Dependabot PRs the repo has ever received, then dropping 8 unused devDependencies [8] cuts Node security alerts from 33 to 0 without bloating the lockfile [7]. In kernels-community, Ilyas Moutawwakil added Mamba layer variations to deprecate lazy-load kernels [4] and synced Sonic-MOE with upstream v2 expert parallelism support [5]. The pattern across all three repos is the same: reduce friction through consolidation, not expansion.
One email a day. Unsubscribe in one click.
Keep up with Hugging Face in about 3 minutes a day: what actually shipped — the commits, pull requests, releases, and security advisories that matter.
One email a day. Unsubscribe in one click. Read a past issue →
Action items
- → Review and merge kernel loading refactor PRs #745 and #746 in kernels huggingface/kernels [plan]
- → Merge tokenizers cleanup PRs #2285 and #2287 to stop Dependabot noise huggingface/tokenizers [plan]
- → Monitor Mamba layer PRs in kernels-community for deprecation readiness huggingface/kernels-community [monitor]
References
- [1] Untangle kernel loading, part2 ↗ huggingface/kernels
- [2] Kernel loading untangling ↗ huggingface/kernels
- [3] Kernel loading untangling (#745) huggingface/kernels
- [4] mamba-ssm: add layers ↗ huggingface/kernels-community
- [5] sonic-moe: v2 ep support (#1060) huggingface/kernels-community
- [6] chore: remove stale examples (kills 50% of dependabot traffic) (#2285) huggingface/tokenizers
- [7] chore(node): take node security alerts from 33 to 0 ↗ huggingface/tokenizers
- [8] chore(node): drop 8 unused devDependencies ↗ huggingface/tokenizers