$ the-wire ยท showcase
Transformers Brings Biology to v5 Main
By RepoJournal ยท Filed ยท About Hugging Face ยท Composed from the cited sources ยท methodology
Hugging Face's flagship repo hauled two protein-folding models onto the v5 mainline, and a wav2vec2 attention fix is ready to unblock your SDPA workflows.
The bio breakthrough lands this morning: ESMC and ESMFold2 are being ported into Transformers [2], lifting protein-folding straight into the framework's core [1]. The port is the verbatim fork code, with v5 convention adaptation coming as follow-up work [1]. Meanwhile, wav2vec2 conformer and SeamlessM4T now dispatch correctly with attn_implementation="sdpa", fixing crashes during from_pretrained [4]. On the reliability front, a LongT5 and Pop2Piano embedding tie fix prevents dropped structural weights [2], and a Retry transient network errors patch finally corrals the flaky RemoteDisconnected CI tracebacks [3]. The kernels repo lays groundwork with a resolver infrastructure [5] that will recursively solve kernel dependencies in coming PRs. Finally, sentence-transformers bumps setup-uv to 10.0.0, disabling automatic caching for sensitive events [6].
Action items
- โ Test ESMC/ESMFold2 on v5 main to catch breaking changes early huggingface/transformers [plan]
- โ Upgrade wav2vec2/SDPA path to absorb the dispatch fix huggingface/transformers [immediate]
- โ Review the kernel resolver API before building on it huggingface/kernels [monitor]
- โ Bump setup-uv to 10.0.0 in CI workflows huggingface/sentence-transformers [plan]
References
- [1] Port ESMC and ESMFold2 to Transformers (#46419) โ huggingface/transformers
- [2] Always tie embeddings for LongT5 and Pop2Piano (#47620) โ huggingface/transformers
- [3] Retry transient network errors (RemoteDisconnected) in github_utils (#48124) โ huggingface/transformers
- [4] ๐จ[wav2vec2] Support attn_implementation=sdpa dispatch โ huggingface/transformers
- [5] Add kernel resolver infrastructure โ huggingface/kernels
- [6] Bump astral-sh/setup-uv from 9.0.0 to 10.0.0 in the actions group โ huggingface/sentence-transformers