Releases: ai4sd/multiscale-byte-lm
Releases · ai4sd/multiscale-byte-lm
v0.3.0
What's Changed
- docs: update readme and example configs by @eegli in #9
- fix: parallel csv writer fails on win32 due to newlines by @eegli in #10
- test: extend test matrix to win32 and macos for latest python version by @eegli in #12
- chore: fix license by @eegli in #11
- fix: stage block serialization and pyproject cleanup by @eegli in #13
- fix: cpu tests with cuda and suppress user warnings by @eegli in #15
- feat: generalize byte streamer and allow recovery from invalid utf8 by @eegli in #16
- feat: register datasets and custom stage blocks via decorators by @eegli in #17
Full Changelog: v0.2.0...v0.3.0
v0.2.0
v0.1.0
Initial release 🎉