Tarry Singh c109b12e1b Various minor fixes: rewrite tinyllama tokenizer newline token, prevent HostBuffer.isContiguous false trigger on 1‑dim axes, improve HostBuffer.slice1d error messages, simplify module.zig output to show .mlir file path, correct setFlags handling of comptime int/float, make tokenizer.zig return <oob> for out‑of‑range detokenization, and speed up Buffer.constant creation up to 2.5 GB/s on CUDA.		2024-02-19 12:34:18 +00:00
..
gguf	Add stdx utilities and rework async signature inference; tidy executable logging.	2023-06-21 14:45:14 +00:00
torch	Add stdx utilities and rework async signature inference; tidy executable logging.	2023-06-21 14:45:14 +00:00
gguf.zig	Add stdx utilities and rework async signature inference; tidy executable logging.	2023-06-21 14:45:14 +00:00
json.zig	Rename zml.aio.Value to zml.aio.Metadata, simplify its type variants, and update torch pickle/eval APIs accordingly.	2023-04-07 16:45:58 +00:00
nemo.zig	Add stdx utilities and rework async signature inference; tidy executable logging.	2023-06-21 14:45:14 +00:00
safetensors.zig	Add stdx utilities and rework async signature inference; tidy executable logging.	2023-06-21 14:45:14 +00:00
sentencepiece.zig	Add Normalizer.fromHfJson to read HuggingFace tokenizer JSON and map to internal options, including a configurable magic space token and a debug flag for token merges. Adjust default handling of extra whitespaces to align with HF defaults.	2023-03-29 16:10:29 +00:00
tinyllama.zig	Various minor fixes: rewrite tinyllama tokenizer newline token, prevent HostBuffer.isContiguous false trigger on 1‑dim axes, improve HostBuffer.slice1d error messages, simplify module.zig output to show .mlir file path, correct setFlags handling of comptime int/float, make tokenizer.zig return <oob> for out‑of‑range detokenization, and speed up Buffer.constant creation up to 2.5 GB/s on CUDA.	2024-02-19 12:34:18 +00:00
torch.zig	Add stdx utilities and rework async signature inference; tidy executable logging.	2023-06-21 14:45:14 +00:00
yaml.zig	Rename zml.aio.Value to zml.aio.Metadata, simplify its type variants, and update torch pickle/eval APIs accordingly.	2023-04-07 16:45:58 +00:00