8 Commits

Author	SHA1	Message	Date
Tarry Singh	b8a0aaee5a	Update tokenizer to handle byte_fallback for Llama3 GPT2 vocab and add a Llama3‑specific normalizer; adjust tinyllama.zig and hostbuffer.zig to use the new tokenization logic.	2024-02-05 15:22:44 +00:00
Tarry Singh	5bd7f8aae9	zml: HostBuffer.prettyPrint() ... Add pretty printing of HostBuffer. This will be leverage by the debug helper `x.print()` It can also be used like this: `std.log.info("my buffer: {}", .{host_buffer.pretty()})`	2023-12-25 13:01:17 +00:00
Tarry Singh	9b7eea8ac2	Add stdx utilities and rework async signature inference; tidy executable logging.	2023-06-21 14:45:14 +00:00
Tarry Singh	2f129f76c9	Add in-process sharding support across core ZML components (platform, shape, tensor, MLIR generation, buffers, and PJRT integration)	2023-02-24 17:33:14 +00:00
Tarry Singh	be6328813d	zml: clean up dead and commented code; note that copyslice is currently broken and pending reimplementation	2023-02-08 17:13:47 +00:00
Tarry Singh	7dcd8b516c	zml/nn: fix resize implementations (resizeBilinear and resizeBicubic) and expand refAllDecl usage; all tests pass	2023-01-27 14:35:11 +00:00
Tarry Singh	ebdb8db213	zml/tests: re‑enable all Zig tests, fix precision issue by switching to f32, and add refAllDecls to ensure all declarations are tested	2023-01-23 16:28:19 +00:00
Tarry Singh	266da6d4be	Add initial Bazel build configuration, async runtime implementation, and core MLIR dialect definitions for ZML.	2023-01-02 14:28:25 +00:00