|
|
66881899ca
|
Fix testLayer by removing unnecessary compile_options argument and updating testing logic for new sharded output, ensuring proper usage by llama.zig.
|
2023-03-31 14:23:45 +00:00 |
|
|
|
05d23beb23
|
Add Normalizer.fromHfJson to read HuggingFace tokenizer JSON and map to internal options, including a configurable magic space token and a debug flag for token merges. Adjust default handling of extra whitespaces to align with HF defaults.
|
2023-03-29 16:10:29 +00:00 |
|
|
|
ef922e3aea
|
Fix empty JSON array handling in safetensor metadata loader and refactor torch loader (make ops slices const and improve readability).
|
2023-03-28 16:17:00 +00:00 |
|
|
|
a4f0fc96c0
|
Integrate user sharding hints and HLO sharding annotations across MLIR dialects and ZML core, and remove the now‑unused module options arguments.
|
2023-03-21 10:50:39 +00:00 |
|
|
|
8746a5ce78
|
Expose zml/test_runner.zig publicly to enable users to employ the async test runner. Made the dependency on zml explicit and suggest treating test_runner as a zig_library rather than a filegroup.
|
2023-03-16 13:22:35 +00:00 |
|
|
|
7ef67eea27
|
zml: Relocate tests next to the functions they verify and remove obsolete dynamicSlice1d test.
|
2023-03-08 14:10:11 +00:00 |
|
|
|
dfa71018a5
|
zml: Remove pjrtx wrapper, migrate remaining helpers to their native modules, and fix blocking issue in Event.await.
|
2023-03-06 17:05:56 +00:00 |
|
|
|
ecf52ad724
|
zml.tokenizer: Implement proper byte fallback support by converting hex byte strings (e.g., “<0x40>”) to their characters and splitting unknown UTF‑8 codepoints into bytes, fixing tokenization.
|
2023-02-28 14:40:25 +00:00 |
|
|
|
2f129f76c9
|
Add in-process sharding support across core ZML components (platform, shape, tensor, MLIR generation, buffers, and PJRT integration)
|
2023-02-24 17:33:14 +00:00 |
|
|
|
639f5cd994
|
Replace log with select for generating the attention mask to avoid NaNs on zero values.
|
2023-02-16 10:36:23 +00:00 |
|
|
|
24a7c98476
|
Implement scatterSlices functionality.
|
2023-02-14 13:52:49 +00:00 |
|
|
|
934acb35a8
|
zml: initialize Tensor.min and Tensor.max reductions with proper extreme values to ensure correct results
|
2023-02-10 12:28:41 +00:00 |
|
|
|
be6328813d
|
zml: clean up dead and commented code; note that copyslice is currently broken and pending reimplementation
|
2023-02-08 17:13:47 +00:00 |
|
|
|
058e1415fa
|
zml: deprecate buggy Tensor.chunk; introduce chunkExact and chunkAllowTrailing with clarified behavior
|
2023-02-07 12:42:34 +00:00 |
|
|
|
0606ea1d7c
|
Update Bazel workspace and runtime BUILD files to newer XLA, StableHLO, and LLVM versions, enabling batching‑dims support for the gather operator.
|
2023-02-01 15:58:30 +00:00 |
|
|
|
897786e440
|
aio: correct refAllDecls handling for yaml and nemo modules
|
2023-01-31 11:58:58 +00:00 |
|
|
|
7dcd8b516c
|
zml/nn: fix resize implementations (resizeBilinear and resizeBicubic) and expand refAllDecl usage; all tests pass
|
2023-01-27 14:35:11 +00:00 |
|
|
|
5e1688cbfd
|
aio: refactor PyTorch model parsing for better readability and optimize slice handling
|
2023-01-25 12:16:27 +00:00 |
|
|
|
ebdb8db213
|
zml/tests: re‑enable all Zig tests, fix precision issue by switching to f32, and add refAllDecls to ensure all declarations are tested
|
2023-01-23 16:28:19 +00:00 |
|
|
|
f39b16e13d
|
zml/test_runner: add optional filtering of test functions via command‑line argument, allowing selective execution of tests (e.g., bazel run //zml:test -- sdpa)
|
2023-01-20 13:50:36 +00:00 |
|
|
|
b961856e5f
|
zml/tensor: correct typo in uniform comment ('substract' → 'subtract')
|
2023-01-19 12:20:40 +00:00 |
|
|
|
ccdf218961
|
Add multi‑axis, batched gatherValues support to tensor, shape, nn, quantization, and torch modules.
|
2023-01-18 12:03:48 +00:00 |
|
|
|
266da6d4be
|
Add initial Bazel build configuration, async runtime implementation, and core MLIR dialect definitions for ZML.
|
2023-01-02 14:28:25 +00:00 |
|
