..
aio
zml/aio: enable reading metadata from index.json for sharded safetensor files, allowing metadata storage alongside model config.
2023-05-23 15:06:59 +00:00
nn
Add initial Bazel build configuration, async runtime implementation, and core MLIR dialect definitions for ZML.
2023-01-02 14:28:25 +00:00
tools
Add initial Bazel build configuration, async runtime implementation, and core MLIR dialect definitions for ZML.
2023-01-02 14:28:25 +00:00
aio.zig
zml: small cleanup
2023-06-19 15:29:29 +00:00
buffer.zig
zml: small cleanup
2023-06-19 15:29:29 +00:00
BUILD.bazel
Refactor torch module: merge PickleData into Parser as torch.File, rename value file to py_object.zig, use buffered reader for pickle and zip headers, adjust intermediate result handling, simplify Python dict representation, separate kwargs from args, and add extensive tests for long integers, protocol 0, zipped pickle, and a complex PyTorch Conv2d case; also streamline BufferStore initialization.
2023-04-20 15:43:18 +00:00
context.zig
Add PJRT custom call integration with generic zmlHostBufferCallback to copy tensors to host and invoke user callbacks. Introduce Tensor.print() method to output runtime tensor values (CUDA‑specific, uses a pre‑allocated host buffer).
2023-06-05 13:42:45 +00:00
dtype.zig
Implement scatterSlices functionality.
2023-02-14 13:52:49 +00:00
floats.zig
zml: small cleanup
2023-06-19 15:29:29 +00:00
helpers.zig
zml: small cleanup
2023-06-19 15:29:29 +00:00
hostbuffer.zig
Add in-process sharding support across core ZML components (platform, shape, tensor, MLIR generation, buffers, and PJRT integration)
2023-02-24 17:33:14 +00:00
meta.zig
Rename zml.aio.Value to zml.aio.Metadata, simplify its type variants, and update torch pickle/eval APIs accordingly.
2023-04-07 16:45:58 +00:00
mlir.zig
Implement scatterSlices functionality.
2023-02-14 13:52:49 +00:00
module.zig
zml: reintroduce pjrtx to handle reactor blocking issues in async scenarios, particularly with Events.
2023-05-26 15:54:15 +00:00
nn.zig
zml.nn: add dynamic sampling with support for top‑k, top‑p, and min‑p settings. Implements token index computation based on the selected sampling strategy, including options for top_k, max_top_k, top_p, and min_p.
2023-06-16 14:34:18 +00:00
ops.zig
zml: small cleanup
2023-06-19 15:29:29 +00:00
pjrtx.zig
pjrtx: change behavior to return an error when OpenXLA fails to serialize the new batching_dim attribute for gather/scatter, instead of panicking.
2023-05-29 17:18:19 +00:00
platform.zig
zml: reintroduce pjrtx to handle reactor blocking issues in async scenarios, particularly with Events.
2023-05-26 15:54:15 +00:00
posix.h
Configure the runfiles environment globally at context start to ensure Bazel-built binaries locate their runfiles correctly.
2023-05-12 11:40:23 +00:00
posix.zig
Add initial Bazel build configuration, async runtime implementation, and core MLIR dialect definitions for ZML.
2023-01-02 14:28:25 +00:00
quantization.zig
Add multi‑axis, batched gatherValues support to tensor, shape, nn, quantization, and torch modules.
2023-01-18 12:03:48 +00:00
shape.zig
zml.tensor: add triangular operator to zero out the upper‑right matrix region with configurable offset, and toDiagonal (diag_embed) to embed a vector as a diagonal matrix, correcting previous diag naming. Also add ELU activation under zml.nn.Activation.
2023-05-18 16:39:21 +00:00
tensor.zig
zml: small cleanup
2023-06-19 15:29:29 +00:00
test_runner.zig
zml/test_runner: add optional filtering of test functions via command‑line argument, allowing selective execution of tests (e.g., bazel run //zml:test -- sdpa)
2023-01-20 13:50:36 +00:00
testing.zig
zml.tensor: add triangular operator to zero out the upper‑right matrix region with configurable offset, and toDiagonal (diag_embed) to embed a vector as a diagonal matrix, correcting previous diag naming. Also add ELU activation under zml.nn.Activation.
2023-05-18 16:39:21 +00:00
tokenizer.zig
Add Normalizer.fromHfJson to read HuggingFace tokenizer JSON and map to internal options, including a configurable magic space token and a debug flag for token merges. Adjust default handling of extra whitespaces to align with HF defaults.
2023-03-29 16:10:29 +00:00
torch.zig
Add multi‑axis, batched gatherValues support to tensor, shape, nn, quantization, and torch modules.
2023-01-18 12:03:48 +00:00
zml.zig
zml/nn: fix resize implementations (resizeBilinear and resizeBicubic) and expand refAllDecl usage; all tests pass
2023-01-27 14:35:11 +00:00
Tarry Singh
c30aa018dc