|
|
6e4fef8844
|
zml: Introduce arena allocator in CompilationContext. Expose arena allocator to replace existing allocator, enabling safe allocation for ops without misusing std.BoundedArray. Includes breaking changes to chunkAllowTrailing and split. Upgrade axis_ types to anytype for tag handling and add TODOs for upcoming Tensor API.
|
2023-11-16 15:11:23 +00:00 |
|
|
|
98b512c495
|
Implement func.call emission and function caching across MLIR dialects and ZML module/ops, propagating tags and donations.
|
2023-10-19 17:01:55 +00:00 |
|
|
|
7d36913b31
|
Refactor ZML API: move compile, compileFn and related types to exe.zig, update BaseExe allocation and inline caching in compileInternal, and clean up supporting modules (func.zig, meta.zig, signature.zig, cuda.zig, testing.zig, zml.zig).
|
2023-10-13 16:08:08 +00:00 |
|
|
|
3bc6ad98be
|
Update module.zig to donate all buffers except the token_index buffer for the Llama+Neuron example.
|
2023-10-06 10:10:56 +00:00 |
|
|
|
5122ca0203
|
Refactor rope implementation to compute only required offsets, eliminating full cos/sin matrix generation in module, nn, and tensor code.
|
2023-09-27 11:45:33 +00:00 |
|
|
|
7d24329d0a
|
Add Bazel build rules and runtime implementation for AWS Neuron/Trainium/Inferentia support.
|
2023-08-18 17:11:27 +00:00 |
|
|
|
0709b1b32f
|
zml: reduce memory usage of sdpaMemEfficient by using zml.ops.while instead of zml.ops.for, avoiding concatenation of intermediate results.
|
2023-08-14 14:24:11 +00:00 |
|
|
|
01eff33fa0
|
Update workspace dependencies to newer LLVM, XLA, StableHLO, and PJRT versions and expose new pjrt plugin attribute APIs and stablehlo version APIs in build and runtime configurations.
|
2023-08-07 12:28:36 +00:00 |
|
|
|
b53462b515
|
Fix crash in for_ by ensuring values are pushed to their block before opening a new block, adding asserts for block state, and guaranteeing first_step is used. Adjust padding syntax to improve usability.
|
2023-07-25 14:25:47 +00:00 |
|
|
|
f675a203c2
|
zml.ops.makeBlock now returns the inner tensor to propagate tags. The function returns both the created mlir.Block and tensors from the supplied function, allowing shape and tag propagation without exposing mlir.Values. Updated tests to run on non‑CPU platforms.
|
2023-07-21 09:01:01 +00:00 |
|
|
|
0f9a92f27d
|
module-cache: raise max_pjrt_executable_size limit to 400 MB to accommodate large PJRT executables.
|
2023-07-14 17:58:22 +00:00 |
|
|
|
63aca9f9c2
|
Hotfixes for build rule, math utilities, module system, and NN implementation (fixes,)
|
2023-06-29 10:26:54 +00:00 |
|
|
|
9b7eea8ac2
|
Add stdx utilities and rework async signature inference; tidy executable logging.
|
2023-06-21 14:45:14 +00:00 |
|
|
|
52ef20f981
|
zml: reintroduce pjrtx to handle reactor blocking issues in async scenarios, particularly with Events.
|
2023-05-26 15:54:15 +00:00 |
|
|
|
c68ec4bc5c
|
async: implement default threaded backend using a thread pool. Backend selectable via @zml//async:impl flag (threaded or zigcoro). Provides workaround for environments where io_uring is unavailable.
|
2023-05-25 16:02:11 +00:00 |
|
|
|
57130577e9
|
Add fallback for runtimes lacking PJRT_Event by using thread‑pool dispatch for buffer copies and treating operations as synchronous when events are absent.
|
2023-05-09 12:44:56 +00:00 |
|
|
|
5543c8192f
|
Rename async_ to asyncc and add Generic async slugs in async.zig, aio.zig, and module.zig.
|
2023-05-04 14:44:12 +00:00 |
|
|
|
8e43a45a3c
|
Add event waiting when invoking a module and improve multi‑device sharding handling.
|
2023-04-11 11:32:09 +00:00 |
|
|
|
66881899ca
|
Fix testLayer by removing unnecessary compile_options argument and updating testing logic for new sharded output, ensuring proper usage by llama.zig.
|
2023-03-31 14:23:45 +00:00 |
|
|
|
a4f0fc96c0
|
Integrate user sharding hints and HLO sharding annotations across MLIR dialects and ZML core, and remove the now‑unused module options arguments.
|
2023-03-21 10:50:39 +00:00 |
|
|
|
dfa71018a5
|
zml: Remove pjrtx wrapper, migrate remaining helpers to their native modules, and fix blocking issue in Event.await.
|
2023-03-06 17:05:56 +00:00 |
|
|
|
2f129f76c9
|
Add in-process sharding support across core ZML components (platform, shape, tensor, MLIR generation, buffers, and PJRT integration)
|
2023-02-24 17:33:14 +00:00 |
|
|
|
24a7c98476
|
Implement scatterSlices functionality.
|
2023-02-14 13:52:49 +00:00 |
|
|
|
be6328813d
|
zml: clean up dead and commented code; note that copyslice is currently broken and pending reimplementation
|
2023-02-08 17:13:47 +00:00 |
|
|
|
7dcd8b516c
|
zml/nn: fix resize implementations (resizeBilinear and resizeBicubic) and expand refAllDecl usage; all tests pass
|
2023-01-27 14:35:11 +00:00 |
|
|
|
ebdb8db213
|
zml/tests: re‑enable all Zig tests, fix precision issue by switching to f32, and add refAllDecls to ensure all declarations are tested
|
2023-01-23 16:28:19 +00:00 |
|
|
|
266da6d4be
|
Add initial Bazel build configuration, async runtime implementation, and core MLIR dialect definitions for ZML.
|
2023-01-02 14:28:25 +00:00 |
|
