c30aa018dc
zml: small cleanup
...
- Add more scatterSlices test cases.
- Replace helpers.mapTensors with zml.meta.map.
- Fix shape handling when a for loop is fully unrolled.
- Allow zml.Tensor.pad to accept i64 for dimension compatibility.
- Enable arrays of tensors inside model structs.
- Split Buffer.asViewOf into asViewOfHostBuffer and asViewOfDeviceBuffer.
2023-06-19 15:29:29 +00:00
c68ec4bc5c
async: implement default threaded backend using a thread pool. Backend selectable via @zml//async:impl flag (threaded or zigcoro). Provides workaround for environments where io_uring is unavailable.
2023-05-25 16:02:11 +00:00
5543c8192f
Rename async_ to asyncc and add Generic async slugs in async.zig, aio.zig, and module.zig.
2023-05-04 14:44:12 +00:00
11006ca08d
Refactor torch module: merge PickleData into Parser as torch.File, rename value file to py_object.zig, use buffered reader for pickle and zip headers, adjust intermediate result handling, simplify Python dict representation, separate kwargs from args, and add extensive tests for long integers, protocol 0, zipped pickle, and a complex PyTorch Conv2d case; also streamline BufferStore initialization.
2023-04-20 15:43:18 +00:00
0189b71070
Rename zml.aio.Value to zml.aio.Metadata, simplify its type variants, and update torch pickle/eval APIs accordingly.
2023-04-07 16:45:58 +00:00
66881899ca
Fix testLayer by removing unnecessary compile_options argument and updating testing logic for new sharded output, ensuring proper usage by llama.zig.
2023-03-31 14:23:45 +00:00
dfa71018a5
zml: Remove pjrtx wrapper, migrate remaining helpers to their native modules, and fix blocking issue in Event.await.
2023-03-06 17:05:56 +00:00
2f129f76c9
Add in-process sharding support across core ZML components (platform, shape, tensor, MLIR generation, buffers, and PJRT integration)
2023-02-24 17:33:14 +00:00
be6328813d
zml: clean up dead and commented code; note that copyslice is currently broken and pending reimplementation
2023-02-08 17:13:47 +00:00
897786e440
aio: correct refAllDecls handling for yaml and nemo modules
2023-01-31 11:58:58 +00:00
7dcd8b516c
zml/nn: fix resize implementations (resizeBilinear and resizeBicubic) and expand refAllDecl usage; all tests pass
2023-01-27 14:35:11 +00:00
266da6d4be
Add initial Bazel build configuration, async runtime implementation, and core MLIR dialect definitions for ZML.
2023-01-02 14:28:25 +00:00
