Commit Graph

278 Commits

Author SHA1 Message Date
e6286b6097 Update Buffer.from to be blocking by default and add options for async loading and memory placement, adjusting aio, hostbuffer, pjrtx, and tensor implementations. 2024-12-25 17:14:44 +00:00
da1fd2d9dc Add examples demonstrating Buffer.from options, non‑blocking loading, and memory copy behavior. 2024-12-20 09:30:35 +00:00
bb2b77d7de Correctly set model.norm.eps in Llama examples. 2024-12-18 11:48:23 +00:00
6aa9aa5a7b Add preliminary implementation for custom call support. 2024-12-10 09:36:37 +00:00
1d5b79111a modernbert: set default epsilon value for embeddings layernorm. 2024-12-09 16:43:29 +00:00
a63d0a4aa3 Update example MODULE.bazel and lockfile to use the toolchains_llvm_bootstrapped configuration. 2024-12-04 11:30:44 +00:00
5464281c91 Update workspace configuration to use the toolchains_llvm_bootstrapped toolchain for Zig builds. 2024-12-03 13:50:58 +00:00
f5ab2c3a55 zml: eliminate compile-time fields from Bufferized, removing the need to pass undefined to exe.call for inlined arguments. Introduce BufferizedWithArgs in zml.testing for compileAndCall utility. 2024-11-28 12:24:39 +00:00
364a222dc1 Update example MODULE.bazel and lockfile to target XLA version 20250527.0‑cb67f2f. 2024-11-25 17:57:45 +00:00
95453c7242 Update XLA dependency to version 20250527.0‑cb67f2f and refresh related Bazel BUILD, MODULE, overlay and patch files. 2024-11-22 16:50:20 +00:00
fa13287931 workspace: upgrade to Zig 0.14.1 and handle empty tuple syntax &.{} being detected as *const @TypeOf(.{}). 2024-11-19 11:45:36 +00:00
d8a83830e8 runtimes: switch to Cloudflare Debian snapshots for more reliable dependency pinning. 2024-11-15 09:40:58 +00:00
ea3ce685a9 runtimes/neuron: bump runtime version and expose nrt.h header to Zig. 2024-11-14 13:37:47 +00:00
09da9c2982 Make zls.sh example explicitly set the ZLS runner target. 2024-11-06 16:22:44 +00:00
948c577205 Make ZLS runner target explicit in workspace BUILD files and update the zls.sh script accordingly. 2024-11-04 13:57:59 +00:00
47a4eda5f6 runtimes/cuda: expose cuda.h in the C namespace for CUDA runtimes, enabling custom calls to CUDA functions. 2024-11-01 13:27:24 +00:00
3849eb10b7 Add buffer and hostbuffer utilities with precise f32→bf16 conversion, type inference for loadBuffers, store expected input shapes, enhance meta.visit and JSON TaggedUnion support, and improve logging. 2024-10-28 11:21:46 +00:00
1540c6e85e Update loader example to demonstrate new HostBuffer helpers and type‑inferred buffer loading. 2024-10-25 10:20:04 +00:00
048d7eb38e third_party/sentencepiece: add missing protobuf_lite dependency and bump version. 2024-10-22 16:41:52 +00:00
4ef81b89ea stdx.fmt: add slice formatting support, improving on previous prettyPrinter implementation by leveraging internal fmt mechanisms. 2024-10-18 15:05:08 +00:00
fe55c600d4 Add/refresh how‑to docs and example loader for deployment, Docker, HuggingFace token, and getting‑started tutorials. 2024-10-14 11:27:41 +00:00
59f99c4501 Enable Bazel debug/release Zig builds and add stdx.time.Duration.hz and stdx.math.roundeven utilities. 2024-10-08 09:39:00 +00:00
aacbf2ee04 Fix Llama3 rope scaling implementation in the neural network module (zml/nn.zig) 2024-10-07 12:53:03 +00:00
9f61a8aacb Update example Zig code for llama3 rope scaling and modernbert usage. 2024-10-04 17:49:07 +00:00
d0cf5d3042 Update example MODULE.bazel and its lock file to incorporate workspace fixes and version bumps 2024-09-30 14:00:16 +00:00
4a0b1cce50 Update Bazel workspace and XLA overlay (MODULE.bazel, BUILD files, patches) to prevent dual LLVM builds and apply migration/bump patches. 2024-09-27 14:00:44 +00:00
8b53ebbd9b pjrt: bind PJRT_Device_AddressableMemories. 2024-09-26 12:02:04 +00:00
2863c1f5e0 zml/tensor: fix returned value in Tensor.toMemory – ensure _output_memory_kind is set correctly in the result. 2024-09-18 13:18:08 +00:00
fa4a8d8de4 async: enforce synchronous logging by routing async.zig logs through std.log.defaultLog to avoid panics when using async.LogFn 2024-09-17 09:03:48 +00:00
aec7072837 pjrt: add FFI bindings for custom calls 2024-09-10 09:14:28 +00:00
1f5ff96c10 zml/ops: add wiring for operand output alias in zml.ops.triton 2024-09-09 15:00:28 +00:00
7e0fcecfc9 async: adjust implementation for xev version bump 2024-09-06 16:00:58 +00:00
4b7e618b43 zml/aio: add bool handling in struct population within populateStruct 2024-09-02 14:11:47 +00:00
1068d0bb33 async: fix TCP connection handling 2024-08-29 17:10:30 +00:00
ac63c30e12 add mini-DSL for creating MLIR common attributes and types, leveraging Zig 0.14 to simplify mlir.Type and mlir.Attribute creation 2024-08-26 14:19:00 +00:00
63ef78efcc zml: add support for NVTX tracing 2024-08-21 14:41:40 +00:00
a5e588f53b async: detect xev only when the API is dynamic to fix macOS 2024-08-20 13:51:50 +00:00
8a8d3e0b15 workspace: fix incorrect checksum for ZLS macOS x86_64 2024-08-16 14:54:11 +00:00
4d809118d2 async: detect and select the most suitable xev backend, enabling use of io_uring when supported 2024-08-14 14:23:57 +00:00
12713ea8c7 Update Bazel MODULE files to fetch LLVM, StableHLO, and Triton dependencies, aligning versions for XLA. 2024-08-07 17:13:03 +00:00
7df89301dc Bump XLA version and import llvm, stablehlo, triton, and zig‑protobuf modules in workspace BUILD files. 2024-08-06 10:28:43 +00:00
cbe6e730bd stablehlo: fix forwarding of optional operand and result layout attributes in custom call 2024-07-31 17:53:18 +00:00
44933c9b89 Add macOS x86_64 support to example Bazel MODULE and platform mappings. 2024-07-29 10:31:51 +00:00
ca4e061ad5 Add Bazel build configurations for macOS x86_64 CPU runtime and ZLS third‑party integration. 2024-07-25 15:58:14 +00:00
3f36506f1c zml: remove usingnamespace from floats.zig and related dependencies; note that incremental compilation does not improve overall build time due to linking overhead 2024-07-23 17:43:43 +00:00
42dee5d0e0 mlir: rework stablehlo custom call implementation and add a Triton example 2024-07-16 13:23:07 +00:00
aec1d96e6d mlir: rework DenseElementsAttribute to correctly slice inputs and modify .as() to return a concrete value instead of an optional 2024-07-15 12:32:24 +00:00
201f5245c1 mlir: add MLIR index type 2024-07-11 11:14:22 +00:00
efcf955a4e workspace, third_party/rules_zig: adjust ZLS to require --version as the first parameter and add missing keys to the BuildConfig object for code completion 2024-07-10 15:20:12 +00:00
b67fd2367d Add benchmark, Llama, and ModernBERT example programs plus third‑party non‑module dependencies. 2024-07-03 11:30:49 +00:00