tarry.singh/Radix
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity
155 Commits 1 Branch 0 Tags 1.8 MiB
Zig 92.6%
Starlark 5.8%
Python 0.6%
Assembly 0.3%
Rust 0.2%
Other 0.4%
13eff4e661
Go to file
Tarry Singh 13eff4e661 pjrt,zml: add memory bindings 
This preliminary PR binds PJRT memory endpoints and adds them to
`zml.Buffer`.

A follow up PR will properly integrate it inside `zml.Buffer`
2024-04-11 15:43:24 +00:00
async Replace real mutex with async Mutex for logFn, add fallback logger support outside coroutines, and fix ResetCondition handling. 2024-03-14 11:43:33 +00:00
bazel bazel: use OID as sha256 for Git LFS files to prevent unnecessary HuggingFace redownloads. 2024-03-28 17:52:52 +00:00
docs Update Llama example docs and Bazel build files, and add tests for the new HuggingFace tokenizer integration. 2024-03-04 12:11:13 +00:00
examples llama: simplify llama3 prompt template encoding by removing redundant newline re-encoding and ensuring a trailing newline. 2024-04-10 09:36:28 +00:00
ffi Add HuggingFace tokenizer bindings and SentencePiece integration; update BUILD files, async utilities, and FFI modules to support the new tokenizers. 2024-02-28 15:47:37 +00:00
mlir pjrt,zml: add memory bindings 2024-04-11 15:43:24 +00:00
pjrt pjrt,zml: add memory bindings 2024-04-11 15:43:24 +00:00
platforms Add initial Bazel build configuration, async runtime implementation, and core MLIR dialect definitions for ZML. 2023-01-02 14:28:25 +00:00
runtimes Ensure all runtime plugins have correct SONAME values, fixing issues with prebuilt PJRT plugins. 2024-03-11 10:15:22 +00:00
stdx Integrate TinyLlama support, restore the homemade tokenizer, and align Zig API naming across stdx and zml tokenizer modules. 2024-04-05 15:07:29 +00:00
third_party Add HuggingFace tokenizer bindings and SentencePiece integration; update BUILD files, async utilities, and FFI modules to support the new tokenizers. 2024-02-28 15:47:37 +00:00
tools Update tutorial documentation in write_first_model.md with quick fixes. 2023-11-30 12:14:33 +00:00
zml pjrt,zml: add memory bindings 2024-04-11 15:43:24 +00:00
BUILD.bazel Update Bazel build files and helper scripts to integrate the custom build runner for ZLS code completion. 2023-11-20 15:29:01 +00:00
build.zig Add initial Bazel build configuration, async runtime implementation, and core MLIR dialect definitions for ZML. 2023-01-02 14:28:25 +00:00
MODULE.bazel bazel: depend on prebuilt protoc binaries to eliminate ~1300 build steps. Note: integration is currently blocked due to version constraints in rules_proto and toolchains_protoc. 2024-03-29 09:54:57 +00:00
MODULE.bazel.lock Add HuggingFace tokenizer bindings and SentencePiece integration; update BUILD files, async utilities, and FFI modules to support the new tokenizers. 2024-02-28 15:47:37 +00:00
platform_mappings Add initial Bazel build configuration, async runtime implementation, and core MLIR dialect definitions for ZML. 2023-01-02 14:28:25 +00:00