Go to file
Tarry Singh 1427286716 runtimes/neuron: fix neuron runtime
This PR fixes the neuron runtime with the following:

Proxy the PJRT Api method to enforce the client struct sizes since the
neuron PJRT plugin doesn't use `>=` but `==` to assert them, breaking
PJRT compatibility guarantees.
Fixes https://github.com/aws-neuron/aws-neuron-sdk/issues/1095

Reimplement `libneuronxla` in Zig to control neuronx-cc sandboxing and
invocation.

Implement a python bootstrapper in Zig to create a full blown
`neuronx-cc` executable, avoiding the infamous chicken and egg problem
of python executables boostrapping when sandboxed (due to fixed path
shebangs).

---------

Co-authored-by: Corentin Kerisit <corentin.kerisit@gmail.com>
2025-07-15 15:26:03 +00:00
async Switch workspace build rules from zig_cc_binary to zig_binary, removing the hack and using the C linker directly. 2025-07-03 15:10:36 +00:00
bazel runtimes/rocm: implement zmlxrocm in Zig 2025-07-07 16:48:07 +00:00
docs Update docs and example BUILD files to reflect the switch from zig_cc_binary to zig_binary. 2025-07-04 15:10:46 +00:00
examples Update docs and example BUILD files to reflect the switch from zig_cc_binary to zig_binary. 2025-07-04 15:10:46 +00:00
ffi Add HuggingFace tokenizer bindings and SentencePiece integration; update BUILD files, async utilities, and FFI modules to support the new tokenizers. 2024-02-28 15:47:37 +00:00
mlir runtimes/rocm: implement zmlxrocm in Zig 2025-07-07 16:48:07 +00:00
pjrt Switch workspace build rules from zig_cc_binary to zig_binary, removing the hack and using the C linker directly. 2025-07-03 15:10:36 +00:00
platforms workspace: remove glibc version constraint, update rules_rust, and re-enable frame pointers following sandboxing changes. 2025-04-29 12:09:13 +00:00
runtimes runtimes/neuron: fix neuron runtime 2025-07-15 15:26:03 +00:00
stdx Switch workspace build rules from zig_cc_binary to zig_binary, removing the hack and using the C linker directly. 2025-07-03 15:10:36 +00:00
third_party Switch workspace build rules from zig_cc_binary to zig_binary, removing the hack and using the C linker directly. 2025-07-03 15:10:36 +00:00
tools third_party/xla: de-modularize xla 2025-06-23 09:13:43 +00:00
upb runtimes/neuron: fix neuron runtime 2025-07-15 15:26:03 +00:00
zml runtimes/rocm: implement zmlxrocm in Zig 2025-07-07 16:48:07 +00:00
bazel.sh Remove examples workspace and clean up related Bazel BUILD/MODULE files and Zig build scripts. 2025-06-19 09:30:29 +00:00
BUILD.bazel Make ZLS runner target explicit in workspace BUILD files and update the zls.sh script accordingly. 2024-11-04 13:57:59 +00:00
build.zig Add initial Bazel build configuration, async runtime implementation, and core MLIR dialect definitions for ZML. 2023-01-02 14:28:25 +00:00
MODULE.bazel runtimes/neuron: fix neuron runtime 2025-07-15 15:26:03 +00:00
MODULE.bazel.lock third_party/xla: de-modularize xla 2025-06-23 09:13:43 +00:00
platform_mappings stablehlo: fix forwarding of optional operand and result layout attributes in custom call 2024-07-31 17:53:18 +00:00