Radix/runtimes/neuron
Tarry Singh 1427286716 runtimes/neuron: fix neuron runtime
This PR fixes the neuron runtime with the following:

Proxy the PJRT Api method to enforce the client struct sizes since the
neuron PJRT plugin doesn't use `>=` but `==` to assert them, breaking
PJRT compatibility guarantees.
Fixes https://github.com/aws-neuron/aws-neuron-sdk/issues/1095

Reimplement `libneuronxla` in Zig to control neuronx-cc sandboxing and
invocation.

Implement a python bootstrapper in Zig to create a full blown
`neuronx-cc` executable, avoiding the infamous chicken and egg problem
of python executables boostrapping when sandboxed (due to fixed path
shebangs).

---------

Co-authored-by: Corentin Kerisit <corentin.kerisit@gmail.com>
2025-07-15 15:26:03 +00:00
..
BUILD.bazel runtimes/neuron: fix neuron runtime 2025-07-15 15:26:03 +00:00
libneuronxla.zig runtimes/neuron: fix neuron runtime 2025-07-15 15:26:03 +00:00
libpjrt_neuron.BUILD.bazel runtimes/neuron: fix neuron runtime 2025-07-15 15:26:03 +00:00
libpjrt_neuron.zig runtimes/neuron: fix neuron runtime 2025-07-15 15:26:03 +00:00
libpython.h Add Bazel build rules and runtime implementation for AWS Neuron/Trainium/Inferentia support. 2023-08-18 17:11:27 +00:00
neuron.bzl runtimes/neuron: fix neuron runtime 2025-07-15 15:26:03 +00:00
neuron.zig runtimes/neuron: fix neuron runtime 2025-07-15 15:26:03 +00:00
neuronx-cc.zig runtimes/neuron: fix neuron runtime 2025-07-15 15:26:03 +00:00
nrt.h runtimes/neuron: fix neuron runtime 2025-07-15 15:26:03 +00:00
packages.lock.json Add sandbox neuron dependencies: define a trampoline PJRT, create an empty repository for distroless deps, and update Bazel build files and Zig/C sources accordingly. 2025-05-19 17:35:33 +00:00
packages.yaml Add sandbox neuron dependencies: define a trampoline PJRT, create an empty repository for distroless deps, and update Bazel build files and Zig/C sources accordingly. 2025-05-19 17:35:33 +00:00
requirements.in Add Bazel build rules and runtime implementation for AWS Neuron/Trainium/Inferentia support. 2023-08-18 17:11:27 +00:00
requirements.lock.txt runtimes/neuron: fix neuron runtime 2025-07-15 15:26:03 +00:00