Foke Singh b67685b941 Add example Bazel build files and tokenizer test for tinyllama, including tigerbeetle integration and flags.		2024-04-01 17:40:18 +00:00
..
BUILD.bazel	Add example Bazel build files and tokenizer test for tinyllama, including tigerbeetle integration and flags.	2024-04-01 17:40:18 +00:00
llama.zig	Add example Bazel build files and tokenizer test for tinyllama, including tigerbeetle integration and flags.	2024-04-01 17:40:18 +00:00
main.zig	Add example Bazel build files and tokenizer test for tinyllama, including tigerbeetle integration and flags.	2024-04-01 17:40:18 +00:00
test_tokenizer.zig	Add Bazel build rule and test for Llama3 tokenizer’s byte fallback and unknown token handling.	2024-02-02 10:25:48 +00:00
test.zig	Update Llama example docs and Bazel build files, and add tests for the new HuggingFace tokenizer integration.	2024-03-04 12:11:13 +00:00