huggingface/text-generation-inference
5
0
Fork 0
mirror of https://github.com/huggingface/text-generation-inference.git synced 2025-04-21 23:12:07 +00:00
Code Issues Packages Projects Releases Wiki Activity
4ee2ee58c9
text-generation-inference/backends/llamacpp/csrc
History
Morgan Funtowicz 2d9465d181 misc(backend): allow rebinding numa core affinity
2024-11-22 14:02:58 +01:00
..
backend.cpp misc(backend): allow rebinding numa core affinity 2024-11-22 14:02:58 +01:00
backend.hpp feat(backend): correctly setup llama_context providing n_threads and n_ubatch 2024-11-21 21:43:50 +01:00
ffi.hpp misc(backend): allow rebinding numa core affinity 2024-11-22 14:02:58 +01:00