text-generation-inference/csrc/tgiccl/tgiccl.hpp

//
// Created by mfuntowicz on 9/25/24.
//

#ifndef TEXT_GENERATION_INFERENCE_TGICCL_H
#define TEXT_GENERATION_INFERENCE_TGICCL_H

#include <optional>

#include <nvml.h>

#include "TgiCclBackend.hpp"

namespace huggingface::tgi::tgiccl
{

}

#endif //TEXT_GENERATION_INFERENCE_TGICCL_H
feat(tgiccl): initial commit for custom tgiccl backend 2024-09-25 12:27:28 +00:00			`//`
			`// Created by mfuntowicz on 9/25/24.`
			`//`

			`#ifndef TEXT_GENERATION_INFERENCE_TGICCL_H`
			`#define TEXT_GENERATION_INFERENCE_TGICCL_H`

Add some utility functions in tgiccl for now 2024-09-26 21:31:07 +00:00			`#include <optional>`
feat(tgiccl): initial commit for custom tgiccl backend 2024-09-25 12:27:28 +00:00
Add some utility functions in tgiccl for now 2024-09-26 21:31:07 +00:00			`#include <nvml.h>`
feat(tgiccl): initial commit for custom tgiccl backend 2024-09-25 12:27:28 +00:00
Add some utility functions in tgiccl for now 2024-09-26 21:31:07 +00:00			`#include "TgiCclBackend.hpp"`
feat(tgiccl): initial commit for custom tgiccl backend 2024-09-25 12:27:28 +00:00
feat(tgi_common): add initial set of common functions for reuse 2024-09-27 16:53:56 +00:00			`namespace huggingface::tgi::tgiccl`
			`{`
feat(tgiccl): initial commit for custom tgiccl backend 2024-09-25 12:27:28 +00:00
			`}`

			`#endif //TEXT_GENERATION_INFERENCE_TGICCL_H`