Goekdeniz-Guelmez/KANama-fineweb-v2-test1

The Model Goekdeniz-Guelmez/KANama-fineweb-v2-test1 was created using KANama.

Use with KANama

pip install KANama, transformers

from model.handler import from_pretrained, quick_inference
from transformers import AutoTokenizer

tokenizer = AutoTokenizer.from_pretrained("Goekdeniz-Guelmez/KANama-fineweb-v2-test1")
model = from_pretrained("path/to/model/folder")

prompt="hello"

input_tokens = tokenizer(prompt, return_tensors="pt").input_ids.to(device)

generated_tokens, generated_text = quick_inference(model, input_tokens, max_new_tokens=50, tokenizer=tokenizer)
print(generated_text)