ollama model files (vietnamese LLM)

README-ollama.md

model files to use with https://github.com/ollama/ollama

ollama create example -f modelfile.txt
ollama run example
ollama rm example

modelfile-phogpt.txt

# download from
# - https://huggingface.co/nguyenviet/PhoGPT-4B-Chat-GGUF/tree/main
# - https://huggingface.co/nguyenviet/PhoGPT-7B5-Instruct-GGUF/tree/main

FROM ./PhoGPT-4B-Chat-q5_k_m.gguf

PARAMETER num_gpu 99
PARAMETER num_ctx 4096
PARAMETER temperature 1.0
PARAMETER num_predict 1024
PARAMETER top_k 50
PARAMETER top_p 0.9

TEMPLATE """
### Câu hỏi: {{ .Prompt }}
### Trả lời: {{ .Response }}
"""

modelfile-torolama.txt

# download from https://huggingface.co/ndthai/ToRoLaMa-7B-GGUF/tree/main

FROM ./ToRoLaMa-7b.Q5_K_M.gguf

PARAMETER num_gpu 99
PARAMETER num_ctx 4096
PARAMETER temperature 1.0
PARAMETER num_predict 2048
PARAMETER top_k 50
PARAMETER top_p 0.9
PARAMETER stop </s>

SYSTEM "Cuộc hội thoại giữa người dùng và một trí thông minh nhân tạo. Đưa ra câu trả lời chính xác, giúp ích cho người dùng."

TEMPLATE """
USER: {{ .Prompt }}
ASSISTANT: {{ .Response }}</s>
"""

modelfile-vistral.txt

# download from
# - https://huggingface.co/janhq/Vistral-7b-Chat-GGUF/tree/main
# - https://huggingface.co/uonlp/Vistral-7B-Chat-gguf/tree/main

FROM ./vistral-7b-chat.Q5_K_M.gguf

PARAMETER num_gpu 99
PARAMETER num_ctx 4096
PARAMETER temperature 0.1
PARAMETER repeat_penalty 1.05
PARAMETER num_predict 768
PARAMETER top_k 40
PARAMETER top_p 0.95

SYSTEM """
Bạn là một trợ lí Tiếng Việt nhiệt tình và trung thực. Hãy luôn trả lời một cách hữu ích nhất có thể, đồng thời giữ an toàn.
Câu trả lời của bạn không nên chứa bất kỳ nội dung gây hại, phân biệt chủng tộc, phân biệt giới tính, độc hại, nguy hiểm hoặc bất hợp pháp nào. Hãy đảm bảo rằng các câu trả lời của bạn không có thiên kiến xã hội và mang tính tích cực.
Nếu một câu hỏi không có ý nghĩa hoặc không hợp lý về mặt thông tin, hãy giải thích tại sao thay vì trả lời một điều gì đó không chính xác. Nếu bạn không biết câu trả lời cho một câu hỏi, hãy trẳ lời là bạn không biết và vui lòng không chia sẻ thông tin sai lệch.
"""