Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

GGUF imported model crashes only in v0.1.38 #4523

Open
mindspawn opened this issue May 19, 2024 · 2 comments
Open

GGUF imported model crashes only in v0.1.38 #4523

mindspawn opened this issue May 19, 2024 · 2 comments
Labels
bug Something isn't working importing Issues relating to ollama create

Comments

@mindspawn
Copy link

What is the issue?

heegyu/EEVE-Korean-Instruct-10.8B-v1.0-GGUF worked in all prior versions of ollama. Since v0.1.38 it core dumps.
I have temporarily reverted to v0.1.37 to resolve the issue. Any help is appreciated.

OS

Linux

GPU

Nvidia

CPU

Intel

Ollama version

0.1.38

@mindspawn mindspawn added the bug Something isn't working label May 19, 2024
@pdevine
Copy link
Contributor

pdevine commented May 20, 2024

@mindspawn Can you attach the logs and the Modelfile? Also, do you have a link to the gguf binary, or did you convert it yourself?

@pdevine pdevine added the importing Issues relating to ollama create label May 20, 2024
@mindspawn
Copy link
Author

@mindspawn Can you attach the logs and the Modelfile? Also, do you have a link to the gguf binary, or did you convert it yourself?

I used the f16 version from here: https://huggingface.co/heegyu/EEVE-Korean-Instruct-10.8B-v1.0-GGUF/tree/main

For Modelfile, all I have in it is FROM ./ggml-model-f16.gguf

Unfortunately, it is deployed in an environment where I am unable to pull log files from. I have been using at least the last 4-5 versions of ollama with no issues. Great application by the way :)

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Something isn't working importing Issues relating to ollama create
Projects
None yet
Development

No branches or pull requests

2 participants