Skip to content

Convert bloomz-7b1-mt to ggml error. #34

Description

I have the following problems when converting bloomz-7b1-mt model:

Some weights of BloomForCausalLM were not initialized from the model checkpoint at D:\projects\code\bloomz-7b1-mt and are newly initialized: ['lm_head.weight']
You should probably TRAIN this model on a down-stream task to be able to use it for predictions and inference.
...
Traceback (most recent call last):
  File "D:\projects\code\bloomz.cpp\convert-hf-to-ggml.py", line 151, in <module>
    data.tofile(fout)
OSError: 67108864 requested and 0 written

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Projects

    No projects

      Milestone

      No milestone

      Relationships

      None yet

      Development

      No branches or pull requests

      Issue actions