草庐IT

LlamaForCausalLM

全部标签

huggingface transformers库中LlamaForCausalLM

新手入门笔记。LlamaForCausalLM的使用示例,这应该是一段推理代码。fromtransformersimportAutoTokenizer,LlamaForCausalLMmodel=LlamaForCausalLM.from_pretrained(PATH_TO_CONVERTED_WEIGHTS)tokenizer=AutoTokenizer.from_pretrained(PATH_TO_CONVERTED_TOKENIZER)prompt="Hey,areyouconscious?Canyoutalktome?"inputs=tokenizer(prompt,return_