from_pretrained
-
AutoTokenizer.from_pretrained:从path/vocab.json中加载tokenizer
-
AutoConfig.from_pretrained:从path/config.json中加载模型配置信息
- 更新模型配置信息:model = Model(config)
-
PreTrainedModel.from_pretrained:加载模型结构和模型参数
load_checkpoint
从 checkpoint 中加载模型 parameter,而不加载模型结构
- PreTrainedModel from_pretrained load_state_dict pretrained statepretrainedmodel from_pretrained load_state_dict from_pretrained huggingface from_pretrained pretrained函数 load_state_dict load_state_dict strict state load 模型model load load_state_dict pretrainedmodel pretrainedmodel transformers modeloutput笔记 pretrain pretraining