如何摆脱GPT-2警告消息？

问题描述

每次我运行GPT-2时，都会收到此消息。有什么办法可以解决这个问题吗？

Some weights of GPT2LMHeadModel were not initialized from the model checkpoint at gpt2 and are newly initialized: ['h.0.attn.masked_bias','h.1.attn.masked_bias','h.2.attn.masked_bias','h.3.attn.masked_bias','h.4.attn.masked_bias','h.5.attn.masked_bias','h.6.attn.masked_bias','h.7.attn.masked_bias','h.8.attn.masked_bias','h.9.attn.masked_bias','h.10.attn.masked_bias','h.11.attn.masked_bias','lm_head.weight']
You should probably TRAIN this model on a down-stream task to be able to use it for predictions and inference.

解决方法

是的，您需要更改loglevel ，然后再从转换器库中导入任何内容：

import logging
logging.basicConfig(level='ERROR')

from transformers import GPT2LMHeadModel

model = GPT2LMHeadModel.from_pretrained('gpt2')