类型错误：无法序列化“_io.TextIOWrapper”对象

问题描述

我使用的是 rtx 3080、python 3.7、torch 1.7.1、torchvision 0.8.2

我尝试更改 python 版本和批量大小等。但不起作用..

我该怎么做才能解决这个问题

Traceback (most recent call last):
  File "run_captioning.py",line 882,in <module>
    main()
  File "run_captioning.py",line 861,in main
    global_step,avg_loss = train(args,train_dataset,val_dataset,model,tokenizer)
  File "run_captioning.py",line 424,in train
    for step,(img_keys,batch) in enumerate(train_dataloader):
  File "C:\Users\User\.conda\envs\py37\lib\site-packages\torch\utils\data\dataloader.py",line 352,in __iter__
    return self._get_iterator()
  File "C:\Users\User\.conda\envs\py37\lib\site-packages\torch\utils\data\dataloader.py",line 294,in _get_iterator
    return _MultiProcessingDataLoaderIter(self)
  File "C:\Users\User\.conda\envs\py37\lib\site-packages\torch\utils\data\dataloader.py",line 801,in __init__
    w.start()
  File "C:\Users\User\.conda\envs\py37\lib\multiprocessing\process.py",line 112,in start
    self._popen = self._Popen(self)
  File "C:\Users\User\.conda\envs\py37\lib\multiprocessing\context.py",line 223,in _Popen
    return _default_context.get_context().Process._Popen(process_obj)
  File "C:\Users\User\.conda\envs\py37\lib\multiprocessing\context.py",line 322,in _Popen
    return Popen(process_obj)
  File "C:\Users\User\.conda\envs\py37\lib\multiprocessing\popen_spawn_win32.py",line 65,in __init__
    reduction.dump(process_obj,to_child)
  File "C:\Users\User\.conda\envs\py37\lib\multiprocessing\reduction.py",line 60,in dump
    ForkingPickler(file,protocol).dump(obj)
TypeError: cannot serialize '_io.TextIOWrapper' object

(py37) D:\Oscar\oscar>Traceback (most recent call last):
  File "<string>",line 1,in <module>
  File "C:\Users\User\.conda\envs\py37\lib\multiprocessing\spawn.py",line 105,in spawn_main
    exitcode = _main(fd)
  File "C:\Users\User\.conda\envs\py37\lib\multiprocessing\spawn.py",line 115,in _main
    self = reduction.pickle.load(from_parent)
EOFError: Ran out of input

解决方法

是window编译器的问题。

只有linux提供这个功能。

当我用 wsl 运行这段代码时，错误消失了。