求大神帮忙,read error
0大麦O 发布于2020-05-25 04:31 浏览:316 回复:11
0
收藏
最后编辑于2020-05-31

大半夜的,急死了,一直报这个错,求大神帮忙:

------------------------------------------
Python Call Stacks (More useful to users):
------------------------------------------
File "/opt/conda/envs/python35-paddle120-env/lib/python3.7/site-packages/paddle/fluid/framework.py", line 2610, in append_op
attrs=kwargs.get("attrs", None))
File "/opt/conda/envs/python35-paddle120-env/lib/python3.7/site-packages/paddle/fluid/reader.py", line 1078, in _init_non_iterable
attrs={'drop_last': self._drop_last})
File "/opt/conda/envs/python35-paddle120-env/lib/python3.7/site-packages/paddle/fluid/reader.py", line 976, in __init__
self._init_non_iterable()
File "/opt/conda/envs/python35-paddle120-env/lib/python3.7/site-packages/paddle/fluid/reader.py", line 608, in from_generator
iterable, return_list, drop_last)
File "/home/aistudio/PaddleDetection-release-0.3/ppdet/modeling/architectures/cascade_mask_rcnn.py", line 426, in build_inputs
iterable=iterable) if use_dataloader else None
File "PaddleDetection-release-0.3/tools/train.py", line 112, in main
feed_vars, train_loader = model.build_inputs(**inputs_def)
File "PaddleDetection-release-0.3/tools/train.py", line 366, in
main()

----------------------
Error Message Summary:
----------------------
Error: Blocking queue is killed because the data reader raises an exception
[Hint: Expected killed_ != true, but received killed_:1 == true:1.] at (/paddle/paddle/fluid/operators/reader/blocking_queue.h:141)
[operator < read > error]

 

收藏
点赞
0
个赞
共11条回复 最后由鹿鼎记肯定回复于2020-05-31 12:27
#12鹿鼎记肯定回复于2020-05-31 12:27:26
#11 45315879回复
我在运行在GLUE数据集上复现ERNIE时遇到了同样的问题,请问现在问题解决了吗?具体的解决方法是什么?谢谢!
展开

可以去GitHub上找找有没有类似问题,开发的小哥哥会帮你解决的~

0
#1145315879回复于2020-05-30 23:51:55

我在运行在GLUE数据集上复现ERNIE时遇到了同样的问题,请问现在问题解决了吗?具体的解决方法是什么?谢谢!

0
#10鹿鼎记肯定回复于2020-05-26 09:50:00
#9 0大麦O回复
PaddleDetection-release-0.3是用以下代码加载数据的,我尝试了将capacity改小,use_double_buffer改为False,iterable改为True(默认False)都不管用 [代码] 再补充一段错误提示信息: 2020-05-25 22:57:26,321-WARNING: Your reader has raised an exception! Exception in thread Thread-10: Traceback (most recent call last): File "/opt/conda/envs/python35-paddle120-env/lib/python3.7/threading.py", line 926, in _bootstrap_inner self.run() File "/opt/conda/envs/python35-paddle120-env/lib/python3.7/threading.py", line 870, in run self._target(*self._args, **self._kwargs) File "/opt/conda/envs/python35-paddle120-env/lib/python3.7/site-packages/paddle/fluid/reader.py", line 1156, in __thread_main__ six.reraise(*sys.exc_info()) File "/opt/conda/envs/python35-paddle120-env/lib/python3.7/site-packages/six.py", line 693, in reraise raise value File "/opt/conda/envs/python35-paddle120-env/lib/python3.7/site-packages/paddle/fluid/reader.py", line 1136, in __thread_main__ for tensors in self._tensor_reader(): File "/opt/conda/envs/python35-paddle120-env/lib/python3.7/site-packages/paddle/fluid/reader.py", line 1206, in __tensor_reader_impl__ for slots in paddle_reader(): File "/opt/conda/envs/python35-paddle120-env/lib/python3.7/site-packages/paddle/fluid/data_feeder.py", line 505, in __reader_creator__ for item in reader(): File "/home/aistudio/PaddleDetection-release-0.3/ppdet/data/reader.py", line 421, in _reader reader.reset() File "/home/aistudio/PaddleDetection-release-0.3/ppdet/data/parallel_map.py", line 259, in reset assert not self._exit, "cannot reset for already stopped dataset" AssertionError: cannot reset for already stopped dataset
展开

辛苦提一下issue吧

https://github.com/PaddlePaddle/Paddle/issues

0
#90大麦O回复于2020-05-25 23:22:32
#8 鹿鼎记肯定回复
你在DataLoader(dataset, places=place, num_workers=3, batch_size=128, drop_last=True,shuffle=True, use_shared_memory=False)设置use_shared_memory=False试下
展开

PaddleDetection-release-0.3是用以下代码加载数据的,我尝试了将capacity改小,use_double_buffer改为False,iterable改为True(默认False)都不管用

loader = fluid.io.DataLoader.from_generator(
            feed_list=list(feed_vars.values()),
            capacity=16,
            use_double_buffer=True,
            iterable=iterable) if use_dataloader else None

再补充一段错误提示信息:

2020-05-25 22:57:26,321-WARNING: Your reader has raised an exception!
Exception in thread Thread-10:
Traceback (most recent call last):
File "/opt/conda/envs/python35-paddle120-env/lib/python3.7/threading.py", line 926, in _bootstrap_inner
self.run()
File "/opt/conda/envs/python35-paddle120-env/lib/python3.7/threading.py", line 870, in run
self._target(*self._args, **self._kwargs)
File "/opt/conda/envs/python35-paddle120-env/lib/python3.7/site-packages/paddle/fluid/reader.py", line 1156, in __thread_main__
six.reraise(*sys.exc_info())
File "/opt/conda/envs/python35-paddle120-env/lib/python3.7/site-packages/six.py", line 693, in reraise
raise value
File "/opt/conda/envs/python35-paddle120-env/lib/python3.7/site-packages/paddle/fluid/reader.py", line 1136, in __thread_main__
for tensors in self._tensor_reader():
File "/opt/conda/envs/python35-paddle120-env/lib/python3.7/site-packages/paddle/fluid/reader.py", line 1206, in __tensor_reader_impl__
for slots in paddle_reader():
File "/opt/conda/envs/python35-paddle120-env/lib/python3.7/site-packages/paddle/fluid/data_feeder.py", line 505, in __reader_creator__
for item in reader():
File "/home/aistudio/PaddleDetection-release-0.3/ppdet/data/reader.py", line 421, in _reader
reader.reset()
File "/home/aistudio/PaddleDetection-release-0.3/ppdet/data/parallel_map.py", line 259, in reset
assert not self._exit, "cannot reset for already stopped dataset"
AssertionError: cannot reset for already stopped dataset

0
#8鹿鼎记肯定回复于2020-05-25 17:50:05
#7 0大麦O回复
大佬,work_num设置为0, 2个小时都没动,一直停留在“places would be ommited when DataLoader is not iterable”这句log。我跑yolov3就没问题。头大。
展开

你在DataLoader(dataset, places=place, num_workers=3, batch_size=128, drop_last=True,shuffle=True, use_shared_memory=False)设置use_shared_memory=False试下

0
#70大麦O回复于2020-05-25 14:00:24
#4 鹿鼎记肯定回复
这个得看你数据大小了,需要慢慢试错

大佬,work_num设置为0, 2个小时都没动,一直停留在“places would be ommited when DataLoader is not iterable”这句log。我跑yolov3就没问题。头大。

0
#60大麦O回复于2020-05-25 11:28:06
#4 鹿鼎记肯定回复
这个得看你数据大小了,需要慢慢试错

设置为0巨慢

0
#50大麦O回复于2020-05-25 11:27:51
#4 鹿鼎记肯定回复
这个得看你数据大小了,需要慢慢试错

设置为1都报错

0
#4鹿鼎记肯定回复于2020-05-25 11:19:19
#3 0大麦O回复
您说是把work_num设置为0,是吗

这个得看你数据大小了,需要慢慢试错

0
#30大麦O回复于2020-05-25 10:31:01
#2 鹿鼎记肯定回复
开的多线程吗?aistudio的shm只有64mb

您说是把work_num设置为0,是吗

0
#2鹿鼎记肯定回复于2020-05-25 10:19:44

开的多线程吗?aistudio的shm只有64mb

0
TOP
切换版块