VersionCount: 501
rab1194639930 发布于2021-10 浏览:674 回复:1
0
收藏
快速回复

VersionCount 为501后,停止spark后也没有降低下来。

be.info

I1018 10:46:20.359575 2822 compaction.cpp:82] start cumulative compaction. tablet=15354.437959963.524cf25b70c814e3-32916c0e2da925a7, output_version=27652-32984, permits: 5
I1018 10:46:20.363271 2822 compaction.cpp:134] succeed to do cumulative compaction. tablet=15354.437959963.524cf25b70c814e3-32916c0e2da925a7, output_version=27652-32984, segments=0. elapsed time=0.003723s.
I1018 10:46:20.363303 2822 cumulative_compaction.cpp:86] after cumulative compaction, current cumulative point is 27652, tablet=15354.437959963.524cf25b70c814e3-32916c0e2da925a7
I1018 10:46:20.406697 2821 compaction.cpp:134] succeed to do cumulative compaction. tablet=12134.410397332.6b4bfb2c3ae2de30-e0185ece90b31d95, output_version=23858-41018, segments=1. elapsed time=0.356423s.
I1018 10:46:20.406733 2821 cumulative_compaction.cpp:86] after cumulative compaction, current cumulative point is 23858, tablet=12134.410397332.6b4bfb2c3ae2de30-e0185ece90b31d95
I1018 10:46:20.415563 2822 compaction.cpp:82] start cumulative compaction. tablet=15358.437959963.e54a476d912683a1-280543a4a4152a86, output_version=27648-32984, permits: 5
I1018 10:46:20.513007 2822 compaction.cpp:134] succeed to do cumulative compaction. tablet=15358.437959963.e54a476d912683a1-280543a4a4152a86, output_version=27648-32984, segments=5. elapsed time=0.097471s.
I1018 10:46:20.513044 2822 cumulative_compaction.cpp:86] after cumulative compaction, current cumulative point is 27648, tablet=15358.437959963.e54a476d912683a1-280543a4a4152a86
I1018 13:46:21.428536 30904 olap_server.cpp:82] compaction tasks producer thread started
I1018 13:46:21.428593 31136 olap_server.cpp:316] try to start compaction producer process!

收藏
点赞
0
个赞
共1条回复 最后由qiliyazhe回复于2021-11
#2qiliyazhe回复于2021-11

这个是由于短时间内频繁导入导致数据文件版本过多导致的。一般停止导入后,后台会自动做compaction version会降下来 

看你这个日志,succeed to do cumulative compaction. compaction实在正常的做,稍微等一会 应该就好了

0
快速回复
TOP
切换版块