imbajin

2021-12-07 22:55:04,573 [ERROR][rpc:222]: Runstep failed with code: ANALYTICAL_ENGINE_INTERNAL_ERROR, message: Error occurred during preprocessing, The traceback is: Traceback (most recent call last):
  File "/home/graphscope/.local/lib/python3.8/site-packages/gscoordinator/coordinator.py", line 349, in run_on_analytical_engine
    response = self._analytical_engine_stub.RunStep(request)
  File "/home/graphscope/.local/lib/python3.8/site-packages/grpc/_channel.py", line 946, in __call__
    return _end_unary_response_blocking(state, call, False, None)
  File "/home/graphscope/.local/lib/python3.8/site-packages/grpc/_channel.py", line 849, in _end_unary_response_blocking
    raise _InactiveRpcError(state)
grpc._channel._InactiveRpcError: <_InactiveRpcError of RPC that terminated with:
	status = StatusCode.INTERNAL
	details = "ArrowError occurred on worker 0: ArrowError occurred on worker 0: /opt/graphscope/include/graphscope/core/loader/arrow_fragment_loader.h:425: readTableFromLocation -> Arrow error: Invalid

imbajin

Server运行一段时间后写入Hbase提示Cell过大的问题

Server运行一段时间后, 导入数据突然出现提示大量Hbase单Cell超过10Mb的异常, 导入任何数据源都可以触发, 不管是覆盖写入还是更新写入 并且数据源确认没有过长的数据, 而且重启Server之后, 这个错误就不报了... :(

怀疑是HG-Server运行时间长了之后什么隐蔽的问题导致, 但是不确定如何定位.

# 日志截取如下 ,其他都是重复日志 ,输出内容完全一样
2019-07-06 12:50:36 852477567 [hconnection-0x474f77f0-shared-pool14-t6147] [WARN ] org.apache.hadoop.hbase.client.AsyncRequestFutureImpl [] - id=4, table=hugegraph:graph_v, attempt=1/16, failed=8328ops, last exception=org.apache.hadoop.hbase.DoNotRetryIOException: org.apache.hadoop.hbase.DoNotRetryIOException: Cell with size 11438200 exceeds limit of 10485760 bytes