Search before asking
Version
4.0.1
What's Wrong?
通过kafka消费,flink实时同步到Doris时,报错Could not find function date_trunc ,偶发现象,怀疑是kafka的字段为空,但为啥报错是date_trunc 找不到,从日志上event_name 字段是String,但为啥进行时间转换?不太理解
,查看了下源码,是不是bug问题没有注册date_trunc .偶发性问题
以下为flink日志信息:
Caused by: org.apache.doris.flink.exception.DorisRuntimeException: table chapters_log.public_event_data stream load error: [CANCELLED]cancelled: [INTERNAL_ERROR]Could not find function date_trunc, arg event_name: Nullable(String), String: String return DateV2
0# doris::vectorized::VectorizedFnCall::prepare(doris::RuntimeState*, doris::RowDescriptor const&, doris::vectorized::VExprContext*) at /usr/local/ldb-toolchain-v0.26/bin/../lib/gcc/x86_64-pc-linux-gnu/15/include/g++-v15/bits/basic_string.h:239
1# doris::vectorized::VExprContext::prepare(doris::RuntimeState*, doris::RowDescriptor const&) at /home/zcp/repo_center/doris_release/doris/be/src/vec/exprs/vexpr_context.cpp:0
2# doris::vectorized::VRowDistribution::open(doris::RowDescriptor*) at /home/zcp/repo_center/doris_release/doris/be/src/common/status.h:524
3# doris::vectorized::VTabletWriter::_init_row_distribution() at /home/zcp/repo_center/doris_release/doris/be/src/vec/sink/writer/vtablet_writer.cpp:1414
4# doris::vectorized::VTabletWriter::_init(doris::RuntimeState*, doris::RuntimeProfile*) at /home/zcp/repo_center/doris_release/doris/be/src/common/status.h:524
5# doris::vectorized::VTabletWriter::open(doris::RuntimeState*, doris::RuntimeProfile*) at /home/zcp/repo_center/doris_release/doris/be/src/common/status.h:524
6# doris::vectorized::AsyncResultWriter::process_block(doris::RuntimeState*, doris::RuntimeProfile*) at /home/zcp/repo_center/doris_release/doris/be/src/common/status.h:524
7# std::_Function_handler<void (), doris::vectorized::AsyncResultWriter::start_writer(doris::RuntimeState*, doris::RuntimeProfile*)::$_0>::_M_invoke(std::_Any_data const&) at /usr/local/ldb-toolchain-v0.26/bin/../lib/gcc/x86_64-pc-linux-gnu/15/include/g++-v15/bits/shared_ptr_base.h:1098
8# doris::ThreadPool::dispatch_thread() at /usr/local/ldb-toolchain-v0.26/bin/../lib/gcc/x86_64-pc-linux-gnu/15/include/g++-v15/bits/shared_ptr_base.h:1097
9# doris::Thread::supervise_thread(void*) at /usr/local/ldb-toolchain-v0.26/bin/../usr/include/pthread.h:562
10# ?
11# ?
, see more in null
at org.apache.doris.flink.sink.writer.DorisStreamLoad.stopLoad(DorisStreamLoad.java:331)
at org.apache.doris.flink.sink.writer.DorisWriter.prepareCommit(DorisWriter.java:236)
at org.apache.flink.streaming.runtime.operators.sink.SinkWriterOperator.emitCommittables(SinkWriterOperator.java:208)
at org.apache.flink.streaming.runtime.operators.sink.SinkWriterOperator.prepareSnapshotPreBarrier(SinkWriterOperator.java:174)
at org.apache.flink.streaming.runtime.tasks.RegularOperatorChain.prepareSnapshotPreBarrier(RegularOperatorChain.java:89)
at org.apache.flink.streaming.runtime.tasks.SubtaskCheckpointCoordinatorImpl.checkpointState(SubtaskCheckpointCoordinatorImpl.java:332)
at org.apache.flink.streaming.runtime.tasks.StreamTask.lambda$performCheckpoint$18(StreamTask.java:1437)
at org.apache.flink.streaming.runtime.tasks.StreamTaskActionExecutor$1.runThrowing(StreamTaskActionExecutor.java:50)
at org.apache.flink.streaming.runtime.tasks.StreamTask.performCheckpoint(StreamTask.java:1425)
at org.apache.flink.streaming.runtime.tasks.StreamTask.triggerCheckpointAsyncInMailbox(StreamTask.java:1310)
... 14 more
What You Expected?
提示信息更准确,从日志上看一头雾水
How to Reproduce?
No response
Anything Else?
No response
Are you willing to submit PR?
Code of Conduct
Search before asking
Version
4.0.1
What's Wrong?
通过kafka消费,flink实时同步到Doris时,报错Could not find function date_trunc ,偶发现象,怀疑是kafka的字段为空,但为啥报错是date_trunc 找不到,从日志上event_name 字段是String,但为啥进行时间转换?不太理解
,查看了下源码,是不是bug问题没有注册date_trunc .偶发性问题
以下为flink日志信息:
Caused by: org.apache.doris.flink.exception.DorisRuntimeException: table chapters_log.public_event_data stream load error: [CANCELLED]cancelled: [INTERNAL_ERROR]Could not find function date_trunc, arg event_name: Nullable(String), String: String return DateV2
, see more in null
at org.apache.doris.flink.sink.writer.DorisStreamLoad.stopLoad(DorisStreamLoad.java:331)
at org.apache.doris.flink.sink.writer.DorisWriter.prepareCommit(DorisWriter.java:236)
at org.apache.flink.streaming.runtime.operators.sink.SinkWriterOperator.emitCommittables(SinkWriterOperator.java:208)
at org.apache.flink.streaming.runtime.operators.sink.SinkWriterOperator.prepareSnapshotPreBarrier(SinkWriterOperator.java:174)
at org.apache.flink.streaming.runtime.tasks.RegularOperatorChain.prepareSnapshotPreBarrier(RegularOperatorChain.java:89)
at org.apache.flink.streaming.runtime.tasks.SubtaskCheckpointCoordinatorImpl.checkpointState(SubtaskCheckpointCoordinatorImpl.java:332)
at org.apache.flink.streaming.runtime.tasks.StreamTask.lambda$performCheckpoint$18(StreamTask.java:1437)
at org.apache.flink.streaming.runtime.tasks.StreamTaskActionExecutor$1.runThrowing(StreamTaskActionExecutor.java:50)
at org.apache.flink.streaming.runtime.tasks.StreamTask.performCheckpoint(StreamTask.java:1425)
at org.apache.flink.streaming.runtime.tasks.StreamTask.triggerCheckpointAsyncInMailbox(StreamTask.java:1310)
... 14 more
What You Expected?
提示信息更准确,从日志上看一头雾水
How to Reproduce?
No response
Anything Else?
No response
Are you willing to submit PR?
Code of Conduct