fink+iceberg ,如何更新冰山中的数据

问题描述

2021-07-13T11:28:31.187430109+08:00 java.lang.UnsupportedOperationException: 发现覆盖操作,无法支持快照中的增量数据 (6836035541320694960,292593706187078)

2021-07-13T11:28:31.187439398+08:00 在 org.apache.iceberg.IncrementalDataTableScan.snapshotsWithin(IncrementalDataTableScan.java:123) ~[iceberg-flink-runtime-a6a88e6]

>

2021-07-13T11:28:31.187445899+08:00 在 org.apache.iceberg.IncrementalDataTableScan.planFiles(IncrementalDataTableScan.java:73) ~[iceberg-flink-runtime-a6a88e6.jar:?]

2021-07-13T11:28:31.187454652+08:00 在 org.apache.iceberg.BaseTableScan.planTasks(BaseTableScan.java:241) ~[iceberg-flink-runtime-a6a88e6.jar:?]

2021-07-13T11:28:31.187460151+08:00 在 org.apache.iceberg.DataTableScan.planTasks(DataTableScan.java:28) ~[iceberg-flink-runtime-a6a88e6.jar:?]

2021-07-13T11:28:31.187481059+08:00 在 org.apache.iceberg.flink.source.FlinkSplitGenerator.tasks(FlinkSplitGenerator.java:86) ~[iceberg-flink-runtime-a6a88e6.jar:? ]

2021-07-13T11:28:31.187486890+08:00 在 org.apache.iceberg.flink.source.FlinkSplitGenerator.createInputSplits(FlinkSplitGenerator.java:38) ~[iceberg-flink-runtime-a6a88e6.jar: ]

2021-07-13T11:28:31.187493214+08:00 在 org.apache.iceberg.flink.source.StreamingMonitorFunction.monitorAndForwardSplits(StreamingMonitorFunction.java:143) ~[iceberg-flink.jar-8e6a- ]

2021-07-13T11:28:31.187497911+08:00 在 org.apache.iceberg.flink.source.StreamingMonitorFunction.run(StreamingMonitorFunction.java:121) ~[iceberg-flink-runtime-a6a88e6. ]

2021-07-13T11:28:31.187502585+08:00 在 org.apache.flink.streaming.api.operators.StreamSource.run(StreamSource.java:110) ~[flink-dist_2.11-1.12.4 .jar:1.12.4]

2021-07-13T11:28:31.187507397+08:00 在 org.apache.flink.streaming.api.operators.StreamSource.run(StreamSource.java:66) ~[flink-dist_2.11-1.12.4 .jar:1.12.4]

2021-07-13T11:28:31.187512294+08:00 在 org.apache.flink.streaming.runtime.tasks.sourceStreamTask$LegacySourceFunctionThread.run(SourceStreamTask.java:263) ~[flink-dist_2.11-1.1.1.1 .4.jar:1.12.4]

2021-07-13T11:28:31.187545900+08:00 2021-07-13 03:28:31,187 INFO org.apache.flink.runtime.taskmanager.Task [] - 释放任务资源来源:冰山表

解决方法

暂无找到可以解决该程序问题的有效方法,小编努力寻找整理中!

如果你已经找到好的解决方法,欢迎将解决方案带上本链接一起发送给小编。

小编邮箱:dio#foxmail.com (将#修改为@)