为提高效率,提问时请提供以下信息,问题描述清晰可优先响应。
【DM版本】:达梦8
【操作系统】:centos
【CPU】:
【问题描述】*:
cdc 使用的是达梦论坛中提供的:https://eco.dameng.com/community/post/202411191132168PD86B201G3HYB7NK5
测试达梦cdc的过程中出现下面报错该如何解决
Caused by: dm.shaded.io.debezium.DebeziumException: The db history topic or its content is fully or partially missing. Please check database history topic configuration and re-execute the snapshot.
at dm.shaded.io.debezium.connector.dm.DMDatabaseSchema.recover(DMDatabaseSchema.java:95)
at dm.shaded.com.ververica.cdc.connectors.dm.source.reader.fetch.DMSourceFetchTaskContext.validateAndLoadDatabaseHistory(DMSourceFetchTaskContext.java:301)
at dm.shaded.com.ververica.cdc.connectors.dm.source.reader.fetch.DMSourceFetchTaskContext.configure(DMSourceFetchTaskContext.java:124)
at dm.shaded.com.ververica.cdc.connectors.base.source.reader.external.IncrementalSourceStreamFetcher.submitTask(IncrementalSourceStreamFetcher.java:84)
at dm.shaded.com.ververica.cdc.connectors.dm.source.reader.DMIncrementalSourceSplitReader.checkSplitOrStartNext(DMIncrementalSourceSplitReader.java:135)
at dm.shaded.com.ververica.cdc.connectors.dm.source.reader.DMIncrementalSourceSplitReader.fetch(DMIncrementalSourceSplitReader.java:62)
at org.apache.flink.connector.base.source.reader.fetcher.FetchTask.run(FetchTask.java:58)
at org.apache.flink.connector.base.source.reader.fetcher.SplitFetcher.runOnce(SplitFetcher.java:142)
... 6 more

遇到相同问题,跟了下代码,这个异常是
if (hasNonNullOffsets) {
if (!this.databaseHistory.exists()) {
String msg = "The db history topic or its content is fully or partially missing. Please check database history topic configuration and re-execute the snapshot.";
throw new DebeziumException(msg);
这里抛出的,一层层往上排查,基本上是tableSchemas集合为空集合引发的,排查下DMSourceBuilder中的schemaList是不是没有match到库中的schema导致的