注册

急急急-达梦快速载入dmfldr导入数据时,数据存在换行符问题;

CHAO 2025/02/11 545 8

我在写一个程序,用来把mysql的数据定时同步到达梦数据库中,逻辑是这样的,msyql 导出csv,在利用dmfldr导入到达梦数据库,但是在达梦导入的时候,勿把数据中的换行符当成了新的一行,导致导入时数据错误而导入失败,csv每个字段的数据都是用双引号引起来的,但似乎也还是当成了两行进行导入,请问一下,这种情况需要怎么处理,dmfldr有没有相关参数进行配置,忽略数据里的换行符,我找了几天没试出来;
下面是我导入的一些信息.

mysql导出:
SELECT
*
FROM
BIC_AZXM_D00200
INTO OUTFILE '/data/mysql_data/backup/25021122312978gxtf.BIC_AZXM_D00200.csv'
CHARACTER SET utf8mb4
FIELDS TERMINATED BY ','
OPTIONALLY ENCLOSED BY '"'
LINES TERMINATED BY '\n'

导出的CSV某行内容:
"01fbafe6-f312-499b-bd82-915e13b41dde","45","1003482282","2021年长讯通信服务有限公司2020年天等东平镇光缆整治项目立项(GXCZA1901151BGY00-GX00047)","东平镇光缆整治项目立项(GXCZA1901151BGY00-GX00047)","","GC","00010","00001","A01010102","NULL","00001","00003","GC_AUDIT","审计","","CX-XM-440624-2021-00772-ZXM-01","2021年长讯通信服务有限公司2020年天等东平镇光缆整治项目立项(GXCZA1901151BGY00-GX00047)","00000","NULL","0000000000450014","4500140006","0510003871","451425","S","0510003871","20220117","NULL","20240101","1","3","NULL","2","NULL","20210701","20221231","NULL","20220118","2021年长讯通信服务有限公司2020年天等东平镇光缆整治项目立项
(GXCZA1901151BGY00-GX00047)","1","NULL","NULL","NULL","NULL","NULL","NULL","NULL","NULL","20241127095510","0","NULL","NULL","NULL","NULL","NULL","NULL","","NULL","0","2","NULL","","1","","30","0","0","NULL","45","NULL","NULL","NULL","NULL","NULL","NULL","NULL","NULL","NULL","NULL","NULL","NULL","NULL","NULL","NULL","NULL","NULL","NULL"

达梦导入执行命令:
/home/dmdba/dmdbms/bin/dmfldr 'userid="xxxx"/"xxxxx"@10.xxx.xx.22:5237' control='/data/25021122312978gxtf.BIC_AZXM_D00200-in.ctl' mode='in' NULL_MODE=true

控制文件:
LOAD DATA
INFILE '/data/dmpushTmp/25021122312978gxtf.BIC_AZXM_D00200.csv'
INTO TABLE "gxtf"."BIC_AZXM_D00200"
FIELDS ',' ENCLOSE BY '"'

导入错误数据日志:
[root@10-203-37-22 dmpushTmp]# cat fldr.bad
dmfldr: 2025-02-11 16:06:47 gxtf->BIC_AZXM_D00200 DMFLDR BAD FILE

dmfldr: 2025-02-11 16:06:47 gxtf->BIC_AZXM_D00200 "01fbafe6-f312-499b-bd82-915e13b41dde","45","1003482282","2021年长讯通信服务有限公司2020年天等东平镇光缆整治项目立项 (GXCZA1901151BGY00-GX00047)","东平镇光缆整治项目立项 (GXCZA1901151BGY00-GX00047)","","GC","00010","00001","A01010102","NULL","00001","00003","GC_AUDIT","审计","","CX-XM-440624-2021-00772-ZXM-01","2021年长讯通信服务有限公司2020年天等东平镇光缆整治项目立项 (GXCZA1901151BGY00-GX00047)","00000","NULL","0000000000450014","4500140006","0510003871","451425","S","0510003871","20220117","NULL","20240101","1","3","NULL","2","NULL","20210701","20221231","NULL","20220118","2021年长讯通信服务有限公司2020年天等东平镇光缆整治项目立项

dmfldr: 2025-02-11 16:06:47 gxtf->BIC_AZXM_D00200 (GXCZA1901151BGY00-GX00047)","1","NULL","NULL","NULL","NULL","NULL","NULL","NULL","NULL","20241127095510","0","NULL","NULL","NULL","NULL","NULL","NULL","","NULL","0","2","NULL","","1","","30","0","0","NULL","45","NULL","NULL","NULL","NULL","NULL","NULL","NULL","NULL","NULL","NULL","NULL","NULL","NULL","NULL","NULL","NULL","NULL","NULL"

回答 0
暂无回答
扫一扫
联系客服