V2EX jackLoveDota 的所有回复 第 1 页 / 共 2 页
V2EX = way to explore
V2EX 是一个关于分享和探索的地方
现在注册
已注册用户请  登录
V2EX    jackLoveDota    全部回复第 1 页 / 共 2 页
回复总数  35
1  2  
谢谢回答,还是不生效,我看了 connector-clickhouse 的源码,好像就没有配置项可以开启 https
这是加上 secure=true 的启动结果
Caused by: com.clickhouse.client.ClickHouseException: Connection reset, server ClickHouseNode [uri=http://xxx.aws.clickhouse.cloud:8443/local_test, optiOns={server_time_zOne=UTC}]@-1455942788
at com.clickhouse.client.ClickHouseException.of(ClickHouseException.java:168)
at com.clickhouse.client.AbstractClient.lambda$execute$0(AbstractClient.java:291)
at java.base/java.util.concurrent.CompletableFuture$AsyncSupply.run(CompletableFuture.java:1768)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1144)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:642)
at java.base/java.lang.Thread.run(Thread.java:1583)
Caused by: java.net.SocketException: Connection reset
at java.base/sun.nio.ch.NioSocketImpl.implRead(NioSocketImpl.java:318)
at java.base/sun.nio.ch.NioSocketImpl.read(NioSocketImpl.java:346)
at java.base/sun.nio.ch.NioSocketImpl$1.read(NioSocketImpl.java:796)
at java.base/java.net.Socket$SocketInputStream.read(Socket.java:1099)
at java.base/java.io.BufferedInputStream.fill(BufferedInputStream.java:291)
at java.base/java.io.BufferedInputStream.read1(BufferedInputStream.java:347)
at java.base/java.io.BufferedInputStream.implRad(BufferedInputStream.java:420)
at java.base/java.io.BufferedInputStream.read(BufferedInputStream.java:399)
at java.base/sun.net.www.http.HttpClient.parseHTTPHeader(HttpClient.java:827)
at java.base/sun.net.www.http.HttpClient.parseHTTP(HttpClient.java:759)
at java.base/sun.net.www.http.HttpClient.parseHTTP(HttpClient.java:786)
at java.base/sun.net.www.protocol.http.HttpURLConnection.getInputStream0(HttpURLConnection.java:1690)
at java.base/sun.net.www.protocol.http.HttpURLConnection.getInputStream(HttpURLConnection.java:1599)
at java.base/java.net.HttpURLConnection.getResponseCode(HttpURLConnection.java:531)
at com.clickhouse.client.http.HttpUrlConnectionImpl.checkResponse(HttpUrlConnectionImpl.java:162)
at com.clickhouse.client.http.HttpUrlConnectionImpl.post(HttpUrlConnectionImpl.java:289)
at com.clickhouse.client.http.ClickHouseHttpClient.send(ClickHouseHttpClient.java:123)
at com.clickhouse.client.AbstractClient.sendAsync(AbstractClient.java:156)
at com.clickhouse.client.AbstractClient.lambda$execute$0(AbstractClient.java:289)
这是脱敏后的配置文件,有那么用过的能帮忙解决下,解决后留地址,打 100u 给大佬买咖啡,谢谢了
```
env {
execution.parallelism = 8
job.mode = "STREAMING"
# 检查点配置
checkpoint.interval = 60000
# 支持多次运行
restart.strategy = "fixed-delay"
restart.attempts = 3
}
source {
# MySQL 源表配置
MySQL-CDC {
result_table_name = "mysql_source"
server-id = 5400-5408
hostname = "localhost"
port = 3306
username = "root"
password = "root"
database-name = "abc"
# t_test 每天数据量 1000w ,按照天为纬度分表,这里合并到 clickhouse ,聚合成一张表,方便统计,是否合理?
table-names = ["abc.t_test","abc.t_test_*"]
base-url = "jdbc:mysql://localhost:3306/abc"
# 需要全量+增量
startup.mode = "INITIAL"
driver = "com.mysql.cj.jdbc.Driver"
# CDC 配置
monitor.interval = 1000
chunk.size = 32768
exactly-Once= true
# 并行读取配置
split.size = 50000
split.even-distribution.factor.lower-bound = 0.05
split.even-distribution.factor.upper-bound = 0.95
# 并行读取优化
connection.pool.size = 8 # 增加连接池大小
fetch.size = 10000 # 增加每次获取的记录数

# 启用批量模式
enable.batch = true
batch.size = 10000

# 记录同步位点
offset.storage = "filesystem"
offset.storage.path = "/tmp/seatunnel/offset"
}
}
transform {
Sql {
query = """
SELECT
id,
CASE
WHEN statistic_finished = 1 THEN 1
ELSE 0
END as statistic_finished,
ip,
created_at,
updated_at
FROM mysql_source
"""
}
}
sink {
Clickhouse {
# ClickHouse Cloud 连接配置
host = "xxx.clickhouse.cloud:8443"
database = "local_test"
table = "t_test"
username = "default"
password = "123456"
# 表操作配置
primary_key = "id"
# 针对公网延迟优化的写入配置
bulk_size = 5000 # 考虑网络延迟,稍微减小批量
flush_interval = 5000 # 增加刷新间隔
# 重试配置
retry_codes = [429, 500, 503]
max_retries = 5
retry_interval = 10000
# 超时配置
connect_timeout = 60000
socket_timeout = 300000
# 连接池配置
connection_pool {
max_size = 16
core_size = 8
min_evictable_idle_time_millis = 300000
}
# 写入优化
enable_partition = true
partition_strategy = "balanced"
# 压缩配置
compression = true
compression_type = "gzip"
# 时区设置
server_time_zOne= "UTC"
}
}
```
2024-02-29 16:33:32 +08:00
回复了 whoami9426 创建的主题 生活 如何帮父母代缴社保医保?
我母亲还有几个月 60 岁,湖北农村户口,身体健康,体检没有任何问题,目前只交了新农合,这种一次性补缴 60 岁划算吗?我有点算不明白
2024-02-22 10:15:43 +08:00
回复了 codcrafts 创建的主题 旅行 4 月份去泰国旅游,有没有什么注意的
最近朋友有想法在清迈开民宿,有邀请我加入,这块有搞头吗
支持一下,试用下
2023-10-20 11:25:33 +08:00
回复了 BaseException 创建的主题 生活 骑电瓶车未戴头盔被摄像头拍到,收到短信了
请问下,你们的头盔都是怎么放的,2 个头盔感觉电动车放不下
2023-07-28 14:08:29 +08:00
回复了 EyebrowsWhite 创建的主题 推广 [抽奖] 评论送两台 OneKey Mini
中奖中奖
界面挺不错的,求个码试用下,邮箱 NTAyMzA4NzkzamFja0BnbWFpbC5jb20=
2023-05-15 08:57:16 +08:00
回复了 iyobucuo 创建的主题 推广 [抽奖 4 斤樱桃] 烟台大樱桃 - 感谢 - 感悟
万一中了呢
2023-05-08 16:48:14 +08:00
回复了 ackyes 创建的主题 推广 送 一个 ChatGPT plus
分子
2023-04-21 15:19:32 +08:00
回复了 opentrade 创建的主题 程序员 五一来了,大家公司有发啥福利没?
没被辞退算吗
2023-04-06 18:20:19 +08:00
回复了 dogfood 创建的主题 问与答 有人对量化交易感兴趣吗
MTM4MjUxMjE0NDg= 求拉
1  2  
关于     帮助文档     自助推广系统     博客     API     FAQ     Solana     2984 人在线   最高记录 6679       Select Language
创意工作者们的社区
World is powered by solitude
VERSION: 3.9.8.5 36ms UTC 12:55 PVG 20:55 LAX 04:55 JFK 07:55
Do have faith in what you're doing.
ubao msn snddm index pchome yahoo rakuten mypaper meadowduck bidyahoo youbao zxmzxm asda bnvcg cvbfg dfscv mmhjk xxddc yybgb zznbn ccubao uaitu acv GXCV ET GDG YH FG BCVB FJFH CBRE CBC GDG ET54 WRWR RWER WREW WRWER RWER SDG EW SF DSFSF fbbs ubao fhd dfg ewr dg df ewwr ewwr et ruyut utut dfg fgd gdfgt etg dfgt dfgd ert4 gd fgg wr 235 wer3 we vsdf sdf gdf ert xcv sdf rwer hfd dfg cvb rwf afb dfh jgh bmn lgh rty gfds cxv xcv xcs vdas fdf fgd cv sdf tert sdf sdf sdf sdf sdf sdf sdf sdf sdf sdf sdf sdf sdf sdf sdf sdf sdf sdf sdf sdf sdf sdf sdf sdf sdf sdf sdf sdf sdf sdf sdf sdf sdf sdf sdf sdf sdf sdf sdf sdf shasha9178 shasha9178 shasha9178 shasha9178 shasha9178 liflif2 liflif2 liflif2 liflif2 liflif2 liblib3 liblib3 liblib3 liblib3 liblib3 zhazha444 zhazha444 zhazha444 zhazha444 zhazha444 dende5 dende denden denden2 denden21 fenfen9 fenf619 fen619 fenfe9 fe619 sdf sdf sdf sdf sdf zhazh90 zhazh0 zhaa50 zha90 zh590 zho zhoz zhozh zhozho zhozho2 lislis lls95 lili95 lils5 liss9 sdf0ty987 sdft876 sdft9876 sdf09876 sd0t9876 sdf0ty98 sdf0976 sdf0ty986 sdf0ty96 sdf0t76 sdf0876 df0ty98 sf0t876 sd0ty76 sdy76 sdf76 sdf0t76 sdf0ty9 sdf0ty98 sdf0ty987 sdf0ty98 sdf6676 sdf876 sd876 sd876 sdf6 sdf6 sdf9876 sdf0t sdf06 sdf0ty9776 sdf0ty9776 sdf0ty76 sdf8876 sdf0t sd6 sdf06 s688876 sd688 sdf86