Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

starrocks-writer在连接Fe节点时,能不能修改默认超时时间为30S,否则单个Fe节点的集群在写数据时容易报:connect time out #2229

Open
juyonychen opened this issue Oct 23, 2024 · 2 comments

Comments

@juyonychen
Copy link

当使用starrocks-writer插件写数据至sr集群的时候,完全没有规律的会报一下异常
: Failed to connect to address:http://x.x.x.x:8030 java.net.SocketTimeOutException: connect time out
会导致整个datax的采集任务失败;
当我查看了下starrocks-writer插件源代码,发现每次写数据至sr集群时,会测试当前fe节点是否正常连接,我把这段代码复制出来进行单独测试,发现平均1K次会有0-5次左右失败,错误和上面的异常是能对应的;最终参考flink-starrocks插件,代码都相同,只是超时时间datax设置的1s,flink设置的是30秒,当把datax的超时时间修改为30s后,生产环境就比较稳定。

在sr集群中fe节点只有1个的时候这种情况比较常见。如果是3个节点那大概率是不会发生的。

所以能不能将datax中设置超时时间和flink中保持一致,都默认设置为30S?

@juyonychen
Copy link
Author

Uploading 企业微信截图_17283588452442.png…

@mikePengW
Copy link

我估计那需要你自己改源码,重新编译一下了

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants