cassandra 日志中一直出現(xiàn)Connection reset by peer

cassandra 日志中一直出現(xiàn)Connection reset by peer

cassandra 上阿里云后,啟動cassandra日志中一直出現(xiàn)Connection reset by peer,更具體的日志請看下面


INFO  [epollEventLoopGroup-2-42] 2019-05-22 16:23:46,079 Message.java:623 - Unexpected exception during request; channel = [id: 0x107e01cb, L:/172.19.78.33:9042 - R:/100.120.134.66:28963]
io.netty.channel.unix.Errors$NativeIoException: syscall:read(...)() failed: Connection reset by peer
        at io.netty.channel.unix.FileDescriptor.readAddress(...)(Unknown Source) ~[netty-all-4.0.44.Final.jar:4.0.44.Final]
INFO  [epollEventLoopGroup-2-43] 2019-05-22 16:23:46,583 Message.java:623 - Unexpected exception during request; channel = [id: 0xadc8d2f9, L:/172.19.78.33:9042 - R:/100.120.134.2:54244]
io.netty.channel.unix.Errors$NativeIoException: syscall:read(...)() failed: Connection reset by peer
        at io.netty.channel.unix.FileDescriptor.readAddress(...)(Unknown Source) ~[netty-all-4.0.44.Final.jar:4.0.44.Final]
INFO  [epollEventLoopGroup-2-44] 2019-05-22 16:23:46,717 Message.java:623 - Unexpected exception during request; channel = [id: 0x2734761d, L:/172.19.78.33:9042 - R:/100.121.206.192:42460]
io.netty.channel.unix.Errors$NativeIoException: syscall:read(...)() failed: Connection reset by peer
        at io.netty.channel.unix.FileDescriptor.readAddress(...)(Unknown Source) ~[netty-all-4.0.44.Final.jar:4.0.44.Final]
INFO  [epollEventLoopGroup-2-45] 2019-05-22 16:23:47,075 Message.java:623 - Unexpected exception during request; channel = [id: 0x9d1a7792, L:/172.19.78.33:9042 - R:/100.121.206.0:31693]
io.netty.channel.unix.Errors$NativeIoException: syscall:read(...)() failed: Connection reset by peer
        at io.netty.channel.unix.FileDescriptor.readAddress(...)(Unknown Source) ~[netty-all-4.0.44.Final.jar:4.0.44.Final]
INFO  [epollEventLoopGroup-2-46] 2019-05-22 16:23:47,519 Message.java:623 - Unexpected exception during request; channel = [id: 0x9ef064a7, L:/172.19.78.33:9042 - R:/100.120.134.131:30985]
io.netty.channel.unix.Errors$NativeIoException: syscall:read(...)() failed: Connection reset by peer
        at io.netty.channel.unix.FileDescriptor.readAddress(...)(Unknown Source) ~[netty-all-4.0.44.Final.jar:4.0.44.Final]
INFO  [epollEventLoopGroup-2-47] 2019-05-22 16:23:47,787 Message.java:623 - Unexpected exception during request; channel = [id: 0x72d74006, L:/172.19.78.33:9042 - R:/100.121.206.64:52459]
io.netty.channel.unix.Errors$NativeIoException: syscall:read(...)() failed: Connection reset by peer
        at io.netty.channel.unix.FileDescriptor.readAddress(...)(Unknown Source) ~[netty-all-4.0.44.Final.jar:4.0.44.Final]
INFO  [epollEventLoopGroup-2-48] 2019-05-22 16:23:47,865 Message.java:623 - Unexpected exception during request; channel = [id: 0x703a2d37, L:/172.19.78.33:9042 - R:/100.120.134.195:19486]
io.netty.channel.unix.Errors$NativeIoException: syscall:read(...)() failed: Connection reset by peer
        at io.netty.channel.unix.FileDescriptor.readAddress(...)(Unknown Source) ~[netty-all-4.0.44.Final.jar:4.0.44.Final]
INFO  [epollEventLoopGroup-2-49] 2019-05-22 16:23:48,111 Message.java:623 - Unexpected exception during request; channel = [id: 0xa43202af, L:/172.19.78.33:9042 - R:/100.121.206.129:33635]
io.netty.channel.unix.Errors$NativeIoException: syscall:read(...)() failed: Connection reset by peer
        at io.netty.channel.unix.FileDescriptor.readAddress(...)(Unknown Source) ~[netty-all-4.0.44.Final.jar:4.0.44.Final]
INFO  [epollEventLoopGroup-2-50] 2019-05-22 16:23:48,136 Message.java:623 - Unexpected exception during request; channel = [id: 0x300cc413, L:/172.19.78.33:9042 - R:/100.120.134.66:10785]
io.netty.channel.unix.Errors$NativeIoException: syscall:read(...)() failed: Connection reset by peer
        at io.netty.channel.unix.FileDescriptor.readAddress(...)(Unknown Source) ~[netty-all-4.0.44.Final.jar:4.0.44.Final]
INFO  [epollEventLoopGroup-2-51] 2019-05-22 16:23:48,614 Message.java:623 - Unexpected exception during request; channel = [id: 0xee01428d, L:/172.19.78.33:9042 - R:/100.120.134.2:40153]
io.netty.channel.unix.Errors$NativeIoException: syscall:read(...)() failed: Connection reset by peer
        at io.netty.channel.unix.FileDescriptor.readAddress(...)(Unknown Source) ~[netty-all-4.0.44.Final.jar:4.0.44.Final]
INFO  [epollEventLoopGroup-2-52] 2019-05-22 16:23:48,644 Message.java:623 - Unexpected exception during request; channel = [id: 0x74db5764, L:/172.19.78.33:9042 - R:/100.121.206.192:40722]
io.netty.channel.unix.Errors$NativeIoException: syscall:read(...)() failed: Connection reset by peer
        at io.netty.channel.unix.FileDescriptor.readAddress(...)(Unknown Source) ~[netty-all-4.0.44.Final.jar:4.0.44.Final]
INFO  [epollEventLoopGroup-2-53] 2019-05-22 16:23:49,155 Message.java:623 - Unexpected exception during request; channel = [id: 0x5205ed46, L:/172.19.78.33:9042 - R:/100.121.206.0:41350]
io.netty.channel.unix.Errors$NativeIoException: syscall:read(...)() failed: Connection reset by peer
        at io.netty.channel.unix.FileDescriptor.readAddress(...)(Unknown Source) ~[netty-all-4.0.44.Final.jar:4.0.44.Final]

這種情況在我們內(nèi)網(wǎng)開發(fā)環(huán)境當(dāng)然也發(fā)生過,但是都是配置的關(guān)系,導(dǎo)致別的cassandra節(jié)點不能連接,但是這次運維人員確認(rèn)了配置沒有問題。然后開始詳細(xì)看錯誤提示,拿了其中一段日志出來分析

INFO  [epollEventLoopGroup-2-52] 2019-05-22 16:23:48,644 Message.java:623 - Unexpected exception during request; channel = [id: 0x74db5764, L:/172.19.78.33:9042 - R:/100.121.206.192:40722]
io.netty.channel.unix.Errors$NativeIoException: syscall:read(...)() failed: Connection reset by peer
        at io.netty.channel.unix.FileDescriptor.readAddress(...)(Unknown Source) ~[netty-all-4.0.44.Final.jar:4.0.44.Final]

這上面有兩個明細(xì)的IP地址,一個是cassandra節(jié)點的,另一個不知道,然后我一開始并不知道 L跟R代表什么意思,后面去群里請教知道 L是local, R 是request, 這樣的話就能理解這個日志了。就是有很多 100.121.206.* 的節(jié)點嘗試跟 我們的cassandra 建立連接,然后一直導(dǎo)致出現(xiàn)建立連接失敗,日志中這種錯誤信息一直在出現(xiàn),增長率還蠻快的。

我們懷疑過是別的cassandra集群連接我們,我們修改了端口,但是還是有這個錯誤日志,最終排查到是因為做了負(fù)載均衡,一直在做連通性測試。


最后編輯于
?著作權(quán)歸作者所有,轉(zhuǎn)載或內(nèi)容合作請聯(lián)系作者
【社區(qū)內(nèi)容提示】社區(qū)部分內(nèi)容疑似由AI輔助生成,瀏覽時請結(jié)合常識與多方信息審慎甄別。
平臺聲明:文章內(nèi)容(如有圖片或視頻亦包括在內(nèi))由作者上傳并發(fā)布,文章內(nèi)容僅代表作者本人觀點,簡書系信息發(fā)布平臺,僅提供信息存儲服務(wù)。

友情鏈接更多精彩內(nèi)容