[lvs-users] connections are remaining established for very long periods

Gary Smith gary.smith at holdstead.com
Sun Apr 25 21:37:29 BST 2010


I've setup several a few different clusters this week on our test servers and I have noticed that there are a lot of lingering connections that are marked as open on some of the real servers.  I have a clamsmtpd cluster, spamassassin cluster, and a mysql cluster in place.  

The clamsmtpd cluster is ranging somewhere in the ~240 established connections per server.  On the calling servers there are two.  Coincidentally, there have been about 500 requests per server total in the last 48 hours per server, thus 50% of the connections are still appearing open.  The big concern here is that production has this number per minute (not ever 48 hours).  

I had a similar issue with mysql but I dropped the idle connection timeout to 15 minutes and it stabilized.  Any ideas on how to resolve these connections with the other services?

Ipvsadm -Sn
-A -t 10.80.55.11:3917 -s wlc
-a -t 10.80.55.11:3917 -r 10.80.50.2:3917 -m -w 100
-a -t 10.80.55.11:3917 -r 10.80.50.3:3917 -m -w 100
-A -t 10.80.55.13:5847 -s wlc
-a -t 10.80.55.13:5847 -r 10.80.51.3:5847 -m -w 100
-a -t 10.80.55.13:5847 -r 10.80.51.2:5847 -m -w 100


Output from netstat -atunepn
tcp        0      0 10.80.51.2:5847             10.80.91.15:53714         ESTABLISHED 500        23388      1843/perl
--rate
IP Virtual Server version 1.2.1 (size=4096)
Prot LocalAddress:Port                 CPS    InPPS   OutPPS    InBPS   OutBPS
  -> RemoteAddress:Port
TCP  10.80.55.11:3917                    0        2        2      153     1135
  -> 10.80.50.2:3917                     0        1        1      111      667
  -> 10.80.50.3:3917                     0        0        1       42      468
TCP  10.80.55.13:5847                    0        0        0        0        0
  -> 10.80.51.3:5847                     0        0        0        0        0
  -> 10.80.51.2:5847                     0        0        0        0        0

--stats
IP Virtual Server version 1.2.1 (size=4096)
Prot LocalAddress:Port               Conns   InPkts  OutPkts  InBytes OutBytes
  -> RemoteAddress:Port
TCP  10.80.55.11:3917                80577  1141313  1149588  143804K  562393K
  -> 10.80.50.2:3917                 40248   571893   575238 72416158  280880K
  -> 10.80.50.3:3917                 40329   569420   574350 71388368  281512K
TCP  10.80.55.13:5847                  834     6475     4290  1590616   354409
  -> 10.80.51.3:5847                   440     3376     2255   825578   185876
  -> 10.80.51.2:5847                   394     3099     2035   765038   168533
All of the OS's are CentOS 5.4 (current updates).

	




More information about the lvs-users mailing list