[lvs-users] RX Packet drops on high traffic LVS in DR setup

Sashi Kant sashi.kant at eng.admob.com
Wed Oct 15 18:50:45 BST 2008


Hello list,

We experiencing lots of RX packets being dropped on LVS server. 
Moving some high traffic VIPs to other LVS which reduced rate of packet
drops however not completely eliminated. 

Anyone seen this issue or have insight into it ?

Configuration :

2 Intel Xeon Quad core processors, 8 GB RAM

Debian etch running 2.6.18-6-amd64 kernel.

heartbeat-2                       2.0.7-2
ldirectord-2                      2.0.7-2  
Interface cards 		  Broadcom BCM5708 Gigabit[ eth0 & eth1 are bound
using bonding round robin configuration ] on a Cisco 3560 using group
channel.


VIPS : 15 (1 UDP, 14 TCP) all in Direct server return and WLB mode.
Real Servers : 79
Traffic : 120 Mb/s
Uptime : 1 day


ethtool -S eth0
NIC statistics:
     rx_bytes: 430641106351
     rx_error_bytes: 0
     tx_bytes: 431611074788
     tx_error_bytes: 0
     rx_ucast_packets: 1366781696
     rx_mcast_packets: 0
     rx_bcast_packets: 80484
     tx_ucast_packets: 1369737193
     tx_mcast_packets: 0
     tx_bcast_packets: 255
     tx_mac_errors: 0
     tx_carrier_errors: 0
     rx_crc_errors: 0
     rx_align_errors: 0
     tx_single_collisions: 0
     tx_multi_collisions: 0
     tx_deferred: 0
     tx_excess_collisions: 0
     tx_late_collisions: 0
     tx_total_collisions: 0
     rx_fragments: 0
     rx_jabbers: 0
     rx_undersize_packets: 0
     rx_oversize_packets: 0
     rx_64_byte_packets: 107960817
     rx_65_to_127_byte_packets: 895778205
     rx_128_to_255_byte_packets: 33174681
     rx_256_to_511_byte_packets: 47993184
     rx_512_to_1023_byte_packets: 100704895
     rx_1024_to_1522_byte_packets: 181250398
     rx_1523_to_9022_byte_packets: 0
     tx_64_byte_packets: 108065172
     tx_65_to_127_byte_packets: 897680355
     tx_128_to_255_byte_packets: 33448180
     tx_256_to_511_byte_packets: 47915393
     tx_512_to_1023_byte_packets: 100960219
     tx_1024_to_1522_byte_packets: 181668129
     tx_1523_to_9022_byte_packets: 0
     rx_xon_frames: 0
     rx_xoff_frames: 0
     tx_xon_frames: 0
     tx_xoff_frames: 0
     rx_mac_ctrl_frames: 0
     rx_filtered_packets: 191661
     rx_discards: 0
     rx_fw_discards: 19009


ethtool -S eth1
NIC statistics:
     rx_bytes: 432641015097
     rx_error_bytes: 0
     tx_bytes: 431524032120
     tx_error_bytes: 0
     rx_ucast_packets: 1373169619
     rx_mcast_packets: 0
     rx_bcast_packets: 80491
     tx_ucast_packets: 1369465057
     tx_mcast_packets: 0
     tx_bcast_packets: 214
     tx_mac_errors: 0
     tx_carrier_errors: 0
     rx_crc_errors: 0
     rx_align_errors: 0
     tx_single_collisions: 0
     tx_multi_collisions: 0
     tx_deferred: 0
     tx_excess_collisions: 0
     tx_late_collisions: 0
     tx_total_collisions: 0
     rx_fragments: 0
     rx_jabbers: 0
     rx_undersize_packets: 0
     rx_oversize_packets: 0
     rx_64_byte_packets: 108515278
     rx_65_to_127_byte_packets: 899939130
     rx_128_to_255_byte_packets: 33328340
     rx_256_to_511_byte_packets: 48200913
     rx_512_to_1023_byte_packets: 101184728
     rx_1024_to_1522_byte_packets: 182081721
     rx_1523_to_9022_byte_packets: 0
     tx_64_byte_packets: 108033676
     tx_65_to_127_byte_packets: 897549045
     tx_128_to_255_byte_packets: 33421386
     tx_256_to_511_byte_packets: 47893736
     tx_512_to_1023_byte_packets: 100924619
     tx_1024_to_1522_byte_packets: 181642809
     tx_1523_to_9022_byte_packets: 0
     rx_xon_frames: 0
     rx_xoff_frames: 0
     tx_xon_frames: 0
     tx_xoff_frames: 0
     rx_mac_ctrl_frames: 0
     rx_filtered_packets: 191524
     rx_discards: 0
     rx_fw_discards: 18654




-  

Thanks
-Sashi






More information about the lvs-users mailing list