Eric Dumazet 645ca708f9 udp: introduce struct udp_table and multiple spinlocks ... UDP sockets are hashed in a 128 slots hash table. This hash table is protected by *one* rwlock. This rwlock is readlocked each time an incoming UDP message is handled. This rwlock is writelocked each time a socket must be inserted in hash table (bind time), or deleted from this table (close time) This is not scalable on SMP machines : 1) Even in read mode, lock() and unlock() are atomic operations and must dirty a contended cache line, shared by all cpus. 2) A writer might be starved if many readers are 'in flight'. This can happen on a machine with some NIC receiving many UDP messages. User process can be delayed a long time at socket creation/dismantle time. This patch prepares RCU migration, by introducing 'struct udp_table and struct udp_hslot', and using one spinlock per chain, to reduce contention on central rwlock. Introducing one spinlock per chain reduces latencies, for port randomization on heavily loaded UDP servers. This also speedup bindings to specific ports. udp_lib_unhash() was uninlined, becoming to big. Some cleanups were done to ease review of following patch (RCUification of UDP Unicast lookups) Signed-off-by: Eric Dumazet <dada1@cosmosbay.com> Signed-off-by: David S. Miller <davem@davemloft.net>		2008-10-29 01:41:45 -07:00
..
netfilter	netfilter: snmp nat leaks memory in case of failure	2008-10-20 03:33:24 -07:00
af_inet.c	ipv4: Allow binding to non-local addresses if IP_TRANSPARENT is set	2008-10-01 07:31:24 -07:00
ah4.c	[IPSEC]: Fix bogus usage of u64 on input sequence number	2008-02-12 22:50:35 -08:00
arp.c	netfilter: replace old NF_ARP calls with NFPROTO_ARP	2008-10-20 03:34:51 -07:00
cipso_ipv4.c	net: don't use INIT_RCU_HEAD	2008-10-28 13:25:09 -07:00
datagram.c	mib: add net to IP_INC_STATS_BH	2008-07-16 20:20:11 -07:00
devinet.c	net: don't use INIT_RCU_HEAD	2008-10-28 13:25:09 -07:00
esp4.c	ipsec: Interfamily IPSec BEET	2008-08-06 02:39:30 -07:00
fib_frontend.c	netns: add namespace parameter to rt_cache_flush	2008-07-05 19:00:44 -07:00
fib_hash.c	netns: add namespace parameter to rt_cache_flush	2008-07-05 19:00:44 -07:00
fib_lookup.h	[IPV4] FIB_HASH: Reduce memory needs and speedup lookups	2008-01-28 15:02:46 -08:00
fib_rules.c	net: add fib_rules_ops to flush_cache method	2008-07-05 19:01:28 -07:00
fib_semantics.c	Merge branch 'master' of master.kernel.org:/pub/scm/linux/kernel/git/davem/net-2.6	2008-06-13 20:52:39 -07:00
fib_trie.c	proc: consolidate per-net single-release callers	2008-07-18 04:07:44 -07:00
icmp.c	net: reduce structures when XFRM=n	2008-10-28 13:24:06 -07:00
igmp.c	net: Rationalise email address: Network Specific Parts	2008-10-13 19:01:08 -07:00
inet_connection_sock.c	inet: cleanup of local_port_range	2008-10-08 14:18:04 -07:00
inet_diag.c	net: Remove CONFIG_KMOD from net/ (towards removing CONFIG_KMOD entirely)	2008-10-16 15:24:51 -07:00
inet_fragment.c	net: convert BUG_TRAP to generic WARN_ON	2008-07-25 21:43:18 -07:00
inet_hashtables.c	net: convert BUG_TRAP to generic WARN_ON	2008-07-25 21:43:18 -07:00
inet_lro.c	net/inet_lro: remove setting skb->ip_summed when not LRO-able	2008-06-27 20:09:00 -07:00
inet_timewait_sock.c	ipv4: Implement IP_TRANSPARENT socket option	2008-10-01 07:30:02 -07:00
inetpeer.c	net: remove CVS keywords	2008-06-11 21:00:38 -07:00
ip_forward.c	net: reduce structures when XFRM=n	2008-10-28 13:24:06 -07:00
ip_fragment.c	net: Rationalise email address: Network Specific Parts	2008-10-13 19:01:08 -07:00
ip_gre.c	gre: Initialise rtnl_link tunnel parameters properly	2008-10-11 12:20:15 -07:00
ip_input.c	net: Rationalise email address: Network Specific Parts	2008-10-13 19:01:08 -07:00
ip_options.c	cipso: Add support for native local labeling and fixup mapping names	2008-10-10 10:16:34 -04:00
ip_output.c	ipv4: Make Netfilter's ip_route_me_harder() non-local address compatible	2008-10-01 07:44:42 -07:00
ip_sockglue.c	ipv4: Implement IP_TRANSPARENT socket option	2008-10-01 07:30:02 -07:00
ipcomp.c	ipcomp: Fix warnings after ipcomp consolidation.	2008-07-27 03:59:24 -07:00
ipconfig.c	netns: Use net_eq() to compare net-namespaces for optimization.	2008-07-19 22:34:43 -07:00
ipip.c	net: Rationalise email address: Network Specific Parts	2008-10-13 19:01:08 -07:00
ipmr.c	net: Rationalise email address: Network Specific Parts	2008-10-13 19:01:08 -07:00
Kconfig	IPVS: Move IPVS to net/netfilter/ipvs	2008-10-07 08:38:24 +11:00
Makefile	IPVS: Move IPVS to net/netfilter/ipvs	2008-10-07 08:38:24 +11:00
netfilter.c	netfilter: netns: fix {ip,6}_route_me_harder() in netns	2008-10-08 11:35:03 +02:00
proc.c	tcp: MD5: Use MIB counter instead of warning for MD5 mismatch.	2008-07-30 03:27:25 -07:00
protocol.c	net: remove CVS keywords	2008-06-11 21:00:38 -07:00
raw.c	mib: add net to IP_INC_STATS	2008-07-16 20:19:49 -07:00
route.c	net: don't use INIT_RCU_HEAD	2008-10-28 13:25:09 -07:00
syncookies.c	tcp: Port redirection support for TCP	2008-10-01 07:46:49 -07:00
sysctl_net_ipv4.c	net: implement emergency route cache rebulds when gc_elasticity is exceeded	2008-10-27 17:06:14 -07:00
tcp_bic.c	[TCP]: BIC web page link is corrected.	2008-02-28 22:14:32 -08:00
tcp_cong.c	net: Remove CONFIG_KMOD from net/ (towards removing CONFIG_KMOD entirely)	2008-10-16 15:24:51 -07:00
tcp_cubic.c	rename div64_64 to div64_u64	2008-05-01 08:03:58 -07:00
tcp_diag.c	net: remove CVS keywords	2008-06-11 21:00:38 -07:00
tcp_highspeed.c	[TCP]: Cong.ctrl modules: remove unused good_ack from cong_avoid	2008-01-28 14:55:41 -08:00
tcp_htcp.c	[TCP]: Cong.ctrl modules: remove unused good_ack from cong_avoid	2008-01-28 14:55:41 -08:00
tcp_hybla.c	tcp: Fix tcp_hybla zero congestion window growth with small rho and large cwnd.	2008-10-07 15:58:17 -07:00
tcp_illinois.c	[TCP]: Cong.ctrl modules: remove unused good_ack from cong_avoid	2008-01-28 14:55:41 -08:00
tcp_input.c	net: replace uses of NIP6_FMT with %p6	2008-10-28 23:02:31 -07:00
tcp_ipv4.c	tcpv[46]: fix md5 pseudoheader address field ordering	2008-10-09 14:37:47 -07:00
tcp_lp.c	[TCP]: Cong.ctrl modules: remove unused good_ack from cong_avoid	2008-01-28 14:55:41 -08:00
tcp_minisocks.c	tcp: kill pointless urg_mode	2008-10-07 14:43:06 -07:00
tcp_output.c	syncookies: fix inclusion of tcp options in syn-ack	2008-10-26 23:10:12 -07:00
tcp_probe.c	tcp: correct kcalloc usage	2008-07-10 16:51:32 -07:00
tcp_scalable.c	[TCP]: Cong.ctrl modules: remove unused good_ack from cong_avoid	2008-01-28 14:55:41 -08:00
tcp_timer.c	net: replace uses of NIP6_FMT with %p6	2008-10-28 23:02:31 -07:00
tcp_vegas.c	net: fix returning void-valued expression warnings	2008-05-01 02:47:38 -07:00
tcp_vegas.h	[TCP]: congestion control API pass RTT in microseconds	2007-07-31 02:27:57 -07:00
tcp_veno.c	net: fix returning void-valued expression warnings	2008-05-01 02:47:38 -07:00
tcp_westwood.c	[TCP]: congestion control API pass RTT in microseconds	2007-07-31 02:27:57 -07:00
tcp_yeah.c	[TCP]: Cong.ctrl modules: remove unused good_ack from cong_avoid	2008-01-28 14:55:41 -08:00
tcp.c	tcp: kill pointless urg_mode	2008-10-07 14:43:06 -07:00
tunnel4.c	[IPV4] TUNNEL4: Fix incoming packet length check for inter-protocol tunnel.	2008-06-05 04:02:33 +09:00
udp_impl.h	udp: introduce struct udp_table and multiple spinlocks	2008-10-29 01:41:45 -07:00
udp.c	udp: introduce struct udp_table and multiple spinlocks	2008-10-29 01:41:45 -07:00
udplite.c	udp: introduce struct udp_table and multiple spinlocks	2008-10-29 01:41:45 -07:00
xfrm4_input.c	[IPSEC]: Fix transport-mode async resume on intput without netfilter	2008-01-28 15:00:10 -08:00
xfrm4_mode_beet.c	ipsec: Interfamily IPSec BEET	2008-08-06 02:39:30 -07:00
xfrm4_mode_transport.c	[IPSEC]: Use IPv6 calling convention as the convention for x->mode->output	2007-10-10 16:55:54 -07:00
xfrm4_mode_tunnel.c	xfrm: fix fragmentation for ipv4 xfrm tunnel	2008-06-17 16:38:23 -07:00
xfrm4_output.c	[IPSEC]: Fix inter address family IPsec tunnel handling.	2008-03-24 14:51:51 -07:00
xfrm4_policy.c	[NET] NETNS: Omit net_device->nd_net without CONFIG_NET_NS.	2008-03-26 04:39:53 +09:00
xfrm4_state.c	[IPSEC]: Fix BEET output	2008-03-26 16:51:09 -07:00
xfrm4_tunnel.c	[IPCOMP]: Fix reception of incompressible packets	2008-01-31 19:27:24 -08:00