Eric Dumazet 625788b584 net: add per-cpu storage and net->core_stats ... Before adding yet another possibly contended atomic_long_t, it is time to add per-cpu storage for existing ones: dev->tx_dropped, dev->rx_dropped, and dev->rx_nohandler Because many devices do not have to increment such counters, allocate the per-cpu storage on demand, so that dev_get_stats() does not have to spend considerable time folding zero counters. Note that some drivers have abused these counters which were supposed to be only used by core networking stack. v4: should use per_cpu_ptr() in dev_get_stats() (Jakub) v3: added a READ_ONCE() in netdev_core_stats_alloc() (Paolo) v2: add a missing include (reported by kernel test robot <lkp@intel.com>) Change in netdev_core_stats_alloc() (Jakub) Signed-off-by: Eric Dumazet <edumazet@google.com> Cc: jeffreyji <jeffreyji@google.com> Reviewed-by: Brian Vazquez <brianvv@google.com> Reviewed-by: Jakub Kicinski <kuba@kernel.org> Acked-by: Paolo Abeni <pabeni@redhat.com> Link: https://lore.kernel.org/r/20220311051420.2608812-1-eric.dumazet@gmail.com Signed-off-by: Jakub Kicinski <kuba@kernel.org>		2022-03-11 23:17:24 -08:00
..
bpf_sk_storage.c	bpf: Allow bpf_local_storage to be used by sleepable programs	2021-12-29 17:54:40 -08:00
datagram.c	net: avoid double accounting for pure zerocopy skbs	2021-11-03 11:19:49 +00:00
datagram.h
dev_addr_lists_test.c	net: kunit: add a test for dev_addr_lists	2021-11-20 12:25:57 +00:00
dev_addr_lists.c	dev_addr_list: put the first addr on the tree	2021-11-20 12:25:57 +00:00
dev_ioctl.c	net_tstamp: add new flag HWTSTAMP_FLAG_BONDED_PHC_INDEX	2021-12-14 12:28:24 +00:00
dev.c	net: add per-cpu storage and net->core_stats	2022-03-11 23:17:24 -08:00
devlink.c	Merge git://git.kernel.org/pub/scm/linux/kernel/git/bpf/bpf-next	2021-12-31 14:35:40 +00:00
drop_monitor.c	drop_monitor: remove quadratic behavior	2022-02-23 12:39:58 +00:00
dst_cache.c	wireguard: device: reset peer src endpoint when netns exits	2021-11-29 19:50:45 -08:00
dst.c	net: dst: add net device refcount tracking to dst_entry	2021-12-06 16:05:10 -08:00
failover.c	net: failover: add net device refcount tracker	2021-12-06 16:06:02 -08:00
fib_notifier.c
fib_rules.c	fib: expand fib_rule_policy	2021-12-16 07:18:35 -08:00
filter.c	bpf: Add __sk_buff->delivery_time_type and bpf_skb_set_skb_delivery_time()	2022-03-03 14:38:49 +00:00
flow_dissector.c	flow_dissector: Add support for HSRv0	2022-03-11 11:05:52 +00:00
flow_offload.c	flow_offload: add reoffload process to update hw_count	2021-12-19 14:08:48 +00:00
gen_estimator.c	net: sched: Remove Qdisc::running sequence counter	2021-10-18 12:54:41 +01:00
gen_stats.c	net: stats: Read the statistics in ___gnet_stats_copy_basic() instead of adding.	2021-10-21 12:47:56 +01:00
gro_cells.c	net: add per-cpu storage and net->core_stats	2022-03-11 23:17:24 -08:00
gro.c	Merge git://git.kernel.org/pub/scm/linux/kernel/git/netdev/net	2022-03-10 17:16:56 -08:00
hwbm.c
link_watch.c	net: refine dev_put()/dev_hold() debugging	2022-02-05 15:22:45 +00:00
lwt_bpf.c	net: Don't include filter.h from net/sock.h	2021-12-29 08:48:14 -08:00
lwtunnel.c	lwtunnel: Validate RTA_ENCAP_TYPE attribute length	2021-12-31 14:31:59 +00:00
Makefile	net: kunit: add a test for dev_addr_lists	2021-11-20 12:25:57 +00:00
neighbour.c	net: neigh: use kfree_skb_reason() for __neigh_event_send()	2022-02-26 12:53:59 +00:00
net_namespace.c	net: initialize init_net earlier	2022-02-06 11:04:29 +00:00
net-procfs.c	net-procfs: show net devices bound packet types	2022-01-24 11:58:46 +00:00
net-sysfs.c	net-sysfs: add check for netdevice being present to speed_show	2022-02-18 10:59:11 +00:00
net-sysfs.h	net-sysfs: add netdev_change_owner()	2020-02-26 20:07:25 -08:00
net-traces.c	tcp: add tracepoint for checksum errors	2021-05-14 15:26:03 -07:00
netclassid_cgroup.c	bpf, cgroups: Fix cgroup v2 fallback on v1/v2 mixed mode	2021-09-13 16:35:58 -07:00
netevent.c	net: core: Correct function name netevent_unregister_notifier() in the kerneldoc	2021-03-28 17:56:56 -07:00
netpoll.c	netpoll: add net device refcount tracker to struct netpoll	2021-12-06 16:06:02 -08:00
netprio_cgroup.c	bpf, cgroups: Fix cgroup v2 fallback on v1/v2 mixed mode	2021-09-13 16:35:58 -07:00
of_net.c	Revert "of: net: support NVMEM cells with MAC in text format"	2022-01-12 14:14:36 +00:00
page_pool.c	page_pool: Add function to batch and return stats	2022-03-03 09:55:28 +00:00
pktgen.c	proc: remove PDE_DATA() completely	2022-01-22 08:33:37 +02:00
ptp_classifier.c	ptp: Add generic PTP is_sync() function	2022-03-07 11:31:34 +00:00
request_sock.c	tcp: add rcu protection around tp->fastopen_rsk	2019-10-13 10:13:08 -07:00
rtnetlink.c	net: limit altnames to 64k total	2022-03-10 20:15:23 -08:00
scm.c	memcg: enable accounting for scm_fp_list objects	2021-07-20 06:00:38 -07:00
secure_seq.c	net: align static siphash keys	2021-11-16 19:07:54 -08:00
selftests.c	net: core: constify mac addrs in selftests	2021-10-24 13:59:44 +01:00
skbuff.c	net: skb: introduce the function kfree_skb_list_reason()	2022-03-04 12:17:11 +00:00
skmsg.c	bpf, sockmap: Do not ignore orig_len parameter	2022-03-02 22:49:03 -08:00
sock_destructor.h	skb_expand_head() adjust skb->truesize incorrectly	2021-10-22 12:35:51 -07:00
sock_diag.c	net: Don't include filter.h from net/sock.h	2021-12-29 08:48:14 -08:00
sock_map.c	bpf: support BPF_PROG_QUERY for progs attached to sockmap	2022-01-20 21:30:58 -08:00
sock_reuseport.c	tcp: Add stats for socket migration.	2021-06-23 12:56:08 -07:00
sock.c	SO_ZEROCOPY should return -EOPNOTSUPP rather than -ENOTSUPP	2022-03-08 22:14:49 -08:00
stream.c	net: stream: don't purge sk_error_queue in sk_stream_kill_queues()	2021-10-16 09:06:09 +01:00
sysctl_net_core.c	net/sysctl: avoid two synchronize_rcu() calls	2022-02-28 11:40:47 +00:00
timestamping.c	net: Introduce a new MII time stamping interface.	2019-12-25 19:51:33 -08:00
tso.c	net: tso: add UDP segmentation support	2020-06-18 20:46:23 -07:00
utils.c	net: core: Use csum_replace_by_diff() and csum_sub() instead of opencoding	2022-02-21 11:40:44 +00:00
xdp.c	Merge git://git.kernel.org/pub/scm/linux/kernel/git/netdev/net	2022-03-10 17:16:56 -08:00