Hugh Dickins 2bcf887963
mm: take pagevecs off reclaim stack ...
Replace pagevecs in putback_lru_pages() and move_active_pages_to_lru()
by lists of pages_to_free: then apply Konstantin Khlebnikov's
free_hot_cold_page_list() to them instead of pagevec_release().
Which simplifies the flow (no need to drop and retake lock whenever
pagevec fills up) and reduces stale addresses in stack backtraces
(which often showed through the pagevecs); but more importantly,
removes another 120 bytes from the deepest stacks in page reclaim.
Although I've not recently seen an actual stack overflow here with
a vanilla kernel, move_active_pages_to_lru() has often featured in
deep backtraces.
However, free_hot_cold_page_list() does not handle compound pages
(nor need it: a Transparent HugePage would have been split by the
time it reaches the call in shrink_page_list()), but it is possible
for putback_lru_pages() or move_active_pages_to_lru() to be left
holding the last reference on a THP, so must exclude the unlikely
compound case before putting on pages_to_free.
Remove pagevec_strip(), its work now done in move_active_pages_to_lru().
The pagevec in scan_mapping_unevictable_pages() remains in mm/vmscan.c,
but that is never on the reclaim path, and cannot be replaced by a list.
Signed-off-by: Hugh Dickins <hughd@google.com >
Reviewed-by: KOSAKI Motohiro <kosaki.motohiro@jp.fujitsu.com >
Reviewed-by: Konstantin Khlebnikov <khlebnikov@openvz.org >
Cc: KAMEZAWA Hiroyuki <kamezawa.hiroyu@jp.fujitsu.com >
Cc: Mel Gorman <mel@csn.ul.ie >
Signed-off-by: Andrew Morton <akpm@linux-foundation.org >
Signed-off-by: Linus Torvalds <torvalds@linux-foundation.org >
2012-01-12 20:13:10 -08:00
2012-01-09 14:28:38 -08:00
2011-12-13 15:31:27 -05:00
2011-08-26 12:02:50 -04:00
2011-12-01 13:09:31 -05:00
2011-11-11 09:50:19 -08:00
2011-09-03 19:07:21 -03:00
2011-11-03 09:40:51 -07:00
2011-12-30 15:25:52 -08:00
2011-12-11 18:25:16 -05:00
2012-01-12 08:00:30 -08:00
2011-12-19 14:57:07 -05:00
2011-12-10 16:18:35 -05:00
2012-01-09 18:26:26 +00:00
2012-01-09 13:08:28 -08:00
2011-08-26 12:02:50 -04:00
2011-12-27 20:31:38 +01:00
2011-08-26 12:02:50 -04:00
2011-09-13 22:44:10 -04:00
2012-01-03 09:10:09 +01:00
2012-01-09 14:21:03 -08:00
2012-01-06 05:22:21 +04:00
2011-12-23 10:17:51 +11:00
2012-01-03 20:20:01 +00:00
2011-09-11 09:17:53 +08:00
2011-11-17 12:15:39 -08:00
2011-12-13 15:30:49 -05:00
2012-01-10 14:57:40 -08:00
2011-07-14 14:45:59 -07:00
2012-01-04 15:52:42 -08:00
2011-10-31 19:32:32 -04:00
2011-12-05 10:21:48 -08:00
2011-07-22 08:25:37 -07:00
2012-01-08 19:14:59 -05:00
2011-11-02 16:07:03 -07:00
2011-08-10 14:55:29 -07:00
2011-12-15 11:15:39 +01:00
2011-07-20 20:47:43 -04:00
2011-06-06 22:55:11 -07:00
2011-12-13 18:46:56 -05:00
2011-08-26 12:02:50 -04:00
2011-06-22 16:09:57 -04:00
2011-11-26 16:40:30 -05:00
2011-10-26 15:43:26 -04:00
2011-10-26 15:43:25 -04:00
2011-07-26 16:49:47 -07:00
2012-01-03 22:55:17 -05:00
2011-08-26 12:02:50 -04:00
2011-10-31 00:33:36 +08:00
2011-09-14 18:09:38 -07:00
2011-07-20 01:43:10 -04:00
2011-11-16 09:21:50 +01:00
2011-07-26 16:49:47 -07:00
2011-08-03 11:30:42 -04:00
2011-12-06 08:33:54 +01:00
2011-10-24 16:11:30 +02:00
2011-11-23 10:59:13 +01:00
2011-10-31 17:30:54 -07:00
2011-08-09 01:33:04 -07:00
2011-07-14 11:47:49 -07:00
2011-07-31 22:05:09 +02:00
2011-07-26 16:49:47 -07:00
2011-05-25 08:39:43 -07:00
2011-10-17 19:22:46 -04:00
2011-10-20 18:21:36 -04:00
2011-11-22 15:22:23 -05:00
2012-01-09 12:59:24 -08:00
2011-05-26 10:01:36 -06:00
2011-12-28 21:25:35 +08:00
2011-10-13 14:36:58 +01:00
2011-10-03 09:34:16 +02:00
2011-09-08 11:10:56 +02:00
2011-12-19 11:41:40 +01:00
2011-09-28 13:41:50 -04:00
2011-10-31 17:30:49 -07:00
2012-01-03 22:55:19 -05:00
2012-01-10 16:30:42 -08:00
2011-05-25 08:39:46 -07:00
2012-01-10 16:30:42 -08:00
2012-01-03 22:54:57 -05:00
2011-08-25 16:25:33 -07:00
2011-10-29 21:20:22 +02:00
2011-09-23 12:05:29 +05:30
2012-01-07 12:03:30 -08:00
2011-06-28 13:54:26 -07:00
2011-12-08 13:57:20 +11:00
2011-07-26 16:49:44 -07:00
2011-05-28 17:02:57 +02:00
2011-10-30 15:16:41 +01:00
2011-06-03 15:01:06 -04:00
2011-08-08 11:33:23 -07:00
2011-11-06 19:44:47 -08:00
2011-08-06 22:12:37 -07:00
2011-10-21 14:24:07 +02:00
2011-07-06 14:44:42 -07:00
2011-07-25 20:57:16 -07:00
2012-01-10 13:06:32 -05:00
2011-07-05 23:42:17 -07:00
2011-06-06 22:55:11 -07:00
2011-07-26 16:49:47 -07:00
2012-01-08 12:19:57 -08:00
2011-11-23 18:49:22 +01:00
2011-11-07 23:54:53 +01:00
2011-10-31 19:32:26 -04:00
2011-10-31 20:19:04 +00:00
2012-01-08 12:19:57 -08:00
2011-11-09 12:10:37 +02:00
2011-06-10 14:55:36 +02:00
2012-01-04 08:56:31 -06:00
2011-05-29 13:03:09 +01:00
2011-10-31 20:19:04 +00:00
2011-10-31 20:18:58 +00:00
2011-10-31 20:21:24 +00:00
2011-12-16 08:49:57 -08:00
2012-01-06 10:20:21 +00:00
2011-06-21 19:17:20 -07:00
2011-11-06 17:12:03 -08:00
2011-11-06 19:44:47 -08:00
2011-10-31 17:30:44 -07:00
2011-06-30 09:23:45 +02:00
2011-09-15 14:02:57 +02:00
2011-10-04 13:08:18 -07:00
2011-05-25 18:30:37 +05:30
2011-10-31 17:30:54 -07:00
2011-11-29 12:46:19 -05:00
2011-06-27 09:11:02 -04:00
2011-12-14 15:21:07 -08:00
2011-11-26 14:59:39 -05:00
2011-07-25 20:57:16 -07:00
2011-12-09 17:35:51 -08:00
2011-10-19 14:33:08 +02:00
2011-10-06 19:47:19 -04:00
2011-10-30 15:16:43 +01:00
2011-12-11 18:25:16 -05:00
2011-07-13 02:29:59 -07:00
2012-01-04 14:10:28 -05:00
2012-01-12 20:13:04 -08:00
2011-09-14 15:24:51 -04:00
2011-10-31 09:20:11 -04:00
2011-08-31 11:54:51 -04:00
2011-10-10 18:25:59 +02:00
2012-01-03 22:54:58 -05:00
2011-08-03 14:25:20 -10:00
2011-07-20 20:47:59 -04:00
2011-07-07 08:18:18 +02:00
2011-07-26 16:49:47 -07:00
2011-10-19 19:35:51 -04:00
2011-07-16 07:24:32 +02:00
2011-07-26 16:49:47 -07:00
2011-10-31 19:32:32 -04:00
2011-05-26 17:12:33 -07:00
2011-12-27 01:06:33 +01:00
2012-01-12 20:13:09 -08:00
2011-10-31 17:30:54 -07:00
2011-07-07 13:21:56 -07:00
2011-07-08 00:21:27 -05:00
2011-10-05 01:10:12 +00:00
2011-07-26 16:49:47 -07:00
2011-12-05 13:28:45 -05:00
2011-10-31 19:32:32 -04:00
2011-08-08 16:08:08 +02:00
2011-11-06 19:44:47 -08:00
2011-08-03 11:15:57 -04:00
2011-07-25 14:30:23 -04:00
2011-12-03 09:35:08 -08:00
2012-01-03 22:54:55 -05:00
2012-01-10 16:30:43 -08:00
2011-11-15 19:08:27 +08:00
2011-10-24 16:04:06 +02:00
2011-07-01 15:34:45 -07:00
2011-12-11 10:31:24 -08:00
2011-08-17 13:00:20 -07:00
2012-01-09 11:24:59 +01:00
2011-06-28 10:48:34 +02:00
2012-01-12 20:13:08 -08:00
2011-05-26 09:20:31 -07:00
2011-11-19 06:15:59 -05:00
2011-07-01 11:06:38 +02:00
2011-05-25 14:15:12 +02:00
2011-11-08 09:28:27 +02:00
2012-01-04 16:13:05 -08:00
2011-10-29 09:37:09 +01:00
2012-01-06 11:42:52 -08:00
2011-07-01 10:37:15 +02:00
2012-01-03 22:54:56 -05:00
2011-08-03 14:25:20 -10:00
2011-12-13 15:30:40 -05:00
2011-12-05 18:27:56 -05:00
2011-10-16 13:15:38 -07:00
2011-10-21 02:53:07 -04:00
2011-10-03 14:03:48 -04:00
2011-08-26 12:02:50 -04:00
2011-08-26 12:02:50 -04:00
2011-11-16 18:16:38 -05:00
2011-12-08 19:52:42 -05:00
2011-11-13 16:10:10 -05:00
2011-07-18 12:29:38 -04:00
2011-08-26 12:02:50 -04:00
2011-12-30 16:42:19 -05:00
2011-07-21 13:47:54 -07:00
2012-01-09 12:59:24 -08:00
2011-10-28 14:25:01 -07:00
2011-09-14 15:24:52 -04:00
2011-10-26 16:17:32 +02:00
2011-10-17 11:42:49 +02:00
2011-10-28 05:54:23 -07:00
2011-07-12 14:24:35 +02:00
2012-01-09 13:06:28 +01:00
2011-07-31 14:30:59 -10:00
2011-09-20 14:50:00 -04:00
2011-07-26 16:49:44 -07:00
2012-01-03 22:55:17 -05:00
2011-10-31 19:32:32 -04:00
2011-10-31 19:32:32 -04:00
2011-12-11 18:25:16 -05:00
2011-08-26 12:02:50 -04:00
2011-08-26 12:02:50 -04:00
2011-10-04 12:43:49 +02:00
2011-10-31 19:32:35 -04:00
2011-10-31 19:32:35 -04:00
2011-12-23 22:33:58 +00:00
2011-06-03 14:53:15 +02:00
2012-01-03 22:54:55 -05:00
2011-09-27 18:08:04 +02:00
2011-12-28 17:46:46 -05:00
2011-10-27 04:38:18 -04:00
2012-01-09 13:52:09 +01:00
2011-09-21 10:28:51 +02:00
2011-07-25 17:24:47 +02:00
2011-12-06 20:41:03 +01:00
2011-10-31 17:30:54 -07:00
2011-12-30 16:42:19 -05:00
2011-07-29 21:53:30 +02:00
2011-10-31 17:30:54 -07:00
2011-12-06 09:06:38 +01:00
2012-01-12 20:13:03 -08:00
2011-10-31 17:46:07 -07:00
2011-11-17 09:35:32 +11:00
2011-07-26 16:49:47 -07:00
2011-07-26 16:49:47 -07:00
2011-12-09 23:36:36 +01:00
2011-06-15 20:03:59 -07:00
2011-06-12 17:45:41 -04:00
2011-12-21 15:13:54 -08:00
2011-09-13 11:11:45 +02:00
2011-12-14 11:19:07 -08:00
2011-11-21 12:32:23 -08:00
2011-12-27 11:24:29 +02:00
2011-12-27 11:26:41 +02:00
2011-12-26 13:27:44 +02:00
2011-08-26 12:02:50 -04:00
2011-09-16 19:20:20 -04:00
2011-11-17 12:20:19 +01:00
2011-07-25 20:57:15 -07:00
2011-05-25 08:39:50 -07:00
2012-01-10 16:30:49 -08:00
2011-05-25 08:39:51 -07:00
2011-12-22 02:02:20 -05:00
2011-07-22 14:39:48 +09:30
2011-10-31 17:30:54 -07:00
2012-01-12 20:13:03 -08:00
2011-10-31 17:30:52 -07:00
2011-08-26 12:02:50 -04:00
2011-10-31 17:30:57 -07:00
2011-11-14 13:35:16 +01:00
2011-12-12 22:06:55 -08:00
2011-11-04 17:22:14 -07:00
2012-01-04 16:25:45 +04:00
2011-11-02 16:06:59 -07:00
2011-12-13 18:46:55 -05:00
2011-11-15 16:56:17 -05:00
2011-11-15 16:56:17 -05:00
2011-12-08 10:22:09 -08:00
2012-01-12 20:13:07 -08:00
2011-07-25 20:57:08 -07:00
2011-12-21 14:48:43 -08:00
2012-01-10 16:30:45 -08:00
2012-01-12 20:13:09 -08:00
2011-11-21 15:27:19 -05:00
2012-01-03 22:55:15 -05:00
2012-01-12 20:13:05 -08:00
2012-01-12 20:13:03 -08:00
2012-01-11 19:12:10 -08:00
2011-07-26 16:49:47 -07:00
2011-10-31 17:30:54 -07:00
2011-05-25 08:39:19 -07:00
2012-01-12 20:13:09 -08:00
2012-01-03 22:57:13 -05:00
2011-11-22 10:58:30 +00:00
2011-10-31 09:20:11 -04:00
2011-07-24 22:06:04 +09:30
2011-10-31 09:20:11 -04:00
2012-01-03 22:57:12 -05:00
2011-11-09 11:45:26 +02:00
2012-01-06 12:10:25 -08:00
2011-07-26 16:49:47 -07:00
2011-11-02 12:53:42 +01:00
2011-11-14 00:47:54 -05:00
2011-10-19 17:00:35 -04:00
2011-05-27 13:41:33 -04:00
2011-11-16 17:43:12 -05:00
2012-01-09 14:46:52 -08:00
2011-08-26 12:02:50 -04:00
2011-08-26 12:02:50 -04:00
2011-08-26 12:02:50 -04:00
2011-11-21 16:38:08 -05:00
2011-12-06 13:57:36 -05:00
2011-07-03 20:02:07 -07:00
2011-08-26 12:02:50 -04:00
2012-01-04 14:30:43 -05:00
2011-10-19 11:52:12 -04:00
2012-01-05 11:59:18 -05:00
2012-01-03 22:52:34 -05:00
2012-01-07 13:22:46 -05:00
2011-10-19 13:58:38 -07:00
2012-01-07 13:22:46 -05:00
2011-07-31 12:18:16 -04:00
2011-12-19 14:34:13 -05:00
2011-11-18 10:51:01 -08:00
2011-12-21 14:48:43 -08:00
2011-07-26 16:49:43 -07:00
2011-07-25 20:57:15 -07:00
2011-07-20 01:44:07 -04:00
2011-07-18 16:37:45 -06:00
2011-12-27 10:57:13 -06:00
2011-12-12 13:40:16 -07:00
2011-10-31 14:03:22 +01:00
2011-07-27 09:30:56 +08:00
2011-06-08 09:08:17 +10:00
2011-10-31 19:32:27 -04:00
2012-01-07 12:18:52 -08:00
2011-08-29 12:38:51 -03:00
2012-01-12 20:13:06 -08:00
2011-12-03 09:35:17 -08:00
2011-11-04 22:28:13 +01:00
2011-09-13 11:12:05 +02:00
2012-01-12 20:13:07 -08:00
2012-01-10 16:30:42 -08:00
2011-07-30 08:21:48 -10:00
2011-07-25 20:57:10 -07:00
2012-01-12 20:13:10 -08:00
2011-10-31 19:32:32 -04:00
2012-01-06 12:11:40 -08:00
2012-01-11 18:50:26 -08:00
2012-01-06 12:10:26 -08:00
2011-10-31 10:23:57 -07:00
2012-01-06 12:15:21 -08:00
2011-08-19 21:03:22 +04:00
2011-09-13 11:11:47 +02:00
2011-12-22 10:40:20 -08:00
2011-12-21 10:26:37 +01:00
2011-08-25 10:17:28 -07:00
2011-11-18 14:37:40 -05:00
2011-10-24 02:54:50 -04:00
2012-01-10 16:30:54 -08:00
2011-05-26 17:12:37 -07:00
2012-01-05 14:01:21 -05:00
2012-01-08 13:10:57 -08:00
2011-07-08 14:02:53 +02:00
2011-08-25 15:34:19 +02:00
2011-12-09 23:22:41 +01:00
2011-12-25 23:43:11 +01:00
2011-12-01 21:46:42 +01:00
2011-12-25 23:43:05 +01:00
2011-07-12 13:40:29 -04:00
2011-06-10 14:55:36 +02:00
2011-12-08 10:22:07 -08:00
2011-08-03 00:58:42 -04:00
2011-08-10 14:55:26 -07:00
2012-01-04 09:09:35 +04:00
2011-11-02 16:07:02 -07:00
2011-06-10 15:15:40 +02:00
2011-10-31 17:30:54 -07:00
2012-01-10 16:30:54 -08:00
2011-09-13 11:11:50 +02:00
2011-11-17 13:13:29 -08:00
2011-07-01 15:39:38 -07:00
2011-09-29 00:32:03 -04:00
2011-07-17 20:23:52 +02:00
2011-08-25 16:25:34 -07:00
2011-07-26 16:49:47 -07:00
2011-10-31 17:30:54 -07:00
2011-08-03 14:25:24 -10:00
2012-01-03 22:55:07 -05:00
2011-07-26 16:49:46 -07:00
2011-10-28 05:29:07 -07:00
2011-09-13 11:11:54 +02:00
2011-07-20 14:10:20 -07:00
2011-12-11 10:32:06 -08:00
2011-09-28 21:38:20 -07:00
2011-09-28 21:36:42 -07:00
2011-07-25 20:57:14 -07:00
2011-12-13 00:12:48 +08:00
2011-07-25 14:30:23 -04:00
2012-01-06 23:20:13 -05:00
2012-01-06 23:20:13 -05:00
2011-07-25 14:30:23 -04:00
2012-01-03 22:54:56 -05:00
2011-10-03 15:19:19 -04:00
2011-08-30 12:27:45 -04:00
2011-11-02 16:07:01 -07:00
2011-08-25 16:25:34 -07:00
2012-01-12 20:13:06 -08:00
2011-08-26 12:02:50 -04:00
2011-07-26 14:50:01 -07:00
2011-07-08 14:02:53 +02:00
2011-07-25 13:56:39 -07:00
2011-09-13 11:11:59 +02:00
2011-09-13 11:11:59 +02:00
2012-01-06 06:13:35 +04:00
2012-01-12 20:13:03 -08:00
2011-07-18 11:06:03 -07:00
2011-06-07 10:02:35 +02:00
2012-01-10 21:51:23 -08:00
2011-11-02 16:07:01 -07:00
2011-09-13 11:11:57 +02:00
2012-01-03 22:52:40 -05:00
2011-06-11 13:17:28 -07:00
2011-12-09 19:14:13 -08:00
2011-11-26 20:11:20 -08:00
2011-09-22 15:50:38 -07:00
2011-12-02 20:09:48 +09:00
2011-11-15 12:13:44 -08:00
2011-10-31 19:32:32 -04:00
2011-12-09 18:01:05 +09:00
2011-06-21 17:56:11 +09:00
2011-09-28 13:41:51 -04:00
2011-12-25 23:39:11 +01:00
2012-01-09 09:33:57 +09:00
2011-07-30 08:44:19 -10:00
2012-01-03 22:55:07 -05:00
2011-12-09 07:50:27 -08:00
2012-01-10 16:30:54 -08:00
2012-01-05 14:01:21 -05:00
2012-01-09 14:19:33 -08:00
2011-07-07 21:04:12 +03:00
2011-06-16 19:40:20 +03:00
2011-09-27 23:03:30 +03:00
2011-06-17 10:17:12 +02:00
2012-01-03 20:23:18 -05:00
2011-09-15 14:49:43 -04:00
2011-12-30 16:42:19 -05:00
2011-08-07 22:48:07 -07:00
2011-07-26 16:49:47 -07:00
2011-07-26 16:49:47 -07:00
2011-07-25 20:57:11 -07:00
2011-12-11 10:32:06 -08:00
2011-06-14 22:48:51 -04:00
2011-07-21 15:29:16 -07:00
2011-10-31 19:32:28 -04:00
2011-10-31 17:30:47 -07:00
2011-08-16 00:16:49 -07:00
2011-12-08 23:22:21 +01:00
2012-01-10 16:30:43 -08:00
2011-08-03 14:25:22 -10:00
2011-12-06 10:38:03 +00:00
2012-01-03 22:55:19 -05:00
2012-01-03 22:55:12 -05:00
2011-10-31 19:32:24 -04:00
2012-01-03 22:54:56 -05:00
2011-12-21 01:03:23 -05:00
2011-10-31 19:32:32 -04:00
2011-08-02 14:51:57 -04:00
2011-08-22 14:13:32 -07:00
2011-12-11 10:31:57 -08:00
2011-08-26 12:02:50 -04:00
2011-09-20 15:53:21 +10:00
2011-09-19 11:35:58 -04:00
2011-10-31 17:30:54 -07:00
2011-06-27 20:30:08 +02:00
2011-08-10 20:38:14 -04:00
2011-08-23 10:10:38 -07:00
2011-06-04 06:33:24 +09:00
2011-10-26 15:11:09 +02:00
2012-01-08 13:21:22 -08:00
2011-05-25 19:56:23 -04:00
2012-01-04 22:19:55 -08:00
2011-10-12 21:13:11 -07:00
2011-10-31 19:32:32 -04:00
2011-08-26 12:02:50 -04:00
2011-12-30 16:46:02 -05:00
2011-06-07 09:05:42 -07:00
2012-01-09 12:09:47 -08:00
2011-06-15 20:04:00 -07:00
2011-11-02 16:07:02 -07:00
2011-10-31 19:32:31 -04:00
2011-10-31 19:32:23 -04:00
2011-11-03 18:29:09 -02:00
2011-05-30 11:14:14 +09:30
2011-05-30 11:14:14 +09:30
2011-05-30 11:14:14 +09:30
2011-12-02 13:49:21 -05:00
2011-05-30 11:14:14 +09:30
2011-05-30 11:14:14 +09:30
2011-11-24 13:04:47 +10:30
2011-06-11 15:57:47 -07:00
2011-05-30 11:14:14 +09:30
2011-11-02 11:40:59 +10:30
2011-11-02 11:40:59 +10:30
2011-10-31 19:32:32 -04:00
2011-05-26 17:12:34 -07:00
2011-12-05 23:27:59 +00:00
2011-07-26 16:49:47 -07:00
2011-07-26 16:49:45 -07:00
2011-07-25 20:57:15 -07:00
2011-12-21 10:07:39 +01:00
2011-12-02 14:57:31 +01:00
2012-01-06 15:22:04 +01:00
2011-10-11 16:01:09 +03:00
2011-07-04 19:31:38 -07:00
2012-01-10 16:30:54 -08:00
2012-01-10 16:59:59 -08:00
2011-08-26 12:02:50 -04:00
2011-09-14 15:24:51 -04:00
2011-06-10 14:55:36 +02:00
2bcf887963