Harvest for GBIF classification Created 16 Nov 11:20

Stage: completed
Fetched: 16 Nov 11:20
Validated: 16 Nov 11:24
Deltas Created 16 Nov 11:24
Units Normalized: 19 Nov 02:18
Ancestry Built: 17 Nov 01:30
Nodes Matched: 19 Nov 01:03
Names Parsed: 17 Nov 02:23
New Models Stored: 16 Nov 16:17
Indexed: 19 Nov 02:18
Completed: 19 Nov 08:38
Time to Harvest: 13 minutes

Harvesting Log

(3106 lines) (showing only the last 1000 lines, see /app/public/data/gbif_classificat/process.log for the full file)
[INFO] [2020-11-16 10:38:21] Starting batch with ID 75069461...
[INFO] [2020-11-16 10:38:22] Starting batch with ID 75075740...
[INFO] [2020-11-16 10:38:24] Starting batch with ID 75239278...
[INFO] [2020-11-16 10:38:26] Starting batch with ID 75239278...
[INFO] [2020-11-16 10:38:27] Starting batch with ID 75114984...
[INFO] [2020-11-16 10:38:29] Starting batch with ID 75243092...
[INFO] [2020-11-16 10:38:31] Starting batch with ID 75004949...
[INFO] [2020-11-16 10:38:32] Starting batch with ID 75223202...
[INFO] [2020-11-16 10:38:33] Starting batch with ID 75097066...
[INFO] [2020-11-16 10:38:34] Starting batch with ID 75084582...
[INFO] [2020-11-16 10:38:36] Starting batch with ID 75202752...
[INFO] [2020-11-16 10:38:37] Starting batch with ID 75927185...
[INFO] [2020-11-16 10:38:39] Starting batch with ID 75922560...
[INFO] [2020-11-16 10:38:41] Starting batch with ID 76008439...
[INFO] [2020-11-16 10:38:42] Starting batch with ID 76008442...
[INFO] [2020-11-16 10:38:44] Starting batch with ID 76085306...
[INFO] [2020-11-16 10:38:45] Starting batch with ID 76085306...
[INFO] [2020-11-16 10:38:46] Starting batch with ID 75779778...
[INFO] [2020-11-16 10:38:48] Starting batch with ID 75837113...
[INFO] [2020-11-16 10:38:50] Starting batch with ID 75905171...
[INFO] [2020-11-16 10:38:51] Starting batch with ID 75952016...
[INFO] [2020-11-16 10:38:53] Starting batch with ID 76029025...
[INFO] [2020-11-16 10:38:55] Starting batch with ID 76031756...
[INFO] [2020-11-16 10:38:56] Starting batch with ID 75962233...
[INFO] [2020-11-16 10:38:58] Starting batch with ID 75967573...
[INFO] [2020-11-16 10:38:59] Starting batch with ID 76018618...
[INFO] [2020-11-16 10:39:00] Starting batch with ID 76061793...
[INFO] [2020-11-16 10:39:02] Starting batch with ID 76097376...
[INFO] [2020-11-16 10:39:03] Starting batch with ID 75617620...
[INFO] [2020-11-16 10:39:05] Starting batch with ID 75615968...
[INFO] [2020-11-16 10:39:06] Starting batch with ID 75637440...
[INFO] [2020-11-16 10:39:08] Starting batch with ID 75638847...
[INFO] [2020-11-16 10:39:09] Starting batch with ID 75361800...
[INFO] [2020-11-16 10:39:11] Starting batch with ID 75461099...
[INFO] [2020-11-16 10:39:12] Starting batch with ID 75517135...
[INFO] [2020-11-16 10:39:14] Starting batch with ID 75570373...
[INFO] [2020-11-16 10:39:16] Starting batch with ID 75036025...
[INFO] [2020-11-16 10:39:17] Starting batch with ID 75198492...
[INFO] [2020-11-16 10:39:18] Starting batch with ID 75346013...
[INFO] [2020-11-16 10:39:20] Starting batch with ID 75348631...
[INFO] [2020-11-16 10:39:21] Starting batch with ID 75479662...
[INFO] [2020-11-16 10:39:23] Starting batch with ID 75334612...
[INFO] [2020-11-16 10:39:24] Starting batch with ID 75327929...
[INFO] [2020-11-16 10:39:26] Starting batch with ID 75496722...
[INFO] [2020-11-16 10:39:27] Starting batch with ID 75563218...
[INFO] [2020-11-16 10:39:29] Starting batch with ID 75389490...
[INFO] [2020-11-16 10:39:31] Starting batch with ID 75387344...
[INFO] [2020-11-16 10:39:32] Starting batch with ID 75535292...
[INFO] [2020-11-16 10:39:34] Starting batch with ID 75709076...
[INFO] [2020-11-16 10:39:35] Starting batch with ID 75720307...
[INFO] [2020-11-16 10:39:37] Starting batch with ID 75817199...
[INFO] [2020-11-16 10:39:38] Starting batch with ID 75889902...
[INFO] [2020-11-16 10:39:40] Starting batch with ID 75878788...
[INFO] [2020-11-16 10:39:41] Starting batch with ID 75688361...
[INFO] [2020-11-16 10:39:43] Starting batch with ID 75762293...
[INFO] [2020-11-16 10:39:44] Starting batch with ID 75824983...
[INFO] [2020-11-16 10:39:45] Starting batch with ID 75670644...
[INFO] [2020-11-16 10:39:47] Starting batch with ID 75738748...
[INFO] [2020-11-16 10:39:48] Starting batch with ID 75874632...
[INFO] [2020-11-16 10:39:50] Starting batch with ID 75723788...
[INFO] [2020-11-16 10:39:51] Starting batch with ID 75793234...
[INFO] [2020-11-16 10:39:53] Starting batch with ID 75924309...
[INFO] [2020-11-16 10:39:54] Starting batch with ID 76130687...
[INFO] [2020-11-16 10:39:56] Starting batch with ID 76234630...
[INFO] [2020-11-16 10:39:58] Starting batch with ID 76275397...
[INFO] [2020-11-16 10:39:59] Starting batch with ID 76282632...
[INFO] [2020-11-16 10:40:00] Starting batch with ID 76311393...
[INFO] [2020-11-16 10:40:02] Starting batch with ID 76311393...
[INFO] [2020-11-16 10:40:04] Starting batch with ID 77154562...
[INFO] [2020-11-16 10:40:05] Starting batch with ID 77229304...
[INFO] [2020-11-16 10:40:07] Starting batch with ID 77255815...
[INFO] [2020-11-16 10:40:08] Starting batch with ID 77096887...
[INFO] [2020-11-16 10:40:10] Starting batch with ID 77198853...
[INFO] [2020-11-16 10:40:11] Starting batch with ID 77198853...
[INFO] [2020-11-16 10:40:13] Starting batch with ID 77166528...
[INFO] [2020-11-16 10:40:15] Starting batch with ID 77166528...
[INFO] [2020-11-16 10:40:16] Starting batch with ID 77142824...
[INFO] [2020-11-16 10:40:18] Starting batch with ID 77142824...
[INFO] [2020-11-16 10:40:19] Starting batch with ID 77138248...
[INFO] [2020-11-16 10:40:21] Starting batch with ID 77138348...
[INFO] [2020-11-16 10:40:22] Starting batch with ID 77180670...
[INFO] [2020-11-16 10:40:24] Starting batch with ID 77267242...
[INFO] [2020-11-16 10:40:25] Starting batch with ID 76184179...
[INFO] [2020-11-16 10:40:27] Starting batch with ID 76181533...
[INFO] [2020-11-16 10:40:28] Starting batch with ID 76120251...
[INFO] [2020-11-16 10:40:30] Starting batch with ID 76118415...
[INFO] [2020-11-16 10:40:32] Starting batch with ID 76217490...
[INFO] [2020-11-16 10:40:33] Starting batch with ID 76217490...
[INFO] [2020-11-16 10:40:34] Starting batch with ID 75358453...
[INFO] [2020-11-16 10:40:36] Starting batch with ID 75525923...
[INFO] [2020-11-16 10:40:37] Starting batch with ID 75520954...
[INFO] [2020-11-16 10:40:39] Starting batch with ID 75430994...
[INFO] [2020-11-16 10:40:40] Starting batch with ID 75423160...
[INFO] [2020-11-16 10:40:41] Starting batch with ID 75584030...
[INFO] [2020-11-16 10:40:42] Starting batch with ID 75581171...
[INFO] [2020-11-16 10:40:44] Starting batch with ID 76152940...
[INFO] [2020-11-16 10:40:45] Starting batch with ID 76150881...
[INFO] [2020-11-16 10:40:46] Starting batch with ID 76246742...
[INFO] [2020-11-16 10:40:47] Starting batch with ID 76256546...
[INFO] [2020-11-16 10:40:48] Starting batch with ID 76320845...
[INFO] [2020-11-16 10:40:49] Starting batch with ID 76309826...
[INFO] [2020-11-16 10:40:50] Starting batch with ID 76351159...
[INFO] [2020-11-16 10:40:51] Starting batch with ID 76447846...
[INFO] [2020-11-16 10:40:52] Starting batch with ID 76448391...
[INFO] [2020-11-16 10:40:53] Starting batch with ID 76733121...
[INFO] [2020-11-16 10:40:54] Starting batch with ID 76733121...
[INFO] [2020-11-16 10:40:55] Starting batch with ID 76629147...
[INFO] [2020-11-16 10:40:56] Starting batch with ID 76629147...
[INFO] [2020-11-16 10:40:57] Starting batch with ID 76750473...
[INFO] [2020-11-16 10:40:58] Starting batch with ID 76750473...
[INFO] [2020-11-16 10:40:59] Starting batch with ID 76572039...
[INFO] [2020-11-16 10:41:01] Starting batch with ID 76572039...
[INFO] [2020-11-16 10:41:02] Starting batch with ID 76491194...
[INFO] [2020-11-16 10:41:03] Starting batch with ID 76491194...
[INFO] [2020-11-16 10:41:04] Starting batch with ID 76713528...
[INFO] [2020-11-16 10:41:05] Starting batch with ID 76713528...
[INFO] [2020-11-16 10:41:06] Starting batch with ID 76523126...
[INFO] [2020-11-16 10:41:07] Starting batch with ID 76523126...
[INFO] [2020-11-16 10:41:08] Starting batch with ID 76487813...
[INFO] [2020-11-16 10:41:09] Starting batch with ID 76487813...
[INFO] [2020-11-16 10:41:10] Starting batch with ID 76696400...
[INFO] [2020-11-16 10:41:11] Starting batch with ID 76696400...
[INFO] [2020-11-16 10:41:12] Starting batch with ID 76557423...
[INFO] [2020-11-16 10:41:13] Starting batch with ID 76436177...
[INFO] [2020-11-16 10:41:15] Starting batch with ID 76520880...
[INFO] [2020-11-16 10:41:16] Starting batch with ID 76657113...
[INFO] [2020-11-16 10:41:17] Starting batch with ID 76601696...
[INFO] [2020-11-16 10:41:18] Starting batch with ID 76655083...
[INFO] [2020-11-16 10:41:19] Starting batch with ID 76649950...
[INFO] [2020-11-16 10:41:20] Starting batch with ID 76506014...
[INFO] [2020-11-16 10:41:21] Starting batch with ID 76509656...
[INFO] [2020-11-16 10:41:22] Starting batch with ID 76803971...
[INFO] [2020-11-16 10:41:23] Starting batch with ID 76797675...
[INFO] [2020-11-16 10:41:24] Starting batch with ID 77056511...
[INFO] [2020-11-16 10:41:25] Starting batch with ID 77059239...
[INFO] [2020-11-16 10:41:26] Starting batch with ID 76960869...
[INFO] [2020-11-16 10:41:27] Starting batch with ID 76951513...
[INFO] [2020-11-16 10:41:28] Starting batch with ID 76843773...
[INFO] [2020-11-16 10:41:29] Starting batch with ID 76871477...
[INFO] [2020-11-16 10:41:30] Starting batch with ID 77064777...
[INFO] [2020-11-16 10:41:31] Starting batch with ID 77063321...
[INFO] [2020-11-16 10:41:32] Starting batch with ID 76791600...
[INFO] [2020-11-16 10:41:33] Starting batch with ID 76979118...
[INFO] [2020-11-16 10:41:34] Starting batch with ID 76759223...
[INFO] [2020-11-16 10:41:35] Starting batch with ID 76880918...
[INFO] [2020-11-16 10:41:36] Starting batch with ID 76988889...
[INFO] [2020-11-16 10:41:37] Starting batch with ID 76817622...
[INFO] [2020-11-16 10:41:38] Starting batch with ID 76939821...
[INFO] [2020-11-16 10:41:40] Starting batch with ID 77026422...
[INFO] [2020-11-16 10:41:41] Starting batch with ID 76768739...
[INFO] [2020-11-16 10:41:42] Starting batch with ID 76892922...
[INFO] [2020-11-16 10:41:43] Starting batch with ID 77044739...
[INFO] [2020-11-16 10:41:44] Starting batch with ID 76850848...
[INFO] [2020-11-16 10:41:45] Starting batch with ID 76906902...
[INFO] [2020-11-16 10:41:46] Starting batch with ID 77021964...
[INFO] [2020-11-16 10:41:47] Starting batch with ID 76809981...
[INFO] [2020-11-16 10:41:48] Starting batch with ID 76928686...
[INFO] [2020-11-16 10:41:50] Starting batch with ID 73656438...
[INFO] [2020-11-16 10:41:51] Starting batch with ID 73637975...
[INFO] [2020-11-16 10:41:52] Starting batch with ID 73686082...
[INFO] [2020-11-16 10:41:53] Starting batch with ID 73678581...
[INFO] [2020-11-16 10:41:54] Starting batch with ID 73481067...
[INFO] [2020-11-16 10:41:55] Starting batch with ID 73517219...
[INFO] [2020-11-16 10:41:56] Starting batch with ID 73578525...
[INFO] [2020-11-16 10:41:58] Starting batch with ID 73632323...
[INFO] [2020-11-16 10:41:59] Starting batch with ID 73789454...
[INFO] [2020-11-16 10:42:00] Starting batch with ID 73784720...
[INFO] [2020-11-16 10:42:01] Starting batch with ID 73980056...
[INFO] [2020-11-16 10:42:02] Starting batch with ID 73985015...
[INFO] [2020-11-16 10:42:03] Starting batch with ID 73527263...
[INFO] [2020-11-16 10:42:04] Starting batch with ID 73567187...
[INFO] [2020-11-16 10:42:06] Starting batch with ID 73618944...
[INFO] [2020-11-16 10:42:07] Starting batch with ID 73751301...
[INFO] [2020-11-16 10:42:08] Starting batch with ID 73933870...
[INFO] [2020-11-16 10:42:09] Starting batch with ID 74024092...
[INFO] [2020-11-16 10:42:10] Starting batch with ID 73799274...
[INFO] [2020-11-16 10:42:11] Starting batch with ID 73990988...
[INFO] [2020-11-16 10:42:13] Starting batch with ID 74001611...
[INFO] [2020-11-16 10:42:14] Starting batch with ID 73719894...
[INFO] [2020-11-16 10:42:15] Starting batch with ID 73771765...
[INFO] [2020-11-16 10:42:17] Starting batch with ID 73939089...
[INFO] [2020-11-16 10:42:18] Starting batch with ID 74005671...
[INFO] [2020-11-16 10:42:19] Starting batch with ID 73736711...
[INFO] [2020-11-16 10:42:20] Starting batch with ID 73728752...
[INFO] [2020-11-16 10:42:21] Starting batch with ID 73966101...
[INFO] [2020-11-16 10:42:23] Starting batch with ID 73973404...
[INFO] [2020-11-16 10:42:24] Starting batch with ID 73727608...
[INFO] [2020-11-16 10:42:25] Starting batch with ID 73705783...
[INFO] [2020-11-16 10:42:27] Starting batch with ID 73951770...
[INFO] [2020-11-16 10:42:28] Starting batch with ID 74065695...
[INFO] [2020-11-16 10:42:29] Starting batch with ID 73754953...
[INFO] [2020-11-16 10:42:31] Starting batch with ID 73766694...
[INFO] [2020-11-16 10:42:32] Starting batch with ID 74065457...
[INFO] [2020-11-16 10:42:33] Starting batch with ID 74532940...
[INFO] [2020-11-16 10:42:35] Starting batch with ID 74683817...
[INFO] [2020-11-16 10:42:36] Starting batch with ID 74837122...
[INFO] [2020-11-16 10:42:38] Starting batch with ID 74654445...
[INFO] [2020-11-16 10:42:39] Starting batch with ID 74652813...
[INFO] [2020-11-16 10:42:40] Starting batch with ID 74873589...
[INFO] [2020-11-16 10:42:42] Starting batch with ID 74565815...
[INFO] [2020-11-16 10:42:44] Starting batch with ID 74728349...
[INFO] [2020-11-16 10:42:45] Starting batch with ID 74541527...
[INFO] [2020-11-16 10:42:47] Starting batch with ID 74611940...
[INFO] [2020-11-16 10:42:48] Starting batch with ID 74774559...
[INFO] [2020-11-16 10:42:50] Starting batch with ID 74865637...
[INFO] [2020-11-16 10:42:51] Starting batch with ID 74757719...
[INFO] [2020-11-16 10:42:53] Starting batch with ID 74754335...
[INFO] [2020-11-16 10:42:54] Starting batch with ID 74593393...
[INFO] [2020-11-16 10:42:56] Starting batch with ID 74590066...
[INFO] [2020-11-16 10:42:58] Starting batch with ID 74819996...
[INFO] [2020-11-16 10:42:59] Starting batch with ID 74814733...
[INFO] [2020-11-16 10:43:01] Starting batch with ID 74716238...
[INFO] [2020-11-16 10:43:02] Starting batch with ID 74822997...
[INFO] [2020-11-16 10:43:04] Starting batch with ID 74261391...
[INFO] [2020-11-16 10:43:06] Starting batch with ID 74267358...
[INFO] [2020-11-16 10:43:07] Starting batch with ID 74510249...
[INFO] [2020-11-16 10:43:09] Starting batch with ID 74631867...
[INFO] [2020-11-16 10:43:11] Starting batch with ID 74704942...
[INFO] [2020-11-16 10:43:12] Starting batch with ID 74795123...
[INFO] [2020-11-16 10:43:14] Starting batch with ID 74526002...
[INFO] [2020-11-16 10:43:15] Starting batch with ID 74658236...
[INFO] [2020-11-16 10:43:17] Starting batch with ID 74791623...
[INFO] [2020-11-16 10:43:19] Starting batch with ID 74994063...
[INFO] [2020-11-16 10:43:20] Starting batch with ID 75226571...
[INFO] [2020-11-16 10:43:22] Starting batch with ID 74917247...
[INFO] [2020-11-16 10:43:24] Starting batch with ID 75055092...
[INFO] [2020-11-16 10:43:25] Starting batch with ID 75208883...
[INFO] [2020-11-16 10:43:27] Starting batch with ID 74949948...
[INFO] [2020-11-16 10:43:28] Starting batch with ID 75181395...
[INFO] [2020-11-16 10:43:30] Starting batch with ID 75041243...
[INFO] [2020-11-16 10:43:32] Starting batch with ID 75192041...
[INFO] [2020-11-16 10:43:33] Starting batch with ID 75028641...
[INFO] [2020-11-16 10:43:35] Starting batch with ID 75027194...
[INFO] [2020-11-16 10:43:37] Starting batch with ID 74893734...
[INFO] [2020-11-16 10:43:38] Starting batch with ID 75011373...
[INFO] [2020-11-16 10:43:40] Starting batch with ID 75146252...
[INFO] [2020-11-16 10:43:42] Starting batch with ID 74915040...
[INFO] [2020-11-16 10:43:43] Starting batch with ID 75060017...
[INFO] [2020-11-16 10:43:44] Starting batch with ID 74965273...
[INFO] [2020-11-16 10:43:46] Starting batch with ID 75005248...
[INFO] [2020-11-16 10:43:48] Starting batch with ID 74972782...
[INFO] [2020-11-16 10:43:49] Starting batch with ID 74974414...
[INFO] [2020-11-16 10:43:51] Starting batch with ID 75237219...
[INFO] [2020-11-16 10:43:53] Starting batch with ID 74233345...
[INFO] [2020-11-16 10:43:54] Starting batch with ID 74362373...
[INFO] [2020-11-16 10:43:56] Starting batch with ID 74472255...
[INFO] [2020-11-16 10:43:57] Starting batch with ID 74157975...
[INFO] [2020-11-16 10:43:59] Starting batch with ID 74301274...
[INFO] [2020-11-16 10:44:00] Starting batch with ID 74302734...
[INFO] [2020-11-16 10:44:02] Starting batch with ID 74189389...
[INFO] [2020-11-16 10:44:04] Starting batch with ID 74346725...
[INFO] [2020-11-16 10:44:05] Starting batch with ID 74341873...
[INFO] [2020-11-16 10:44:07] Starting batch with ID 74178736...
[INFO] [2020-11-16 10:44:08] Starting batch with ID 74372468...
[INFO] [2020-11-16 10:44:10] Starting batch with ID 74498807...
[INFO] [2020-11-16 10:44:12] Starting batch with ID 74191928...
[INFO] [2020-11-16 10:44:13] Starting batch with ID 74407384...
[INFO] [2020-11-16 10:44:15] Starting batch with ID 74414075...
[INFO] [2020-11-16 10:44:17] Starting batch with ID 73922691...
[INFO] [2020-11-16 10:44:18] Starting batch with ID 73922917...
[INFO] [2020-11-16 10:44:20] Starting batch with ID 73762637...
[INFO] [2020-11-16 10:44:21] Starting batch with ID 73871697...
[INFO] [2020-11-16 10:44:23] Starting batch with ID 73872740...
[INFO] [2020-11-16 10:44:24] Starting batch with ID 74208610...
[INFO] [2020-11-16 10:44:27] Starting batch with ID 74425527...
[INFO] [2020-11-16 10:44:28] Starting batch with ID 74425527...
[INFO] [2020-11-16 10:44:30] Starting batch with ID 74333875...
[INFO] [2020-11-16 10:44:32] Starting batch with ID 74336076...
[INFO] [2020-11-16 10:44:33] Starting batch with ID 74160288...
[INFO] [2020-11-16 10:44:35] Starting batch with ID 74155846...
[INFO] [2020-11-16 10:44:36] Starting batch with ID 74400813...
[INFO] [2020-11-16 10:44:38] Starting batch with ID 74400813...
[INFO] [2020-11-16 10:44:39] Starting batch with ID 75354049...
[INFO] [2020-11-16 10:44:42] Starting batch with ID 75445661...
[INFO] [2020-11-16 10:44:43] Starting batch with ID 75268544...
[INFO] [2020-11-16 10:44:44] Starting batch with ID 75232450...
[INFO] [2020-11-16 10:44:46] Starting batch with ID 75468398...
[INFO] [2020-11-16 10:44:47] Starting batch with ID 75554386...
[INFO] [2020-11-16 10:44:49] Starting batch with ID 75388894...
[INFO] [2020-11-16 10:44:51] Starting batch with ID 75384893...
[INFO] [2020-11-16 10:44:53] Starting batch with ID 75570255...
[INFO] [2020-11-16 10:44:54] Starting batch with ID 75305067...
[INFO] [2020-11-16 10:44:56] Starting batch with ID 75418531...
[INFO] [2020-11-16 10:44:57] Starting batch with ID 75528712...
[INFO] [2020-11-16 10:44:59] Starting batch with ID 75524466...
[INFO] [2020-11-16 10:45:01] Starting batch with ID 75428722...
[INFO] [2020-11-16 10:45:02] Starting batch with ID 75336472...
[INFO] [2020-11-16 10:45:06] Starting batch with ID 75503009...
[INFO] [2020-11-16 10:45:07] Starting batch with ID 75356680...
[INFO] [2020-11-16 10:45:09] Starting batch with ID 75499688...
[INFO] [2020-11-16 10:45:10] Starting batch with ID 75312937...
[INFO] [2020-11-16 10:45:12] Starting batch with ID 75481137...
[INFO] [2020-11-16 10:45:13] Starting batch with ID 76902576...
[INFO] [2020-11-16 10:45:15] Starting batch with ID 77001442...
[INFO] [2020-11-16 10:45:16] Starting batch with ID 76921347...
[INFO] [2020-11-16 10:45:18] Starting batch with ID 76921347...
[INFO] [2020-11-16 10:45:19] Starting batch with ID 77110759...
[INFO] [2020-11-16 10:45:21] Starting batch with ID 77112070...
[INFO] [2020-11-16 10:45:23] Starting batch with ID 77029218...
[INFO] [2020-11-16 10:45:24] Starting batch with ID 77022706...
[INFO] [2020-11-16 10:45:26] Starting batch with ID 76940020...
[INFO] [2020-11-16 10:45:27] Starting batch with ID 77083551...
[INFO] [2020-11-16 10:45:29] Starting batch with ID 77090956...
[INFO] [2020-11-16 10:45:31] Starting batch with ID 77059260...
[INFO] [2020-11-16 10:45:32] Starting batch with ID 77067984...
[INFO] [2020-11-16 10:45:34] Starting batch with ID 76962249...
[INFO] [2020-11-16 10:45:35] Starting batch with ID 77049097...
[INFO] [2020-11-16 10:45:37] Starting batch with ID 76955812...
[INFO] [2020-11-16 10:45:38] Starting batch with ID 77072370...
[INFO] [2020-11-16 10:45:40] Starting batch with ID 73399201...
[INFO] [2020-11-16 10:45:42] Starting batch with ID 76371926...
[INFO] [2020-11-16 10:45:43] Starting batch with ID 76392560...
[INFO] [2020-11-16 10:45:45] Starting batch with ID 76424966...
[INFO] [2020-11-16 10:45:46] Starting batch with ID 76465670...
[INFO] [2020-11-16 10:45:48] Starting batch with ID 76471499...
[INFO] [2020-11-16 10:45:49] Starting batch with ID 76383357...
[INFO] [2020-11-16 10:45:51] Starting batch with ID 76412004...
[INFO] [2020-11-16 10:45:53] Starting batch with ID 76435765...
[INFO] [2020-11-16 10:45:54] Starting batch with ID 76459219...
[INFO] [2020-11-16 10:45:56] Starting batch with ID 76487649...
[INFO] [2020-11-16 10:45:58] Starting batch with ID 76505952...
[INFO] [2020-11-16 10:45:59] Starting batch with ID 77145009...
[INFO] [2020-11-16 10:46:01] Starting batch with ID 77145807...
[INFO] [2020-11-16 10:46:02] Starting batch with ID 77261415...
[INFO] [2020-11-16 10:46:04] Starting batch with ID 77169653...
[INFO] [2020-11-16 10:46:05] Starting batch with ID 77227432...
[INFO] [2020-11-16 10:46:06] Starting batch with ID 77159290...
[INFO] [2020-11-16 10:46:08] Starting batch with ID 77248093...
[INFO] [2020-11-16 10:46:10] Starting batch with ID 77277427...
[INFO] [2020-11-16 10:46:12] Starting batch with ID 77275640...
[INFO] [2020-11-16 10:46:13] Starting batch with ID 77273678...
[INFO] [2020-11-16 10:46:15] Starting batch with ID 77268006...
[INFO] [2020-11-16 10:46:16] Starting batch with ID 77232961...
[INFO] [2020-11-16 10:46:18] Starting batch with ID 75640984...
[INFO] [2020-11-16 10:46:19] Starting batch with ID 75761681...
[INFO] [2020-11-16 10:46:21] Starting batch with ID 75853358...
[INFO] [2020-11-16 10:46:22] Starting batch with ID 76080101...
[INFO] [2020-11-16 10:46:24] Starting batch with ID 76101789...
[INFO] [2020-11-16 10:46:25] Starting batch with ID 76128295...
[INFO] [2020-11-16 10:46:27] Starting batch with ID 76150717...
[INFO] [2020-11-16 10:46:28] Starting batch with ID 76116088...
[INFO] [2020-11-16 10:46:30] Starting batch with ID 76140393...
[INFO] [2020-11-16 10:46:32] Starting batch with ID 76165671...
[INFO] [2020-11-16 10:46:33] Starting batch with ID 76032634...
[INFO] [2020-11-16 10:46:35] Starting batch with ID 76042917...
[INFO] [2020-11-16 10:46:36] Starting batch with ID 76197251...
[INFO] [2020-11-16 10:46:38] Starting batch with ID 76203792...
[INFO] [2020-11-16 10:46:39] Starting batch with ID 73429197...
[INFO] [2020-11-16 10:46:41] Starting batch with ID 73423149...
[INFO] [2020-11-16 10:46:43] Starting batch with ID 73451340...
[INFO] [2020-11-16 10:46:45] Starting batch with ID 73448969...
[INFO] [2020-11-16 10:46:46] Starting batch with ID 73441648...
[INFO] [2020-11-16 10:46:48] Starting batch with ID 73475647...
[INFO] [2020-11-16 10:46:49] Starting batch with ID 73554258...
[INFO] [2020-11-16 10:46:51] Starting batch with ID 73564608...
[INFO] [2020-11-16 10:46:52] Starting batch with ID 73497298...
[INFO] [2020-11-16 10:46:53] Starting batch with ID 73535909...
[INFO] [2020-11-16 10:46:55] Starting batch with ID 73589573...
[INFO] [2020-11-16 10:46:56] Starting batch with ID 73640219...
[INFO] [2020-11-16 10:46:57] Starting batch with ID 76557393...
[INFO] [2020-11-16 10:46:58] Starting batch with ID 76594509...
[INFO] [2020-11-16 10:46:59] Starting batch with ID 76636391...
[INFO] [2020-11-16 10:47:00] Starting batch with ID 76667722...
[INFO] [2020-11-16 10:47:01] Starting batch with ID 76552806...
[INFO] [2020-11-16 10:47:02] Starting batch with ID 76581032...
[INFO] [2020-11-16 10:47:03] Starting batch with ID 76623471...
[INFO] [2020-11-16 10:47:04] Starting batch with ID 76663583...
[INFO] [2020-11-16 10:47:05] Starting batch with ID 76528948...
[INFO] [2020-11-16 10:47:06] Starting batch with ID 76572497...
[INFO] [2020-11-16 10:47:07] Starting batch with ID 76651256...
[INFO] [2020-11-16 10:47:08] Starting batch with ID 76649535...
[INFO] [2020-11-16 10:47:10] Starting batch with ID 76243322...
[INFO] [2020-11-16 10:47:11] Starting batch with ID 76231388...
[INFO] [2020-11-16 10:47:12] Starting batch with ID 76312163...
[INFO] [2020-11-16 10:47:13] Starting batch with ID 76310265...
[INFO] [2020-11-16 10:47:14] Starting batch with ID 76213057...
[INFO] [2020-11-16 10:47:15] Starting batch with ID 76261950...
[INFO] [2020-11-16 10:47:16] Starting batch with ID 76297233...
[INFO] [2020-11-16 10:47:17] Starting batch with ID 76331972...
[INFO] [2020-11-16 10:47:19] Starting batch with ID 76214356...
[INFO] [2020-11-16 10:47:20] Starting batch with ID 76283056...
[INFO] [2020-11-16 10:47:21] Starting batch with ID 76280244...
[INFO] [2020-11-16 10:47:22] Starting batch with ID 76357520...
[INFO] [2020-11-16 10:47:23] Starting batch with ID 76358352...
[INFO] [2020-11-16 10:47:24] Starting batch with ID 75703939...
[INFO] [2020-11-16 10:47:25] Starting batch with ID 75714200...
[INFO] [2020-11-16 10:47:26] Starting batch with ID 75594571...
[INFO] [2020-11-16 10:47:27] Starting batch with ID 75589821...
[INFO] [2020-11-16 10:47:28] Starting batch with ID 75730038...
[INFO] [2020-11-16 10:47:29] Starting batch with ID 75820328...
[INFO] [2020-11-16 10:47:30] Starting batch with ID 75615965...
[INFO] [2020-11-16 10:47:31] Starting batch with ID 75717126...
[INFO] [2020-11-16 10:47:32] Starting batch with ID 75810310...
[INFO] [2020-11-16 10:47:33] Starting batch with ID 75597755...
[INFO] [2020-11-16 10:47:34] Starting batch with ID 75688332...
[INFO] [2020-11-16 10:47:36] Starting batch with ID 75799685...
[INFO] [2020-11-16 10:47:37] Starting batch with ID 75878268...
[INFO] [2020-11-16 10:47:38] Starting batch with ID 75886854...
[INFO] [2020-11-16 10:47:39] Starting batch with ID 75947739...
[INFO] [2020-11-16 10:47:40] Starting batch with ID 75970204...
[INFO] [2020-11-16 10:47:41] Starting batch with ID 75996706...
[INFO] [2020-11-16 10:47:42] Starting batch with ID 75574863...
[INFO] [2020-11-16 10:47:43] Starting batch with ID 75775577...
[INFO] [2020-11-16 10:47:44] Starting batch with ID 75859860...
[INFO] [2020-11-16 10:47:45] Starting batch with ID 75921039...
[INFO] [2020-11-16 10:47:47] Starting batch with ID 75955817...
[INFO] [2020-11-16 10:47:48] Starting batch with ID 76009389...
[INFO] [2020-11-16 10:47:49] Starting batch with ID 76093642...
[INFO] [2020-11-16 10:47:50] Starting batch with ID 76710915...
[INFO] [2020-11-16 10:47:51] Starting batch with ID 76733864...
[INFO] [2020-11-16 10:47:52] Starting batch with ID 76759686...
[INFO] [2020-11-16 10:47:53] Starting batch with ID 76788932...
[INFO] [2020-11-16 10:47:54] Starting batch with ID 76690971...
[INFO] [2020-11-16 10:47:55] Starting batch with ID 76717325...
[INFO] [2020-11-16 10:47:56] Starting batch with ID 76776975...
[INFO] [2020-11-16 10:47:57] Starting batch with ID 76801100...
[INFO] [2020-11-16 10:47:59] Starting batch with ID 75657460...
[INFO] [2020-11-16 10:48:00] Starting batch with ID 75745588...
[INFO] [2020-11-16 10:48:01] Starting batch with ID 75830534...
[INFO] [2020-11-16 10:48:02] Starting batch with ID 75910317...
[INFO] [2020-11-16 10:48:03] Starting batch with ID 75929947...
[INFO] [2020-11-16 10:48:04] Starting batch with ID 75976770...
[INFO] [2020-11-16 10:48:05] Starting batch with ID 76013787...
[INFO] [2020-11-16 10:48:06] Starting batch with ID 73386565...
[INFO] [2020-11-16 10:48:07] Starting batch with ID 76808263...
[INFO] [2020-11-16 10:48:08] Starting batch with ID 76829323...
[INFO] [2020-11-16 10:48:09] Starting batch with ID 76843735...
[INFO] [2020-11-16 10:48:10] Starting batch with ID 76842317...
[INFO] [2020-11-16 10:48:11] Starting batch with ID 76865594...
[INFO] [2020-11-16 10:48:11] Starting batch with ID 76865594...
[INFO] [2020-11-16 10:48:11] Starting batch with ID 76865594...
[INFO] [2020-11-16 10:48:12] ## remove_type: Node
[INFO] [2020-11-16 10:48:13] ++ Batch removal of 3915001 instances...
[INFO] [2020-11-16 10:48:13] [10:48:13.072] Batch 0...
[INFO] [2020-11-16 10:48:14] [10:48:14.708] Batch 1...
[INFO] [2020-11-16 10:48:16] [10:48:16.526] Batch 2...
[INFO] [2020-11-16 10:48:18] [10:48:18.340] Batch 3...
[INFO] [2020-11-16 10:48:20] [10:48:20.151] Batch 4...
[INFO] [2020-11-16 10:48:22] [10:48:22.099] Batch 5...
[INFO] [2020-11-16 10:48:24] [10:48:24.334] Batch 6...
[INFO] [2020-11-16 10:48:26] [10:48:26.480] Batch 7...
[INFO] [2020-11-16 10:48:28] [10:48:28.903] Batch 8...
[INFO] [2020-11-16 10:48:31] [10:48:31.049] Batch 9...
[INFO] [2020-11-16 10:48:34] [10:48:34.052] Batch 10...
[INFO] [2020-11-16 10:48:36] [10:48:36.752] Batch 11...
[INFO] [2020-11-16 10:48:40] [10:48:40.047] Batch 12...
[INFO] [2020-11-16 10:48:42] [10:48:42.886] Batch 13...
[INFO] [2020-11-16 10:48:46] [10:48:46.750] Batch 14...
[INFO] [2020-11-16 10:48:48] [10:48:48.648] Batch 15...
[INFO] [2020-11-16 10:48:50] [10:48:50.483] Batch 16...
[INFO] [2020-11-16 10:48:52] [10:48:52.017] Batch 17...
[INFO] [2020-11-16 10:48:53] [10:48:53.787] Batch 18...
[INFO] [2020-11-16 10:48:55] [10:48:55.669] Batch 19...
[INFO] [2020-11-16 10:48:57] [10:48:57.725] Batch 20...
[INFO] [2020-11-16 10:48:59] [10:48:59.649] Batch 21...
[INFO] [2020-11-16 10:49:01] [10:49:01.231] Batch 22...
[INFO] [2020-11-16 10:49:02] [10:49:02.990] Batch 23...
[INFO] [2020-11-16 10:49:04] [10:49:04.540] Batch 24...
[INFO] [2020-11-16 10:49:06] [10:49:06.691] Batch 25...
[INFO] [2020-11-16 10:49:08] [10:49:08.677] Batch 26...
[INFO] [2020-11-16 10:49:10] [10:49:10.497] Batch 27...
[INFO] [2020-11-16 10:49:12] [10:49:12.119] Batch 28...
[INFO] [2020-11-16 10:49:13] [10:49:13.603] Batch 29...
[INFO] [2020-11-16 10:49:15] [10:49:15.499] Batch 30...
[INFO] [2020-11-16 10:49:17] [10:49:17.365] Batch 31...
[INFO] [2020-11-16 10:49:19] [10:49:19.063] Batch 32...
[INFO] [2020-11-16 10:49:20] [10:49:20.793] Batch 33...
[INFO] [2020-11-16 10:49:22] [10:49:22.288] Batch 34...
[INFO] [2020-11-16 10:49:23] [10:49:23.715] Batch 35...
[INFO] [2020-11-16 10:49:25] [10:49:25.718] Batch 36...
[INFO] [2020-11-16 10:49:27] [10:49:27.607] Batch 37...
[INFO] [2020-11-16 10:49:29] [10:49:29.499] Batch 38...
[INFO] [2020-11-16 10:49:31] [10:49:31.421] Batch 39...
[INFO] [2020-11-16 10:49:32] [10:49:32.964] Batch 40...
[INFO] [2020-11-16 10:49:34] [10:49:34.631] Batch 41...
[INFO] [2020-11-16 10:49:36] [10:49:36.583] Batch 42...
[INFO] [2020-11-16 10:49:38] [10:49:38.417] Batch 43...
[INFO] [2020-11-16 10:49:39] [10:49:39.905] Batch 44...
[INFO] [2020-11-16 10:49:41] [10:49:41.381] Batch 45...
[INFO] [2020-11-16 10:49:42] [10:49:42.860] Batch 46...
[INFO] [2020-11-16 10:49:44] [10:49:44.658] Batch 47...
[INFO] [2020-11-16 10:49:46] [10:49:46.387] Batch 48...
[INFO] [2020-11-16 10:49:47] [10:49:47.883] Batch 49...
[INFO] [2020-11-16 10:49:49] [10:49:49.331] Batch 50...
[INFO] [2020-11-16 10:49:50] [10:49:50.744] Batch 51...
[INFO] [2020-11-16 10:49:52] [10:49:52.588] Batch 52...
[INFO] [2020-11-16 10:49:54] [10:49:54.592] Batch 53...
[INFO] [2020-11-16 10:49:56] [10:49:56.278] Batch 54...
[INFO] [2020-11-16 10:49:57] [10:49:57.747] Batch 55...
[INFO] [2020-11-16 10:49:59] [10:49:59.556] Batch 56...
[INFO] [2020-11-16 10:50:01] [10:50:01.364] Batch 57...
[INFO] [2020-11-16 10:50:02] [10:50:02.765] Batch 58...
[INFO] [2020-11-16 10:50:04] [10:50:04.475] Batch 59...
[INFO] [2020-11-16 10:50:06] [10:50:06.190] Batch 60...
[INFO] [2020-11-16 10:50:07] [10:50:07.590] Batch 61...
[INFO] [2020-11-16 10:50:09] [10:50:09.279] Batch 62...
[INFO] [2020-11-16 10:50:10] [10:50:10.662] Batch 63...
[INFO] [2020-11-16 10:50:12] [10:50:12.524] Batch 64...
[INFO] [2020-11-16 10:50:14] [10:50:14.369] Batch 65...
[INFO] [2020-11-16 10:50:15] [10:50:15.919] Batch 66...
[INFO] [2020-11-16 10:50:17] [10:50:17.393] Batch 67...
[INFO] [2020-11-16 10:50:18] [10:50:18.862] Batch 68...
[INFO] [2020-11-16 10:50:20] [10:50:20.747] Batch 69...
[INFO] [2020-11-16 10:50:22] [10:50:22.450] Batch 70...
[INFO] [2020-11-16 10:50:24] [10:50:24.443] Batch 71...
[INFO] [2020-11-16 10:50:25] [10:50:25.844] Batch 72...
[INFO] [2020-11-16 10:50:27] [10:50:27.681] Batch 73...
[INFO] [2020-11-16 10:50:29] [10:50:29.564] Batch 74...
[INFO] [2020-11-16 10:50:31] [10:50:31.374] Batch 75...
[INFO] [2020-11-16 10:50:32] [10:50:32.742] Batch 76...
[INFO] [2020-11-16 10:50:34] [10:50:34.745] Batch 77...
[INFO] [2020-11-16 10:50:36] [10:50:36.477] Batch 78...
[INFO] [2020-11-16 10:50:38] [10:50:38.147] Batch 79...
[INFO] [2020-11-16 10:50:39] [10:50:39.560] Batch 80...
[INFO] [2020-11-16 10:50:41] [10:50:41.257] Batch 81...
[INFO] [2020-11-16 10:50:42] [10:50:42.691] Batch 82...
[INFO] [2020-11-16 10:50:44] [10:50:44.346] Batch 83...
[INFO] [2020-11-16 10:50:45] [10:50:45.703] Batch 84...
[INFO] [2020-11-16 10:50:47] [10:50:47.543] Batch 85...
[INFO] [2020-11-16 10:50:49] [10:50:49.196] Batch 86...
[INFO] [2020-11-16 10:50:50] [10:50:50.688] Batch 87...
[INFO] [2020-11-16 10:50:52] [10:50:52.601] Batch 88...
[INFO] [2020-11-16 10:50:54] [10:50:54.375] Batch 89...
[INFO] [2020-11-16 10:50:55] [10:50:55.771] Batch 90...
[INFO] [2020-11-16 10:50:57] [10:50:57.293] Batch 91...
[INFO] [2020-11-16 10:50:58] [10:50:58.601] Batch 92...
[INFO] [2020-11-16 10:51:00] [10:51:00.243] Batch 93...
[INFO] [2020-11-16 10:51:01] [10:51:01.558] Batch 94...
[INFO] [2020-11-16 10:51:03] [10:51:03.315] Batch 95...
[INFO] [2020-11-16 10:51:04] [10:51:04.641] Batch 96...
[INFO] [2020-11-16 10:51:06] [10:51:06.333] Batch 97...
[INFO] [2020-11-16 10:51:07] [10:51:07.734] Batch 98...
[INFO] [2020-11-16 10:51:09] [10:51:09.385] Batch 99...
[INFO] [2020-11-16 10:51:10] [10:51:10.731] Batch 100...
[INFO] [2020-11-16 10:51:12] [10:51:12.342] Batch 101...
[INFO] [2020-11-16 10:51:13] [10:51:13.671] Batch 102...
[INFO] [2020-11-16 10:51:15] [10:51:15.118] Batch 103...
[INFO] [2020-11-16 10:51:16] [10:51:16.479] Batch 104...
[INFO] [2020-11-16 10:51:17] [10:51:17.744] Batch 105...
[INFO] [2020-11-16 10:51:19] [10:51:19.416] Batch 106...
[INFO] [2020-11-16 10:51:20] [10:51:20.813] Batch 107...
[INFO] [2020-11-16 10:51:22] [10:51:22.118] Batch 108...
[INFO] [2020-11-16 10:51:23] [10:51:23.459] Batch 109...
[INFO] [2020-11-16 10:51:24] [10:51:24.945] Batch 110...
[INFO] [2020-11-16 10:51:26] [10:51:26.379] Batch 111...
[INFO] [2020-11-16 10:51:27] [10:51:27.645] Batch 112...
[INFO] [2020-11-16 10:51:29] [10:51:29.359] Batch 113...
[INFO] [2020-11-16 10:51:30] [10:51:30.626] Batch 114...
[INFO] [2020-11-16 10:51:32] [10:51:32.161] Batch 115...
[INFO] [2020-11-16 10:51:33] [10:51:33.518] Batch 116...
[INFO] [2020-11-16 10:51:35] [10:51:35.193] Batch 117...
[INFO] [2020-11-16 10:51:36] [10:51:36.738] Batch 118...
[INFO] [2020-11-16 10:51:38] [10:51:38.210] Batch 119...
[INFO] [2020-11-16 10:51:39] [10:51:39.714] Batch 120...
[INFO] [2020-11-16 10:51:41] [10:51:41.350] Batch 121...
[INFO] [2020-11-16 10:51:42] [10:51:42.689] Batch 122...
[INFO] [2020-11-16 10:51:44] [10:51:44.466] Batch 123...
[INFO] [2020-11-16 10:51:46] [10:51:46.144] Batch 124...
[INFO] [2020-11-16 10:51:47] [10:51:47.482] Batch 125...
[INFO] [2020-11-16 10:51:49] [10:51:49.160] Batch 126...
[INFO] [2020-11-16 10:51:50] [10:51:50.537] Batch 127...
[INFO] [2020-11-16 10:51:52] [10:51:52.277] Batch 128...
[INFO] [2020-11-16 10:51:53] [10:51:53.652] Batch 129...
[INFO] [2020-11-16 10:51:55] [10:51:55.277] Batch 130...
[INFO] [2020-11-16 10:51:56] [10:51:56.643] Batch 131...
[INFO] [2020-11-16 10:51:58] [10:51:58.290] Batch 132...
[INFO] [2020-11-16 10:51:59] [10:51:59.597] Batch 133...
[INFO] [2020-11-16 10:52:00] [10:52:00.901] Batch 134...
[INFO] [2020-11-16 10:52:02] [10:52:02.505] Batch 135...
[INFO] [2020-11-16 10:52:03] [10:52:03.888] Batch 136...
[INFO] [2020-11-16 10:52:05] [10:52:05.455] Batch 137...
[INFO] [2020-11-16 10:52:06] [10:52:06.759] Batch 138...
[INFO] [2020-11-16 10:52:08] [10:52:08.444] Batch 139...
[INFO] [2020-11-16 10:52:09] [10:52:09.721] Batch 140...
[INFO] [2020-11-16 10:52:11] [10:52:11.380] Batch 141...
[INFO] [2020-11-16 10:52:12] [10:52:12.668] Batch 142...
[INFO] [2020-11-16 10:52:14] [10:52:14.464] Batch 143...
[INFO] [2020-11-16 10:52:16] [10:52:16.038] Batch 144...
[INFO] [2020-11-16 10:52:17] [10:52:17.414] Batch 145...
[INFO] [2020-11-16 10:52:18] [10:52:18.615] Batch 146...
[INFO] [2020-11-16 10:52:20] [10:52:20.231] Batch 147...
[INFO] [2020-11-16 10:52:21] [10:52:21.450] Batch 148...
[INFO] [2020-11-16 10:52:22] [10:52:22.664] Batch 149...
[INFO] [2020-11-16 10:52:24] [10:52:24.571] Batch 150...
[INFO] [2020-11-16 10:52:26] [10:52:26.375] Batch 151...
[INFO] [2020-11-16 10:52:27] [10:52:27.743] Batch 152...
[INFO] [2020-11-16 10:52:29] [10:52:29.859] Batch 153...
[INFO] [2020-11-16 10:52:31] [10:52:31.190] Batch 154...
[INFO] [2020-11-16 10:52:32] [10:52:32.921] Batch 155...
[INFO] [2020-11-16 10:52:34] [10:52:34.556] Batch 156...
[INFO] [2020-11-16 10:52:36] [10:52:36.325] Batch 157...
[INFO] [2020-11-16 10:52:37] [10:52:37.730] Batch 158...
[INFO] [2020-11-16 10:52:39] [10:52:39.363] Batch 159...
[INFO] [2020-11-16 10:52:40] [10:52:40.683] Batch 160...
[INFO] [2020-11-16 10:52:42] [10:52:42.573] Batch 161...
[INFO] [2020-11-16 10:52:44] [10:52:44.300] Batch 162...
[INFO] [2020-11-16 10:52:45] [10:52:45.570] Batch 163...
[INFO] [2020-11-16 10:52:47] [10:52:47.141] Batch 164...
[INFO] [2020-11-16 10:52:48] [10:52:48.578] Batch 165...
[INFO] [2020-11-16 10:52:50] [10:52:50.199] Batch 166...
[INFO] [2020-11-16 10:52:51] [10:52:51.311] Batch 167...
[INFO] [2020-11-16 10:52:52] [10:52:52.426] Batch 168...
[INFO] [2020-11-16 10:52:53] [10:52:53.631] Batch 169...
[INFO] [2020-11-16 10:52:55] [10:52:55.191] Batch 170...
[INFO] [2020-11-16 10:52:56] [10:52:56.514] Batch 171...
[INFO] [2020-11-16 10:52:57] [10:52:57.662] Batch 172...
[INFO] [2020-11-16 10:52:59] [10:52:59.317] Batch 173...
[INFO] [2020-11-16 10:53:00] [10:53:00.504] Batch 174...
[INFO] [2020-11-16 10:53:01] [10:53:01.652] Batch 175...
[INFO] [2020-11-16 10:53:03] [10:53:03.657] Batch 176...
[INFO] [2020-11-16 10:53:05] [10:53:05.982] Batch 177...
[INFO] [2020-11-16 10:53:07] [10:53:07.626] Batch 178...
[INFO] [2020-11-16 10:53:09] [10:53:09.112] Batch 179...
[INFO] [2020-11-16 10:53:10] [10:53:10.520] Batch 180...
[INFO] [2020-11-16 10:53:12] [10:53:12.219] Batch 181...
[INFO] [2020-11-16 10:53:13] [10:53:13.570] Batch 182...
[INFO] [2020-11-16 10:53:15] [10:53:15.114] Batch 183...
[INFO] [2020-11-16 10:53:16] [10:53:16.448] Batch 184...
[INFO] [2020-11-16 10:53:17] [10:53:17.906] Batch 185...
[INFO] [2020-11-16 10:53:19] [10:53:19.164] Batch 186...
[INFO] [2020-11-16 10:53:20] [10:53:20.645] Batch 187...
[INFO] [2020-11-16 10:53:22] [10:53:22.435] Batch 188...
[INFO] [2020-11-16 10:53:23] [10:53:23.640] Batch 189...
[INFO] [2020-11-16 10:53:25] [10:53:25.246] Batch 190...
[INFO] [2020-11-16 10:53:26] [10:53:26.616] Batch 191...
[INFO] [2020-11-16 10:53:28] [10:53:28.163] Batch 192...
[INFO] [2020-11-16 10:53:29] [10:53:29.341] Batch 193...
[INFO] [2020-11-16 10:53:30] [10:53:30.588] Batch 194...
[INFO] [2020-11-16 10:53:32] [10:53:32.355] Batch 195...
[INFO] [2020-11-16 10:53:33] [10:53:33.620] Batch 196...
[INFO] [2020-11-16 10:53:35] [10:53:35.284] Batch 197...
[INFO] [2020-11-16 10:53:36] [10:53:36.563] Batch 198...
[INFO] [2020-11-16 10:53:38] [10:53:38.023] Batch 199...
[INFO] [2020-11-16 10:53:39] [10:53:39.540] Batch 200...
[INFO] [2020-11-16 10:53:41] [10:53:41.114] Batch 201...
[INFO] [2020-11-16 10:53:42] [10:53:42.312] Batch 202...
[INFO] [2020-11-16 10:53:43] [10:53:43.440] Batch 203...
[INFO] [2020-11-16 10:53:44] [10:53:44.599] Batch 204...
[INFO] [2020-11-16 10:53:46] [10:53:46.128] Batch 205...
[INFO] [2020-11-16 10:53:47] [10:53:47.256] Batch 206...
[INFO] [2020-11-16 10:53:48] [10:53:48.349] Batch 207...
[INFO] [2020-11-16 10:53:49] [10:53:49.499] Batch 208...
[INFO] [2020-11-16 10:53:50] [10:53:50.771] Batch 209...
[INFO] [2020-11-16 10:53:52] [10:53:52.498] Batch 210...
[INFO] [2020-11-16 10:53:53] [10:53:53.629] Batch 211...
[INFO] [2020-11-16 10:53:55] [10:53:55.194] Batch 212...
[INFO] [2020-11-16 10:53:56] [10:53:56.318] Batch 213...
[INFO] [2020-11-16 10:53:57] [10:53:57.469] Batch 214...
[INFO] [2020-11-16 10:53:59] [10:53:59.090] Batch 215...
[INFO] [2020-11-16 10:54:00] [10:54:00.386] Batch 216...
[INFO] [2020-11-16 10:54:01] [10:54:01.504] Batch 217...
[INFO] [2020-11-16 10:54:02] [10:54:02.681] Batch 218...
[INFO] [2020-11-16 10:54:04] [10:54:04.182] Batch 219...
[INFO] [2020-11-16 10:54:05] [10:54:05.347] Batch 220...
[INFO] [2020-11-16 10:54:06] [10:54:06.434] Batch 221...
[INFO] [2020-11-16 10:54:07] [10:54:07.527] Batch 222...
[INFO] [2020-11-16 10:54:08] [10:54:08.627] Batch 223...
[INFO] [2020-11-16 10:54:10] [10:54:10.002] Batch 224...
[INFO] [2020-11-16 10:54:11] [10:54:11.347] Batch 225...
[INFO] [2020-11-16 10:54:12] [10:54:12.486] Batch 226...
[INFO] [2020-11-16 10:54:13] [10:54:13.682] Batch 227...
[INFO] [2020-11-16 10:54:14] [10:54:14.919] Batch 228...
[INFO] [2020-11-16 10:54:16] [10:54:16.373] Batch 229...
[INFO] [2020-11-16 10:54:17] [10:54:17.568] Batch 230...
[INFO] [2020-11-16 10:54:18] [10:54:18.938] Batch 231...
[INFO] [2020-11-16 10:54:20] [10:54:20.479] Batch 232...
[INFO] [2020-11-16 10:54:21] [10:54:21.589] Batch 233...
[INFO] [2020-11-16 10:54:23] [10:54:23.145] Batch 234...
[INFO] [2020-11-16 10:54:24] [10:54:24.412] Batch 235...
[INFO] [2020-11-16 10:54:25] [10:54:25.537] Batch 236...
[INFO] [2020-11-16 10:54:27] [10:54:27.079] Batch 237...
[INFO] [2020-11-16 10:54:28] [10:54:28.391] Batch 238...
[INFO] [2020-11-16 10:54:29] [10:54:29.453] Batch 239...
[INFO] [2020-11-16 10:54:30] [10:54:30.511] Batch 240...
[INFO] [2020-11-16 10:54:31] [10:54:31.769] Batch 241...
[INFO] [2020-11-16 10:54:32] [10:54:32.985] Batch 242...
[INFO] [2020-11-16 10:54:34] [10:54:34.157] Batch 243...
[INFO] [2020-11-16 10:54:35] [10:54:35.734] Batch 244...
[INFO] [2020-11-16 10:54:37] [10:54:37.332] Batch 245...
[INFO] [2020-11-16 10:54:38] [10:54:38.746] Batch 246...
[INFO] [2020-11-16 10:54:40] [10:54:40.311] Batch 247...
[INFO] [2020-11-16 10:54:41] [10:54:41.329] Batch 248...
[INFO] [2020-11-16 10:54:42] [10:54:42.361] Batch 249...
[INFO] [2020-11-16 10:54:43] [10:54:43.479] Batch 250...
[INFO] [2020-11-16 10:54:44] [10:54:44.685] Batch 251...
[INFO] [2020-11-16 10:54:46] [10:54:46.145] Batch 252...
[INFO] [2020-11-16 10:54:47] [10:54:47.352] Batch 253...
[INFO] [2020-11-16 10:54:48] [10:54:48.445] Batch 254...
[INFO] [2020-11-16 10:54:49] [10:54:49.724] Batch 255...
[INFO] [2020-11-16 10:54:50] [10:54:50.964] Batch 256...
[INFO] [2020-11-16 10:54:52] [10:54:52.303] Batch 257...
[INFO] [2020-11-16 10:54:53] [10:54:53.360] Batch 258...
[INFO] [2020-11-16 10:54:54] [10:54:54.886] Batch 259...
[INFO] [2020-11-16 10:54:56] [10:54:56.462] Batch 260...
[INFO] [2020-11-16 10:54:58] [10:54:58.170] Batch 261...
[INFO] [2020-11-16 10:54:59] [10:54:59.445] Batch 262...
[INFO] [2020-11-16 10:55:00] [10:55:00.894] Batch 263...
[INFO] [2020-11-16 10:55:02] [10:55:02.351] Batch 264...
[INFO] [2020-11-16 10:55:03] [10:55:03.688] Batch 265...
[INFO] [2020-11-16 10:55:05] [10:55:05.248] Batch 266...
[INFO] [2020-11-16 10:55:06] [10:55:06.464] Batch 267...
[INFO] [2020-11-16 10:55:07] [10:55:07.534] Batch 268...
[INFO] [2020-11-16 10:55:09] [10:55:09.329] Batch 269...
[INFO] [2020-11-16 10:55:10] [10:55:10.454] Batch 270...
[INFO] [2020-11-16 10:55:11] [10:55:11.986] Batch 271...
[INFO] [2020-11-16 10:55:13] [10:55:13.385] Batch 272...
[INFO] [2020-11-16 10:55:14] [10:55:14.453] Batch 273...
[INFO] [2020-11-16 10:55:15] [10:55:15.504] Batch 274...
[INFO] [2020-11-16 10:55:16] [10:55:16.502] Batch 275...
[INFO] [2020-11-16 10:55:17] [10:55:17.904] Batch 276...
[INFO] [2020-11-16 10:55:19] [10:55:19.357] Batch 277...
[INFO] [2020-11-16 10:55:20] [10:55:20.415] Batch 278...
[INFO] [2020-11-16 10:55:22] [10:55:22.020] Batch 279...
[INFO] [2020-11-16 10:55:23] [10:55:23.366] Batch 280...
[INFO] [2020-11-16 10:55:24] [10:55:24.639] Batch 281...
[INFO] [2020-11-16 10:55:26] [10:55:26.074] Batch 282...
[INFO] [2020-11-16 10:55:27] [10:55:27.319] Batch 283...
[INFO] [2020-11-16 10:55:28] [10:55:28.400] Batch 284...
[INFO] [2020-11-16 10:55:29] [10:55:29.472] Batch 285...
[INFO] [2020-11-16 10:55:31] [10:55:31.146] Batch 286...
[INFO] [2020-11-16 10:55:32] [10:55:32.170] Batch 287...
[INFO] [2020-11-16 10:55:33] [10:55:33.168] Batch 288...
[INFO] [2020-11-16 10:55:34] [10:55:34.361] Batch 289...
[INFO] [2020-11-16 10:55:36] [10:55:36.164] Batch 290...
[INFO] [2020-11-16 10:55:37] [10:55:37.367] Batch 291...
[INFO] [2020-11-16 10:55:38] [10:55:38.393] Batch 292...
[INFO] [2020-11-16 10:55:40] [10:55:40.141] Batch 293...
[INFO] [2020-11-16 10:55:41] [10:55:41.141] Batch 294...
[INFO] [2020-11-16 10:55:42] [10:55:42.572] Batch 295...
[INFO] [2020-11-16 10:55:44] [10:55:44.253] Batch 296...
[INFO] [2020-11-16 10:55:45] [10:55:45.345] Batch 297...
[INFO] [2020-11-16 10:55:47] [10:55:47.099] Batch 298...
[INFO] [2020-11-16 10:55:48] [10:55:48.222] Batch 299...
[INFO] [2020-11-16 10:55:49] [10:55:49.391] Batch 300...
[INFO] [2020-11-16 10:55:50] [10:55:50.451] Batch 301...
[INFO] [2020-11-16 10:55:52] [10:55:52.065] Batch 302...
[INFO] [2020-11-16 10:55:53] [10:55:53.225] Batch 303...
[INFO] [2020-11-16 10:55:54] [10:55:54.628] Batch 304...
[INFO] [2020-11-16 10:55:56] [10:55:56.164] Batch 305...
[INFO] [2020-11-16 10:55:57] [10:55:57.445] Batch 306...
[INFO] [2020-11-16 10:55:59] [10:55:59.320] Batch 307...
[INFO] [2020-11-16 10:56:00] [10:56:00.414] Batch 308...
[INFO] [2020-11-16 10:56:02] [10:56:02.145] Batch 309...
[INFO] [2020-11-16 10:56:03] [10:56:03.288] Batch 310...
[INFO] [2020-11-16 10:56:04] [10:56:04.262] Batch 311...
[INFO] [2020-11-16 10:56:05] [10:56:05.398] Batch 312...
[INFO] [2020-11-16 10:56:06] [10:56:06.792] Batch 313...
[INFO] [2020-11-16 10:56:08] [10:56:08.271] Batch 314...
[INFO] [2020-11-16 10:56:09] [10:56:09.412] Batch 315...
[INFO] [2020-11-16 10:56:11] [10:56:11.111] Batch 316...
[INFO] [2020-11-16 10:56:12] [10:56:12.429] Batch 317...
[INFO] [2020-11-16 10:56:13] [10:56:13.930] Batch 318...
[INFO] [2020-11-16 10:56:15] [10:56:15.379] Batch 319...
[INFO] [2020-11-16 10:56:16] [10:56:16.351] Batch 320...
[INFO] [2020-11-16 10:56:17] [10:56:17.545] Batch 321...
[INFO] [2020-11-16 10:56:18] [10:56:18.871] Batch 322...
[INFO] [2020-11-16 10:56:20] [10:56:20.353] Batch 323...
[INFO] [2020-11-16 10:56:22] [10:56:22.072] Batch 324...
[INFO] [2020-11-16 10:56:23] [10:56:23.329] Batch 325...
[INFO] [2020-11-16 10:56:24] [10:56:24.913] Batch 326...
[INFO] [2020-11-16 10:56:26] [10:56:26.359] Batch 327...
[INFO] [2020-11-16 10:56:27] [10:56:27.431] Batch 328...
[INFO] [2020-11-16 10:56:29] [10:56:29.226] Batch 329...
[INFO] [2020-11-16 10:56:30] [10:56:30.463] Batch 330...
[INFO] [2020-11-16 10:56:31] [10:56:31.561] Batch 331...
[INFO] [2020-11-16 10:56:33] [10:56:33.144] Batch 332...
[INFO] [2020-11-16 10:56:34] [10:56:34.241] Batch 333...
[INFO] [2020-11-16 10:56:35] [10:56:35.224] Batch 334...
[INFO] [2020-11-16 10:56:36] [10:56:36.638] Batch 335...
[INFO] [2020-11-16 10:56:38] [10:56:38.302] Batch 336...
[INFO] [2020-11-16 10:56:40] [10:56:40.212] Batch 337...
[INFO] [2020-11-16 10:56:41] [10:56:41.228] Batch 338...
[INFO] [2020-11-16 10:56:42] [10:56:42.246] Batch 339...
[INFO] [2020-11-16 10:56:43] [10:56:43.650] Batch 340...
[INFO] [2020-11-16 10:56:45] [10:56:45.198] Batch 341...
[INFO] [2020-11-16 10:56:46] [10:56:46.376] Batch 342...
[INFO] [2020-11-16 10:56:47] [10:56:47.724] Batch 343...
[INFO] [2020-11-16 10:56:49] [10:56:49.231] Batch 344...
[INFO] [2020-11-16 10:56:50] [10:56:50.404] Batch 345...
[INFO] [2020-11-16 10:56:51] [10:56:51.464] Batch 346...
[INFO] [2020-11-16 10:56:53] [10:56:53.111] Batch 347...
[INFO] [2020-11-16 10:56:54] [10:56:54.293] Batch 348...
[INFO] [2020-11-16 10:56:55] [10:56:55.687] Batch 349...
[INFO] [2020-11-16 10:56:57] [10:56:57.231] Batch 350...
[INFO] [2020-11-16 10:56:58] [10:56:58.235] Batch 351...
[INFO] [2020-11-16 10:56:59] [10:56:59.270] Batch 352...
[INFO] [2020-11-16 10:57:00] [10:57:00.854] Batch 353...
[INFO] [2020-11-16 10:57:02] [10:57:02.283] Batch 354...
[INFO] [2020-11-16 10:57:03] [10:57:03.630] Batch 355...
[INFO] [2020-11-16 10:57:05] [10:57:05.060] Batch 356...
[INFO] [2020-11-16 10:57:06] [10:57:06.210] Batch 357...
[INFO] [2020-11-16 10:57:07] [10:57:07.260] Batch 358...
[INFO] [2020-11-16 10:57:08] [10:57:08.560] Batch 359...
[INFO] [2020-11-16 10:57:09] [10:57:09.950] Batch 360...
[INFO] [2020-11-16 10:57:11] [10:57:11.259] Batch 361...
[INFO] [2020-11-16 10:57:12] [10:57:12.262] Batch 362...
[INFO] [2020-11-16 10:57:13] [10:57:13.280] Batch 363...
[INFO] [2020-11-16 10:57:14] [10:57:14.304] Batch 364...
[INFO] [2020-11-16 10:57:15] [10:57:15.243] Batch 365...
[INFO] [2020-11-16 10:57:16] [10:57:16.719] Batch 366...
[INFO] [2020-11-16 10:57:18] [10:57:18.105] Batch 367...
[INFO] [2020-11-16 10:57:19] [10:57:19.725] Batch 368...
[INFO] [2020-11-16 10:57:21] [10:57:21.205] Batch 369...
[INFO] [2020-11-16 10:57:22] [10:57:22.177] Batch 370...
[INFO] [2020-11-16 10:57:23] [10:57:23.110] Batch 371...
[INFO] [2020-11-16 10:57:24] [10:57:24.344] Batch 372...
[INFO] [2020-11-16 10:57:25] [10:57:25.333] Batch 373...
[INFO] [2020-11-16 10:57:26] [10:57:26.359] Batch 374...
[INFO] [2020-11-16 10:57:27] [10:57:27.605] Batch 375...
[INFO] [2020-11-16 10:57:29] [10:57:29.142] Batch 376...
[INFO] [2020-11-16 10:57:30] [10:57:30.336] Batch 377...
[INFO] [2020-11-16 10:57:31] [10:57:31.289] Batch 378...
[INFO] [2020-11-16 10:57:32] [10:57:32.995] Batch 379...
[INFO] [2020-11-16 10:57:34] [10:57:34.101] Batch 380...
[INFO] [2020-11-16 10:57:35] [10:57:35.276] Batch 381...
[INFO] [2020-11-16 10:57:36] [10:57:36.341] Batch 382...
[INFO] [2020-11-16 10:57:37] [10:57:37.815] Batch 383...
[INFO] [2020-11-16 10:57:38] [10:57:38.788] Batch 384...
[INFO] [2020-11-16 10:57:40] [10:57:40.151] Batch 385...
[INFO] [2020-11-16 10:57:41] [10:57:41.669] Batch 386...
[INFO] [2020-11-16 10:57:42] [10:57:42.933] Batch 387...
[INFO] [2020-11-16 10:57:44] [10:57:44.075] Batch 388...
[INFO] [2020-11-16 10:57:44] [10:57:44.928] Batch 389...
[INFO] [2020-11-16 10:57:46] [10:57:46.016] Batch 390...
[INFO] [2020-11-16 10:57:46] [10:57:46.957] Batch 391...
[INFO] [2020-11-16 10:57:47] [10:57:47.679] Removed 3915001 Nodes
[START] [2020-11-16 11:19:53] logged process: 58bbc42b01abb4c1b2698de049792ffb4b63b979

[START] [2020-11-16 11:19:53] Creating resource from OpenData
[START] [2020-11-16 11:20:10] logged process: 58bbc42b01abb4c1b2698de049792ffb4b63b979

[START] [2020-11-16 11:20:10] Parse meta.xml file and create formats with fields
[STOP] [2020-11-16 11:20:11] Parse meta.xml file and create formats with fields
[STOP] [2020-11-16 11:20:11] Creating resource from OpenData
[START] [2020-11-16 11:20:11] logged process: 58bbc42b01abb4c1b2698de049792ffb4b63b979

[START] [2020-11-16 11:20:11] create_harvest_instance
[STOP] [2020-11-16 11:20:12] create_harvest_instance
[START] [2020-11-16 11:20:12] fetch_files
[STOP] [2020-11-16 11:20:12] fetch_files
[START] [2020-11-16 11:20:12] validate_each_file
[STOP] [2020-11-16 11:24:11] validate_each_file
[START] [2020-11-16 11:24:11] convert_to_csv
[CMD] [2020-11-16 11:24:11] /usr/bin/sort /app/public/converted_csv/gbif_classificat_nodes_24273.csv > /app/public/converted_csv/gbif_classificat_nodes_24273.csv_sorted
[STOP] [2020-11-16 11:24:13] convert_to_csv
[START] [2020-11-16 11:24:13] calculate_delta
[CMD] [2020-11-16 11:24:13] echo "0a" > /app/public/diff/gbif_classificat_nodes_24273.diff
[CMD] [2020-11-16 11:24:13] tail -n +1 /app/public/converted_csv/gbif_classificat_nodes_24273.csv >> /app/public/diff/gbif_classificat_nodes_24273.diff
[CMD] [2020-11-16 11:24:14] echo "." >> /app/public/diff/gbif_classificat_nodes_24273.diff
[STOP] [2020-11-16 11:24:14] calculate_delta
[START] [2020-11-16 11:24:14] parse_diff_and_store
[INFO] [2020-11-16 11:24:17] Loading nodes diff file into memory (true lines)...
[WARN] [2020-11-16 11:24:17] New Taxonomic status: doubtful; treatings as unusable...
[WARN] [2020-11-16 11:24:18] New Taxonomic status: proparte synonym; treatings as unusable...
[WARN] [2020-11-16 11:24:21] Filtered Scientific Name `Motacilla citreola x  flava` to `Motacilla citreola x flava`
[WARN] [2020-11-16 11:24:22] Filtered Scientific Name `Sophora  yellow stunt  alphasatellite 4` to `Sophora yellow stunt alphasatellite 4`
[WARN] [2020-11-16 11:24:26] Filtered Scientific Name `Lentivirus: Visna/maedi virus ICTV` to `Lentivirus: Visnamaedi virus ICTV`
[WARN] [2020-11-16 11:24:28] Filtered Scientific Name `Nephrolepis pendula  j smith x undulata` to `Nephrolepis pendula j smith x undulata`
[WARN] [2020-11-16 11:24:34] Filtered Scientific Name `Sophora  yellow stunt  alphasatellite 5` to `Sophora yellow stunt alphasatellite 5`
[WARN] [2020-11-16 11:24:35] Filtered Scientific Name `Pea necrotic yellow dwarf   alphasatellite 1` to `Pea necrotic yellow dwarf alphasatellite 1`
[WARN] [2020-11-16 11:24:39] Filtered Scientific Name `Eleocharis acutangula  schultes x e plicarrhachis` to `Eleocharis acutangula schultes x e plicarrhachis`
[WARN] [2020-11-16 11:24:43] Filtered Scientific Name `Inovirus: Enterobacteria phage ZJ/2 ICTV` to `Inovirus: Enterobacteria phage ZJ2 ICTV`
[WARN] [2020-11-16 11:24:50] Filtered Scientific Name `Banana bunchy top  alphasatellite 2` to `Banana bunchy top alphasatellite 2`
[WARN] [2020-11-16 11:24:52] Filtered Scientific Name `Turdus atrogularis x eunomus/naumanni` to `Turdus atrogularis x eunomusnaumanni`
[WARN] [2020-11-16 11:24:54] Filtered Scientific Name `Pea necrotic yellow dwarf  alphasatellite 2` to `Pea necrotic yellow dwarf alphasatellite 2`
[WARN] [2020-11-16 11:25:13] Filtered Scientific Name `Papilio minor Esper, 1777/79` to `Papilio minor Esper, 177779`
[WARN] [2020-11-16 11:25:13] Filtered Scientific Name `Tortrix tristana Hübner, 1796/99` to `Tortrix tristana Hübner, 179699`
[WARN] [2020-11-16 11:28:49] Filtered Scientific Name `Xyleutes leucolophus Guérin-Meneville, 1829/44` to `Xyleutes leucolophus Guérin-Meneville, 182944`
[WARN] [2020-11-16 11:28:51] Filtered Scientific Name `Phragmataecia terebrifer Fletcher, 1926/27` to `Phragmataecia terebrifer Fletcher, 192627`
[WARN] [2020-11-16 11:28:51] Filtered Scientific Name `Phragmataecia purpureus Fletcher, 1926/27` to `Phragmataecia purpureus Fletcher, 192627`
[WARN] [2020-11-16 11:28:51] Filtered Scientific Name `Gastromega badia Saalmüller, 1877/78` to `Gastromega badia Saalmüller, 187778`
[WARN] [2020-11-16 11:28:53] Filtered Scientific Name `Lechriolepis stumpfi Saalmüller, 1877/78` to `Lechriolepis stumpfi Saalmüller, 187778`
[WARN] [2020-11-16 11:29:04] Filtered Scientific Name `Aterpia charpentierana Hübner, 1822/23` to `Aterpia charpentierana Hübner, 182223`
[WARN] [2020-11-16 11:29:05] Filtered Scientific Name `Bactra lanceolana Hübner, 1796/99` to `Bactra lanceolana Hübner, 179699`
[WARN] [2020-11-16 11:29:05] Filtered Scientific Name `Macroplectra unicolor Moore, 1858/59` to `Macroplectra unicolor Moore, 185859`
[WARN] [2020-11-16 11:29:06] Filtered Scientific Name `Miresa nivaha Moore, 1858/59` to `Miresa nivaha Moore, 185859`
[WARN] [2020-11-16 11:29:06] Filtered Scientific Name `Birthama saturata Kiriakoff, 1946/49` to `Birthama saturata Kiriakoff, 194649`
[WARN] [2020-11-16 11:29:06] Filtered Scientific Name `Tetraclonia dyraspes Druce, 1891/901` to `Tetraclonia dyraspes Druce, 1891901`
[WARN] [2020-11-16 11:29:06] Filtered Scientific Name `Clelea pravata Moore, 1858/59` to `Clelea pravata Moore, 185859`
[WARN] [2020-11-16 11:29:06] Filtered Scientific Name `Seryda basirei Druce, 1891/901` to `Seryda basirei Druce, 1891901`
[WARN] [2020-11-16 11:29:06] Filtered Scientific Name `Phauda mahisa Moore, 1858/59` to `Phauda mahisa Moore, 185859`
[WARN] [2020-11-16 11:29:07] Filtered Scientific Name `Trachea macrophtalma Berio, 1976/77` to `Trachea macrophtalma Berio, 197677`
[WARN] [2020-11-16 11:29:07] Filtered Scientific Name `Trachea bipectinata Berio, 1976/77` to `Trachea bipectinata Berio, 197677`
[WARN] [2020-11-16 11:29:07] (Reached filtered-name limit; supressing further warnings.)
[INFO] [2020-11-16 13:13:44] Storing 3889747 ScientificNames
[INFO] [2020-11-16 13:13:44] Processing group of 3889747 in 3890 groups of 1000
[INFO] [2020-11-16 14:38:14] Average Time: 1.274
[INFO] [2020-11-16 14:38:14] Total Time: 1h24m31s
[INFO] [2020-11-16 14:38:14] last 3 / first 3: 1.01
[INFO] [2020-11-16 14:38:14] Std.Dev: 6.569474864857921; Max: 52.69
[INFO] [2020-11-16 14:38:14] Storing 2959884 Nodes
[INFO] [2020-11-16 14:38:14] Processing group of 2959884 in 2960 groups of 1000
[INFO] [2020-11-16 16:17:37] Average Time: 1.951
[INFO] [2020-11-16 16:17:37] Total Time: 1h39m23s
[INFO] [2020-11-16 16:17:37] last 3 / first 3: 0.79
[INFO] [2020-11-16 16:17:37] Std.Dev: 9.449232773087981; Max: 62.52
[STOP] [2020-11-16 16:17:37] parse_diff_and_store
[START] [2020-11-16 16:17:37] resolve_keys
[INFO] [2020-11-16 16:23:47] Occurrences to nodes (through scientific_names)...
[INFO] [2020-11-16 16:23:47] traits to occurrences...
[INFO] [2020-11-16 16:23:47] traits to nodes (through occurrences)...
[INFO] [2020-11-16 16:23:47] Traits to sex term...
[INFO] [2020-11-16 16:23:47] Traits to lifestage term...
[INFO] [2020-11-16 16:23:47] MetaTraits to traits...
[INFO] [2020-11-16 16:23:47] MetaTraits (simple, measurement row refers to parent) to traits...
[INFO] [2020-11-16 16:23:47] Assocs to occurrences...
[INFO] [2020-11-16 16:23:47] Assocs to nodes...
[INFO] [2020-11-16 16:23:47] Assoc to sex term...
[INFO] [2020-11-16 16:23:47] Assoc to lifestage term...
[INFO] [2020-11-16 16:23:47] MetaAssoc to assocs...
[STOP] [2020-11-16 16:23:47] resolve_keys
[START] [2020-11-16 16:23:47] hold_for_later_1
[STOP] [2020-11-16 16:23:47] hold_for_later_1
[START] [2020-11-16 16:23:47] hold_for_later_2
[STOP] [2020-11-16 16:23:47] hold_for_later_2
[START] [2020-11-16 16:23:47] resolve_missing_parents
[STOP] [2020-11-16 16:24:20] resolve_missing_parents
[START] [2020-11-16 16:24:20] rebuild_nodes
[START] [2020-11-16 16:24:20] Flattener#flatten
[START] [2020-11-16 16:24:20] Flattener#study_resource
[START] [2020-11-16 16:25:57] Flattener#build_ancestry
[STOP] [2020-11-17 00:48:35] Flattener#build_ancestry
[INFO] [2020-11-17 00:48:35] 2959884 ancestry keys
[START] [2020-11-17 00:48:35] build_node_ancestors
[INFO] [2020-11-17 00:48:35] old ancestors deleted.
[STOP] [2020-11-17 01:20:26] build_node_ancestors
[START] [2020-11-17 01:20:27] Flattener#propagate_ancestor_ids
[STOP] [2020-11-17 01:30:53] Flattener#propagate_ancestor_ids
[STOP] [2020-11-17 01:30:53] Flattener#flatten
[STOP] [2020-11-17 01:30:53] rebuild_nodes
[START] [2020-11-17 01:30:53] resolve_missing_media_owners
[STOP] [2020-11-17 01:30:53] resolve_missing_media_owners
[START] [2020-11-17 01:30:53] sanitize_media_verbatims
[STOP] [2020-11-17 01:30:53] sanitize_media_verbatims
[START] [2020-11-17 01:30:53] queue_downloads
[STOP] [2020-11-17 01:30:53] queue_downloads
[START] [2020-11-17 01:30:53] parse_names
[WARN] [2020-11-17 01:30:57] I see 3889747 names which still need to be parsed.
[WARN] [2020-11-17 02:22:45] I see 55 names which still need to be parsed.
[WARN] [2020-11-17 02:22:59] I see 4 names which still need to be parsed.
[WARN] [2020-11-17 02:23:13] I see 1 names which still need to be parsed.
[STOP] [2020-11-17 02:23:27] parse_names
[START] [2020-11-17 02:23:27] denormalize_canonical_names_to_nodes
[STOP] [2020-11-17 02:24:11] denormalize_canonical_names_to_nodes
[START] [2020-11-17 02:24:11] match_nodes
[START] [2020-11-17 02:24:15] map_all_nodes_to_pages
[INFO] [2020-11-18 19:07:09] ## HARVEST: type = resume_-harvest
[START] [2020-11-18 19:07:10] logged process: 58bbc42b01abb4c1b2698de049792ffb4b63b979

[ERR] [2020-11-18 19:07:10][hdls] *****
[ERR] [2020-11-18 19:07:10][hdls] ***** HARVEST ATTEMPT FAILED: This resource is locked; assuming it is already running. Remove lock if not.
[ERR] [2020-11-18 19:07:10][hdls] *****
[INFO] [2020-11-18 19:25:31] ## HARVEST: type = resume_-harvest
[START] [2020-11-18 19:25:32] logged process: 58bbc42b01abb4c1b2698de049792ffb4b63b979

[INFO] [2020-11-18 19:25:32] Already completed stage create_harvest_instance, skipping...
[INFO] [2020-11-18 19:25:32] Already completed stage fetch_files, skipping...
[INFO] [2020-11-18 19:25:32] Already completed stage validate_each_file, skipping...
[INFO] [2020-11-18 19:25:32] Already completed stage convert_to_csv, skipping...
[INFO] [2020-11-18 19:25:32] Already completed stage calculate_delta, skipping...
[INFO] [2020-11-18 19:25:32] Already completed stage parse_diff_and_store, skipping...
[INFO] [2020-11-18 19:25:32] Already completed stage resolve_keys, skipping...
[INFO] [2020-11-18 19:25:32] Already completed stage hold_for_later_1, skipping...
[INFO] [2020-11-18 19:25:32] Already completed stage hold_for_later_2, skipping...
[INFO] [2020-11-18 19:25:32] Already completed stage resolve_missing_parents, skipping...
[INFO] [2020-11-18 19:25:32] Already completed stage rebuild_nodes, skipping...
[INFO] [2020-11-18 19:25:32] Already completed stage resolve_missing_media_owners, skipping...
[INFO] [2020-11-18 19:25:32] Already completed stage sanitize_media_verbatims, skipping...
[INFO] [2020-11-18 19:25:32] Already completed stage queue_downloads, skipping...
[INFO] [2020-11-18 19:25:32] Already completed stage parse_names, skipping...
[INFO] [2020-11-18 19:25:32] Already completed stage denormalize_canonical_names_to_nodes, skipping...
[START] [2020-11-18 19:25:32] match_nodes
[START] [2020-11-18 19:25:35] map_all_nodes_to_pages
[STOP] [2020-11-19 01:03:18] map_all_nodes_to_pages
[INFO] [2020-11-19 01:03:18] 54279 Unmatched nodes (of 2959884)! That's too many to output. First 10: Dicliptera roxburghiana roxburghiana (#83703459); Dicliptera riparia riparia (#84039290); Dicliptera paniculata paniculata (#83918474); Dicliptera foetida foetida (#83709622); Dicliptera obtusifolia obtusifolia (#83663726); Dicliptera moritziana moritziana (#83663733); Dicliptera sebastinei sebastinei (#84390228); Dicliptera caerulea (#83921894); Dicliptera horsfieldii (#84031863); Dicliptera retorta (#84121113)
[START] [2020-11-19 01:03:18] update_nodes
[STOP] [2020-11-19 01:03:25] update_nodes
[STOP] [2020-11-19 01:03:25] match_nodes
[START] [2020-11-19 01:03:25] reindex_search
[STOP] [2020-11-19 02:18:52] reindex_search
[START] [2020-11-19 02:18:52] normalize_units
[STOP] [2020-11-19 02:18:52] normalize_units
[START] [2020-11-19 02:18:52] calculate_statistics
[STOP] [2020-11-19 02:18:56] calculate_statistics
[START] [2020-11-19 02:18:56] complete_harvest_instance
[START] [2020-11-19 02:18:56] overall_tsv_creation
[INFO] [2020-11-19 02:18:59] Processing group of 2959884 in 296 batches of 10000
[INFO] [2020-11-19 08:38:29] Average Time: 48.85
[INFO] [2020-11-19 08:38:29] Total Time: 6h19m31s
[INFO] [2020-11-19 08:38:29] last 3 / first 3: 1.04
[INFO] [2020-11-19 08:38:29] Std.Dev: 6.065228767326093; Max: 84.89
[STOP] [2020-11-19 08:38:29] overall_tsv_creation
[INFO] [2020-11-19 08:38:29] Done. Check your files:
[INFO] [2020-11-19 08:38:29] (2959884 lines) /app/public/data/gbif_classificat/publish_nodes.tsv
[INFO] [2020-11-19 08:38:29] (17201175 lines) /app/public/data/gbif_classificat/publish_node_ancestors.tsv
[INFO] [2020-11-19 08:38:30] (3872512 lines) /app/public/data/gbif_classificat/publish_scientific_names.tsv
[STOP] [2020-11-19 08:38:34] complete_harvest_instance
[START] [2020-11-19 08:38:34] completed
[STOP] [2020-11-19 08:38:34] completed
[STOP] [2020-11-19 08:38:34] logged process, took 47581.97

Latest Process