Harvest for BOLDS data coverage Created 04 Jun 06:42

Stage: completed
Fetched: 04 Jun 06:42
Validated: 04 Jun 06:43
Deltas Created 04 Jun 06:43
Units Normalized: 04 Jun 09:57
Ancestry Built: 04 Jun 07:29
Nodes Matched: 04 Jun 09:47
Names Parsed: 04 Jun 07:35
New Models Stored: 04 Jun 07:03
Indexed: 04 Jun 09:57
Completed: 04 Jun 12:51
Time to Harvest: 6 minutes
Harvesting Log

(952 lines)
[INFO] [2024-06-04 06:42:53] Created harvest instance #4547
[STOP] [2024-06-04 06:42:53] create_harvest_instance
[START] [2024-06-04 06:42:53] fetch_files
[STOP] [2024-06-04 06:42:53] fetch_files
[START] [2024-06-04 06:42:53] validate_each_file
[INFO] [2024-06-04 06:42:53] Looping over 3 formats...
[INFO] [2024-06-04 06:42:53] ...nodes (/app/public/data/bolds_data_cover/taxon.tab)
[INFO] [2024-06-04 06:43:04] Valid: /app/public/data/bolds_data_cover/converted_csv/bolds_data_cover_nodes_31149.csv (524701 lines)
[INFO] [2024-06-04 06:43:04] ...occurrences (/app/public/data/bolds_data_cover/occurrence_specific.tab)
[INFO] [2024-06-04 06:43:11] Valid: /app/public/data/bolds_data_cover/converted_csv/bolds_data_cover_occurrences_31150.csv (513111 lines)
[INFO] [2024-06-04 06:43:11] ...measurements (/app/public/data/bolds_data_cover/measurement_or_fact_specific.tab)
[INFO] [2024-06-04 06:43:25] Valid: /app/public/data/bolds_data_cover/converted_csv/bolds_data_cover_measurements_31151.csv (513111 lines)
[STOP] [2024-06-04 06:43:25] validate_each_file
[START] [2024-06-04 06:43:25] convert_to_csv
[INFO] [2024-06-04 06:43:25] Looping over 3 formats...
[INFO] [2024-06-04 06:43:25] ...nodes (/app/public/data/bolds_data_cover/taxon.tab)
[CMD] [2024-06-04 06:43:25] /usr/bin/sort /app/public/data/bolds_data_cover/converted_csv/bolds_data_cover_nodes_31149.csv > /app/public/data/bolds_data_cover/converted_csv/bolds_data_cover_nodes_31149.csv_sorted
[INFO] [2024-06-04 06:43:25] Converted: /app/public/data/bolds_data_cover/converted_csv/bolds_data_cover_nodes_31149.csv (524701 lines)
[INFO] [2024-06-04 06:43:25] ...occurrences (/app/public/data/bolds_data_cover/occurrence_specific.tab)
[CMD] [2024-06-04 06:43:25] /usr/bin/sort /app/public/data/bolds_data_cover/converted_csv/bolds_data_cover_occurrences_31150.csv > /app/public/data/bolds_data_cover/converted_csv/bolds_data_cover_occurrences_31150.csv_sorted
[INFO] [2024-06-04 06:43:26] Converted: /app/public/data/bolds_data_cover/converted_csv/bolds_data_cover_occurrences_31150.csv (513111 lines)
[INFO] [2024-06-04 06:43:26] ...measurements (/app/public/data/bolds_data_cover/measurement_or_fact_specific.tab)
[CMD] [2024-06-04 06:43:26] /usr/bin/sort /app/public/data/bolds_data_cover/converted_csv/bolds_data_cover_measurements_31151.csv > /app/public/data/bolds_data_cover/converted_csv/bolds_data_cover_measurements_31151.csv_sorted
[INFO] [2024-06-04 06:43:28] Converted: /app/public/data/bolds_data_cover/converted_csv/bolds_data_cover_measurements_31151.csv (513111 lines)
[STOP] [2024-06-04 06:43:28] convert_to_csv
[START] [2024-06-04 06:43:28] calculate_delta
[INFO] [2024-06-04 06:43:28] Looping over 3 formats...
[INFO] [2024-06-04 06:43:28] ...nodes (/app/public/data/bolds_data_cover/taxon.tab)
[CMD] [2024-06-04 06:43:28] echo "0a" > /app/public/data/bolds_data_cover/diff/bolds_data_cover_nodes_31149.diff
[CMD] [2024-06-04 06:43:29] tail -n +1 /app/public/data/bolds_data_cover/converted_csv/bolds_data_cover_nodes_31149.csv >> /app/public/data/bolds_data_cover/diff/bolds_data_cover_nodes_31149.diff
[CMD] [2024-06-04 06:43:29] echo "." >> /app/public/data/bolds_data_cover/diff/bolds_data_cover_nodes_31149.diff
[INFO] [2024-06-04 06:43:29] Created diff: /app/public/data/bolds_data_cover/diff/bolds_data_cover_nodes_31149.diff (524703 lines)
[INFO] [2024-06-04 06:43:29] ...occurrences (/app/public/data/bolds_data_cover/occurrence_specific.tab)
[CMD] [2024-06-04 06:43:29] echo "0a" > /app/public/data/bolds_data_cover/diff/bolds_data_cover_occurrences_31150.diff
[CMD] [2024-06-04 06:43:30] tail -n +1 /app/public/data/bolds_data_cover/converted_csv/bolds_data_cover_occurrences_31150.csv >> /app/public/data/bolds_data_cover/diff/bolds_data_cover_occurrences_31150.diff
[CMD] [2024-06-04 06:43:30] echo "." >> /app/public/data/bolds_data_cover/diff/bolds_data_cover_occurrences_31150.diff
[INFO] [2024-06-04 06:43:30] Created diff: /app/public/data/bolds_data_cover/diff/bolds_data_cover_occurrences_31150.diff (513113 lines)
[INFO] [2024-06-04 06:43:30] ...measurements (/app/public/data/bolds_data_cover/measurement_or_fact_specific.tab)
[CMD] [2024-06-04 06:43:30] echo "0a" > /app/public/data/bolds_data_cover/diff/bolds_data_cover_measurements_31151.diff
[CMD] [2024-06-04 06:43:30] tail -n +1 /app/public/data/bolds_data_cover/converted_csv/bolds_data_cover_measurements_31151.csv >> /app/public/data/bolds_data_cover/diff/bolds_data_cover_measurements_31151.diff
[CMD] [2024-06-04 06:43:32] echo "." >> /app/public/data/bolds_data_cover/diff/bolds_data_cover_measurements_31151.diff
[INFO] [2024-06-04 06:43:32] Created diff: /app/public/data/bolds_data_cover/diff/bolds_data_cover_measurements_31151.diff (513113 lines)
[STOP] [2024-06-04 06:43:32] calculate_delta
[START] [2024-06-04 06:43:32] parse_diff_and_store
[INFO] [2024-06-04 06:43:32] Handling diff: /app/public/data/bolds_data_cover/diff/bolds_data_cover_nodes_31149.diff (524703 lines)
[INFO] [2024-06-04 06:43:32] Loading nodes diff file into memory (524703 lines)...
[INFO] [2024-06-04 06:43:35] Storing 9999 ScientificNames (19998/10000/524703)
[INFO] [2024-06-04 06:43:38] Storing 9999 Nodes (19998/10000/524703)
[INFO] [2024-06-04 06:43:44] Storing 10000 ScientificNames (39998/20000/524703)
[INFO] [2024-06-04 06:43:48] Storing 10000 Nodes (39998/20000/524703)
[INFO] [2024-06-04 06:43:54] Storing 10000 ScientificNames (59998/30000/524703)
[INFO] [2024-06-04 06:43:57] Storing 10000 Nodes (59998/30000/524703)
[INFO] [2024-06-04 06:44:04] Storing 10000 ScientificNames (79998/40000/524703)
[INFO] [2024-06-04 06:44:07] Storing 10000 Nodes (79998/40000/524703)
[WARN] [2024-06-04 06:44:13] Filtered Scientific Name `Ephoron cf. indicus EP01KN/1-658` to `Ephoron cf. indicus EP01KN1-658`
[INFO] [2024-06-04 06:44:14] Storing 10000 ScientificNames (99998/50000/524703)
[INFO] [2024-06-04 06:44:17] Storing 10000 Nodes (99998/50000/524703)
[WARN] [2024-06-04 06:44:21] Filtered Scientific Name `Odontosyllis cf. fulgurans MNCN 16.01/18963` to `Odontosyllis cf. fulgurans MNCN 16.0118963`
[WARN] [2024-06-04 06:44:21] Filtered Scientific Name `Odontosyllis cf. gibba MNCN 16.01/18983` to `Odontosyllis cf. gibba MNCN 16.0118983`
[INFO] [2024-06-04 06:44:24] Storing 10000 ScientificNames (119998/60000/524703)
[INFO] [2024-06-04 06:44:27] Storing 10000 Nodes (119998/60000/524703)
[WARN] [2024-06-04 06:44:31] Filtered Scientific Name `Leucauge cf. taiwanica/tessellata GH1768` to `Leucauge cf. taiwanicatessellata GH1768`
[INFO] [2024-06-04 06:44:34] Storing 10000 ScientificNames (139998/70000/524703)
[INFO] [2024-06-04 06:44:37] Storing 10000 Nodes (139998/70000/524703)
[WARN] [2024-06-04 06:44:41] Filtered Scientific Name `Hylaeus affinis/modestus` to `Hylaeus affinismodestus`
[WARN] [2024-06-04 06:44:41] Filtered Scientific Name `Stegopterna mutata/diplomutata` to `Stegopterna mutatadiplomutata`
[INFO] [2024-06-04 06:44:44] Storing 10000 ScientificNames (159998/80000/524703)
[INFO] [2024-06-04 06:44:47] Storing 10000 Nodes (159998/80000/524703)
[WARN] [2024-06-04 06:44:52] Filtered Scientific Name `Casinaria CAS-03/08` to `Casinaria CAS-0308`
[INFO] [2024-06-04 06:44:54] Storing 10000 ScientificNames (179998/90000/524703)
[INFO] [2024-06-04 06:44:57] Storing 10000 Nodes (179998/90000/524703)
[INFO] [2024-06-04 06:45:03] Storing 10000 ScientificNames (199998/100000/524703)
[INFO] [2024-06-04 06:45:07] Storing 10000 Nodes (199998/100000/524703)
[INFO] [2024-06-04 06:45:13] Storing 10000 ScientificNames (219998/110000/524703)
[INFO] [2024-06-04 06:45:17] Storing 10000 Nodes (219998/110000/524703)
[WARN] [2024-06-04 06:45:20] Filtered Scientific Name `Casinaria INB-04/09DHJ02` to `Casinaria INB-0409DHJ02`
[INFO] [2024-06-04 06:45:23] Storing 10000 ScientificNames (239998/120000/524703)
[INFO] [2024-06-04 06:45:26] Storing 10000 Nodes (239998/120000/524703)
[INFO] [2024-06-04 06:45:33] Storing 10000 ScientificNames (259998/130000/524703)
[INFO] [2024-06-04 06:45:36] Storing 10000 Nodes (259998/130000/524703)
[INFO] [2024-06-04 06:45:43] Storing 10000 ScientificNames (279998/140000/524703)
[INFO] [2024-06-04 06:45:46] Storing 10000 Nodes (279998/140000/524703)
[INFO] [2024-06-04 06:45:53] Storing 10000 ScientificNames (299998/150000/524703)
[INFO] [2024-06-04 06:45:57] Storing 10000 Nodes (299998/150000/524703)
[INFO] [2024-06-04 06:46:04] Storing 10000 ScientificNames (319998/160000/524703)
[INFO] [2024-06-04 06:46:07] Storing 10000 Nodes (319998/160000/524703)
[INFO] [2024-06-04 06:46:14] Storing 10000 ScientificNames (339998/170000/524703)
[INFO] [2024-06-04 06:46:18] Storing 10000 Nodes (339998/170000/524703)
[INFO] [2024-06-04 06:46:25] Storing 10000 ScientificNames (359998/180000/524703)
[INFO] [2024-06-04 06:46:29] Storing 10000 Nodes (359998/180000/524703)
[WARN] [2024-06-04 06:46:34] Filtered Scientific Name `Hydropsyche bronta/morosa` to `Hydropsyche brontamorosa`
[INFO] [2024-06-04 06:46:36] Storing 10000 ScientificNames (379998/190000/524703)
[INFO] [2024-06-04 06:46:39] Storing 10000 Nodes (379998/190000/524703)
[WARN] [2024-06-04 06:46:45] Filtered Scientific Name `Conostigmus sp32/33IM` to `Conostigmus sp3233IM`
[INFO] [2024-06-04 06:46:47] Storing 10000 ScientificNames (399998/200000/524703)
[INFO] [2024-06-04 06:46:50] Storing 10000 Nodes (399998/200000/524703)
[WARN] [2024-06-04 06:46:55] Filtered Scientific Name `Stegopterna diplomutata/mutata` to `Stegopterna diplomutatamutata`
[WARN] [2024-06-04 06:46:56] Filtered Scientific Name `Simulium anatinum/randalense` to `Simulium anatinumrandalense`
[INFO] [2024-06-04 06:46:58] Storing 10000 ScientificNames (419998/210000/524703)
[INFO] [2024-06-04 06:47:01] Storing 10000 Nodes (419998/210000/524703)
[WARN] [2024-06-04 06:47:06] Filtered Scientific Name `Apostasia cf. stylidoides Clements 4823/O-461` to `Apostasia cf. stylidoides Clements 4823O-461`
[INFO] [2024-06-04 06:47:09] Storing 10000 ScientificNames (439998/220000/524703)
[INFO] [2024-06-04 06:47:13] Storing 10000 Nodes (439998/220000/524703)
[INFO] [2024-06-04 06:47:20] Storing 10000 ScientificNames (459998/230000/524703)
[INFO] [2024-06-04 06:47:24] Storing 10000 Nodes (459998/230000/524703)
[INFO] [2024-06-04 06:47:32] Storing 10000 ScientificNames (479998/240000/524703)
[INFO] [2024-06-04 06:47:36] Storing 10000 Nodes (479998/240000/524703)
[WARN] [2024-06-04 06:47:40] Filtered Scientific Name `Solanum anomalum/distichum` to `Solanum anomalumdistichum`
[WARN] [2024-06-04 06:47:40] Filtered Scientific Name `Solanum erianthum/lanceolatum` to `Solanum erianthumlanceolatum`
[WARN] [2024-06-04 06:47:40] Filtered Scientific Name `Solanum lasiocarpum/violaceum` to `Solanum lasiocarpumviolaceum`
[WARN] [2024-06-04 06:47:40] Filtered Scientific Name `Solanum mitlense/lanceolatum` to `Solanum mitlenselanceolatum`
[INFO] [2024-06-04 06:47:43] Storing 10000 ScientificNames (499998/250000/524703)
[INFO] [2024-06-04 06:47:47] Storing 10000 Nodes (499998/250000/524703)
[WARN] [2024-06-04 06:47:50] Filtered Scientific Name `Casinaria CAS-04/09DHJ01` to `Casinaria CAS-0409DHJ01`
[WARN] [2024-06-04 06:47:50] Filtered Scientific Name `Charops WahlJ/H` to `Charops WahlJH`
[INFO] [2024-06-04 06:47:55] Storing 10000 ScientificNames (519998/260000/524703)
[INFO] [2024-06-04 06:47:58] Storing 10000 Nodes (519998/260000/524703)
[WARN] [2024-06-04 06:48:01] Filtered Scientific Name `Copestylum CR-15/33` to `Copestylum CR-1533`
[WARN] [2024-06-04 06:48:01] Filtered Scientific Name `Copestylum CR-12/13` to `Copestylum CR-1213`
[WARN] [2024-06-04 06:48:01] Filtered Scientific Name `Ocyptamus CR-4/ct` to `Ocyptamus CR-4ct`
[INFO] [2024-06-04 06:48:06] Storing 10000 ScientificNames (539998/270000/524703)
[INFO] [2024-06-04 06:48:09] Storing 10000 Nodes (539998/270000/524703)
[WARN] [2024-06-04 06:48:14] Filtered Scientific Name `Lineus cf. ruber/viridis` to `Lineus cf. ruberviridis`
[WARN] [2024-06-04 06:48:15] Filtered Scientific Name `Achrysocharoides cf. butus/latreillei` to `Achrysocharoides cf. butuslatreillei`
[WARN] [2024-06-04 06:48:15] Filtered Scientific Name `Synchaeta cf. tremula/oblonga` to `Synchaeta cf. tremulaoblonga`
[INFO] [2024-06-04 06:48:18] Storing 10000 ScientificNames (559998/280000/524703)
[INFO] [2024-06-04 06:48:21] Storing 10000 Nodes (559998/280000/524703)
[INFO] [2024-06-04 06:48:29] Storing 10000 ScientificNames (579998/290000/524703)
[INFO] [2024-06-04 06:48:33] Storing 10000 Nodes (579998/290000/524703)
[WARN] [2024-06-04 06:48:36] Filtered Scientific Name `Tasmanocoenis tillyardi/rieki` to `Tasmanocoenis tillyardirieki`
[WARN] [2024-06-04 06:48:37] Filtered Scientific Name `Casinaria INB-CAS-16/20` to `Casinaria INB-CAS-1620`
[INFO] [2024-06-04 06:48:40] Storing 10000 ScientificNames (599998/300000/524703)
[INFO] [2024-06-04 06:48:44] Storing 10000 Nodes (599998/300000/524703)
[INFO] [2024-06-04 06:48:52] Storing 10000 ScientificNames (619998/310000/524703)
[INFO] [2024-06-04 06:48:56] Storing 10000 Nodes (619998/310000/524703)
[WARN] [2024-06-04 06:48:59] Filtered Scientific Name `Cortinarius cf. bovinus IB 86/172` to `Cortinarius cf. bovinus IB 86172`
[WARN] [2024-06-04 06:48:59] Filtered Scientific Name `Hebeloma aff. nigellum IB 90/79` to `Hebeloma aff. nigellum IB 9079`
[WARN] [2024-06-04 06:49:00] (Reached filtered-name limit; supressing further warnings.)
[INFO] [2024-06-04 06:49:04] Storing 10000 ScientificNames (639998/320000/524703)
[INFO] [2024-06-04 06:49:07] Storing 10000 Nodes (639998/320000/524703)
[INFO] [2024-06-04 06:49:16] Storing 10000 ScientificNames (659998/330000/524703)
[INFO] [2024-06-04 06:49:20] Storing 10000 Nodes (659998/330000/524703)
[INFO] [2024-06-04 06:49:28] Storing 10000 ScientificNames (679998/340000/524703)
[INFO] [2024-06-04 06:49:32] Storing 10000 Nodes (679998/340000/524703)
[INFO] [2024-06-04 06:49:40] Storing 10000 ScientificNames (699998/350000/524703)
[INFO] [2024-06-04 06:49:44] Storing 10000 Nodes (699998/350000/524703)
[INFO] [2024-06-04 06:49:53] Storing 10000 ScientificNames (719998/360000/524703)
[INFO] [2024-06-04 06:49:56] Storing 10000 Nodes (719998/360000/524703)
[INFO] [2024-06-04 06:50:05] Storing 10000 ScientificNames (739998/370000/524703)
[INFO] [2024-06-04 06:50:09] Storing 10000 Nodes (739998/370000/524703)
[INFO] [2024-06-04 06:50:17] Storing 10000 ScientificNames (759998/380000/524703)
[INFO] [2024-06-04 06:50:21] Storing 10000 Nodes (759998/380000/524703)
[INFO] [2024-06-04 06:50:30] Storing 10000 ScientificNames (779998/390000/524703)
[INFO] [2024-06-04 06:50:34] Storing 10000 Nodes (779998/390000/524703)
[INFO] [2024-06-04 06:50:42] Storing 10000 ScientificNames (799998/400000/524703)
[INFO] [2024-06-04 06:50:46] Storing 10000 Nodes (799998/400000/524703)
[INFO] [2024-06-04 06:50:55] Storing 10000 ScientificNames (819998/410000/524703)
[INFO] [2024-06-04 06:50:59] Storing 10000 Nodes (819998/410000/524703)
[INFO] [2024-06-04 06:51:08] Storing 10000 ScientificNames (839998/420000/524703)
[INFO] [2024-06-04 06:51:11] Storing 10000 Nodes (839998/420000/524703)
[INFO] [2024-06-04 06:51:20] Storing 10000 ScientificNames (859998/430000/524703)
[INFO] [2024-06-04 06:51:24] Storing 10000 Nodes (859998/430000/524703)
[INFO] [2024-06-04 06:51:33] Storing 10000 ScientificNames (879998/440000/524703)
[INFO] [2024-06-04 06:51:36] Storing 10000 Nodes (879998/440000/524703)
[INFO] [2024-06-04 06:51:46] Storing 10000 ScientificNames (899998/450000/524703)
[INFO] [2024-06-04 06:51:49] Storing 10000 Nodes (899998/450000/524703)
[INFO] [2024-06-04 06:51:58] Storing 10000 ScientificNames (919998/460000/524703)
[INFO] [2024-06-04 06:52:02] Storing 10000 Nodes (919998/460000/524703)
[INFO] [2024-06-04 06:52:11] Storing 10000 ScientificNames (939998/470000/524703)
[INFO] [2024-06-04 06:52:14] Storing 10000 Nodes (939998/470000/524703)
[INFO] [2024-06-04 06:52:24] Storing 10000 ScientificNames (959998/480000/524703)
[INFO] [2024-06-04 06:52:28] Storing 10000 Nodes (959998/480000/524703)
[INFO] [2024-06-04 06:52:37] Storing 10000 ScientificNames (979998/490000/524703)
[INFO] [2024-06-04 06:52:41] Storing 10000 Nodes (979998/490000/524703)
[INFO] [2024-06-04 06:52:51] Storing 10000 ScientificNames (999998/500000/524703)
[INFO] [2024-06-04 06:52:54] Storing 10000 Nodes (999998/500000/524703)
[INFO] [2024-06-04 06:53:04] Storing 10000 ScientificNames (1019998/510000/524703)
[INFO] [2024-06-04 06:53:08] Storing 10000 Nodes (1019998/510000/524703)
[INFO] [2024-06-04 06:53:18] Storing 10000 ScientificNames (1039998/520000/524703)
[INFO] [2024-06-04 06:53:21] Storing 10000 Nodes (1039998/520000/524703)
[INFO] [2024-06-04 06:53:30] Storing 4702 ScientificNames (1049402/524701/524703)
[INFO] [2024-06-04 06:53:31] Storing 4702 Nodes (1049402/524701/524703)
[INFO] [2024-06-04 06:53:33] Handling diff: /app/public/data/bolds_data_cover/diff/bolds_data_cover_occurrences_31150.diff (513113 lines)
[INFO] [2024-06-04 06:53:33] Loading occurrences diff file into memory (513113 lines)...
[INFO] [2024-06-04 06:53:34] Storing 9999 Occurrences (9999/10000/513113)
[INFO] [2024-06-04 06:53:37] Storing 10000 Occurrences (19999/20000/513113)
[INFO] [2024-06-04 06:53:40] Storing 10000 Occurrences (29999/30000/513113)
[INFO] [2024-06-04 06:53:43] Storing 10000 Occurrences (39999/40000/513113)
[INFO] [2024-06-04 06:53:46] Storing 10000 Occurrences (49999/50000/513113)
[INFO] [2024-06-04 06:53:50] Storing 10000 Occurrences (59999/60000/513113)
[INFO] [2024-06-04 06:53:53] Storing 10000 Occurrences (69999/70000/513113)
[INFO] [2024-06-04 06:53:56] Storing 10000 Occurrences (79999/80000/513113)
[INFO] [2024-06-04 06:53:59] Storing 10000 Occurrences (89999/90000/513113)
[INFO] [2024-06-04 06:54:02] Storing 10000 Occurrences (99999/100000/513113)
[INFO] [2024-06-04 06:54:06] Storing 10000 Occurrences (109999/110000/513113)
[INFO] [2024-06-04 06:54:09] Storing 10000 Occurrences (119999/120000/513113)
[INFO] [2024-06-04 06:54:12] Storing 10000 Occurrences (129999/130000/513113)
[INFO] [2024-06-04 06:54:15] Storing 10000 Occurrences (139999/140000/513113)
[INFO] [2024-06-04 06:54:19] Storing 10000 Occurrences (149999/150000/513113)
[INFO] [2024-06-04 06:54:22] Storing 10000 Occurrences (159999/160000/513113)
[INFO] [2024-06-04 06:54:25] Storing 10000 Occurrences (169999/170000/513113)
[INFO] [2024-06-04 06:54:29] Storing 10000 Occurrences (179999/180000/513113)
[INFO] [2024-06-04 06:54:32] Storing 10000 Occurrences (189999/190000/513113)
[INFO] [2024-06-04 06:54:36] Storing 10000 Occurrences (199999/200000/513113)
[INFO] [2024-06-04 06:54:39] Storing 10000 Occurrences (209999/210000/513113)
[INFO] [2024-06-04 06:54:43] Storing 10000 Occurrences (219999/220000/513113)
[INFO] [2024-06-04 06:54:46] Storing 10000 Occurrences (229999/230000/513113)
[INFO] [2024-06-04 06:54:50] Storing 10000 Occurrences (239999/240000/513113)
[INFO] [2024-06-04 06:54:54] Storing 10000 Occurrences (249999/250000/513113)
[INFO] [2024-06-04 06:54:57] Storing 10000 Occurrences (259999/260000/513113)
[INFO] [2024-06-04 06:55:02] Storing 10000 Occurrences (269999/270000/513113)
[INFO] [2024-06-04 06:55:06] Storing 10000 Occurrences (279999/280000/513113)
[INFO] [2024-06-04 06:55:09] Storing 10000 Occurrences (289999/290000/513113)
[INFO] [2024-06-04 06:55:13] Storing 10000 Occurrences (299999/300000/513113)
[INFO] [2024-06-04 06:55:17] Storing 10000 Occurrences (309999/310000/513113)
[INFO] [2024-06-04 06:55:21] Storing 10000 Occurrences (319999/320000/513113)
[INFO] [2024-06-04 06:55:25] Storing 10000 Occurrences (329999/330000/513113)
[INFO] [2024-06-04 06:55:29] Storing 10000 Occurrences (339999/340000/513113)
[INFO] [2024-06-04 06:55:33] Storing 10000 Occurrences (349999/350000/513113)
[INFO] [2024-06-04 06:55:38] Storing 10000 Occurrences (359999/360000/513113)
[INFO] [2024-06-04 06:55:42] Storing 10000 Occurrences (369999/370000/513113)
[INFO] [2024-06-04 06:55:46] Storing 10000 Occurrences (379999/380000/513113)
[INFO] [2024-06-04 06:55:50] Storing 10000 Occurrences (389999/390000/513113)
[INFO] [2024-06-04 06:55:55] Storing 10000 Occurrences (399999/400000/513113)
[INFO] [2024-06-04 06:56:00] Storing 10000 Occurrences (409999/410000/513113)
[INFO] [2024-06-04 06:56:04] Storing 10000 Occurrences (419999/420000/513113)
[INFO] [2024-06-04 06:56:09] Storing 10000 Occurrences (429999/430000/513113)
[INFO] [2024-06-04 06:56:13] Storing 10000 Occurrences (439999/440000/513113)
[INFO] [2024-06-04 06:56:19] Storing 10000 Occurrences (449999/450000/513113)
[INFO] [2024-06-04 06:56:24] Storing 10000 Occurrences (459999/460000/513113)
[INFO] [2024-06-04 06:56:28] Storing 10000 Occurrences (469999/470000/513113)
[INFO] [2024-06-04 06:56:33] Storing 10000 Occurrences (479999/480000/513113)
[INFO] [2024-06-04 06:56:37] Storing 10000 Occurrences (489999/490000/513113)
[INFO] [2024-06-04 06:56:42] Storing 10000 Occurrences (499999/500000/513113)
[INFO] [2024-06-04 06:56:47] Storing 10000 Occurrences (509999/510000/513113)
[INFO] [2024-06-04 06:56:52] Storing 3112 Occurrences (513111/513111/513113)
[INFO] [2024-06-04 06:56:53] Handling diff: /app/public/data/bolds_data_cover/diff/bolds_data_cover_measurements_31151.diff (513113 lines)
[INFO] [2024-06-04 06:56:53] Loading measurements diff file into memory (513113 lines)...
[INFO] [2024-06-04 06:56:57] Storing 9999 Traits (9999/10000/513113)
[INFO] [2024-06-04 06:57:06] Storing 10000 Traits (19999/20000/513113)
[INFO] [2024-06-04 06:57:14] Storing 10000 Traits (29999/30000/513113)
[INFO] [2024-06-04 06:57:22] Storing 10000 Traits (39999/40000/513113)
[INFO] [2024-06-04 06:57:30] Storing 10000 Traits (49999/50000/513113)
[INFO] [2024-06-04 06:57:37] Storing 10000 Traits (59999/60000/513113)
[INFO] [2024-06-04 06:57:44] Storing 10000 Traits (69999/70000/513113)
[INFO] [2024-06-04 06:57:51] Storing 10000 Traits (79999/80000/513113)
[INFO] [2024-06-04 06:57:58] Storing 10000 Traits (89999/90000/513113)
[INFO] [2024-06-04 06:58:05] Storing 10000 Traits (99999/100000/513113)
[INFO] [2024-06-04 06:58:12] Storing 10000 Traits (109999/110000/513113)
[INFO] [2024-06-04 06:58:18] Storing 10000 Traits (119999/120000/513113)
[INFO] [2024-06-04 06:58:25] Storing 10000 Traits (129999/130000/513113)
[INFO] [2024-06-04 06:58:32] Storing 10000 Traits (139999/140000/513113)
[INFO] [2024-06-04 06:58:38] Storing 10000 Traits (149999/150000/513113)
[INFO] [2024-06-04 06:58:45] Storing 10000 Traits (159999/160000/513113)
[INFO] [2024-06-04 06:58:52] Storing 10000 Traits (169999/170000/513113)
[INFO] [2024-06-04 06:58:59] Storing 10000 Traits (179999/180000/513113)
[INFO] [2024-06-04 06:59:05] Storing 10000 Traits (189999/190000/513113)
[INFO] [2024-06-04 06:59:13] Storing 10000 Traits (199999/200000/513113)
[INFO] [2024-06-04 06:59:19] Storing 10000 Traits (209999/210000/513113)
[INFO] [2024-06-04 06:59:26] Storing 10000 Traits (219999/220000/513113)
[INFO] [2024-06-04 06:59:33] Storing 10000 Traits (229999/230000/513113)
[INFO] [2024-06-04 06:59:40] Storing 10000 Traits (239999/240000/513113)
[INFO] [2024-06-04 06:59:47] Storing 10000 Traits (249999/250000/513113)
[INFO] [2024-06-04 06:59:54] Storing 10000 Traits (259999/260000/513113)
[INFO] [2024-06-04 07:00:01] Storing 10000 Traits (269999/270000/513113)
[INFO] [2024-06-04 07:00:09] Storing 10000 Traits (279999/280000/513113)
[INFO] [2024-06-04 07:00:16] Storing 10000 Traits (289999/290000/513113)
[INFO] [2024-06-04 07:00:23] Storing 10000 Traits (299999/300000/513113)
[INFO] [2024-06-04 07:00:30] Storing 10000 Traits (309999/310000/513113)
[INFO] [2024-06-04 07:00:37] Storing 10000 Traits (319999/320000/513113)
[INFO] [2024-06-04 07:00:45] Storing 10000 Traits (329999/330000/513113)
[INFO] [2024-06-04 07:00:52] Storing 10000 Traits (339999/340000/513113)
[INFO] [2024-06-04 07:00:59] Storing 10000 Traits (349999/350000/513113)
[INFO] [2024-06-04 07:01:07] Storing 10000 Traits (359999/360000/513113)
[INFO] [2024-06-04 07:01:14] Storing 10000 Traits (369999/370000/513113)
[INFO] [2024-06-04 07:01:22] Storing 10000 Traits (379999/380000/513113)
[INFO] [2024-06-04 07:01:29] Storing 10000 Traits (389999/390000/513113)
[INFO] [2024-06-04 07:01:37] Storing 10000 Traits (399999/400000/513113)
[INFO] [2024-06-04 07:01:44] Storing 10000 Traits (409999/410000/513113)
[INFO] [2024-06-04 07:01:52] Storing 10000 Traits (419999/420000/513113)
[INFO] [2024-06-04 07:02:00] Storing 10000 Traits (429999/430000/513113)
[INFO] [2024-06-04 07:02:08] Storing 10000 Traits (439999/440000/513113)
[INFO] [2024-06-04 07:02:16] Storing 10000 Traits (449999/450000/513113)
[INFO] [2024-06-04 07:02:23] Storing 10000 Traits (459999/460000/513113)
[INFO] [2024-06-04 07:02:31] Storing 10000 Traits (469999/470000/513113)
[INFO] [2024-06-04 07:02:39] Storing 10000 Traits (479999/480000/513113)
[INFO] [2024-06-04 07:02:47] Storing 10000 Traits (489999/490000/513113)
[INFO] [2024-06-04 07:02:55] Storing 10000 Traits (499999/500000/513113)
[INFO] [2024-06-04 07:03:03] Storing 10000 Traits (509999/510000/513113)
[INFO] [2024-06-04 07:03:09] Storing 3112 Traits (513111/513111/513113)
[STOP] [2024-06-04 07:03:11] parse_diff_and_store
[START] [2024-06-04 07:03:11] resolve_keys
[2024-06-04 07:05:34] Resolving downloaded urls (this is not actually downloading them yet)
[INFO] [2024-06-04 07:05:44] Occurrences to nodes (through scientific_names)...
[INFO] [2024-06-04 07:06:19] traits to occurrences...
[INFO] [2024-06-04 07:07:13] traits to nodes (through occurrences)...
[INFO] [2024-06-04 07:07:42] Traits to sex term...
[INFO] [2024-06-04 07:07:51] Traits to lifestage term...
[INFO] [2024-06-04 07:08:00] MetaTraits to traits...
[INFO] [2024-06-04 07:08:00] MetaTraits (simple, measurement row refers to parent) to traits...
[INFO] [2024-06-04 07:08:01] Assocs to occurrences...
[INFO] [2024-06-04 07:08:01] Assocs to nodes...
[INFO] [2024-06-04 07:08:01] Assoc to sex term...
[INFO] [2024-06-04 07:08:01] Assoc to lifestage term...
[INFO] [2024-06-04 07:08:01] MetaAssoc to assocs...
[STOP] [2024-06-04 07:08:01] resolve_keys
[START] [2024-06-04 07:08:01] hold_for_later_1
[STOP] [2024-06-04 07:08:01] hold_for_later_1
[START] [2024-06-04 07:08:01] hold_for_later_2
[STOP] [2024-06-04 07:08:01] hold_for_later_2
[START] [2024-06-04 07:08:01] resolve_missing_parents
[STOP] [2024-06-04 07:08:14] resolve_missing_parents
[START] [2024-06-04 07:08:14] rebuild_nodes
[START] [2024-06-04 07:08:14] Flattener#flatten
[START] [2024-06-04 07:08:14] Flattener#study_resource
[START] [2024-06-04 07:08:54] Flattener#build_ancestry
[STOP] [2024-06-04 07:20:06] Flattener#build_ancestry
[INFO] [2024-06-04 07:20:06] 524701 ancestry keys
[START] [2024-06-04 07:20:06] build_node_ancestors
[INFO] [2024-06-04 07:20:06] old ancestors deleted.
[STOP] [2024-06-04 07:26:31] build_node_ancestors
[START] [2024-06-04 07:26:35] Flattener#propagate_ancestor_ids
[STOP] [2024-06-04 07:29:30] Flattener#propagate_ancestor_ids
[STOP] [2024-06-04 07:29:30] Flattener#flatten
[STOP] [2024-06-04 07:29:30] rebuild_nodes
[START] [2024-06-04 07:29:30] resolve_missing_media_owners
[STOP] [2024-06-04 07:29:30] resolve_missing_media_owners
[START] [2024-06-04 07:29:30] sanitize_media_verbatims
[STOP] [2024-06-04 07:29:30] sanitize_media_verbatims
[START] [2024-06-04 07:29:30] queue_downloads
[STOP] [2024-06-04 07:29:30] queue_downloads
[START] [2024-06-04 07:29:30] parse_names
[WARN] [2024-06-04 07:29:31] I see 524701 names which still need to be parsed.
[WARN] [2024-06-04 07:29:40] Names to parse: 10000 formatted: 10000 learned: 9861 parsed: 10000
[WARN] [2024-06-04 07:29:47] Names to parse: 10000 formatted: 10000 learned: 9792 parsed: 10000
[WARN] [2024-06-04 07:29:55] Names to parse: 10000 formatted: 10000 learned: 9904 parsed: 10000
[WARN] [2024-06-04 07:30:02] Names to parse: 10000 formatted: 10000 learned: 9775 parsed: 10000
[WARN] [2024-06-04 07:30:09] Names to parse: 10000 formatted: 10000 learned: 9982 parsed: 10000
[WARN] [2024-06-04 07:30:17] Names to parse: 10000 formatted: 10000 learned: 9855 parsed: 10000
[WARN] [2024-06-04 07:30:24] Names to parse: 10000 formatted: 10000 learned: 9867 parsed: 10000
[WARN] [2024-06-04 07:30:31] Names to parse: 10000 formatted: 10000 learned: 9946 parsed: 10000
[WARN] [2024-06-04 07:30:38] Names to parse: 10000 formatted: 10000 learned: 9927 parsed: 10000
[WARN] [2024-06-04 07:30:45] Names to parse: 10000 formatted: 10000 learned: 9970 parsed: 10000
[WARN] [2024-06-04 07:30:52] Names to parse: 10000 formatted: 10000 learned: 9970 parsed: 10000
[WARN] [2024-06-04 07:30:59] Names to parse: 10000 formatted: 10000 learned: 9927 parsed: 10000
[WARN] [2024-06-04 07:31:06] Names to parse: 10000 formatted: 10000 learned: 9959 parsed: 10000
[WARN] [2024-06-04 07:31:13] Names to parse: 10000 formatted: 10000 learned: 9985 parsed: 10000
[WARN] [2024-06-04 07:31:20] Names to parse: 10000 formatted: 10000 learned: 9978 parsed: 10000
[WARN] [2024-06-04 07:31:27] Names to parse: 10000 formatted: 10000 learned: 9986 parsed: 10000
[WARN] [2024-06-04 07:31:34] Names to parse: 10000 formatted: 10000 learned: 9981 parsed: 10000
[WARN] [2024-06-04 07:31:41] Names to parse: 10000 formatted: 10000 learned: 9982 parsed: 10000
[WARN] [2024-06-04 07:31:48] Names to parse: 10000 formatted: 10000 learned: 9934 parsed: 10000
[WARN] [2024-06-04 07:31:55] Names to parse: 10000 formatted: 10000 learned: 9973 parsed: 10000
[WARN] [2024-06-04 07:32:03] Names to parse: 10000 formatted: 10000 learned: 9963 parsed: 10000
[WARN] [2024-06-04 07:32:10] Names to parse: 10000 formatted: 10000 learned: 9995 parsed: 10000
[WARN] [2024-06-04 07:32:17] Names to parse: 10000 formatted: 10000 learned: 10000 parsed: 10000
[WARN] [2024-06-04 07:32:24] Names to parse: 10000 formatted: 10000 learned: 9998 parsed: 10000
[WARN] [2024-06-04 07:32:31] Names to parse: 10000 formatted: 10000 learned: 9996 parsed: 10000
[WARN] [2024-06-04 07:32:38] Names to parse: 10000 formatted: 10000 learned: 9948 parsed: 10000
[WARN] [2024-06-04 07:32:45] Names to parse: 10000 formatted: 10000 learned: 9971 parsed: 10000
[WARN] [2024-06-04 07:32:52] Names to parse: 10000 formatted: 10000 learned: 9885 parsed: 10000
[WARN] [2024-06-04 07:33:00] Names to parse: 10000 formatted: 10000 learned: 9887 parsed: 10000
[WARN] [2024-06-04 07:33:07] Names to parse: 10000 formatted: 10000 learned: 9972 parsed: 10000
[WARN] [2024-06-04 07:33:14] Names to parse: 10000 formatted: 10000 learned: 9921 parsed: 10000
[WARN] [2024-06-04 07:33:21] Names to parse: 10000 formatted: 10000 learned: 9986 parsed: 10000
[WARN] [2024-06-04 07:33:28] Names to parse: 10000 formatted: 10000 learned: 9968 parsed: 10000
[WARN] [2024-06-04 07:33:35] Names to parse: 10000 formatted: 10000 learned: 9947 parsed: 10000
[WARN] [2024-06-04 07:33:42] Names to parse: 10000 formatted: 10000 learned: 9992 parsed: 10000
[WARN] [2024-06-04 07:33:49] Names to parse: 10000 formatted: 10000 learned: 9998 parsed: 10000
[WARN] [2024-06-04 07:33:56] Names to parse: 10000 formatted: 10000 learned: 9868 parsed: 10000
[WARN] [2024-06-04 07:34:03] Names to parse: 10000 formatted: 10000 learned: 9935 parsed: 10000
[WARN] [2024-06-04 07:34:11] Names to parse: 10000 formatted: 10000 learned: 9751 parsed: 10000
[WARN] [2024-06-04 07:34:18] Names to parse: 10000 formatted: 10000 learned: 9954 parsed: 10000
[WARN] [2024-06-04 07:34:25] Names to parse: 10000 formatted: 10000 learned: 9938 parsed: 10000
[WARN] [2024-06-04 07:34:32] Names to parse: 10000 formatted: 10000 learned: 9937 parsed: 10000
[WARN] [2024-06-04 07:34:40] Names to parse: 10000 formatted: 10000 learned: 9669 parsed: 10000
[WARN] [2024-06-04 07:34:47] Names to parse: 10000 formatted: 10000 learned: 9887 parsed: 10000
[WARN] [2024-06-04 07:34:54] Names to parse: 10000 formatted: 10000 learned: 9759 parsed: 10000
[WARN] [2024-06-04 07:35:01] Names to parse: 10000 formatted: 10000 learned: 9987 parsed: 10000
[WARN] [2024-06-04 07:35:08] Names to parse: 10000 formatted: 10000 learned: 9822 parsed: 10000
[WARN] [2024-06-04 07:35:16] Names to parse: 10000 formatted: 10000 learned: 9680 parsed: 10000
[WARN] [2024-06-04 07:35:23] Names to parse: 10000 formatted: 10000 learned: 9851 parsed: 10000
[WARN] [2024-06-04 07:35:30] Names to parse: 10000 formatted: 10000 learned: 9912 parsed: 10000
[WARN] [2024-06-04 07:35:37] Names to parse: 10000 formatted: 10000 learned: 9933 parsed: 10000
[WARN] [2024-06-04 07:35:44] Names to parse: 10000 formatted: 10000 learned: 9932 parsed: 10000
[WARN] [2024-06-04 07:35:51] Names to parse: 4701 formatted: 4701 learned: 4648 parsed: 4701
[STOP] [2024-06-04 07:35:56] parse_names
[START] [2024-06-04 07:35:56] denormalize_canonical_names_to_nodes
[STOP] [2024-06-04 07:36:19] denormalize_canonical_names_to_nodes
[START] [2024-06-04 07:36:19] match_nodes
[START] [2024-06-04 07:36:20] map_all_nodes_to_pages
[STOP] [2024-06-04 09:47:33] map_all_nodes_to_pages
[INFO] [2024-06-04 09:47:33] 95770 Unmatched nodes (of 524701)! That's too many to output. Full list in /app/public/data/bolds_data_cover/unmatched_nodes.txt ; First 10: Canonical: root; Node#154997444; ResourceID: 1; Canonical: Onychophora; Node#154997445; ResourceID: 10; Canonical: Udeonychophora; Node#155056924; ResourceID: 1151875; Canonical: Euonychophora; Node#155152814; ResourceID: 286244; Canonical: Peripatus solorzanoi; Node#155404846; ResourceID: 717954; Canonical: Ooperipatellus cryptus; Node#155366820; ResourceID: 652741; Canonical: Peripatoides novaezealandiae; Node#155177184; ResourceID: 33233; Canonical: Peripatoides aurorbis; Node#155367111; ResourceID: 653129; Canonical: Peripatoides sympatrica; Node#155367113; ResourceID: 653132; Canonical: Peripatoides aurorbis; Node#155491348; ResourceID: 938987
[START] [2024-06-04 09:47:33] update_nodes
[STOP] [2024-06-04 09:47:46] update_nodes
[STOP] [2024-06-04 09:47:46] match_nodes
[START] [2024-06-04 09:47:46] reindex_search
[STOP] [2024-06-04 09:57:14] reindex_search
[START] [2024-06-04 09:57:14] normalize_units
[STOP] [2024-06-04 09:57:15] normalize_units
[START] [2024-06-04 09:57:15] calculate_statistics
[INFO] [2024-06-04 09:57:40] Duplicate page_id count: 0
[STOP] [2024-06-04 09:57:41] calculate_statistics
[START] [2024-06-04 09:57:41] complete_harvest_instance
[START] [2024-06-04 09:57:41] overall_tsv_creation
[INFO] [2024-06-04 09:57:41] Exporting 524701 nodes as TSV in batches of 10000...
[INFO] [2024-06-04 09:57:41] Processing group of 524701 in 53 batches of 10000
[INFO] [2024-06-04 09:59:50] 9646 Traits (unfiltered) and 0 associations...
[INFO] [2024-06-04 09:59:50] Building Traits map for 10000 nodes (this can take a while)...
[INFO] [2024-06-04 09:59:54] Mapped 9646 traits (0 meta) for 10000 nodes.
[INFO] [2024-06-04 09:59:54] Building Associations map (this can take a while)...
[INFO] [2024-06-04 10:00:01] Done. 0 assocs mapped (0 meta).
[INFO] [2024-06-04 10:00:01] Adding 9646 traits...
[INFO] [2024-06-04 10:00:01] 0 metadata added.
[INFO] [2024-06-04 10:00:01] Adding 0 assocs...
[INFO] [2024-06-04 10:00:01] 0 metadata added.
[INFO] [2024-06-04 10:01:22] Processed 10000/524701 nodes
[INFO] [2024-06-04 10:03:23] 9532 Traits (unfiltered) and 0 associations...
[INFO] [2024-06-04 10:03:23] Building Traits map for 10000 nodes (this can take a while)...
[INFO] [2024-06-04 10:03:27] Mapped 9532 traits (0 meta) for 10000 nodes.
[INFO] [2024-06-04 10:03:27] Building Associations map (this can take a while)...
[INFO] [2024-06-04 10:03:32] Done. 0 assocs mapped (0 meta).
[INFO] [2024-06-04 10:03:32] Adding 9532 traits...
[INFO] [2024-06-04 10:03:32] 0 metadata added.
[INFO] [2024-06-04 10:03:32] Adding 0 assocs...
[INFO] [2024-06-04 10:03:32] 0 metadata added.
[INFO] [2024-06-04 10:04:51] Processed 20000/524701 nodes
[INFO] [2024-06-04 10:06:49] 9945 Traits (unfiltered) and 0 associations...
[INFO] [2024-06-04 10:06:49] Building Traits map for 10000 nodes (this can take a while)...
[INFO] [2024-06-04 10:06:53] Mapped 9945 traits (0 meta) for 10000 nodes.
[INFO] [2024-06-04 10:06:53] Building Associations map (this can take a while)...
[INFO] [2024-06-04 10:06:58] Done. 0 assocs mapped (0 meta).
[INFO] [2024-06-04 10:06:58] Adding 9945 traits...
[INFO] [2024-06-04 10:06:58] 0 metadata added.
[INFO] [2024-06-04 10:06:58] Adding 0 assocs...
[INFO] [2024-06-04 10:06:58] 0 metadata added.
[INFO] [2024-06-04 10:08:13] Processed 30000/524701 nodes
[INFO] [2024-06-04 10:10:11] 9874 Traits (unfiltered) and 0 associations...
[INFO] [2024-06-04 10:10:11] Building Traits map for 10000 nodes (this can take a while)...
[INFO] [2024-06-04 10:10:17] Mapped 9874 traits (0 meta) for 10000 nodes.
[INFO] [2024-06-04 10:10:17] Building Associations map (this can take a while)...
[INFO] [2024-06-04 10:10:21] Done. 0 assocs mapped (0 meta).
[INFO] [2024-06-04 10:10:21] Adding 9874 traits...
[INFO] [2024-06-04 10:10:22] 0 metadata added.
[INFO] [2024-06-04 10:10:22] Adding 0 assocs...
[INFO] [2024-06-04 10:10:22] 0 metadata added.
[INFO] [2024-06-04 10:11:37] Processed 40000/524701 nodes
[INFO] [2024-06-04 10:13:38] 9824 Traits (unfiltered) and 0 associations...
[INFO] [2024-06-04 10:13:38] Building Traits map for 10000 nodes (this can take a while)...
[INFO] [2024-06-04 10:13:42] Mapped 9824 traits (0 meta) for 10000 nodes.
[INFO] [2024-06-04 10:13:42] Building Associations map (this can take a while)...
[INFO] [2024-06-04 10:13:47] Done. 0 assocs mapped (0 meta).
[INFO] [2024-06-04 10:13:47] Adding 9824 traits...
[INFO] [2024-06-04 10:13:47] 0 metadata added.
[INFO] [2024-06-04 10:13:47] Adding 0 assocs...
[INFO] [2024-06-04 10:13:47] 0 metadata added.
[INFO] [2024-06-04 10:15:01] Processed 50000/524701 nodes
[INFO] [2024-06-04 10:17:01] 9780 Traits (unfiltered) and 0 associations...
[INFO] [2024-06-04 10:17:01] Building Traits map for 10000 nodes (this can take a while)...
[INFO] [2024-06-04 10:17:06] Mapped 9780 traits (0 meta) for 10000 nodes.
[INFO] [2024-06-04 10:17:06] Building Associations map (this can take a while)...
[INFO] [2024-06-04 10:17:10] Done. 0 assocs mapped (0 meta).
[INFO] [2024-06-04 10:17:10] Adding 9780 traits...
[INFO] [2024-06-04 10:17:11] 0 metadata added.
[INFO] [2024-06-04 10:17:11] Adding 0 assocs...
[INFO] [2024-06-04 10:17:11] 0 metadata added.
[INFO] [2024-06-04 10:18:26] Processed 60000/524701 nodes
[INFO] [2024-06-04 10:20:25] 9571 Traits (unfiltered) and 0 associations...
[INFO] [2024-06-04 10:20:25] Building Traits map for 10000 nodes (this can take a while)...
[INFO] [2024-06-04 10:20:30] Mapped 9571 traits (0 meta) for 10000 nodes.
[INFO] [2024-06-04 10:20:30] Building Associations map (this can take a while)...
[INFO] [2024-06-04 10:20:35] Done. 0 assocs mapped (0 meta).
[INFO] [2024-06-04 10:20:35] Adding 9571 traits...
[INFO] [2024-06-04 10:20:35] 0 metadata added.
[INFO] [2024-06-04 10:20:35] Adding 0 assocs...
[INFO] [2024-06-04 10:20:35] 0 metadata added.
[INFO] [2024-06-04 10:21:47] Processed 70000/524701 nodes
[INFO] [2024-06-04 10:23:46] 9249 Traits (unfiltered) and 0 associations...
[INFO] [2024-06-04 10:23:46] Building Traits map for 10000 nodes (this can take a while)...
[INFO] [2024-06-04 10:23:53] Mapped 9249 traits (0 meta) for 10000 nodes.
[INFO] [2024-06-04 10:23:53] Building Associations map (this can take a while)...
[INFO] [2024-06-04 10:23:58] Done. 0 assocs mapped (0 meta).
[INFO] [2024-06-04 10:23:58] Adding 9249 traits...
[INFO] [2024-06-04 10:23:58] 0 metadata added.
[INFO] [2024-06-04 10:23:58] Adding 0 assocs...
[INFO] [2024-06-04 10:23:58] 0 metadata added.
[INFO] [2024-06-04 10:25:12] Processed 80000/524701 nodes
[INFO] [2024-06-04 10:27:11] 9804 Traits (unfiltered) and 0 associations...
[INFO] [2024-06-04 10:27:11] Building Traits map for 10000 nodes (this can take a while)...
[INFO] [2024-06-04 10:27:15] Mapped 9804 traits (0 meta) for 10000 nodes.
[INFO] [2024-06-04 10:27:15] Building Associations map (this can take a while)...
[INFO] [2024-06-04 10:27:20] Done. 0 assocs mapped (0 meta).
[INFO] [2024-06-04 10:27:20] Adding 9804 traits...
[INFO] [2024-06-04 10:27:22] 0 metadata added.
[INFO] [2024-06-04 10:27:22] Adding 0 assocs...
[INFO] [2024-06-04 10:27:22] 0 metadata added.
[INFO] [2024-06-04 10:28:35] Processed 90000/524701 nodes
[INFO] [2024-06-04 10:30:35] 9893 Traits (unfiltered) and 0 associations...
[INFO] [2024-06-04 10:30:35] Building Traits map for 10000 nodes (this can take a while)...
[INFO] [2024-06-04 10:30:39] Mapped 9893 traits (0 meta) for 10000 nodes.
[INFO] [2024-06-04 10:30:39] Building Associations map (this can take a while)...
[INFO] [2024-06-04 10:30:44] Done. 0 assocs mapped (0 meta).
[INFO] [2024-06-04 10:30:44] Adding 9893 traits...
[INFO] [2024-06-04 10:30:45] 0 metadata added.
[INFO] [2024-06-04 10:30:45] Adding 0 assocs...
[INFO] [2024-06-04 10:30:45] 0 metadata added.
[INFO] [2024-06-04 10:32:00] Processed 100000/524701 nodes
[INFO] [2024-06-04 10:33:59] 9767 Traits (unfiltered) and 0 associations...
[INFO] [2024-06-04 10:33:59] Building Traits map for 10000 nodes (this can take a while)...
[INFO] [2024-06-04 10:34:05] Mapped 9767 traits (0 meta) for 10000 nodes.
[INFO] [2024-06-04 10:34:05] Building Associations map (this can take a while)...
[INFO] [2024-06-04 10:34:09] Done. 0 assocs mapped (0 meta).
[INFO] [2024-06-04 10:34:09] Adding 9767 traits...
[INFO] [2024-06-04 10:34:09] 0 metadata added.
[INFO] [2024-06-04 10:34:09] Adding 0 assocs...
[INFO] [2024-06-04 10:34:09] 0 metadata added.
[INFO] [2024-06-04 10:35:22] Processed 110000/524701 nodes
[INFO] [2024-06-04 10:37:20] 9881 Traits (unfiltered) and 0 associations...
[INFO] [2024-06-04 10:37:20] Building Traits map for 10000 nodes (this can take a while)...
[INFO] [2024-06-04 10:37:24] Mapped 9881 traits (0 meta) for 10000 nodes.
[INFO] [2024-06-04 10:37:24] Building Associations map (this can take a while)...
[INFO] [2024-06-04 10:37:28] Done. 0 assocs mapped (0 meta).
[INFO] [2024-06-04 10:37:28] Adding 9881 traits...
[INFO] [2024-06-04 10:37:29] 0 metadata added.
[INFO] [2024-06-04 10:37:29] Adding 0 assocs...
[INFO] [2024-06-04 10:37:29] 0 metadata added.
[INFO] [2024-06-04 10:38:44] Processed 120000/524701 nodes
[INFO] [2024-06-04 10:40:43] 9779 Traits (unfiltered) and 0 associations...
[INFO] [2024-06-04 10:40:43] Building Traits map for 10000 nodes (this can take a while)...
[INFO] [2024-06-04 10:40:48] Mapped 9779 traits (0 meta) for 10000 nodes.
[INFO] [2024-06-04 10:40:48] Building Associations map (this can take a while)...
[INFO] [2024-06-04 10:40:53] Done. 0 assocs mapped (0 meta).
[INFO] [2024-06-04 10:40:53] Adding 9779 traits...
[INFO] [2024-06-04 10:40:53] 0 metadata added.
[INFO] [2024-06-04 10:40:53] Adding 0 assocs...
[INFO] [2024-06-04 10:40:53] 0 metadata added.
[INFO] [2024-06-04 10:42:08] Processed 130000/524701 nodes
[INFO] [2024-06-04 10:44:04] 9702 Traits (unfiltered) and 0 associations...
[INFO] [2024-06-04 10:44:04] Building Traits map for 10000 nodes (this can take a while)...
[INFO] [2024-06-04 10:44:08] Mapped 9702 traits (0 meta) for 10000 nodes.
[INFO] [2024-06-04 10:44:08] Building Associations map (this can take a while)...
[INFO] [2024-06-04 10:44:12] Done. 0 assocs mapped (0 meta).
[INFO] [2024-06-04 10:44:12] Adding 9702 traits...
[INFO] [2024-06-04 10:44:13] 0 metadata added.
[INFO] [2024-06-04 10:44:13] Adding 0 assocs...
[INFO] [2024-06-04 10:44:13] 0 metadata added.
[INFO] [2024-06-04 10:45:27] Processed 140000/524701 nodes
[INFO] [2024-06-04 10:47:25] 9771 Traits (unfiltered) and 0 associations...
[INFO] [2024-06-04 10:47:25] Building Traits map for 10000 nodes (this can take a while)...
[INFO] [2024-06-04 10:47:29] Mapped 9771 traits (0 meta) for 10000 nodes.
[INFO] [2024-06-04 10:47:29] Building Associations map (this can take a while)...
[INFO] [2024-06-04 10:47:33] Done. 0 assocs mapped (0 meta).
[INFO] [2024-06-04 10:47:33] Adding 9771 traits...
[INFO] [2024-06-04 10:47:35] 0 metadata added.
[INFO] [2024-06-04 10:47:35] Adding 0 assocs...
[INFO] [2024-06-04 10:47:35] 0 metadata added.
[INFO] [2024-06-04 10:48:47] Processed 150000/524701 nodes
[INFO] [2024-06-04 10:50:44] 9821 Traits (unfiltered) and 0 associations...
[INFO] [2024-06-04 10:50:44] Building Traits map for 10000 nodes (this can take a while)...
[INFO] [2024-06-04 10:50:49] Mapped 9821 traits (0 meta) for 10000 nodes.
[INFO] [2024-06-04 10:50:49] Building Associations map (this can take a while)...
[INFO] [2024-06-04 10:50:53] Done. 0 assocs mapped (0 meta).
[INFO] [2024-06-04 10:50:53] Adding 9821 traits...
[INFO] [2024-06-04 10:50:54] 0 metadata added.
[INFO] [2024-06-04 10:50:54] Adding 0 assocs...
[INFO] [2024-06-04 10:50:54] 0 metadata added.
[INFO] [2024-06-04 10:52:07] Processed 160000/524701 nodes
[INFO] [2024-06-04 10:54:04] 9864 Traits (unfiltered) and 0 associations...
[INFO] [2024-06-04 10:54:04] Building Traits map for 10000 nodes (this can take a while)...
[INFO] [2024-06-04 10:54:10] Mapped 9864 traits (0 meta) for 10000 nodes.
[INFO] [2024-06-04 10:54:10] Building Associations map (this can take a while)...
[INFO] [2024-06-04 10:54:14] Done. 0 assocs mapped (0 meta).
[INFO] [2024-06-04 10:54:14] Adding 9864 traits...
[INFO] [2024-06-04 10:54:15] 0 metadata added.
[INFO] [2024-06-04 10:54:15] Adding 0 assocs...
[INFO] [2024-06-04 10:54:15] 0 metadata added.
[INFO] [2024-06-04 10:55:26] Processed 170000/524701 nodes
[INFO] [2024-06-04 10:57:23] 9777 Traits (unfiltered) and 0 associations...
[INFO] [2024-06-04 10:57:23] Building Traits map for 10000 nodes (this can take a while)...
[INFO] [2024-06-04 10:57:30] Mapped 9777 traits (0 meta) for 10000 nodes.
[INFO] [2024-06-04 10:57:30] Building Associations map (this can take a while)...
[INFO] [2024-06-04 10:57:34] Done. 0 assocs mapped (0 meta).
[INFO] [2024-06-04 10:57:34] Adding 9777 traits...
[INFO] [2024-06-04 10:57:35] 0 metadata added.
[INFO] [2024-06-04 10:57:35] Adding 0 assocs...
[INFO] [2024-06-04 10:57:35] 0 metadata added.
[INFO] [2024-06-04 10:58:47] Processed 180000/524701 nodes
[INFO] [2024-06-04 11:00:43] 9769 Traits (unfiltered) and 0 associations...
[INFO] [2024-06-04 11:00:43] Building Traits map for 10000 nodes (this can take a while)...
[INFO] [2024-06-04 11:00:47] Mapped 9769 traits (0 meta) for 10000 nodes.
[INFO] [2024-06-04 11:00:47] Building Associations map (this can take a while)...
[INFO] [2024-06-04 11:00:51] Done. 0 assocs mapped (0 meta).
[INFO] [2024-06-04 11:00:51] Adding 9769 traits...
[INFO] [2024-06-04 11:00:52] 0 metadata added.
[INFO] [2024-06-04 11:00:52] Adding 0 assocs...
[INFO] [2024-06-04 11:00:52] 0 metadata added.
[INFO] [2024-06-04 11:02:05] Processed 190000/524701 nodes
[INFO] [2024-06-04 11:04:02] 9860 Traits (unfiltered) and 0 associations...
[INFO] [2024-06-04 11:04:02] Building Traits map for 10000 nodes (this can take a while)...
[INFO] [2024-06-04 11:04:06] Mapped 9860 traits (0 meta) for 10000 nodes.
[INFO] [2024-06-04 11:04:06] Building Associations map (this can take a while)...
[INFO] [2024-06-04 11:04:11] Done. 0 assocs mapped (0 meta).
[INFO] [2024-06-04 11:04:11] Adding 9860 traits...
[INFO] [2024-06-04 11:04:12] 0 metadata added.
[INFO] [2024-06-04 11:04:12] Adding 0 assocs...
[INFO] [2024-06-04 11:04:12] 0 metadata added.
[INFO] [2024-06-04 11:05:25] Processed 200000/524701 nodes
[INFO] [2024-06-04 11:07:22] 9802 Traits (unfiltered) and 0 associations...
[INFO] [2024-06-04 11:07:22] Building Traits map for 10000 nodes (this can take a while)...
[INFO] [2024-06-04 11:07:27] Mapped 9802 traits (0 meta) for 10000 nodes.
[INFO] [2024-06-04 11:07:27] Building Associations map (this can take a while)...
[INFO] [2024-06-04 11:07:32] Done. 0 assocs mapped (0 meta).
[INFO] [2024-06-04 11:07:32] Adding 9802 traits...
[INFO] [2024-06-04 11:07:32] 0 metadata added.
[INFO] [2024-06-04 11:07:32] Adding 0 assocs...
[INFO] [2024-06-04 11:07:32] 0 metadata added.
[INFO] [2024-06-04 11:08:44] Processed 210000/524701 nodes
[INFO] [2024-06-04 11:10:40] 9847 Traits (unfiltered) and 0 associations...
[INFO] [2024-06-04 11:10:40] Building Traits map for 10000 nodes (this can take a while)...
[INFO] [2024-06-04 11:10:45] Mapped 9847 traits (0 meta) for 10000 nodes.
[INFO] [2024-06-04 11:10:45] Building Associations map (this can take a while)...
[INFO] [2024-06-04 11:10:49] Done. 0 assocs mapped (0 meta).
[INFO] [2024-06-04 11:10:49] Adding 9847 traits...
[INFO] [2024-06-04 11:10:50] 0 metadata added.
[INFO] [2024-06-04 11:10:50] Adding 0 assocs...
[INFO] [2024-06-04 11:10:50] 0 metadata added.
[INFO] [2024-06-04 11:12:03] Processed 220000/524701 nodes
[INFO] [2024-06-04 11:13:59] 9957 Traits (unfiltered) and 0 associations...
[INFO] [2024-06-04 11:13:59] Building Traits map for 10000 nodes (this can take a while)...
[INFO] [2024-06-04 11:14:03] Mapped 9957 traits (0 meta) for 10000 nodes.
[INFO] [2024-06-04 11:14:03] Building Associations map (this can take a while)...
[INFO] [2024-06-04 11:14:07] Done. 0 assocs mapped (0 meta).
[INFO] [2024-06-04 11:14:07] Adding 9957 traits...
[INFO] [2024-06-04 11:14:08] 0 metadata added.
[INFO] [2024-06-04 11:14:08] Adding 0 assocs...
[INFO] [2024-06-04 11:14:08] 0 metadata added.
[INFO] [2024-06-04 11:15:21] Processed 230000/524701 nodes
[INFO] [2024-06-04 11:17:17] 9939 Traits (unfiltered) and 0 associations...
[INFO] [2024-06-04 11:17:17] Building Traits map for 10000 nodes (this can take a while)...
[INFO] [2024-06-04 11:17:23] Mapped 9939 traits (0 meta) for 10000 nodes.
[INFO] [2024-06-04 11:17:23] Building Associations map (this can take a while)...
[INFO] [2024-06-04 11:17:27] Done. 0 assocs mapped (0 meta).
[INFO] [2024-06-04 11:17:27] Adding 9939 traits...
[INFO] [2024-06-04 11:17:28] 0 metadata added.
[INFO] [2024-06-04 11:17:28] Adding 0 assocs...
[INFO] [2024-06-04 11:17:28] 0 metadata added.
[INFO] [2024-06-04 11:18:39] Processed 240000/524701 nodes
[INFO] [2024-06-04 11:20:34] 9929 Traits (unfiltered) and 0 associations...
[INFO] [2024-06-04 11:20:34] Building Traits map for 10000 nodes (this can take a while)...
[INFO] [2024-06-04 11:20:40] Mapped 9929 traits (0 meta) for 10000 nodes.
[INFO] [2024-06-04 11:20:40] Building Associations map (this can take a while)...
[INFO] [2024-06-04 11:20:44] Done. 0 assocs mapped (0 meta).
[INFO] [2024-06-04 11:20:44] Adding 9929 traits...
[INFO] [2024-06-04 11:20:45] 0 metadata added.
[INFO] [2024-06-04 11:20:45] Adding 0 assocs...
[INFO] [2024-06-04 11:20:45] 0 metadata added.
[INFO] [2024-06-04 11:21:56] Processed 250000/524701 nodes
[INFO] [2024-06-04 11:23:55] 9826 Traits (unfiltered) and 0 associations...
[INFO] [2024-06-04 11:23:55] Building Traits map for 10000 nodes (this can take a while)...
[INFO] [2024-06-04 11:24:01] Mapped 9826 traits (0 meta) for 10000 nodes.
[INFO] [2024-06-04 11:24:01] Building Associations map (this can take a while)...
[INFO] [2024-06-04 11:24:05] Done. 0 assocs mapped (0 meta).
[INFO] [2024-06-04 11:24:05] Adding 9826 traits...
[INFO] [2024-06-04 11:24:05] 0 metadata added.
[INFO] [2024-06-04 11:24:05] Adding 0 assocs...
[INFO] [2024-06-04 11:24:05] 0 metadata added.
[INFO] [2024-06-04 11:25:17] Processed 260000/524701 nodes
[INFO] [2024-06-04 11:27:14] 9811 Traits (unfiltered) and 0 associations...
[INFO] [2024-06-04 11:27:14] Building Traits map for 10000 nodes (this can take a while)...
[INFO] [2024-06-04 11:27:19] Mapped 9811 traits (0 meta) for 10000 nodes.
[INFO] [2024-06-04 11:27:19] Building Associations map (this can take a while)...
[INFO] [2024-06-04 11:27:23] Done. 0 assocs mapped (0 meta).
[INFO] [2024-06-04 11:27:23] Adding 9811 traits...
[INFO] [2024-06-04 11:27:25] 0 metadata added.
[INFO] [2024-06-04 11:27:25] Adding 0 assocs...
[INFO] [2024-06-04 11:27:25] 0 metadata added.
[INFO] [2024-06-04 11:28:35] Processed 270000/524701 nodes
[INFO] [2024-06-04 11:30:32] 9882 Traits (unfiltered) and 0 associations...
[INFO] [2024-06-04 11:30:32] Building Traits map for 10000 nodes (this can take a while)...
[INFO] [2024-06-04 11:30:36] Mapped 9882 traits (0 meta) for 10000 nodes.
[INFO] [2024-06-04 11:30:36] Building Associations map (this can take a while)...
[INFO] [2024-06-04 11:30:41] Done. 0 assocs mapped (0 meta).
[INFO] [2024-06-04 11:30:41] Adding 9882 traits...
[INFO] [2024-06-04 11:30:42] 0 metadata added.
[INFO] [2024-06-04 11:30:42] Adding 0 assocs...
[INFO] [2024-06-04 11:30:42] 0 metadata added.
[INFO] [2024-06-04 11:31:55] Processed 280000/524701 nodes
[INFO] [2024-06-04 11:33:53] 9864 Traits (unfiltered) and 0 associations...
[INFO] [2024-06-04 11:33:53] Building Traits map for 10000 nodes (this can take a while)...
[INFO] [2024-06-04 11:33:57] Mapped 9864 traits (0 meta) for 10000 nodes.
[INFO] [2024-06-04 11:33:57] Building Associations map (this can take a while)...
[INFO] [2024-06-04 11:34:01] Done. 0 assocs mapped (0 meta).
[INFO] [2024-06-04 11:34:02] Adding 9864 traits...
[INFO] [2024-06-04 11:34:03] 0 metadata added.
[INFO] [2024-06-04 11:34:03] Adding 0 assocs...
[INFO] [2024-06-04 11:34:03] 0 metadata added.
[INFO] [2024-06-04 11:35:14] Processed 290000/524701 nodes
[INFO] [2024-06-04 11:37:10] 9728 Traits (unfiltered) and 0 associations...
[INFO] [2024-06-04 11:37:10] Building Traits map for 10000 nodes (this can take a while)...
[INFO] [2024-06-04 11:37:14] Mapped 9728 traits (0 meta) for 10000 nodes.
[INFO] [2024-06-04 11:37:14] Building Associations map (this can take a while)...
[INFO] [2024-06-04 11:37:18] Done. 0 assocs mapped (0 meta).
[INFO] [2024-06-04 11:37:18] Adding 9728 traits...
[INFO] [2024-06-04 11:37:19] 0 metadata added.
[INFO] [2024-06-04 11:37:19] Adding 0 assocs...
[INFO] [2024-06-04 11:37:19] 0 metadata added.
[INFO] [2024-06-04 11:38:31] Processed 300000/524701 nodes
[INFO] [2024-06-04 11:40:26] 9966 Traits (unfiltered) and 0 associations...
[INFO] [2024-06-04 11:40:26] Building Traits map for 10000 nodes (this can take a while)...
[INFO] [2024-06-04 11:40:30] Mapped 9966 traits (0 meta) for 10000 nodes.
[INFO] [2024-06-04 11:40:30] Building Associations map (this can take a while)...
[INFO] [2024-06-04 11:40:34] Done. 0 assocs mapped (0 meta).
[INFO] [2024-06-04 11:40:34] Adding 9966 traits...
[INFO] [2024-06-04 11:40:36] 0 metadata added.
[INFO] [2024-06-04 11:40:36] Adding 0 assocs...
[INFO] [2024-06-04 11:40:36] 0 metadata added.
[INFO] [2024-06-04 11:41:46] Processed 310000/524701 nodes
[INFO] [2024-06-04 11:43:42] 9962 Traits (unfiltered) and 0 associations...
[INFO] [2024-06-04 11:43:42] Building Traits map for 10000 nodes (this can take a while)...
[INFO] [2024-06-04 11:43:46] Mapped 9962 traits (0 meta) for 10000 nodes.
[INFO] [2024-06-04 11:43:46] Building Associations map (this can take a while)...
[INFO] [2024-06-04 11:43:50] Done. 0 assocs mapped (0 meta).
[INFO] [2024-06-04 11:43:50] Adding 9962 traits...
[INFO] [2024-06-04 11:43:52] 0 metadata added.
[INFO] [2024-06-04 11:43:52] Adding 0 assocs...
[INFO] [2024-06-04 11:43:52] 0 metadata added.
[INFO] [2024-06-04 11:45:03] Processed 320000/524701 nodes
[INFO] [2024-06-04 11:46:59] 9943 Traits (unfiltered) and 0 associations...
[INFO] [2024-06-04 11:46:59] Building Traits map for 10000 nodes (this can take a while)...
[INFO] [2024-06-04 11:47:03] Mapped 9943 traits (0 meta) for 10000 nodes.
[INFO] [2024-06-04 11:47:03] Building Associations map (this can take a while)...
[INFO] [2024-06-04 11:47:07] Done. 0 assocs mapped (0 meta).
[INFO] [2024-06-04 11:47:07] Adding 9943 traits...
[INFO] [2024-06-04 11:47:08] 0 metadata added.
[INFO] [2024-06-04 11:47:08] Adding 0 assocs...
[INFO] [2024-06-04 11:47:08] 0 metadata added.
[INFO] [2024-06-04 11:48:20] Processed 330000/524701 nodes
[INFO] [2024-06-04 11:50:15] 9883 Traits (unfiltered) and 0 associations...
[INFO] [2024-06-04 11:50:15] Building Traits map for 10000 nodes (this can take a while)...
[INFO] [2024-06-04 11:50:21] Mapped 9883 traits (0 meta) for 10000 nodes.
[INFO] [2024-06-04 11:50:21] Building Associations map (this can take a while)...
[INFO] [2024-06-04 11:50:25] Done. 0 assocs mapped (0 meta).
[INFO] [2024-06-04 11:50:25] Adding 9883 traits...
[INFO] [2024-06-04 11:50:25] 0 metadata added.
[INFO] [2024-06-04 11:50:25] Adding 0 assocs...
[INFO] [2024-06-04 11:50:25] 0 metadata added.
[INFO] [2024-06-04 11:51:35] Processed 340000/524701 nodes
[INFO] [2024-06-04 11:53:30] 9976 Traits (unfiltered) and 0 associations...
[INFO] [2024-06-04 11:53:30] Building Traits map for 10000 nodes (this can take a while)...
[INFO] [2024-06-04 11:53:37] Mapped 9976 traits (0 meta) for 10000 nodes.
[INFO] [2024-06-04 11:53:37] Building Associations map (this can take a while)...
[INFO] [2024-06-04 11:53:41] Done. 0 assocs mapped (0 meta).
[INFO] [2024-06-04 11:53:41] Adding 9976 traits...
[INFO] [2024-06-04 11:53:41] 0 metadata added.
[INFO] [2024-06-04 11:53:41] Adding 0 assocs...
[INFO] [2024-06-04 11:53:41] 0 metadata added.
[INFO] [2024-06-04 11:54:51] Processed 350000/524701 nodes
[INFO] [2024-06-04 11:56:45] 9971 Traits (unfiltered) and 0 associations...
[INFO] [2024-06-04 11:56:45] Building Traits map for 10000 nodes (this can take a while)...
[INFO] [2024-06-04 11:56:50] Mapped 9971 traits (0 meta) for 10000 nodes.
[INFO] [2024-06-04 11:56:50] Building Associations map (this can take a while)...
[INFO] [2024-06-04 11:56:54] Done. 0 assocs mapped (0 meta).
[INFO] [2024-06-04 11:56:54] Adding 9971 traits...
[INFO] [2024-06-04 11:56:55] 0 metadata added.
[INFO] [2024-06-04 11:56:55] Adding 0 assocs...
[INFO] [2024-06-04 11:56:55] 0 metadata added.
[INFO] [2024-06-04 11:58:06] Processed 360000/524701 nodes
[INFO] [2024-06-04 12:00:01] 9853 Traits (unfiltered) and 0 associations...
[INFO] [2024-06-04 12:00:01] Building Traits map for 10000 nodes (this can take a while)...
[INFO] [2024-06-04 12:00:06] Mapped 9853 traits (0 meta) for 10000 nodes.
[INFO] [2024-06-04 12:00:06] Building Associations map (this can take a while)...
[INFO] [2024-06-04 12:00:10] Done. 0 assocs mapped (0 meta).
[INFO] [2024-06-04 12:00:10] Adding 9853 traits...
[INFO] [2024-06-04 12:00:12] 0 metadata added.
[INFO] [2024-06-04 12:00:12] Adding 0 assocs...
[INFO] [2024-06-04 12:00:12] 0 metadata added.
[INFO] [2024-06-04 12:01:22] Processed 370000/524701 nodes
[INFO] [2024-06-04 12:03:18] 9950 Traits (unfiltered) and 0 associations...
[INFO] [2024-06-04 12:03:18] Building Traits map for 10000 nodes (this can take a while)...
[INFO] [2024-06-04 12:03:24] Mapped 9950 traits (0 meta) for 10000 nodes.
[INFO] [2024-06-04 12:03:24] Building Associations map (this can take a while)...
[INFO] [2024-06-04 12:03:28] Done. 0 assocs mapped (0 meta).
[INFO] [2024-06-04 12:03:28] Adding 9950 traits...
[INFO] [2024-06-04 12:03:29] 0 metadata added.
[INFO] [2024-06-04 12:03:29] Adding 0 assocs...
[INFO] [2024-06-04 12:03:29] 0 metadata added.
[INFO] [2024-06-04 12:04:38] Processed 380000/524701 nodes
[INFO] [2024-06-04 12:06:34] 9964 Traits (unfiltered) and 0 associations...
[INFO] [2024-06-04 12:06:34] Building Traits map for 10000 nodes (this can take a while)...
[INFO] [2024-06-04 12:06:40] Mapped 9964 traits (0 meta) for 10000 nodes.
[INFO] [2024-06-04 12:06:40] Building Associations map (this can take a while)...
[INFO] [2024-06-04 12:06:44] Done. 0 assocs mapped (0 meta).
[INFO] [2024-06-04 12:06:44] Adding 9964 traits...
[INFO] [2024-06-04 12:06:44] 0 metadata added.
[INFO] [2024-06-04 12:06:44] Adding 0 assocs...
[INFO] [2024-06-04 12:06:44] 0 metadata added.
[INFO] [2024-06-04 12:07:53] Processed 390000/524701 nodes
[INFO] [2024-06-04 12:09:51] 9890 Traits (unfiltered) and 0 associations...
[INFO] [2024-06-04 12:09:51] Building Traits map for 10000 nodes (this can take a while)...
[INFO] [2024-06-04 12:09:57] Mapped 9890 traits (0 meta) for 10000 nodes.
[INFO] [2024-06-04 12:09:57] Building Associations map (this can take a while)...
[INFO] [2024-06-04 12:10:01] Done. 0 assocs mapped (0 meta).
[INFO] [2024-06-04 12:10:01] Adding 9890 traits...
[INFO] [2024-06-04 12:10:01] 0 metadata added.
[INFO] [2024-06-04 12:10:01] Adding 0 assocs...
[INFO] [2024-06-04 12:10:01] 0 metadata added.
[INFO] [2024-06-04 12:11:10] Processed 400000/524701 nodes
[INFO] [2024-06-04 12:13:07] 9888 Traits (unfiltered) and 0 associations...
[INFO] [2024-06-04 12:13:07] Building Traits map for 10000 nodes (this can take a while)...
[INFO] [2024-06-04 12:13:13] Mapped 9888 traits (0 meta) for 10000 nodes.
[INFO] [2024-06-04 12:13:13] Building Associations map (this can take a while)...
[INFO] [2024-06-04 12:13:17] Done. 0 assocs mapped (0 meta).
[INFO] [2024-06-04 12:13:17] Adding 9888 traits...
[INFO] [2024-06-04 12:13:18] 0 metadata added.
[INFO] [2024-06-04 12:13:18] Adding 0 assocs...
[INFO] [2024-06-04 12:13:18] 0 metadata added.
[INFO] [2024-06-04 12:14:27] Processed 410000/524701 nodes
[INFO] [2024-06-04 12:16:25] 9676 Traits (unfiltered) and 0 associations...
[INFO] [2024-06-04 12:16:25] Building Traits map for 10000 nodes (this can take a while)...
[INFO] [2024-06-04 12:16:29] Mapped 9676 traits (0 meta) for 10000 nodes.
[INFO] [2024-06-04 12:16:29] Building Associations map (this can take a while)...
[INFO] [2024-06-04 12:16:33] Done. 0 assocs mapped (0 meta).
[INFO] [2024-06-04 12:16:33] Adding 9676 traits...
[INFO] [2024-06-04 12:16:34] 0 metadata added.
[INFO] [2024-06-04 12:16:34] Adding 0 assocs...
[INFO] [2024-06-04 12:16:34] 0 metadata added.
[INFO] [2024-06-04 12:17:43] Processed 420000/524701 nodes
[INFO] [2024-06-04 12:19:40] 8774 Traits (unfiltered) and 0 associations...
[INFO] [2024-06-04 12:19:40] Building Traits map for 10000 nodes (this can take a while)...
[INFO] [2024-06-04 12:19:44] Mapped 8774 traits (0 meta) for 10000 nodes.
[INFO] [2024-06-04 12:19:44] Building Associations map (this can take a while)...
[INFO] [2024-06-04 12:19:48] Done. 0 assocs mapped (0 meta).
[INFO] [2024-06-04 12:19:48] Adding 8774 traits...
[INFO] [2024-06-04 12:19:48] 0 metadata added.
[INFO] [2024-06-04 12:19:48] Adding 0 assocs...
[INFO] [2024-06-04 12:19:48] 0 metadata added.
[INFO] [2024-06-04 12:20:58] Processed 430000/524701 nodes
[INFO] [2024-06-04 12:22:54] 9718 Traits (unfiltered) and 0 associations...
[INFO] [2024-06-04 12:22:54] Building Traits map for 10000 nodes (this can take a while)...
[INFO] [2024-06-04 12:22:59] Mapped 9718 traits (0 meta) for 10000 nodes.
[INFO] [2024-06-04 12:22:59] Building Associations map (this can take a while)...
[INFO] [2024-06-04 12:23:02] Done. 0 assocs mapped (0 meta).
[INFO] [2024-06-04 12:23:02] Adding 9718 traits...
[INFO] [2024-06-04 12:23:03] 0 metadata added.
[INFO] [2024-06-04 12:23:03] Adding 0 assocs...
[INFO] [2024-06-04 12:23:03] 0 metadata added.
[INFO] [2024-06-04 12:24:12] Processed 440000/524701 nodes
[INFO] [2024-06-04 12:26:09] 9799 Traits (unfiltered) and 0 associations...
[INFO] [2024-06-04 12:26:09] Building Traits map for 10000 nodes (this can take a while)...
[INFO] [2024-06-04 12:26:12] Mapped 9799 traits (0 meta) for 10000 nodes.
[INFO] [2024-06-04 12:26:12] Building Associations map (this can take a while)...
[INFO] [2024-06-04 12:26:18] Done. 0 assocs mapped (0 meta).
[INFO] [2024-06-04 12:26:18] Adding 9799 traits...
[INFO] [2024-06-04 12:26:19] 0 metadata added.
[INFO] [2024-06-04 12:26:19] Adding 0 assocs...
[INFO] [2024-06-04 12:26:19] 0 metadata added.
[INFO] [2024-06-04 12:27:29] Processed 450000/524701 nodes
[INFO] [2024-06-04 12:29:23] 9859 Traits (unfiltered) and 0 associations...
[INFO] [2024-06-04 12:29:23] Building Traits map for 10000 nodes (this can take a while)...
[INFO] [2024-06-04 12:29:27] Mapped 9859 traits (0 meta) for 10000 nodes.
[INFO] [2024-06-04 12:29:27] Building Associations map (this can take a while)...
[INFO] [2024-06-04 12:29:31] Done. 0 assocs mapped (0 meta).
[INFO] [2024-06-04 12:29:31] Adding 9859 traits...
[INFO] [2024-06-04 12:29:31] 0 metadata added.
[INFO] [2024-06-04 12:29:31] Adding 0 assocs...
[INFO] [2024-06-04 12:29:31] 0 metadata added.
[INFO] [2024-06-04 12:30:42] Processed 460000/524701 nodes
[INFO] [2024-06-04 12:32:37] 9562 Traits (unfiltered) and 0 associations...
[INFO] [2024-06-04 12:32:37] Building Traits map for 10000 nodes (this can take a while)...
[INFO] [2024-06-04 12:32:43] Mapped 9562 traits (0 meta) for 10000 nodes.
[INFO] [2024-06-04 12:32:43] Building Associations map (this can take a while)...
[INFO] [2024-06-04 12:32:47] Done. 0 assocs mapped (0 meta).
[INFO] [2024-06-04 12:32:47] Adding 9562 traits...
[INFO] [2024-06-04 12:32:47] 0 metadata added.
[INFO] [2024-06-04 12:32:47] Adding 0 assocs...
[INFO] [2024-06-04 12:32:47] 0 metadata added.
[INFO] [2024-06-04 12:33:56] Processed 470000/524701 nodes
[INFO] [2024-06-04 12:35:50] 9828 Traits (unfiltered) and 0 associations...
[INFO] [2024-06-04 12:35:50] Building Traits map for 10000 nodes (this can take a while)...
[INFO] [2024-06-04 12:35:54] Mapped 9828 traits (0 meta) for 10000 nodes.
[INFO] [2024-06-04 12:35:54] Building Associations map (this can take a while)...
[INFO] [2024-06-04 12:35:58] Done. 0 assocs mapped (0 meta).
[INFO] [2024-06-04 12:35:58] Adding 9828 traits...
[INFO] [2024-06-04 12:35:59] 0 metadata added.
[INFO] [2024-06-04 12:35:59] Adding 0 assocs...
[INFO] [2024-06-04 12:35:59] 0 metadata added.
[INFO] [2024-06-04 12:37:08] Processed 480000/524701 nodes
[INFO] [2024-06-04 12:39:02] 9795 Traits (unfiltered) and 0 associations...
[INFO] [2024-06-04 12:39:02] Building Traits map for 10000 nodes (this can take a while)...
[INFO] [2024-06-04 12:39:06] Mapped 9795 traits (0 meta) for 10000 nodes.
[INFO] [2024-06-04 12:39:06] Building Associations map (this can take a while)...
[INFO] [2024-06-04 12:39:10] Done. 0 assocs mapped (0 meta).
[INFO] [2024-06-04 12:39:10] Adding 9795 traits...
[INFO] [2024-06-04 12:39:11] 0 metadata added.
[INFO] [2024-06-04 12:39:11] Adding 0 assocs...
[INFO] [2024-06-04 12:39:11] 0 metadata added.
[INFO] [2024-06-04 12:40:20] Processed 490000/524701 nodes
[INFO] [2024-06-04 12:42:13] 9627 Traits (unfiltered) and 0 associations...
[INFO] [2024-06-04 12:42:13] Building Traits map for 10000 nodes (this can take a while)...
[INFO] [2024-06-04 12:42:19] Mapped 9627 traits (0 meta) for 10000 nodes.
[INFO] [2024-06-04 12:42:19] Building Associations map (this can take a while)...
[INFO] [2024-06-04 12:42:23] Done. 0 assocs mapped (0 meta).
[INFO] [2024-06-04 12:42:23] Adding 9627 traits...
[INFO] [2024-06-04 12:42:23] 0 metadata added.
[INFO] [2024-06-04 12:42:23] Adding 0 assocs...
[INFO] [2024-06-04 12:42:23] 0 metadata added.
[INFO] [2024-06-04 12:43:29] Processed 500000/524701 nodes
[INFO] [2024-06-04 12:45:21] 9768 Traits (unfiltered) and 0 associations...
[INFO] [2024-06-04 12:45:21] Building Traits map for 10000 nodes (this can take a while)...
[INFO] [2024-06-04 12:45:29] Mapped 9768 traits (0 meta) for 10000 nodes.
[INFO] [2024-06-04 12:45:29] Building Associations map (this can take a while)...
[INFO] [2024-06-04 12:45:32] Done. 0 assocs mapped (0 meta).
[INFO] [2024-06-04 12:45:32] Adding 9768 traits...
[INFO] [2024-06-04 12:45:33] 0 metadata added.
[INFO] [2024-06-04 12:45:33] Adding 0 assocs...
[INFO] [2024-06-04 12:45:33] 0 metadata added.
[INFO] [2024-06-04 12:46:39] Processed 510000/524701 nodes
[INFO] [2024-06-04 12:48:31] 9348 Traits (unfiltered) and 0 associations...
[INFO] [2024-06-04 12:48:31] Building Traits map for 10000 nodes (this can take a while)...
[INFO] [2024-06-04 12:48:37] Mapped 9348 traits (0 meta) for 10000 nodes.
[INFO] [2024-06-04 12:48:37] Building Associations map (this can take a while)...
[INFO] [2024-06-04 12:48:40] Done. 0 assocs mapped (0 meta).
[INFO] [2024-06-04 12:48:40] Adding 9348 traits...
[INFO] [2024-06-04 12:48:41] 0 metadata added.
[INFO] [2024-06-04 12:48:41] Adding 0 assocs...
[INFO] [2024-06-04 12:48:41] 0 metadata added.
[INFO] [2024-06-04 12:49:48] Processed 520000/524701 nodes
[INFO] [2024-06-04 12:50:02] 4417 Traits (unfiltered) and 0 associations...
[INFO] [2024-06-04 12:50:02] Building Traits map for 4701 nodes (this can take a while)...
[INFO] [2024-06-04 12:50:04] Mapped 4417 traits (0 meta) for 4701 nodes.
[INFO] [2024-06-04 12:50:04] Building Associations map (this can take a while)...
[INFO] [2024-06-04 12:50:07] Done. 0 assocs mapped (0 meta).
[INFO] [2024-06-04 12:50:07] Adding 4417 traits...
[INFO] [2024-06-04 12:50:08] 0 metadata added.
[INFO] [2024-06-04 12:50:08] Adding 0 assocs...
[INFO] [2024-06-04 12:50:08] 0 metadata added.
[INFO] [2024-06-04 12:51:10] Processed 524701/524701 nodes
[INFO] [2024-06-04 12:51:10] Average Time: 98.773
[INFO] [2024-06-04 12:51:10] Total Time: 2h53m30s
[INFO] [2024-06-04 12:51:10] last 3 / first 3: 0.86
[INFO] [2024-06-04 12:51:10] Std.Dev: 3.691; Max: 106.27
[STOP] [2024-06-04 12:51:10] overall_tsv_creation
[INFO] [2024-06-04 12:51:10] Done. Check your files:
[INFO] [2024-06-04 12:51:10] (524701 lines) /app/public/data/bolds_data_cover/publish_nodes.tsv
[INFO] [2024-06-04 12:51:11] (3449094 lines) /app/public/data/bolds_data_cover/publish_node_ancestors.tsv
[INFO] [2024-06-04 12:51:11] (524701 lines) /app/public/data/bolds_data_cover/publish_scientific_names.tsv
[INFO] [2024-06-04 12:51:11] (513112 lines) /app/public/data/bolds_data_cover/publish_traits.tsv
[INFO] [2024-06-04 12:51:11] (1 lines) /app/public/data/bolds_data_cover/publish_metadata.tsv
[STOP] [2024-06-04 12:51:12] complete_harvest_instance
[START] [2024-06-04 12:51:12] completed
[STOP] [2024-06-04 12:51:12] completed
[STOP] [2024-06-04 12:51:12] logged process, took 22099.15
Latest Process

04 Jun 06:42 EXITED currently processing 0