Harvest for iNaturalist data coverage Created 20 May 12:56

Stage: completed
Fetched: 20 May 12:56
Validated: 20 May 12:57
Deltas Created 20 May 12:57
Units Normalized: 20 May 17:30
Ancestry Built: 20 May 13:53
Nodes Matched: 20 May 17:17
Names Parsed: 20 May 13:59
New Models Stored: 20 May 13:21
Indexed: 20 May 17:28
Completed: 20 May 20:10
Time to Harvest: 7 minutes
Harvesting Log

(931 lines)
[INFO] [2024-05-20 12:56:26] Created harvest instance #4537
[STOP] [2024-05-20 12:56:26] create_harvest_instance
[START] [2024-05-20 12:56:26] fetch_files
[STOP] [2024-05-20 12:56:26] fetch_files
[START] [2024-05-20 12:56:26] validate_each_file
[INFO] [2024-05-20 12:56:26] Looping over 3 formats...
[INFO] [2024-05-20 12:56:26] ...nodes (/app/public/data/i_nat_dat_covera/taxon.tab)
[INFO] [2024-05-20 12:56:36] Valid: /app/public/data/i_nat_dat_covera/converted_csv/i_nat_dat_covera_nodes_31116.csv (485171 lines)
[INFO] [2024-05-20 12:56:36] ...occurrences (/app/public/data/i_nat_dat_covera/occurrence_specific.tab)
[INFO] [2024-05-20 12:56:45] Valid: /app/public/data/i_nat_dat_covera/converted_csv/i_nat_dat_covera_occurrences_31117.csv (811041 lines)
[INFO] [2024-05-20 12:56:45] ...measurements (/app/public/data/i_nat_dat_covera/measurement_or_fact_specific.tab)
[INFO] [2024-05-20 12:57:08] Valid: /app/public/data/i_nat_dat_covera/converted_csv/i_nat_dat_covera_measurements_31118.csv (811041 lines)
[STOP] [2024-05-20 12:57:08] validate_each_file
[START] [2024-05-20 12:57:08] convert_to_csv
[INFO] [2024-05-20 12:57:08] Looping over 3 formats...
[INFO] [2024-05-20 12:57:08] ...nodes (/app/public/data/i_nat_dat_covera/taxon.tab)
[CMD] [2024-05-20 12:57:08] /usr/bin/sort /app/public/data/i_nat_dat_covera/converted_csv/i_nat_dat_covera_nodes_31116.csv > /app/public/data/i_nat_dat_covera/converted_csv/i_nat_dat_covera_nodes_31116.csv_sorted
[INFO] [2024-05-20 12:57:09] Converted: /app/public/data/i_nat_dat_covera/converted_csv/i_nat_dat_covera_nodes_31116.csv (485171 lines)
[INFO] [2024-05-20 12:57:09] ...occurrences (/app/public/data/i_nat_dat_covera/occurrence_specific.tab)
[CMD] [2024-05-20 12:57:09] /usr/bin/sort /app/public/data/i_nat_dat_covera/converted_csv/i_nat_dat_covera_occurrences_31117.csv > /app/public/data/i_nat_dat_covera/converted_csv/i_nat_dat_covera_occurrences_31117.csv_sorted
[INFO] [2024-05-20 12:57:10] Converted: /app/public/data/i_nat_dat_covera/converted_csv/i_nat_dat_covera_occurrences_31117.csv (811041 lines)
[INFO] [2024-05-20 12:57:10] ...measurements (/app/public/data/i_nat_dat_covera/measurement_or_fact_specific.tab)
[CMD] [2024-05-20 12:57:10] /usr/bin/sort /app/public/data/i_nat_dat_covera/converted_csv/i_nat_dat_covera_measurements_31118.csv > /app/public/data/i_nat_dat_covera/converted_csv/i_nat_dat_covera_measurements_31118.csv_sorted
[INFO] [2024-05-20 12:57:13] Converted: /app/public/data/i_nat_dat_covera/converted_csv/i_nat_dat_covera_measurements_31118.csv (811041 lines)
[STOP] [2024-05-20 12:57:13] convert_to_csv
[START] [2024-05-20 12:57:13] calculate_delta
[INFO] [2024-05-20 12:57:13] Looping over 3 formats...
[INFO] [2024-05-20 12:57:13] ...nodes (/app/public/data/i_nat_dat_covera/taxon.tab)
[CMD] [2024-05-20 12:57:13] echo "0a" > /app/public/data/i_nat_dat_covera/diff/i_nat_dat_covera_nodes_31116.diff
[CMD] [2024-05-20 12:57:14] tail -n +1 /app/public/data/i_nat_dat_covera/converted_csv/i_nat_dat_covera_nodes_31116.csv >> /app/public/data/i_nat_dat_covera/diff/i_nat_dat_covera_nodes_31116.diff
[CMD] [2024-05-20 12:57:14] echo "." >> /app/public/data/i_nat_dat_covera/diff/i_nat_dat_covera_nodes_31116.diff
[INFO] [2024-05-20 12:57:15] Created diff: /app/public/data/i_nat_dat_covera/diff/i_nat_dat_covera_nodes_31116.diff (485173 lines)
[INFO] [2024-05-20 12:57:15] ...occurrences (/app/public/data/i_nat_dat_covera/occurrence_specific.tab)
[CMD] [2024-05-20 12:57:15] echo "0a" > /app/public/data/i_nat_dat_covera/diff/i_nat_dat_covera_occurrences_31117.diff
[CMD] [2024-05-20 12:57:15] tail -n +1 /app/public/data/i_nat_dat_covera/converted_csv/i_nat_dat_covera_occurrences_31117.csv >> /app/public/data/i_nat_dat_covera/diff/i_nat_dat_covera_occurrences_31117.diff
[CMD] [2024-05-20 12:57:15] echo "." >> /app/public/data/i_nat_dat_covera/diff/i_nat_dat_covera_occurrences_31117.diff
[INFO] [2024-05-20 12:57:16] Created diff: /app/public/data/i_nat_dat_covera/diff/i_nat_dat_covera_occurrences_31117.diff (811043 lines)
[INFO] [2024-05-20 12:57:16] ...measurements (/app/public/data/i_nat_dat_covera/measurement_or_fact_specific.tab)
[CMD] [2024-05-20 12:57:16] echo "0a" > /app/public/data/i_nat_dat_covera/diff/i_nat_dat_covera_measurements_31118.diff
[CMD] [2024-05-20 12:57:16] tail -n +1 /app/public/data/i_nat_dat_covera/converted_csv/i_nat_dat_covera_measurements_31118.csv >> /app/public/data/i_nat_dat_covera/diff/i_nat_dat_covera_measurements_31118.diff
[CMD] [2024-05-20 12:57:17] echo "." >> /app/public/data/i_nat_dat_covera/diff/i_nat_dat_covera_measurements_31118.diff
[INFO] [2024-05-20 12:57:18] Created diff: /app/public/data/i_nat_dat_covera/diff/i_nat_dat_covera_measurements_31118.diff (811043 lines)
[STOP] [2024-05-20 12:57:18] calculate_delta
[START] [2024-05-20 12:57:18] parse_diff_and_store
[INFO] [2024-05-20 12:57:18] Handling diff: /app/public/data/i_nat_dat_covera/diff/i_nat_dat_covera_nodes_31116.diff (485173 lines)
[INFO] [2024-05-20 12:57:18] Loading nodes diff file into memory (485173 lines)...
[INFO] [2024-05-20 12:57:21] Storing 9999 ScientificNames (19998/10000/485173)
[INFO] [2024-05-20 12:57:24] Storing 9999 Nodes (19998/10000/485173)
[INFO] [2024-05-20 12:57:29] Storing 10000 ScientificNames (39998/20000/485173)
[INFO] [2024-05-20 12:57:33] Storing 10000 Nodes (39998/20000/485173)
[INFO] [2024-05-20 12:57:38] Storing 10000 ScientificNames (59998/30000/485173)
[INFO] [2024-05-20 12:57:41] Storing 10000 Nodes (59998/30000/485173)
[INFO] [2024-05-20 12:57:47] Storing 10000 ScientificNames (79998/40000/485173)
[INFO] [2024-05-20 12:57:50] Storing 10000 Nodes (79998/40000/485173)
[INFO] [2024-05-20 12:57:56] Storing 10000 ScientificNames (99998/50000/485173)
[INFO] [2024-05-20 12:57:59] Storing 10000 Nodes (99998/50000/485173)
[INFO] [2024-05-20 12:58:05] Storing 10000 ScientificNames (119998/60000/485173)
[INFO] [2024-05-20 12:58:08] Storing 10000 Nodes (119998/60000/485173)
[INFO] [2024-05-20 12:58:14] Storing 10000 ScientificNames (139998/70000/485173)
[INFO] [2024-05-20 12:58:17] Storing 10000 Nodes (139998/70000/485173)
[INFO] [2024-05-20 12:58:23] Storing 10000 ScientificNames (159998/80000/485173)
[INFO] [2024-05-20 12:58:26] Storing 10000 Nodes (159998/80000/485173)
[INFO] [2024-05-20 12:58:32] Storing 10000 ScientificNames (179998/90000/485173)
[INFO] [2024-05-20 12:58:35] Storing 10000 Nodes (179998/90000/485173)
[INFO] [2024-05-20 12:58:42] Storing 10000 ScientificNames (199998/100000/485173)
[INFO] [2024-05-20 12:58:45] Storing 10000 Nodes (199998/100000/485173)
[INFO] [2024-05-20 12:58:52] Storing 10000 ScientificNames (219998/110000/485173)
[INFO] [2024-05-20 12:58:55] Storing 10000 Nodes (219998/110000/485173)
[INFO] [2024-05-20 12:59:01] Storing 10000 ScientificNames (239998/120000/485173)
[INFO] [2024-05-20 12:59:05] Storing 10000 Nodes (239998/120000/485173)
[INFO] [2024-05-20 12:59:11] Storing 10000 ScientificNames (259998/130000/485173)
[INFO] [2024-05-20 12:59:14] Storing 10000 Nodes (259998/130000/485173)
[INFO] [2024-05-20 12:59:21] Storing 10000 ScientificNames (279998/140000/485173)
[INFO] [2024-05-20 12:59:24] Storing 10000 Nodes (279998/140000/485173)
[INFO] [2024-05-20 12:59:31] Storing 10000 ScientificNames (299998/150000/485173)
[INFO] [2024-05-20 12:59:34] Storing 10000 Nodes (299998/150000/485173)
[INFO] [2024-05-20 12:59:40] Storing 10000 ScientificNames (319998/160000/485173)
[INFO] [2024-05-20 12:59:43] Storing 10000 Nodes (319998/160000/485173)
[INFO] [2024-05-20 12:59:50] Storing 10000 ScientificNames (339998/170000/485173)
[INFO] [2024-05-20 12:59:53] Storing 10000 Nodes (339998/170000/485173)
[INFO] [2024-05-20 13:00:00] Storing 10000 ScientificNames (359998/180000/485173)
[INFO] [2024-05-20 13:00:03] Storing 10000 Nodes (359998/180000/485173)
[INFO] [2024-05-20 13:00:10] Storing 10000 ScientificNames (379998/190000/485173)
[INFO] [2024-05-20 13:00:13] Storing 10000 Nodes (379998/190000/485173)
[INFO] [2024-05-20 13:00:20] Storing 10000 ScientificNames (399998/200000/485173)
[INFO] [2024-05-20 13:00:23] Storing 10000 Nodes (399998/200000/485173)
[INFO] [2024-05-20 13:00:30] Storing 10000 ScientificNames (419998/210000/485173)
[INFO] [2024-05-20 13:00:33] Storing 10000 Nodes (419998/210000/485173)
[INFO] [2024-05-20 13:00:40] Storing 10000 ScientificNames (439998/220000/485173)
[INFO] [2024-05-20 13:00:43] Storing 10000 Nodes (439998/220000/485173)
[INFO] [2024-05-20 13:00:50] Storing 10000 ScientificNames (459998/230000/485173)
[INFO] [2024-05-20 13:00:54] Storing 10000 Nodes (459998/230000/485173)
[INFO] [2024-05-20 13:01:01] Storing 10000 ScientificNames (479998/240000/485173)
[INFO] [2024-05-20 13:01:04] Storing 10000 Nodes (479998/240000/485173)
[INFO] [2024-05-20 13:01:12] Storing 10000 ScientificNames (499998/250000/485173)
[INFO] [2024-05-20 13:01:15] Storing 10000 Nodes (499998/250000/485173)
[INFO] [2024-05-20 13:01:22] Storing 10000 ScientificNames (519998/260000/485173)
[INFO] [2024-05-20 13:01:25] Storing 10000 Nodes (519998/260000/485173)
[WARN] [2024-05-20 13:01:29] Filtered Scientific Name `Triboniophorus nov “kaputar"` to `Triboniophorus nov “kaputar`
[INFO] [2024-05-20 13:01:33] Storing 10000 ScientificNames (539998/270000/485173)
[INFO] [2024-05-20 13:01:36] Storing 10000 Nodes (539998/270000/485173)
[INFO] [2024-05-20 13:01:44] Storing 10000 ScientificNames (559998/280000/485173)
[INFO] [2024-05-20 13:01:47] Storing 10000 Nodes (559998/280000/485173)
[INFO] [2024-05-20 13:01:54] Storing 10000 ScientificNames (579998/290000/485173)
[INFO] [2024-05-20 13:01:58] Storing 10000 Nodes (579998/290000/485173)
[INFO] [2024-05-20 13:02:05] Storing 10000 ScientificNames (599998/300000/485173)
[INFO] [2024-05-20 13:02:08] Storing 10000 Nodes (599998/300000/485173)
[INFO] [2024-05-20 13:02:16] Storing 10000 ScientificNames (619998/310000/485173)
[INFO] [2024-05-20 13:02:20] Storing 10000 Nodes (619998/310000/485173)
[INFO] [2024-05-20 13:02:27] Storing 10000 ScientificNames (639998/320000/485173)
[INFO] [2024-05-20 13:02:30] Storing 10000 Nodes (639998/320000/485173)
[INFO] [2024-05-20 13:02:38] Storing 10000 ScientificNames (659998/330000/485173)
[INFO] [2024-05-20 13:02:41] Storing 10000 Nodes (659998/330000/485173)
[INFO] [2024-05-20 13:02:49] Storing 10000 ScientificNames (679998/340000/485173)
[INFO] [2024-05-20 13:02:53] Storing 10000 Nodes (679998/340000/485173)
[INFO] [2024-05-20 13:03:01] Storing 10000 ScientificNames (699998/350000/485173)
[INFO] [2024-05-20 13:03:04] Storing 10000 Nodes (699998/350000/485173)
[INFO] [2024-05-20 13:03:12] Storing 10000 ScientificNames (719998/360000/485173)
[INFO] [2024-05-20 13:03:15] Storing 10000 Nodes (719998/360000/485173)
[INFO] [2024-05-20 13:03:23] Storing 10000 ScientificNames (739998/370000/485173)
[INFO] [2024-05-20 13:03:26] Storing 10000 Nodes (739998/370000/485173)
[INFO] [2024-05-20 13:03:35] Storing 10000 ScientificNames (759998/380000/485173)
[INFO] [2024-05-20 13:03:38] Storing 10000 Nodes (759998/380000/485173)
[INFO] [2024-05-20 13:03:46] Storing 10000 ScientificNames (779998/390000/485173)
[INFO] [2024-05-20 13:03:49] Storing 10000 Nodes (779998/390000/485173)
[INFO] [2024-05-20 13:03:58] Storing 10000 ScientificNames (799998/400000/485173)
[INFO] [2024-05-20 13:04:01] Storing 10000 Nodes (799998/400000/485173)
[INFO] [2024-05-20 13:04:10] Storing 10000 ScientificNames (819998/410000/485173)
[INFO] [2024-05-20 13:04:12] Storing 10000 Nodes (819998/410000/485173)
[INFO] [2024-05-20 13:04:21] Storing 10000 ScientificNames (839998/420000/485173)
[INFO] [2024-05-20 13:04:24] Storing 10000 Nodes (839998/420000/485173)
[INFO] [2024-05-20 13:04:33] Storing 10000 ScientificNames (859998/430000/485173)
[INFO] [2024-05-20 13:04:36] Storing 10000 Nodes (859998/430000/485173)
[INFO] [2024-05-20 13:04:45] Storing 10000 ScientificNames (879998/440000/485173)
[INFO] [2024-05-20 13:04:48] Storing 10000 Nodes (879998/440000/485173)
[INFO] [2024-05-20 13:04:57] Storing 10000 ScientificNames (899998/450000/485173)
[INFO] [2024-05-20 13:05:00] Storing 10000 Nodes (899998/450000/485173)
[INFO] [2024-05-20 13:05:09] Storing 10000 ScientificNames (919998/460000/485173)
[INFO] [2024-05-20 13:05:12] Storing 10000 Nodes (919998/460000/485173)
[INFO] [2024-05-20 13:05:21] Storing 10000 ScientificNames (939998/470000/485173)
[INFO] [2024-05-20 13:05:24] Storing 10000 Nodes (939998/470000/485173)
[INFO] [2024-05-20 13:05:34] Storing 10000 ScientificNames (959998/480000/485173)
[INFO] [2024-05-20 13:05:37] Storing 10000 Nodes (959998/480000/485173)
[INFO] [2024-05-20 13:05:45] Storing 5172 ScientificNames (970342/485171/485173)
[INFO] [2024-05-20 13:05:47] Storing 5172 Nodes (970342/485171/485173)
[INFO] [2024-05-20 13:05:49] Handling diff: /app/public/data/i_nat_dat_covera/diff/i_nat_dat_covera_occurrences_31117.diff (811043 lines)
[INFO] [2024-05-20 13:05:49] Loading occurrences diff file into memory (811043 lines)...
[INFO] [2024-05-20 13:05:50] Storing 9999 Occurrences (9999/10000/811043)
[INFO] [2024-05-20 13:05:52] Storing 10000 Occurrences (19999/20000/811043)
[INFO] [2024-05-20 13:05:54] Storing 10000 Occurrences (29999/30000/811043)
[INFO] [2024-05-20 13:05:57] Storing 10000 Occurrences (39999/40000/811043)
[INFO] [2024-05-20 13:05:59] Storing 10000 Occurrences (49999/50000/811043)
[INFO] [2024-05-20 13:06:01] Storing 10000 Occurrences (59999/60000/811043)
[INFO] [2024-05-20 13:06:04] Storing 10000 Occurrences (69999/70000/811043)
[INFO] [2024-05-20 13:06:06] Storing 10000 Occurrences (79999/80000/811043)
[INFO] [2024-05-20 13:06:08] Storing 10000 Occurrences (89999/90000/811043)
[INFO] [2024-05-20 13:06:11] Storing 10000 Occurrences (99999/100000/811043)
[INFO] [2024-05-20 13:06:14] Storing 10000 Occurrences (109999/110000/811043)
[INFO] [2024-05-20 13:06:16] Storing 10000 Occurrences (119999/120000/811043)
[INFO] [2024-05-20 13:06:19] Storing 10000 Occurrences (129999/130000/811043)
[INFO] [2024-05-20 13:06:22] Storing 10000 Occurrences (139999/140000/811043)
[INFO] [2024-05-20 13:06:24] Storing 10000 Occurrences (149999/150000/811043)
[INFO] [2024-05-20 13:06:27] Storing 10000 Occurrences (159999/160000/811043)
[INFO] [2024-05-20 13:06:30] Storing 10000 Occurrences (169999/170000/811043)
[INFO] [2024-05-20 13:06:33] Storing 10000 Occurrences (179999/180000/811043)
[INFO] [2024-05-20 13:06:36] Storing 10000 Occurrences (189999/190000/811043)
[INFO] [2024-05-20 13:06:38] Storing 10000 Occurrences (199999/200000/811043)
[INFO] [2024-05-20 13:06:42] Storing 10000 Occurrences (209999/210000/811043)
[INFO] [2024-05-20 13:06:45] Storing 10000 Occurrences (219999/220000/811043)
[INFO] [2024-05-20 13:06:48] Storing 10000 Occurrences (229999/230000/811043)
[INFO] [2024-05-20 13:06:51] Storing 10000 Occurrences (239999/240000/811043)
[INFO] [2024-05-20 13:06:54] Storing 10000 Occurrences (249999/250000/811043)
[INFO] [2024-05-20 13:06:57] Storing 10000 Occurrences (259999/260000/811043)
[INFO] [2024-05-20 13:07:01] Storing 10000 Occurrences (269999/270000/811043)
[INFO] [2024-05-20 13:07:04] Storing 10000 Occurrences (279999/280000/811043)
[INFO] [2024-05-20 13:07:07] Storing 10000 Occurrences (289999/290000/811043)
[INFO] [2024-05-20 13:07:11] Storing 10000 Occurrences (299999/300000/811043)
[INFO] [2024-05-20 13:07:14] Storing 10000 Occurrences (309999/310000/811043)
[INFO] [2024-05-20 13:07:17] Storing 10000 Occurrences (319999/320000/811043)
[INFO] [2024-05-20 13:07:21] Storing 10000 Occurrences (329999/330000/811043)
[INFO] [2024-05-20 13:07:25] Storing 10000 Occurrences (339999/340000/811043)
[INFO] [2024-05-20 13:07:28] Storing 10000 Occurrences (349999/350000/811043)
[INFO] [2024-05-20 13:07:31] Storing 10000 Occurrences (359999/360000/811043)
[INFO] [2024-05-20 13:07:35] Storing 10000 Occurrences (369999/370000/811043)
[INFO] [2024-05-20 13:07:39] Storing 10000 Occurrences (379999/380000/811043)
[INFO] [2024-05-20 13:07:43] Storing 10000 Occurrences (389999/390000/811043)
[INFO] [2024-05-20 13:07:47] Storing 10000 Occurrences (399999/400000/811043)
[INFO] [2024-05-20 13:07:50] Storing 10000 Occurrences (409999/410000/811043)
[INFO] [2024-05-20 13:07:54] Storing 10000 Occurrences (419999/420000/811043)
[INFO] [2024-05-20 13:07:59] Storing 10000 Occurrences (429999/430000/811043)
[INFO] [2024-05-20 13:08:03] Storing 10000 Occurrences (439999/440000/811043)
[INFO] [2024-05-20 13:08:08] Storing 10000 Occurrences (449999/450000/811043)
[INFO] [2024-05-20 13:08:12] Storing 10000 Occurrences (459999/460000/811043)
[INFO] [2024-05-20 13:08:17] Storing 10000 Occurrences (469999/470000/811043)
[INFO] [2024-05-20 13:08:21] Storing 10000 Occurrences (479999/480000/811043)
[INFO] [2024-05-20 13:08:26] Storing 10000 Occurrences (489999/490000/811043)
[INFO] [2024-05-20 13:08:31] Storing 10000 Occurrences (499999/500000/811043)
[INFO] [2024-05-20 13:08:36] Storing 10000 Occurrences (509999/510000/811043)
[INFO] [2024-05-20 13:08:41] Storing 10000 Occurrences (519999/520000/811043)
[INFO] [2024-05-20 13:08:46] Storing 10000 Occurrences (529999/530000/811043)
[INFO] [2024-05-20 13:08:50] Storing 10000 Occurrences (539999/540000/811043)
[INFO] [2024-05-20 13:08:55] Storing 10000 Occurrences (549999/550000/811043)
[INFO] [2024-05-20 13:09:00] Storing 10000 Occurrences (559999/560000/811043)
[INFO] [2024-05-20 13:09:05] Storing 10000 Occurrences (569999/570000/811043)
[INFO] [2024-05-20 13:09:09] Storing 10000 Occurrences (579999/580000/811043)
[INFO] [2024-05-20 13:09:14] Storing 10000 Occurrences (589999/590000/811043)
[INFO] [2024-05-20 13:09:20] Storing 10000 Occurrences (599999/600000/811043)
[INFO] [2024-05-20 13:09:25] Storing 10000 Occurrences (609999/610000/811043)
[INFO] [2024-05-20 13:09:31] Storing 10000 Occurrences (619999/620000/811043)
[INFO] [2024-05-20 13:09:36] Storing 10000 Occurrences (629999/630000/811043)
[INFO] [2024-05-20 13:09:42] Storing 10000 Occurrences (639999/640000/811043)
[INFO] [2024-05-20 13:09:47] Storing 10000 Occurrences (649999/650000/811043)
[INFO] [2024-05-20 13:09:53] Storing 10000 Occurrences (659999/660000/811043)
[INFO] [2024-05-20 13:09:58] Storing 10000 Occurrences (669999/670000/811043)
[INFO] [2024-05-20 13:10:04] Storing 10000 Occurrences (679999/680000/811043)
[INFO] [2024-05-20 13:10:10] Storing 10000 Occurrences (689999/690000/811043)
[INFO] [2024-05-20 13:10:15] Storing 10000 Occurrences (699999/700000/811043)
[INFO] [2024-05-20 13:10:21] Storing 10000 Occurrences (709999/710000/811043)
[INFO] [2024-05-20 13:10:26] Storing 10000 Occurrences (719999/720000/811043)
[INFO] [2024-05-20 13:10:32] Storing 10000 Occurrences (729999/730000/811043)
[INFO] [2024-05-20 13:10:38] Storing 10000 Occurrences (739999/740000/811043)
[INFO] [2024-05-20 13:10:43] Storing 10000 Occurrences (749999/750000/811043)
[INFO] [2024-05-20 13:10:49] Storing 10000 Occurrences (759999/760000/811043)
[INFO] [2024-05-20 13:10:55] Storing 10000 Occurrences (769999/770000/811043)
[INFO] [2024-05-20 13:11:01] Storing 10000 Occurrences (779999/780000/811043)
[INFO] [2024-05-20 13:11:07] Storing 10000 Occurrences (789999/790000/811043)
[INFO] [2024-05-20 13:11:13] Storing 10000 Occurrences (799999/800000/811043)
[INFO] [2024-05-20 13:11:19] Storing 10000 Occurrences (809999/810000/811043)
[INFO] [2024-05-20 13:11:25] Storing 1042 Occurrences (811041/811041/811043)
[INFO] [2024-05-20 13:11:25] Handling diff: /app/public/data/i_nat_dat_covera/diff/i_nat_dat_covera_measurements_31118.diff (811043 lines)
[INFO] [2024-05-20 13:11:25] Loading measurements diff file into memory (811043 lines)...
[INFO] [2024-05-20 13:11:29] Storing 9999 Traits (9999/10000/811043)
[INFO] [2024-05-20 13:11:34] Storing 10000 Traits (19999/20000/811043)
[INFO] [2024-05-20 13:11:40] Storing 10000 Traits (29999/30000/811043)
[INFO] [2024-05-20 13:11:46] Storing 10000 Traits (39999/40000/811043)
[INFO] [2024-05-20 13:11:52] Storing 10000 Traits (49999/50000/811043)
[INFO] [2024-05-20 13:11:57] Storing 10000 Traits (59999/60000/811043)
[INFO] [2024-05-20 13:12:03] Storing 10000 Traits (69999/70000/811043)
[INFO] [2024-05-20 13:12:09] Storing 10000 Traits (79999/80000/811043)
[INFO] [2024-05-20 13:12:15] Storing 10000 Traits (89999/90000/811043)
[INFO] [2024-05-20 13:12:21] Storing 10000 Traits (99999/100000/811043)
[INFO] [2024-05-20 13:12:27] Storing 10000 Traits (109999/110000/811043)
[INFO] [2024-05-20 13:12:33] Storing 10000 Traits (119999/120000/811043)
[INFO] [2024-05-20 13:12:39] Storing 10000 Traits (129999/130000/811043)
[INFO] [2024-05-20 13:12:45] Storing 10000 Traits (139999/140000/811043)
[INFO] [2024-05-20 13:12:51] Storing 10000 Traits (149999/150000/811043)
[INFO] [2024-05-20 13:12:57] Storing 10000 Traits (159999/160000/811043)
[INFO] [2024-05-20 13:13:03] Storing 10000 Traits (169999/170000/811043)
[INFO] [2024-05-20 13:13:09] Storing 10000 Traits (179999/180000/811043)
[INFO] [2024-05-20 13:13:15] Storing 10000 Traits (189999/190000/811043)
[INFO] [2024-05-20 13:13:22] Storing 10000 Traits (199999/200000/811043)
[INFO] [2024-05-20 13:13:29] Storing 10000 Traits (209999/210000/811043)
[INFO] [2024-05-20 13:13:35] Storing 10000 Traits (219999/220000/811043)
[INFO] [2024-05-20 13:13:42] Storing 10000 Traits (229999/230000/811043)
[INFO] [2024-05-20 13:13:48] Storing 10000 Traits (239999/240000/811043)
[INFO] [2024-05-20 13:13:55] Storing 10000 Traits (249999/250000/811043)
[INFO] [2024-05-20 13:14:02] Storing 10000 Traits (259999/260000/811043)
[INFO] [2024-05-20 13:14:08] Storing 10000 Traits (269999/270000/811043)
[INFO] [2024-05-20 13:14:15] Storing 10000 Traits (279999/280000/811043)
[INFO] [2024-05-20 13:14:21] Storing 10000 Traits (289999/290000/811043)
[INFO] [2024-05-20 13:14:28] Storing 10000 Traits (299999/300000/811043)
[INFO] [2024-05-20 13:14:35] Storing 10000 Traits (309999/310000/811043)
[INFO] [2024-05-20 13:14:41] Storing 10000 Traits (319999/320000/811043)
[INFO] [2024-05-20 13:14:48] Storing 10000 Traits (329999/330000/811043)
[INFO] [2024-05-20 13:14:55] Storing 10000 Traits (339999/340000/811043)
[INFO] [2024-05-20 13:15:03] Storing 10000 Traits (349999/350000/811043)
[INFO] [2024-05-20 13:15:11] Storing 10000 Traits (359999/360000/811043)
[INFO] [2024-05-20 13:15:18] Storing 10000 Traits (369999/370000/811043)
[INFO] [2024-05-20 13:15:25] Storing 10000 Traits (379999/380000/811043)
[INFO] [2024-05-20 13:15:32] Storing 10000 Traits (389999/390000/811043)
[INFO] [2024-05-20 13:15:39] Storing 10000 Traits (399999/400000/811043)
[INFO] [2024-05-20 13:15:46] Storing 10000 Traits (409999/410000/811043)
[INFO] [2024-05-20 13:15:54] Storing 10000 Traits (419999/420000/811043)
[INFO] [2024-05-20 13:16:03] Storing 10000 Traits (429999/430000/811043)
[INFO] [2024-05-20 13:16:11] Storing 10000 Traits (439999/440000/811043)
[INFO] [2024-05-20 13:16:18] Storing 10000 Traits (449999/450000/811043)
[INFO] [2024-05-20 13:16:26] Storing 10000 Traits (459999/460000/811043)
[INFO] [2024-05-20 13:16:33] Storing 10000 Traits (469999/470000/811043)
[INFO] [2024-05-20 13:16:41] Storing 10000 Traits (479999/480000/811043)
[INFO] [2024-05-20 13:16:49] Storing 10000 Traits (489999/490000/811043)
[INFO] [2024-05-20 13:16:57] Storing 10000 Traits (499999/500000/811043)
[INFO] [2024-05-20 13:17:04] Storing 10000 Traits (509999/510000/811043)
[INFO] [2024-05-20 13:17:12] Storing 10000 Traits (519999/520000/811043)
[INFO] [2024-05-20 13:17:20] Storing 10000 Traits (529999/530000/811043)
[INFO] [2024-05-20 13:17:28] Storing 10000 Traits (539999/540000/811043)
[INFO] [2024-05-20 13:17:36] Storing 10000 Traits (549999/550000/811043)
[INFO] [2024-05-20 13:17:44] Storing 10000 Traits (559999/560000/811043)
[INFO] [2024-05-20 13:17:52] Storing 10000 Traits (569999/570000/811043)
[INFO] [2024-05-20 13:18:00] Storing 10000 Traits (579999/580000/811043)
[INFO] [2024-05-20 13:18:11] Storing 10000 Traits (589999/590000/811043)
[INFO] [2024-05-20 13:18:19] Storing 10000 Traits (599999/600000/811043)
[INFO] [2024-05-20 13:18:27] Storing 10000 Traits (609999/610000/811043)
[INFO] [2024-05-20 13:18:36] Storing 10000 Traits (619999/620000/811043)
[INFO] [2024-05-20 13:18:44] Storing 10000 Traits (629999/630000/811043)
[INFO] [2024-05-20 13:18:52] Storing 10000 Traits (639999/640000/811043)
[INFO] [2024-05-20 13:19:01] Storing 10000 Traits (649999/650000/811043)
[INFO] [2024-05-20 13:19:09] Storing 10000 Traits (659999/660000/811043)
[INFO] [2024-05-20 13:19:17] Storing 10000 Traits (669999/670000/811043)
[INFO] [2024-05-20 13:19:26] Storing 10000 Traits (679999/680000/811043)
[INFO] [2024-05-20 13:19:35] Storing 10000 Traits (689999/690000/811043)
[INFO] [2024-05-20 13:19:43] Storing 10000 Traits (699999/700000/811043)
[INFO] [2024-05-20 13:19:52] Storing 10000 Traits (709999/710000/811043)
[INFO] [2024-05-20 13:20:00] Storing 10000 Traits (719999/720000/811043)
[INFO] [2024-05-20 13:20:10] Storing 10000 Traits (729999/730000/811043)
[INFO] [2024-05-20 13:20:18] Storing 10000 Traits (739999/740000/811043)
[INFO] [2024-05-20 13:20:27] Storing 10000 Traits (749999/750000/811043)
[INFO] [2024-05-20 13:20:37] Storing 10000 Traits (759999/760000/811043)
[INFO] [2024-05-20 13:20:45] Storing 10000 Traits (769999/770000/811043)
[INFO] [2024-05-20 13:20:54] Storing 10000 Traits (779999/780000/811043)
[INFO] [2024-05-20 13:21:03] Storing 10000 Traits (789999/790000/811043)
[INFO] [2024-05-20 13:21:12] Storing 10000 Traits (799999/800000/811043)
[INFO] [2024-05-20 13:21:21] Storing 10000 Traits (809999/810000/811043)
[INFO] [2024-05-20 13:21:28] Storing 1042 Traits (811041/811041/811043)
[STOP] [2024-05-20 13:21:28] parse_diff_and_store
[START] [2024-05-20 13:21:28] resolve_keys
[2024-05-20 13:23:50] Resolving downloaded urls (this is not actually downloading them yet)
[INFO] [2024-05-20 13:24:02] Occurrences to nodes (through scientific_names)...
[INFO] [2024-05-20 13:24:53] traits to occurrences...
[INFO] [2024-05-20 13:25:49] traits to nodes (through occurrences)...
[INFO] [2024-05-20 13:26:36] Traits to sex term...
[INFO] [2024-05-20 13:26:52] Traits to lifestage term...
[INFO] [2024-05-20 13:27:00] MetaTraits to traits...
[INFO] [2024-05-20 13:27:00] MetaTraits (simple, measurement row refers to parent) to traits...
[INFO] [2024-05-20 13:27:02] Assocs to occurrences...
[INFO] [2024-05-20 13:27:02] Assocs to nodes...
[INFO] [2024-05-20 13:27:02] Assoc to sex term...
[INFO] [2024-05-20 13:27:02] Assoc to lifestage term...
[INFO] [2024-05-20 13:27:02] MetaAssoc to assocs...
[STOP] [2024-05-20 13:27:02] resolve_keys
[START] [2024-05-20 13:27:02] hold_for_later_1
[STOP] [2024-05-20 13:27:02] hold_for_later_1
[START] [2024-05-20 13:27:02] hold_for_later_2
[STOP] [2024-05-20 13:27:02] hold_for_later_2
[START] [2024-05-20 13:27:02] resolve_missing_parents
[STOP] [2024-05-20 13:27:10] resolve_missing_parents
[START] [2024-05-20 13:27:10] rebuild_nodes
[START] [2024-05-20 13:27:10] Flattener#flatten
[START] [2024-05-20 13:27:10] Flattener#study_resource
[START] [2024-05-20 13:27:50] Flattener#build_ancestry
[STOP] [2024-05-20 13:39:32] Flattener#build_ancestry
[INFO] [2024-05-20 13:39:32] 485171 ancestry keys
[START] [2024-05-20 13:39:32] build_node_ancestors
[INFO] [2024-05-20 13:39:32] old ancestors deleted.
[STOP] [2024-05-20 13:49:28] build_node_ancestors
[START] [2024-05-20 13:49:32] Flattener#propagate_ancestor_ids
[STOP] [2024-05-20 13:53:46] Flattener#propagate_ancestor_ids
[STOP] [2024-05-20 13:53:46] Flattener#flatten
[STOP] [2024-05-20 13:53:46] rebuild_nodes
[START] [2024-05-20 13:53:46] resolve_missing_media_owners
[STOP] [2024-05-20 13:53:46] resolve_missing_media_owners
[START] [2024-05-20 13:53:46] sanitize_media_verbatims
[STOP] [2024-05-20 13:53:46] sanitize_media_verbatims
[START] [2024-05-20 13:53:46] queue_downloads
[STOP] [2024-05-20 13:53:46] queue_downloads
[START] [2024-05-20 13:53:46] parse_names
[WARN] [2024-05-20 13:53:47] I see 485171 names which still need to be parsed.
[WARN] [2024-05-20 13:53:51] Names to parse: 10000 formatted: 10000 learned: 9997 parsed: 10000
[WARN] [2024-05-20 13:53:58] Names to parse: 10000 formatted: 10000 learned: 9985 parsed: 10000
[WARN] [2024-05-20 13:54:06] Names to parse: 10000 formatted: 10000 learned: 9990 parsed: 10000
[WARN] [2024-05-20 13:54:15] Names to parse: 10000 formatted: 10000 learned: 9985 parsed: 10000
[WARN] [2024-05-20 13:54:22] Names to parse: 10000 formatted: 10000 learned: 9985 parsed: 10000
[WARN] [2024-05-20 13:54:30] Names to parse: 10000 formatted: 10000 learned: 9990 parsed: 10000
[WARN] [2024-05-20 13:54:37] Names to parse: 10000 formatted: 10000 learned: 9989 parsed: 10000
[WARN] [2024-05-20 13:54:44] Names to parse: 10000 formatted: 10000 learned: 9990 parsed: 10000
[WARN] [2024-05-20 13:54:51] Names to parse: 10000 formatted: 10000 learned: 9981 parsed: 10000
[WARN] [2024-05-20 13:54:58] Names to parse: 10000 formatted: 10000 learned: 9983 parsed: 10000
[WARN] [2024-05-20 13:55:05] Names to parse: 10000 formatted: 10000 learned: 9988 parsed: 10000
[WARN] [2024-05-20 13:55:13] Names to parse: 10000 formatted: 10000 learned: 9952 parsed: 10000
[WARN] [2024-05-20 13:55:20] Names to parse: 10000 formatted: 10000 learned: 9966 parsed: 10000
[WARN] [2024-05-20 13:55:28] Names to parse: 10000 formatted: 10000 learned: 9982 parsed: 10000
[WARN] [2024-05-20 13:55:35] Names to parse: 10000 formatted: 10000 learned: 9949 parsed: 10000
[WARN] [2024-05-20 13:55:43] Names to parse: 10000 formatted: 10000 learned: 9994 parsed: 10000
[WARN] [2024-05-20 13:55:50] Names to parse: 10000 formatted: 10000 learned: 9967 parsed: 10000
[WARN] [2024-05-20 13:55:58] Names to parse: 10000 formatted: 10000 learned: 9993 parsed: 10000
[WARN] [2024-05-20 13:56:06] Names to parse: 10000 formatted: 10000 learned: 10000 parsed: 10000
[WARN] [2024-05-20 13:56:13] Names to parse: 10000 formatted: 10000 learned: 10000 parsed: 10000
[WARN] [2024-05-20 13:56:20] Names to parse: 10000 formatted: 10000 learned: 10000 parsed: 10000
[WARN] [2024-05-20 13:56:28] Names to parse: 10000 formatted: 10000 learned: 9998 parsed: 10000
[WARN] [2024-05-20 13:56:35] Names to parse: 10000 formatted: 10000 learned: 9998 parsed: 10000
[WARN] [2024-05-20 13:56:42] Names to parse: 10000 formatted: 10000 learned: 9996 parsed: 10000
[WARN] [2024-05-20 13:56:49] Names to parse: 10000 formatted: 10000 learned: 10000 parsed: 10000
[WARN] [2024-05-20 13:56:57] Names to parse: 10000 formatted: 10000 learned: 9998 parsed: 10000
[WARN] [2024-05-20 13:57:04] Names to parse: 10000 formatted: 10000 learned: 9998 parsed: 10000
[WARN] [2024-05-20 13:57:11] Names to parse: 10000 formatted: 10000 learned: 9996 parsed: 10000
[WARN] [2024-05-20 13:57:18] Names to parse: 10000 formatted: 10000 learned: 10000 parsed: 10000
[WARN] [2024-05-20 13:57:25] Names to parse: 10000 formatted: 10000 learned: 9999 parsed: 10000
[WARN] [2024-05-20 13:57:32] Names to parse: 10000 formatted: 10000 learned: 9994 parsed: 10000
[WARN] [2024-05-20 13:57:40] Names to parse: 10000 formatted: 10000 learned: 9998 parsed: 10000
[WARN] [2024-05-20 13:57:47] Names to parse: 10000 formatted: 10000 learned: 9998 parsed: 10000
[WARN] [2024-05-20 13:57:54] Names to parse: 10000 formatted: 10000 learned: 9987 parsed: 10000
[WARN] [2024-05-20 13:58:01] Names to parse: 10000 formatted: 10000 learned: 9999 parsed: 10000
[WARN] [2024-05-20 13:58:08] Names to parse: 10000 formatted: 10000 learned: 9999 parsed: 10000
[WARN] [2024-05-20 13:58:15] Names to parse: 10000 formatted: 10000 learned: 10000 parsed: 10000
[WARN] [2024-05-20 13:58:22] Names to parse: 10000 formatted: 10000 learned: 9999 parsed: 10000
[WARN] [2024-05-20 13:58:29] Names to parse: 10000 formatted: 10000 learned: 9976 parsed: 10000
[WARN] [2024-05-20 13:58:36] Names to parse: 10000 formatted: 10000 learned: 9992 parsed: 10000
[WARN] [2024-05-20 13:58:43] Names to parse: 10000 formatted: 10000 learned: 9993 parsed: 10000
[WARN] [2024-05-20 13:58:50] Names to parse: 10000 formatted: 10000 learned: 9998 parsed: 10000
[WARN] [2024-05-20 13:58:57] Names to parse: 10000 formatted: 10000 learned: 9993 parsed: 10000
[WARN] [2024-05-20 13:59:04] Names to parse: 10000 formatted: 10000 learned: 9997 parsed: 10000
[WARN] [2024-05-20 13:59:11] Names to parse: 10000 formatted: 10000 learned: 9997 parsed: 10000
[WARN] [2024-05-20 13:59:18] Names to parse: 10000 formatted: 10000 learned: 9999 parsed: 10000
[WARN] [2024-05-20 13:59:25] Names to parse: 10000 formatted: 10000 learned: 9998 parsed: 10000
[WARN] [2024-05-20 13:59:32] Names to parse: 10000 formatted: 10000 learned: 9988 parsed: 10000
[WARN] [2024-05-20 13:59:39] Names to parse: 5171 formatted: 5171 learned: 5169 parsed: 5171
[STOP] [2024-05-20 13:59:44] parse_names
[START] [2024-05-20 13:59:44] denormalize_canonical_names_to_nodes
[STOP] [2024-05-20 14:00:34] denormalize_canonical_names_to_nodes
[START] [2024-05-20 14:00:34] match_nodes
[START] [2024-05-20 14:00:35] map_all_nodes_to_pages
[STOP] [2024-05-20 17:16:36] map_all_nodes_to_pages
[INFO] [2024-05-20 17:16:36] 31529 Unmatched nodes (of 485171)! That's too many to output. Full list in /app/public/data/i_nat_dat_covera/unmatched_nodes.txt ; First 10: Canonical: Xyela longula; Node#149777443; ResourceID: 1019279; Canonical: Xyela julii; Node#149777444; ResourceID: 1019280; Canonical: Porrorhynchus marginatus; Node#149780285; ResourceID: 1029559; Canonical: Lampris australensis; Node#149788027; ResourceID: 1063064; Canonical: Lampris incognitus; Node#149794469; ResourceID: 1079969; Canonical: Rhipidomella; Node#149795174; ResourceID: 1081675; Canonical: Xyela obscura; Node#149795565; ResourceID: 1083906; Canonical: Sciapteryx semenowi; Node#149795602; ResourceID: 1084112; Canonical: Meleonoma torophanes; Node#149802760; ResourceID: 1107449; Canonical: Resserella; Node#149803011; ResourceID: 1108770
[START] [2024-05-20 17:16:36] update_nodes
[STOP] [2024-05-20 17:17:33] update_nodes
[STOP] [2024-05-20 17:17:33] match_nodes
[START] [2024-05-20 17:17:33] reindex_search
[STOP] [2024-05-20 17:28:34] reindex_search
[START] [2024-05-20 17:28:34] normalize_units
[STOP] [2024-05-20 17:30:00] normalize_units
[START] [2024-05-20 17:30:00] calculate_statistics
[INFO] [2024-05-20 17:30:25] Duplicate page_id count: 0
[STOP] [2024-05-20 17:30:27] calculate_statistics
[START] [2024-05-20 17:30:27] complete_harvest_instance
[START] [2024-05-20 17:30:27] overall_tsv_creation
[INFO] [2024-05-20 17:30:27] Exporting 485171 nodes as TSV in batches of 10000...
[INFO] [2024-05-20 17:30:27] Processing group of 485171 in 49 batches of 10000
[INFO] [2024-05-20 17:32:28] 16963 Traits (unfiltered) and 0 associations...
[INFO] [2024-05-20 17:32:28] Building Traits map for 10000 nodes (this can take a while)...
[INFO] [2024-05-20 17:32:36] Mapped 16963 traits (0 meta) for 10000 nodes.
[INFO] [2024-05-20 17:32:36] Building Associations map (this can take a while)...
[INFO] [2024-05-20 17:32:41] Done. 0 assocs mapped (0 meta).
[INFO] [2024-05-20 17:32:41] Adding 16963 traits...
[INFO] [2024-05-20 17:32:43] 0 metadata added.
[INFO] [2024-05-20 17:32:43] Adding 0 assocs...
[INFO] [2024-05-20 17:32:43] 0 metadata added.
[INFO] [2024-05-20 17:33:55] Processed 10000/485171 nodes
[INFO] [2024-05-20 17:35:53] 16438 Traits (unfiltered) and 0 associations...
[INFO] [2024-05-20 17:35:53] Building Traits map for 10000 nodes (this can take a while)...
[INFO] [2024-05-20 17:36:02] Mapped 16438 traits (0 meta) for 10000 nodes.
[INFO] [2024-05-20 17:36:02] Building Associations map (this can take a while)...
[INFO] [2024-05-20 17:36:06] Done. 0 assocs mapped (0 meta).
[INFO] [2024-05-20 17:36:06] Adding 16438 traits...
[INFO] [2024-05-20 17:36:07] 0 metadata added.
[INFO] [2024-05-20 17:36:07] Adding 0 assocs...
[INFO] [2024-05-20 17:36:07] 0 metadata added.
[INFO] [2024-05-20 17:37:19] Processed 20000/485171 nodes
[INFO] [2024-05-20 17:39:21] 17641 Traits (unfiltered) and 0 associations...
[INFO] [2024-05-20 17:39:21] Building Traits map for 10000 nodes (this can take a while)...
[INFO] [2024-05-20 17:39:30] Mapped 17641 traits (0 meta) for 10000 nodes.
[INFO] [2024-05-20 17:39:30] Building Associations map (this can take a while)...
[INFO] [2024-05-20 17:39:34] Done. 0 assocs mapped (0 meta).
[INFO] [2024-05-20 17:39:34] Adding 17641 traits...
[INFO] [2024-05-20 17:39:35] 0 metadata added.
[INFO] [2024-05-20 17:39:35] Adding 0 assocs...
[INFO] [2024-05-20 17:39:35] 0 metadata added.
[INFO] [2024-05-20 17:40:49] Processed 30000/485171 nodes
[INFO] [2024-05-20 17:42:49] 17399 Traits (unfiltered) and 0 associations...
[INFO] [2024-05-20 17:42:49] Building Traits map for 10000 nodes (this can take a while)...
[INFO] [2024-05-20 17:42:57] Mapped 17399 traits (0 meta) for 10000 nodes.
[INFO] [2024-05-20 17:42:57] Building Associations map (this can take a while)...
[INFO] [2024-05-20 17:43:01] Done. 0 assocs mapped (0 meta).
[INFO] [2024-05-20 17:43:01] Adding 17399 traits...
[INFO] [2024-05-20 17:43:03] 0 metadata added.
[INFO] [2024-05-20 17:43:03] Adding 0 assocs...
[INFO] [2024-05-20 17:43:03] 0 metadata added.
[INFO] [2024-05-20 17:44:15] Processed 40000/485171 nodes
[INFO] [2024-05-20 17:46:15] 17063 Traits (unfiltered) and 0 associations...
[INFO] [2024-05-20 17:46:15] Building Traits map for 10000 nodes (this can take a while)...
[INFO] [2024-05-20 17:46:23] Mapped 17063 traits (0 meta) for 10000 nodes.
[INFO] [2024-05-20 17:46:23] Building Associations map (this can take a while)...
[INFO] [2024-05-20 17:46:27] Done. 0 assocs mapped (0 meta).
[INFO] [2024-05-20 17:46:27] Adding 17063 traits...
[INFO] [2024-05-20 17:46:28] 0 metadata added.
[INFO] [2024-05-20 17:46:28] Adding 0 assocs...
[INFO] [2024-05-20 17:46:28] 0 metadata added.
[INFO] [2024-05-20 17:47:40] Processed 50000/485171 nodes
[INFO] [2024-05-20 17:49:41] 16973 Traits (unfiltered) and 0 associations...
[INFO] [2024-05-20 17:49:41] Building Traits map for 10000 nodes (this can take a while)...
[INFO] [2024-05-20 17:49:48] Mapped 16973 traits (0 meta) for 10000 nodes.
[INFO] [2024-05-20 17:49:48] Building Associations map (this can take a while)...
[INFO] [2024-05-20 17:49:53] Done. 0 assocs mapped (0 meta).
[INFO] [2024-05-20 17:49:53] Adding 16973 traits...
[INFO] [2024-05-20 17:49:54] 0 metadata added.
[INFO] [2024-05-20 17:49:54] Adding 0 assocs...
[INFO] [2024-05-20 17:49:54] 0 metadata added.
[INFO] [2024-05-20 17:51:06] Processed 60000/485171 nodes
[INFO] [2024-05-20 17:53:05] 17024 Traits (unfiltered) and 0 associations...
[INFO] [2024-05-20 17:53:05] Building Traits map for 10000 nodes (this can take a while)...
[INFO] [2024-05-20 17:53:16] Mapped 17024 traits (0 meta) for 10000 nodes.
[INFO] [2024-05-20 17:53:16] Building Associations map (this can take a while)...
[INFO] [2024-05-20 17:53:20] Done. 0 assocs mapped (0 meta).
[INFO] [2024-05-20 17:53:20] Adding 17024 traits...
[INFO] [2024-05-20 17:53:21] 0 metadata added.
[INFO] [2024-05-20 17:53:21] Adding 0 assocs...
[INFO] [2024-05-20 17:53:21] 0 metadata added.
[INFO] [2024-05-20 17:54:31] Processed 70000/485171 nodes
[INFO] [2024-05-20 17:56:33] 17100 Traits (unfiltered) and 0 associations...
[INFO] [2024-05-20 17:56:33] Building Traits map for 10000 nodes (this can take a while)...
[INFO] [2024-05-20 17:56:44] Mapped 17100 traits (0 meta) for 10000 nodes.
[INFO] [2024-05-20 17:56:44] Building Associations map (this can take a while)...
[INFO] [2024-05-20 17:56:49] Done. 0 assocs mapped (0 meta).
[INFO] [2024-05-20 17:56:49] Adding 17100 traits...
[INFO] [2024-05-20 17:56:49] 0 metadata added.
[INFO] [2024-05-20 17:56:49] Adding 0 assocs...
[INFO] [2024-05-20 17:56:49] 0 metadata added.
[INFO] [2024-05-20 17:58:00] Processed 80000/485171 nodes
[INFO] [2024-05-20 18:00:01] 16093 Traits (unfiltered) and 0 associations...
[INFO] [2024-05-20 18:00:01] Building Traits map for 10000 nodes (this can take a while)...
[INFO] [2024-05-20 18:00:10] Mapped 16093 traits (0 meta) for 10000 nodes.
[INFO] [2024-05-20 18:00:10] Building Associations map (this can take a while)...
[INFO] [2024-05-20 18:00:14] Done. 0 assocs mapped (0 meta).
[INFO] [2024-05-20 18:00:14] Adding 16093 traits...
[INFO] [2024-05-20 18:00:15] 0 metadata added.
[INFO] [2024-05-20 18:00:15] Adding 0 assocs...
[INFO] [2024-05-20 18:00:15] 0 metadata added.
[INFO] [2024-05-20 18:01:27] Processed 90000/485171 nodes
[INFO] [2024-05-20 18:03:29] 16604 Traits (unfiltered) and 0 associations...
[INFO] [2024-05-20 18:03:29] Building Traits map for 10000 nodes (this can take a while)...
[INFO] [2024-05-20 18:03:37] Mapped 16604 traits (0 meta) for 10000 nodes.
[INFO] [2024-05-20 18:03:37] Building Associations map (this can take a while)...
[INFO] [2024-05-20 18:03:41] Done. 0 assocs mapped (0 meta).
[INFO] [2024-05-20 18:03:41] Adding 16604 traits...
[INFO] [2024-05-20 18:03:42] 0 metadata added.
[INFO] [2024-05-20 18:03:42] Adding 0 assocs...
[INFO] [2024-05-20 18:03:42] 0 metadata added.
[INFO] [2024-05-20 18:04:52] Processed 100000/485171 nodes
[INFO] [2024-05-20 18:06:52] 17039 Traits (unfiltered) and 0 associations...
[INFO] [2024-05-20 18:06:52] Building Traits map for 10000 nodes (this can take a while)...
[INFO] [2024-05-20 18:07:03] Mapped 17039 traits (0 meta) for 10000 nodes.
[INFO] [2024-05-20 18:07:03] Building Associations map (this can take a while)...
[INFO] [2024-05-20 18:07:08] Done. 0 assocs mapped (0 meta).
[INFO] [2024-05-20 18:07:08] Adding 17039 traits...
[INFO] [2024-05-20 18:07:08] 0 metadata added.
[INFO] [2024-05-20 18:07:08] Adding 0 assocs...
[INFO] [2024-05-20 18:07:08] 0 metadata added.
[INFO] [2024-05-20 18:08:18] Processed 110000/485171 nodes
[INFO] [2024-05-20 18:10:17] 15912 Traits (unfiltered) and 0 associations...
[INFO] [2024-05-20 18:10:17] Building Traits map for 10000 nodes (this can take a while)...
[INFO] [2024-05-20 18:10:26] Mapped 15912 traits (0 meta) for 10000 nodes.
[INFO] [2024-05-20 18:10:26] Building Associations map (this can take a while)...
[INFO] [2024-05-20 18:10:30] Done. 0 assocs mapped (0 meta).
[INFO] [2024-05-20 18:10:30] Adding 15912 traits...
[INFO] [2024-05-20 18:10:31] 0 metadata added.
[INFO] [2024-05-20 18:10:31] Adding 0 assocs...
[INFO] [2024-05-20 18:10:31] 0 metadata added.
[INFO] [2024-05-20 18:11:42] Processed 120000/485171 nodes
[INFO] [2024-05-20 18:13:42] 16344 Traits (unfiltered) and 0 associations...
[INFO] [2024-05-20 18:13:42] Building Traits map for 10000 nodes (this can take a while)...
[INFO] [2024-05-20 18:13:49] Mapped 16344 traits (0 meta) for 10000 nodes.
[INFO] [2024-05-20 18:13:49] Building Associations map (this can take a while)...
[INFO] [2024-05-20 18:13:53] Done. 0 assocs mapped (0 meta).
[INFO] [2024-05-20 18:13:53] Adding 16344 traits...
[INFO] [2024-05-20 18:13:54] 0 metadata added.
[INFO] [2024-05-20 18:13:54] Adding 0 assocs...
[INFO] [2024-05-20 18:13:54] 0 metadata added.
[INFO] [2024-05-20 18:15:04] Processed 130000/485171 nodes
[INFO] [2024-05-20 18:17:03] 16492 Traits (unfiltered) and 0 associations...
[INFO] [2024-05-20 18:17:03] Building Traits map for 10000 nodes (this can take a while)...
[INFO] [2024-05-20 18:17:13] Mapped 16492 traits (0 meta) for 10000 nodes.
[INFO] [2024-05-20 18:17:13] Building Associations map (this can take a while)...
[INFO] [2024-05-20 18:17:17] Done. 0 assocs mapped (0 meta).
[INFO] [2024-05-20 18:17:17] Adding 16492 traits...
[INFO] [2024-05-20 18:17:18] 0 metadata added.
[INFO] [2024-05-20 18:17:18] Adding 0 assocs...
[INFO] [2024-05-20 18:17:18] 0 metadata added.
[INFO] [2024-05-20 18:18:26] Processed 140000/485171 nodes
[INFO] [2024-05-20 18:20:23] 15109 Traits (unfiltered) and 0 associations...
[INFO] [2024-05-20 18:20:23] Building Traits map for 10000 nodes (this can take a while)...
[INFO] [2024-05-20 18:20:33] Mapped 15109 traits (0 meta) for 10000 nodes.
[INFO] [2024-05-20 18:20:33] Building Associations map (this can take a while)...
[INFO] [2024-05-20 18:20:37] Done. 0 assocs mapped (0 meta).
[INFO] [2024-05-20 18:20:37] Adding 15109 traits...
[INFO] [2024-05-20 18:20:38] 0 metadata added.
[INFO] [2024-05-20 18:20:38] Adding 0 assocs...
[INFO] [2024-05-20 18:20:38] 0 metadata added.
[INFO] [2024-05-20 18:21:46] Processed 150000/485171 nodes
[INFO] [2024-05-20 18:23:45] 18600 Traits (unfiltered) and 0 associations...
[INFO] [2024-05-20 18:23:45] Building Traits map for 10000 nodes (this can take a while)...
[INFO] [2024-05-20 18:23:56] Mapped 18600 traits (0 meta) for 10000 nodes.
[INFO] [2024-05-20 18:23:56] Building Associations map (this can take a while)...
[INFO] [2024-05-20 18:24:00] Done. 0 assocs mapped (0 meta).
[INFO] [2024-05-20 18:24:00] Adding 18600 traits...
[INFO] [2024-05-20 18:24:01] 0 metadata added.
[INFO] [2024-05-20 18:24:01] Adding 0 assocs...
[INFO] [2024-05-20 18:24:01] 0 metadata added.
[INFO] [2024-05-20 18:25:11] Processed 160000/485171 nodes
[INFO] [2024-05-20 18:27:06] 14498 Traits (unfiltered) and 0 associations...
[INFO] [2024-05-20 18:27:06] Building Traits map for 10000 nodes (this can take a while)...
[INFO] [2024-05-20 18:27:16] Mapped 14498 traits (0 meta) for 10000 nodes.
[INFO] [2024-05-20 18:27:16] Building Associations map (this can take a while)...
[INFO] [2024-05-20 18:27:20] Done. 0 assocs mapped (0 meta).
[INFO] [2024-05-20 18:27:20] Adding 14498 traits...
[INFO] [2024-05-20 18:27:21] 0 metadata added.
[INFO] [2024-05-20 18:27:21] Adding 0 assocs...
[INFO] [2024-05-20 18:27:21] 0 metadata added.
[INFO] [2024-05-20 18:28:29] Processed 170000/485171 nodes
[INFO] [2024-05-20 18:30:28] 17510 Traits (unfiltered) and 0 associations...
[INFO] [2024-05-20 18:30:28] Building Traits map for 10000 nodes (this can take a while)...
[INFO] [2024-05-20 18:30:35] Mapped 17510 traits (0 meta) for 10000 nodes.
[INFO] [2024-05-20 18:30:35] Building Associations map (this can take a while)...
[INFO] [2024-05-20 18:30:39] Done. 0 assocs mapped (0 meta).
[INFO] [2024-05-20 18:30:39] Adding 17510 traits...
[INFO] [2024-05-20 18:30:43] 0 metadata added.
[INFO] [2024-05-20 18:30:43] Adding 0 assocs...
[INFO] [2024-05-20 18:30:43] 0 metadata added.
[INFO] [2024-05-20 18:31:53] Processed 180000/485171 nodes
[INFO] [2024-05-20 18:33:51] 17074 Traits (unfiltered) and 0 associations...
[INFO] [2024-05-20 18:33:51] Building Traits map for 10000 nodes (this can take a while)...
[INFO] [2024-05-20 18:34:01] Mapped 17074 traits (0 meta) for 10000 nodes.
[INFO] [2024-05-20 18:34:01] Building Associations map (this can take a while)...
[INFO] [2024-05-20 18:34:05] Done. 0 assocs mapped (0 meta).
[INFO] [2024-05-20 18:34:05] Adding 17074 traits...
[INFO] [2024-05-20 18:34:06] 0 metadata added.
[INFO] [2024-05-20 18:34:06] Adding 0 assocs...
[INFO] [2024-05-20 18:34:06] 0 metadata added.
[INFO] [2024-05-20 18:35:15] Processed 190000/485171 nodes
[INFO] [2024-05-20 18:37:13] 15957 Traits (unfiltered) and 0 associations...
[INFO] [2024-05-20 18:37:13] Building Traits map for 10000 nodes (this can take a while)...
[INFO] [2024-05-20 18:37:23] Mapped 15957 traits (0 meta) for 10000 nodes.
[INFO] [2024-05-20 18:37:23] Building Associations map (this can take a while)...
[INFO] [2024-05-20 18:37:27] Done. 0 assocs mapped (0 meta).
[INFO] [2024-05-20 18:37:27] Adding 15957 traits...
[INFO] [2024-05-20 18:37:28] 0 metadata added.
[INFO] [2024-05-20 18:37:28] Adding 0 assocs...
[INFO] [2024-05-20 18:37:28] 0 metadata added.
[INFO] [2024-05-20 18:38:35] Processed 200000/485171 nodes
[INFO] [2024-05-20 18:40:33] 19663 Traits (unfiltered) and 0 associations...
[INFO] [2024-05-20 18:40:33] Building Traits map for 10000 nodes (this can take a while)...
[INFO] [2024-05-20 18:40:46] Mapped 19663 traits (0 meta) for 10000 nodes.
[INFO] [2024-05-20 18:40:46] Building Associations map (this can take a while)...
[INFO] [2024-05-20 18:40:50] Done. 0 assocs mapped (0 meta).
[INFO] [2024-05-20 18:40:50] Adding 19663 traits...
[INFO] [2024-05-20 18:40:51] 0 metadata added.
[INFO] [2024-05-20 18:40:51] Adding 0 assocs...
[INFO] [2024-05-20 18:40:51] 0 metadata added.
[INFO] [2024-05-20 18:42:00] Processed 210000/485171 nodes
[INFO] [2024-05-20 18:44:00] 17176 Traits (unfiltered) and 0 associations...
[INFO] [2024-05-20 18:44:00] Building Traits map for 10000 nodes (this can take a while)...
[INFO] [2024-05-20 18:44:12] Mapped 17176 traits (0 meta) for 10000 nodes.
[INFO] [2024-05-20 18:44:12] Building Associations map (this can take a while)...
[INFO] [2024-05-20 18:44:16] Done. 0 assocs mapped (0 meta).
[INFO] [2024-05-20 18:44:16] Adding 17176 traits...
[INFO] [2024-05-20 18:44:17] 0 metadata added.
[INFO] [2024-05-20 18:44:17] Adding 0 assocs...
[INFO] [2024-05-20 18:44:17] 0 metadata added.
[INFO] [2024-05-20 18:45:24] Processed 220000/485171 nodes
[INFO] [2024-05-20 18:47:25] 16697 Traits (unfiltered) and 0 associations...
[INFO] [2024-05-20 18:47:25] Building Traits map for 10000 nodes (this can take a while)...
[INFO] [2024-05-20 18:47:33] Mapped 16697 traits (0 meta) for 10000 nodes.
[INFO] [2024-05-20 18:47:33] Building Associations map (this can take a while)...
[INFO] [2024-05-20 18:47:36] Done. 0 assocs mapped (0 meta).
[INFO] [2024-05-20 18:47:36] Adding 16697 traits...
[INFO] [2024-05-20 18:47:37] 0 metadata added.
[INFO] [2024-05-20 18:47:37] Adding 0 assocs...
[INFO] [2024-05-20 18:47:37] 0 metadata added.
[INFO] [2024-05-20 18:48:44] Processed 230000/485171 nodes
[INFO] [2024-05-20 18:50:40] 16331 Traits (unfiltered) and 0 associations...
[INFO] [2024-05-20 18:50:40] Building Traits map for 10000 nodes (this can take a while)...
[INFO] [2024-05-20 18:50:51] Mapped 16331 traits (0 meta) for 10000 nodes.
[INFO] [2024-05-20 18:50:51] Building Associations map (this can take a while)...
[INFO] [2024-05-20 18:50:55] Done. 0 assocs mapped (0 meta).
[INFO] [2024-05-20 18:50:55] Adding 16331 traits...
[INFO] [2024-05-20 18:50:56] 0 metadata added.
[INFO] [2024-05-20 18:50:56] Adding 0 assocs...
[INFO] [2024-05-20 18:50:56] 0 metadata added.
[INFO] [2024-05-20 18:52:01] Processed 240000/485171 nodes
[INFO] [2024-05-20 18:53:57] 15851 Traits (unfiltered) and 0 associations...
[INFO] [2024-05-20 18:53:57] Building Traits map for 10000 nodes (this can take a while)...
[INFO] [2024-05-20 18:54:05] Mapped 15851 traits (0 meta) for 10000 nodes.
[INFO] [2024-05-20 18:54:05] Building Associations map (this can take a while)...
[INFO] [2024-05-20 18:54:09] Done. 0 assocs mapped (0 meta).
[INFO] [2024-05-20 18:54:09] Adding 15851 traits...
[INFO] [2024-05-20 18:54:10] 0 metadata added.
[INFO] [2024-05-20 18:54:10] Adding 0 assocs...
[INFO] [2024-05-20 18:54:10] 0 metadata added.
[INFO] [2024-05-20 18:55:16] Processed 250000/485171 nodes
[INFO] [2024-05-20 18:57:09] 15654 Traits (unfiltered) and 0 associations...
[INFO] [2024-05-20 18:57:09] Building Traits map for 10000 nodes (this can take a while)...
[INFO] [2024-05-20 18:57:20] Mapped 15654 traits (0 meta) for 10000 nodes.
[INFO] [2024-05-20 18:57:20] Building Associations map (this can take a while)...
[INFO] [2024-05-20 18:57:23] Done. 0 assocs mapped (0 meta).
[INFO] [2024-05-20 18:57:23] Adding 15654 traits...
[INFO] [2024-05-20 18:57:24] 0 metadata added.
[INFO] [2024-05-20 18:57:24] Adding 0 assocs...
[INFO] [2024-05-20 18:57:24] 0 metadata added.
[INFO] [2024-05-20 18:58:28] Processed 260000/485171 nodes
[INFO] [2024-05-20 19:00:23] 17918 Traits (unfiltered) and 0 associations...
[INFO] [2024-05-20 19:00:23] Building Traits map for 10000 nodes (this can take a while)...
[INFO] [2024-05-20 19:00:34] Mapped 17918 traits (0 meta) for 10000 nodes.
[INFO] [2024-05-20 19:00:34] Building Associations map (this can take a while)...
[INFO] [2024-05-20 19:00:38] Done. 0 assocs mapped (0 meta).
[INFO] [2024-05-20 19:00:38] Adding 17918 traits...
[INFO] [2024-05-20 19:00:39] 0 metadata added.
[INFO] [2024-05-20 19:00:39] Adding 0 assocs...
[INFO] [2024-05-20 19:00:39] 0 metadata added.
[INFO] [2024-05-20 19:01:43] Processed 270000/485171 nodes
[INFO] [2024-05-20 19:03:36] 16614 Traits (unfiltered) and 0 associations...
[INFO] [2024-05-20 19:03:36] Building Traits map for 10000 nodes (this can take a while)...
[INFO] [2024-05-20 19:03:47] Mapped 16614 traits (0 meta) for 10000 nodes.
[INFO] [2024-05-20 19:03:47] Building Associations map (this can take a while)...
[INFO] [2024-05-20 19:03:51] Done. 0 assocs mapped (0 meta).
[INFO] [2024-05-20 19:03:51] Adding 16614 traits...
[INFO] [2024-05-20 19:03:52] 0 metadata added.
[INFO] [2024-05-20 19:03:52] Adding 0 assocs...
[INFO] [2024-05-20 19:03:52] 0 metadata added.
[INFO] [2024-05-20 19:04:54] Processed 280000/485171 nodes
[INFO] [2024-05-20 19:06:47] 16523 Traits (unfiltered) and 0 associations...
[INFO] [2024-05-20 19:06:47] Building Traits map for 10000 nodes (this can take a while)...
[INFO] [2024-05-20 19:06:58] Mapped 16523 traits (0 meta) for 10000 nodes.
[INFO] [2024-05-20 19:06:58] Building Associations map (this can take a while)...
[INFO] [2024-05-20 19:07:02] Done. 0 assocs mapped (0 meta).
[INFO] [2024-05-20 19:07:02] Adding 16523 traits...
[INFO] [2024-05-20 19:07:03] 0 metadata added.
[INFO] [2024-05-20 19:07:03] Adding 0 assocs...
[INFO] [2024-05-20 19:07:03] 0 metadata added.
[INFO] [2024-05-20 19:08:06] Processed 290000/485171 nodes
[INFO] [2024-05-20 19:10:01] 16764 Traits (unfiltered) and 0 associations...
[INFO] [2024-05-20 19:10:01] Building Traits map for 10000 nodes (this can take a while)...
[INFO] [2024-05-20 19:10:11] Mapped 16764 traits (0 meta) for 10000 nodes.
[INFO] [2024-05-20 19:10:11] Building Associations map (this can take a while)...
[INFO] [2024-05-20 19:10:14] Done. 0 assocs mapped (0 meta).
[INFO] [2024-05-20 19:10:14] Adding 16764 traits...
[INFO] [2024-05-20 19:10:17] 0 metadata added.
[INFO] [2024-05-20 19:10:17] Adding 0 assocs...
[INFO] [2024-05-20 19:10:17] 0 metadata added.
[INFO] [2024-05-20 19:11:20] Processed 300000/485171 nodes
[INFO] [2024-05-20 19:13:16] 15377 Traits (unfiltered) and 0 associations...
[INFO] [2024-05-20 19:13:16] Building Traits map for 10000 nodes (this can take a while)...
[INFO] [2024-05-20 19:13:23] Mapped 15377 traits (0 meta) for 10000 nodes.
[INFO] [2024-05-20 19:13:23] Building Associations map (this can take a while)...
[INFO] [2024-05-20 19:13:27] Done. 0 assocs mapped (0 meta).
[INFO] [2024-05-20 19:13:27] Adding 15377 traits...
[INFO] [2024-05-20 19:13:28] 0 metadata added.
[INFO] [2024-05-20 19:13:28] Adding 0 assocs...
[INFO] [2024-05-20 19:13:28] 0 metadata added.
[INFO] [2024-05-20 19:14:29] Processed 310000/485171 nodes
[INFO] [2024-05-20 19:16:23] 16548 Traits (unfiltered) and 0 associations...
[INFO] [2024-05-20 19:16:23] Building Traits map for 10000 nodes (this can take a while)...
[INFO] [2024-05-20 19:16:34] Mapped 16548 traits (0 meta) for 10000 nodes.
[INFO] [2024-05-20 19:16:34] Building Associations map (this can take a while)...
[INFO] [2024-05-20 19:16:38] Done. 0 assocs mapped (0 meta).
[INFO] [2024-05-20 19:16:38] Adding 16548 traits...
[INFO] [2024-05-20 19:16:39] 0 metadata added.
[INFO] [2024-05-20 19:16:39] Adding 0 assocs...
[INFO] [2024-05-20 19:16:39] 0 metadata added.
[INFO] [2024-05-20 19:17:41] Processed 320000/485171 nodes
[INFO] [2024-05-20 19:19:36] 16843 Traits (unfiltered) and 0 associations...
[INFO] [2024-05-20 19:19:36] Building Traits map for 10000 nodes (this can take a while)...
[INFO] [2024-05-20 19:19:46] Mapped 16843 traits (0 meta) for 10000 nodes.
[INFO] [2024-05-20 19:19:46] Building Associations map (this can take a while)...
[INFO] [2024-05-20 19:19:49] Done. 0 assocs mapped (0 meta).
[INFO] [2024-05-20 19:19:49] Adding 16843 traits...
[INFO] [2024-05-20 19:19:52] 0 metadata added.
[INFO] [2024-05-20 19:19:52] Adding 0 assocs...
[INFO] [2024-05-20 19:19:52] 0 metadata added.
[INFO] [2024-05-20 19:20:54] Processed 330000/485171 nodes
[INFO] [2024-05-20 19:22:50] 15694 Traits (unfiltered) and 0 associations...
[INFO] [2024-05-20 19:22:50] Building Traits map for 10000 nodes (this can take a while)...
[INFO] [2024-05-20 19:22:56] Mapped 15694 traits (0 meta) for 10000 nodes.
[INFO] [2024-05-20 19:22:56] Building Associations map (this can take a while)...
[INFO] [2024-05-20 19:23:00] Done. 0 assocs mapped (0 meta).
[INFO] [2024-05-20 19:23:00] Adding 15694 traits...
[INFO] [2024-05-20 19:23:01] 0 metadata added.
[INFO] [2024-05-20 19:23:01] Adding 0 assocs...
[INFO] [2024-05-20 19:23:01] 0 metadata added.
[INFO] [2024-05-20 19:24:03] Processed 340000/485171 nodes
[INFO] [2024-05-20 19:25:57] 19622 Traits (unfiltered) and 0 associations...
[INFO] [2024-05-20 19:25:57] Building Traits map for 10000 nodes (this can take a while)...
[INFO] [2024-05-20 19:26:07] Mapped 19622 traits (0 meta) for 10000 nodes.
[INFO] [2024-05-20 19:26:07] Building Associations map (this can take a while)...
[INFO] [2024-05-20 19:26:11] Done. 0 assocs mapped (0 meta).
[INFO] [2024-05-20 19:26:11] Adding 19622 traits...
[INFO] [2024-05-20 19:26:12] 0 metadata added.
[INFO] [2024-05-20 19:26:12] Adding 0 assocs...
[INFO] [2024-05-20 19:26:12] 0 metadata added.
[INFO] [2024-05-20 19:27:16] Processed 350000/485171 nodes
[INFO] [2024-05-20 19:29:09] 16950 Traits (unfiltered) and 0 associations...
[INFO] [2024-05-20 19:29:09] Building Traits map for 10000 nodes (this can take a while)...
[INFO] [2024-05-20 19:29:20] Mapped 16950 traits (0 meta) for 10000 nodes.
[INFO] [2024-05-20 19:29:20] Building Associations map (this can take a while)...
[INFO] [2024-05-20 19:29:24] Done. 0 assocs mapped (0 meta).
[INFO] [2024-05-20 19:29:24] Adding 16950 traits...
[INFO] [2024-05-20 19:29:25] 0 metadata added.
[INFO] [2024-05-20 19:29:25] Adding 0 assocs...
[INFO] [2024-05-20 19:29:25] 0 metadata added.
[INFO] [2024-05-20 19:30:27] Processed 360000/485171 nodes
[INFO] [2024-05-20 19:32:23] 14599 Traits (unfiltered) and 0 associations...
[INFO] [2024-05-20 19:32:23] Building Traits map for 10000 nodes (this can take a while)...
[INFO] [2024-05-20 19:32:29] Mapped 14599 traits (0 meta) for 10000 nodes.
[INFO] [2024-05-20 19:32:29] Building Associations map (this can take a while)...
[INFO] [2024-05-20 19:32:32] Done. 0 assocs mapped (0 meta).
[INFO] [2024-05-20 19:32:32] Adding 14599 traits...
[INFO] [2024-05-20 19:32:33] 0 metadata added.
[INFO] [2024-05-20 19:32:33] Adding 0 assocs...
[INFO] [2024-05-20 19:32:33] 0 metadata added.
[INFO] [2024-05-20 19:33:37] Processed 370000/485171 nodes
[INFO] [2024-05-20 19:35:32] 17793 Traits (unfiltered) and 0 associations...
[INFO] [2024-05-20 19:35:32] Building Traits map for 10000 nodes (this can take a while)...
[INFO] [2024-05-20 19:35:40] Mapped 17793 traits (0 meta) for 10000 nodes.
[INFO] [2024-05-20 19:35:40] Building Associations map (this can take a while)...
[INFO] [2024-05-20 19:35:43] Done. 0 assocs mapped (0 meta).
[INFO] [2024-05-20 19:35:43] Adding 17793 traits...
[INFO] [2024-05-20 19:35:44] 0 metadata added.
[INFO] [2024-05-20 19:35:44] Adding 0 assocs...
[INFO] [2024-05-20 19:35:44] 0 metadata added.
[INFO] [2024-05-20 19:36:49] Processed 380000/485171 nodes
[INFO] [2024-05-20 19:38:43] 15849 Traits (unfiltered) and 0 associations...
[INFO] [2024-05-20 19:38:43] Building Traits map for 10000 nodes (this can take a while)...
[INFO] [2024-05-20 19:38:50] Mapped 15849 traits (0 meta) for 10000 nodes.
[INFO] [2024-05-20 19:38:50] Building Associations map (this can take a while)...
[INFO] [2024-05-20 19:38:54] Done. 0 assocs mapped (0 meta).
[INFO] [2024-05-20 19:38:54] Adding 15849 traits...
[INFO] [2024-05-20 19:38:55] 0 metadata added.
[INFO] [2024-05-20 19:38:55] Adding 0 assocs...
[INFO] [2024-05-20 19:38:55] 0 metadata added.
[INFO] [2024-05-20 19:39:57] Processed 390000/485171 nodes
[INFO] [2024-05-20 19:41:52] 16410 Traits (unfiltered) and 0 associations...
[INFO] [2024-05-20 19:41:52] Building Traits map for 10000 nodes (this can take a while)...
[INFO] [2024-05-20 19:42:03] Mapped 16410 traits (0 meta) for 10000 nodes.
[INFO] [2024-05-20 19:42:03] Building Associations map (this can take a while)...
[INFO] [2024-05-20 19:42:07] Done. 0 assocs mapped (0 meta).
[INFO] [2024-05-20 19:42:07] Adding 16410 traits...
[INFO] [2024-05-20 19:42:08] 0 metadata added.
[INFO] [2024-05-20 19:42:08] Adding 0 assocs...
[INFO] [2024-05-20 19:42:08] 0 metadata added.
[INFO] [2024-05-20 19:43:10] Processed 400000/485171 nodes
[INFO] [2024-05-20 19:45:03] 17380 Traits (unfiltered) and 0 associations...
[INFO] [2024-05-20 19:45:03] Building Traits map for 10000 nodes (this can take a while)...
[INFO] [2024-05-20 19:45:15] Mapped 17380 traits (0 meta) for 10000 nodes.
[INFO] [2024-05-20 19:45:15] Building Associations map (this can take a while)...
[INFO] [2024-05-20 19:45:19] Done. 0 assocs mapped (0 meta).
[INFO] [2024-05-20 19:45:19] Adding 17380 traits...
[INFO] [2024-05-20 19:45:19] 0 metadata added.
[INFO] [2024-05-20 19:45:19] Adding 0 assocs...
[INFO] [2024-05-20 19:45:19] 0 metadata added.
[INFO] [2024-05-20 19:46:22] Processed 410000/485171 nodes
[INFO] [2024-05-20 19:48:14] 16623 Traits (unfiltered) and 0 associations...
[INFO] [2024-05-20 19:48:14] Building Traits map for 10000 nodes (this can take a while)...
[INFO] [2024-05-20 19:48:26] Mapped 16623 traits (0 meta) for 10000 nodes.
[INFO] [2024-05-20 19:48:26] Building Associations map (this can take a while)...
[INFO] [2024-05-20 19:48:29] Done. 0 assocs mapped (0 meta).
[INFO] [2024-05-20 19:48:29] Adding 16623 traits...
[INFO] [2024-05-20 19:48:30] 0 metadata added.
[INFO] [2024-05-20 19:48:30] Adding 0 assocs...
[INFO] [2024-05-20 19:48:30] 0 metadata added.
[INFO] [2024-05-20 19:49:32] Processed 420000/485171 nodes
[INFO] [2024-05-20 19:51:29] 17145 Traits (unfiltered) and 0 associations...
[INFO] [2024-05-20 19:51:29] Building Traits map for 10000 nodes (this can take a while)...
[INFO] [2024-05-20 19:51:39] Mapped 17145 traits (0 meta) for 10000 nodes.
[INFO] [2024-05-20 19:51:39] Building Associations map (this can take a while)...
[INFO] [2024-05-20 19:51:42] Done. 0 assocs mapped (0 meta).
[INFO] [2024-05-20 19:51:42] Adding 17145 traits...
[INFO] [2024-05-20 19:51:43] 0 metadata added.
[INFO] [2024-05-20 19:51:43] Adding 0 assocs...
[INFO] [2024-05-20 19:51:43] 0 metadata added.
[INFO] [2024-05-20 19:52:47] Processed 430000/485171 nodes
[INFO] [2024-05-20 19:54:41] 16107 Traits (unfiltered) and 0 associations...
[INFO] [2024-05-20 19:54:41] Building Traits map for 10000 nodes (this can take a while)...
[INFO] [2024-05-20 19:54:50] Mapped 16107 traits (0 meta) for 10000 nodes.
[INFO] [2024-05-20 19:54:50] Building Associations map (this can take a while)...
[INFO] [2024-05-20 19:54:54] Done. 0 assocs mapped (0 meta).
[INFO] [2024-05-20 19:54:54] Adding 16107 traits...
[INFO] [2024-05-20 19:54:55] 0 metadata added.
[INFO] [2024-05-20 19:54:55] Adding 0 assocs...
[INFO] [2024-05-20 19:54:55] 0 metadata added.
[INFO] [2024-05-20 19:55:56] Processed 440000/485171 nodes
[INFO] [2024-05-20 19:57:52] 16210 Traits (unfiltered) and 0 associations...
[INFO] [2024-05-20 19:57:52] Building Traits map for 10000 nodes (this can take a while)...
[INFO] [2024-05-20 19:58:03] Mapped 16210 traits (0 meta) for 10000 nodes.
[INFO] [2024-05-20 19:58:03] Building Associations map (this can take a while)...
[INFO] [2024-05-20 19:58:06] Done. 0 assocs mapped (0 meta).
[INFO] [2024-05-20 19:58:06] Adding 16210 traits...
[INFO] [2024-05-20 19:58:07] 0 metadata added.
[INFO] [2024-05-20 19:58:07] Adding 0 assocs...
[INFO] [2024-05-20 19:58:07] 0 metadata added.
[INFO] [2024-05-20 19:59:09] Processed 450000/485171 nodes
[INFO] [2024-05-20 20:01:05] 15984 Traits (unfiltered) and 0 associations...
[INFO] [2024-05-20 20:01:05] Building Traits map for 10000 nodes (this can take a while)...
[INFO] [2024-05-20 20:01:14] Mapped 15984 traits (0 meta) for 10000 nodes.
[INFO] [2024-05-20 20:01:14] Building Associations map (this can take a while)...
[INFO] [2024-05-20 20:01:18] Done. 0 assocs mapped (0 meta).
[INFO] [2024-05-20 20:01:18] Adding 15984 traits...
[INFO] [2024-05-20 20:01:19] 0 metadata added.
[INFO] [2024-05-20 20:01:19] Adding 0 assocs...
[INFO] [2024-05-20 20:01:19] 0 metadata added.
[INFO] [2024-05-20 20:02:26] Processed 460000/485171 nodes
[INFO] [2024-05-20 20:04:24] 16861 Traits (unfiltered) and 0 associations...
[INFO] [2024-05-20 20:04:24] Building Traits map for 10000 nodes (this can take a while)...
[INFO] [2024-05-20 20:04:31] Mapped 16861 traits (0 meta) for 10000 nodes.
[INFO] [2024-05-20 20:04:31] Building Associations map (this can take a while)...
[INFO] [2024-05-20 20:04:35] Done. 0 assocs mapped (0 meta).
[INFO] [2024-05-20 20:04:35] Adding 16861 traits...
[INFO] [2024-05-20 20:04:36] 0 metadata added.
[INFO] [2024-05-20 20:04:36] Adding 0 assocs...
[INFO] [2024-05-20 20:04:36] 0 metadata added.
[INFO] [2024-05-20 20:05:40] Processed 470000/485171 nodes
[INFO] [2024-05-20 20:07:38] 17525 Traits (unfiltered) and 0 associations...
[INFO] [2024-05-20 20:07:38] Building Traits map for 10000 nodes (this can take a while)...
[INFO] [2024-05-20 20:07:50] Mapped 17525 traits (0 meta) for 10000 nodes.
[INFO] [2024-05-20 20:07:50] Building Associations map (this can take a while)...
[INFO] [2024-05-20 20:07:54] Done. 0 assocs mapped (0 meta).
[INFO] [2024-05-20 20:07:54] Adding 17525 traits...
[INFO] [2024-05-20 20:07:55] 0 metadata added.
[INFO] [2024-05-20 20:07:55] Adding 0 assocs...
[INFO] [2024-05-20 20:07:55] 0 metadata added.
[INFO] [2024-05-20 20:09:01] Processed 480000/485171 nodes
[INFO] [2024-05-20 20:09:18] 8497 Traits (unfiltered) and 0 associations...
[INFO] [2024-05-20 20:09:18] Building Traits map for 5171 nodes (this can take a while)...
[INFO] [2024-05-20 20:09:21] Mapped 8497 traits (0 meta) for 5171 nodes.
[INFO] [2024-05-20 20:09:21] Building Associations map (this can take a while)...
[INFO] [2024-05-20 20:09:25] Done. 0 assocs mapped (0 meta).
[INFO] [2024-05-20 20:09:25] Adding 8497 traits...
[INFO] [2024-05-20 20:09:26] 0 metadata added.
[INFO] [2024-05-20 20:09:26] Adding 0 assocs...
[INFO] [2024-05-20 20:09:26] 0 metadata added.
[INFO] [2024-05-20 20:10:29] Processed 485171/485171 nodes
[INFO] [2024-05-20 20:10:29] Average Time: 100.793
[INFO] [2024-05-20 20:10:29] Total Time: 2h40m2s
[INFO] [2024-05-20 20:10:29] last 3 / first 3: 0.92
[INFO] [2024-05-20 20:10:29] Std.Dev: 4.565; Max: 107.24
[STOP] [2024-05-20 20:10:29] overall_tsv_creation
[INFO] [2024-05-20 20:10:29] Done. Check your files:
[INFO] [2024-05-20 20:10:29] (485171 lines) /app/public/data/i_nat_dat_covera/publish_nodes.tsv
[INFO] [2024-05-20 20:10:29] (5367257 lines) /app/public/data/i_nat_dat_covera/publish_node_ancestors.tsv
[INFO] [2024-05-20 20:10:29] (485171 lines) /app/public/data/i_nat_dat_covera/publish_scientific_names.tsv
[INFO] [2024-05-20 20:10:29] (811042 lines) /app/public/data/i_nat_dat_covera/publish_traits.tsv
[INFO] [2024-05-20 20:10:29] (1 lines) /app/public/data/i_nat_dat_covera/publish_metadata.tsv
[STOP] [2024-05-20 20:10:30] complete_harvest_instance
[START] [2024-05-20 20:10:30] completed
[STOP] [2024-05-20 20:10:30] completed
[STOP] [2024-05-20 20:10:30] logged process, took 26044.47
Latest Process

20 May 12:56 EXITED currently processing 0