Stage:
completed
Fetched:
18 Mar 21:34
Validated:
18 Mar 21:51
Deltas Created
18 Mar 21:52
Units Normalized:
22 Mar 22:10
Ancestry Built:
19 Mar 03:35
Nodes Matched:
22 Mar 22:02
Names Parsed:
19 Mar 03:41
New Models Stored:
19 Mar 02:53
Indexed:
22 Mar 22:10
Completed:
23 Mar 01:29
Time to Harvest:
7 minutes
Harvesting Log
(2608 lines)
(showing only the last 1000 lines, see /app/public/data/Globi/process.log for the full file)
[INFO] [2024-03-19 02:41:55] Storing 10000 AssocsReferences (5299998/2650000/2980196)
[INFO] [2024-03-19 02:41:56] Storing 10000 Assocs (5299998/2650000/2980196)
[INFO] [2024-03-19 02:42:14] Storing 10000 AssocsReferences (5319998/2660000/2980196)
[INFO] [2024-03-19 02:42:15] Storing 10000 Assocs (5319998/2660000/2980196)
[INFO] [2024-03-19 02:42:34] Storing 10000 AssocsReferences (5339998/2670000/2980196)
[INFO] [2024-03-19 02:42:34] Storing 10000 Assocs (5339998/2670000/2980196)
[INFO] [2024-03-19 02:42:53] Storing 10000 AssocsReferences (5359998/2680000/2980196)
[INFO] [2024-03-19 02:42:54] Storing 10000 Assocs (5359998/2680000/2980196)
[INFO] [2024-03-19 02:43:12] Storing 10000 AssocsReferences (5379998/2690000/2980196)
[INFO] [2024-03-19 02:43:13] Storing 10000 Assocs (5379998/2690000/2980196)
[INFO] [2024-03-19 02:43:32] Storing 10000 AssocsReferences (5399998/2700000/2980196)
[INFO] [2024-03-19 02:43:32] Storing 10000 Assocs (5399998/2700000/2980196)
[INFO] [2024-03-19 02:43:51] Storing 10000 AssocsReferences (5419998/2710000/2980196)
[INFO] [2024-03-19 02:43:52] Storing 10000 Assocs (5419998/2710000/2980196)
[INFO] [2024-03-19 02:44:10] Storing 10000 AssocsReferences (5439998/2720000/2980196)
[INFO] [2024-03-19 02:44:11] Storing 10000 Assocs (5439998/2720000/2980196)
[INFO] [2024-03-19 02:44:30] Storing 10000 AssocsReferences (5459998/2730000/2980196)
[INFO] [2024-03-19 02:44:31] Storing 10000 Assocs (5459998/2730000/2980196)
[INFO] [2024-03-19 02:44:50] Storing 10000 AssocsReferences (5479998/2740000/2980196)
[INFO] [2024-03-19 02:44:51] Storing 10000 Assocs (5479998/2740000/2980196)
[INFO] [2024-03-19 02:45:10] Storing 10000 AssocsReferences (5499998/2750000/2980196)
[INFO] [2024-03-19 02:45:10] Storing 10000 Assocs (5499998/2750000/2980196)
[INFO] [2024-03-19 02:45:29] Storing 10000 AssocsReferences (5519998/2760000/2980196)
[INFO] [2024-03-19 02:45:30] Storing 10000 Assocs (5519998/2760000/2980196)
[INFO] [2024-03-19 02:45:49] Storing 10000 AssocsReferences (5539998/2770000/2980196)
[INFO] [2024-03-19 02:45:50] Storing 10000 Assocs (5539998/2770000/2980196)
[INFO] [2024-03-19 02:46:09] Storing 10000 AssocsReferences (5559998/2780000/2980196)
[INFO] [2024-03-19 02:46:10] Storing 10000 Assocs (5559998/2780000/2980196)
[INFO] [2024-03-19 02:46:29] Storing 10000 AssocsReferences (5579998/2790000/2980196)
[INFO] [2024-03-19 02:46:30] Storing 10000 Assocs (5579998/2790000/2980196)
[INFO] [2024-03-19 02:46:49] Storing 10000 AssocsReferences (5599998/2800000/2980196)
[INFO] [2024-03-19 02:46:49] Storing 10000 Assocs (5599998/2800000/2980196)
[INFO] [2024-03-19 02:47:09] Storing 10000 AssocsReferences (5619998/2810000/2980196)
[INFO] [2024-03-19 02:47:10] Storing 10000 Assocs (5619998/2810000/2980196)
[INFO] [2024-03-19 02:47:29] Storing 10000 AssocsReferences (5639998/2820000/2980196)
[INFO] [2024-03-19 02:47:30] Storing 10000 Assocs (5639998/2820000/2980196)
[INFO] [2024-03-19 02:47:49] Storing 10000 AssocsReferences (5659998/2830000/2980196)
[INFO] [2024-03-19 02:47:50] Storing 10000 Assocs (5659998/2830000/2980196)
[INFO] [2024-03-19 02:48:09] Storing 10000 AssocsReferences (5679998/2840000/2980196)
[INFO] [2024-03-19 02:48:10] Storing 10000 Assocs (5679998/2840000/2980196)
[INFO] [2024-03-19 02:48:29] Storing 10000 AssocsReferences (5699998/2850000/2980196)
[INFO] [2024-03-19 02:48:30] Storing 10000 Assocs (5699998/2850000/2980196)
[INFO] [2024-03-19 02:48:50] Storing 10000 AssocsReferences (5719998/2860000/2980196)
[INFO] [2024-03-19 02:48:51] Storing 10000 Assocs (5719998/2860000/2980196)
[INFO] [2024-03-19 02:49:10] Storing 10000 AssocsReferences (5739998/2870000/2980196)
[INFO] [2024-03-19 02:49:11] Storing 10000 Assocs (5739998/2870000/2980196)
[INFO] [2024-03-19 02:49:30] Storing 10000 AssocsReferences (5759998/2880000/2980196)
[INFO] [2024-03-19 02:49:31] Storing 10000 Assocs (5759998/2880000/2980196)
[INFO] [2024-03-19 02:49:51] Storing 10000 AssocsReferences (5779998/2890000/2980196)
[INFO] [2024-03-19 02:49:51] Storing 10000 Assocs (5779998/2890000/2980196)
[INFO] [2024-03-19 02:50:11] Storing 10000 AssocsReferences (5799998/2900000/2980196)
[INFO] [2024-03-19 02:50:12] Storing 10000 Assocs (5799998/2900000/2980196)
[INFO] [2024-03-19 02:50:32] Storing 10000 AssocsReferences (5819998/2910000/2980196)
[INFO] [2024-03-19 02:50:32] Storing 10000 Assocs (5819998/2910000/2980196)
[INFO] [2024-03-19 02:50:52] Storing 10000 AssocsReferences (5839998/2920000/2980196)
[INFO] [2024-03-19 02:50:53] Storing 10000 Assocs (5839998/2920000/2980196)
[INFO] [2024-03-19 02:51:13] Storing 10000 AssocsReferences (5859998/2930000/2980196)
[INFO] [2024-03-19 02:51:14] Storing 10000 Assocs (5859998/2930000/2980196)
[INFO] [2024-03-19 02:51:34] Storing 10000 AssocsReferences (5879998/2940000/2980196)
[INFO] [2024-03-19 02:51:34] Storing 10000 Assocs (5879998/2940000/2980196)
[INFO] [2024-03-19 02:51:54] Storing 10000 AssocsReferences (5899998/2950000/2980196)
[INFO] [2024-03-19 02:51:55] Storing 10000 Assocs (5899998/2950000/2980196)
[INFO] [2024-03-19 02:52:15] Storing 10000 AssocsReferences (5919998/2960000/2980196)
[INFO] [2024-03-19 02:52:16] Storing 10000 Assocs (5919998/2960000/2980196)
[INFO] [2024-03-19 02:52:36] Storing 10000 AssocsReferences (5939998/2970000/2980196)
[INFO] [2024-03-19 02:52:36] Storing 10000 Assocs (5939998/2970000/2980196)
[INFO] [2024-03-19 02:52:56] Storing 10000 AssocsReferences (5959998/2980000/2980196)
[INFO] [2024-03-19 02:52:57] Storing 10000 Assocs (5959998/2980000/2980196)
[INFO] [2024-03-19 02:53:13] Storing 195 AssocsReferences (5960388/2980194/2980196)
[INFO] [2024-03-19 02:53:14] Storing 195 Assocs (5960388/2980194/2980196)
[STOP] [2024-03-19 02:53:14] parse_diff_and_store
[START] [2024-03-19 02:53:14] resolve_keys
[2024-03-19 02:55:45] Resolving downloaded urls (this is not actually downloading them yet)
[INFO] [2024-03-19 02:55:57] Occurrences to nodes (through scientific_names)...
[INFO] [2024-03-19 03:01:13] traits to occurrences...
[INFO] [2024-03-19 03:01:13] traits to nodes (through occurrences)...
[INFO] [2024-03-19 03:01:13] Traits to sex term...
[INFO] [2024-03-19 03:01:13] Traits to lifestage term...
[INFO] [2024-03-19 03:01:13] MetaTraits to traits...
[INFO] [2024-03-19 03:01:13] MetaTraits (simple, measurement row refers to parent) to traits...
[INFO] [2024-03-19 03:01:13] Assocs to occurrences...
[INFO] [2024-03-19 03:07:10] Assocs to nodes...
[INFO] [2024-03-19 03:12:41] Assoc to sex term...
[INFO] [2024-03-19 03:12:53] Assoc to lifestage term...
[INFO] [2024-03-19 03:13:06] MetaAssoc to assocs...
[STOP] [2024-03-19 03:17:57] resolve_keys
[START] [2024-03-19 03:17:57] hold_for_later_1
[STOP] [2024-03-19 03:17:57] hold_for_later_1
[START] [2024-03-19 03:17:57] hold_for_later_2
[STOP] [2024-03-19 03:17:57] hold_for_later_2
[START] [2024-03-19 03:17:57] resolve_missing_parents
[STOP] [2024-03-19 03:18:04] resolve_missing_parents
[START] [2024-03-19 03:18:04] rebuild_nodes
[START] [2024-03-19 03:18:04] Flattener#flatten
[START] [2024-03-19 03:18:04] Flattener#study_resource
[START] [2024-03-19 03:18:35] Flattener#build_ancestry
[STOP] [2024-03-19 03:28:50] Flattener#build_ancestry
[INFO] [2024-03-19 03:28:50] 496866 ancestry keys
[START] [2024-03-19 03:28:50] build_node_ancestors
[INFO] [2024-03-19 03:28:50] old ancestors deleted.
[STOP] [2024-03-19 03:33:37] build_node_ancestors
[START] [2024-03-19 03:33:38] Flattener#propagate_ancestor_ids
[STOP] [2024-03-19 03:35:29] Flattener#propagate_ancestor_ids
[STOP] [2024-03-19 03:35:29] Flattener#flatten
[STOP] [2024-03-19 03:35:29] rebuild_nodes
[START] [2024-03-19 03:35:29] resolve_missing_media_owners
[STOP] [2024-03-19 03:35:29] resolve_missing_media_owners
[START] [2024-03-19 03:35:29] sanitize_media_verbatims
[STOP] [2024-03-19 03:35:29] sanitize_media_verbatims
[START] [2024-03-19 03:35:29] queue_downloads
[STOP] [2024-03-19 03:35:29] queue_downloads
[START] [2024-03-19 03:35:29] parse_names
[WARN] [2024-03-19 03:35:31] I see 496866 names which still need to be parsed.
[WARN] [2024-03-19 03:35:32] Names to parse: 10000 formatted: 10000 learned: 9507 parsed: 10000
[WARN] [2024-03-19 03:35:40] Names to parse: 10000 formatted: 10000 learned: 9496 parsed: 10000
[WARN] [2024-03-19 03:35:47] Names to parse: 10000 formatted: 10000 learned: 8201 parsed: 10000
[WARN] [2024-03-19 03:35:57] Names to parse: 10000 formatted: 10000 learned: 9590 parsed: 10000
[WARN] [2024-03-19 03:36:04] Names to parse: 10000 formatted: 10000 learned: 9244 parsed: 10000
[WARN] [2024-03-19 03:36:11] Names to parse: 10000 formatted: 10000 learned: 8939 parsed: 10000
[WARN] [2024-03-19 03:36:20] Names to parse: 10000 formatted: 10000 learned: 9236 parsed: 10000
[WARN] [2024-03-19 03:36:27] Names to parse: 10000 formatted: 10000 learned: 8942 parsed: 10000
[WARN] [2024-03-19 03:36:35] Names to parse: 10000 formatted: 10000 learned: 9272 parsed: 10000
[WARN] [2024-03-19 03:36:43] Names to parse: 10000 formatted: 10000 learned: 9401 parsed: 10000
[WARN] [2024-03-19 03:36:50] Names to parse: 10000 formatted: 10000 learned: 9674 parsed: 10000
[WARN] [2024-03-19 03:36:58] Names to parse: 10000 formatted: 10000 learned: 9311 parsed: 10000
[WARN] [2024-03-19 03:37:06] Names to parse: 10000 formatted: 10000 learned: 9272 parsed: 10000
[WARN] [2024-03-19 03:37:13] Names to parse: 10000 formatted: 10000 learned: 10000 parsed: 10000
[WARN] [2024-03-19 03:37:21] Names to parse: 10000 formatted: 10000 learned: 9935 parsed: 10000
[WARN] [2024-03-19 03:37:28] Names to parse: 10000 formatted: 10000 learned: 9204 parsed: 10000
[WARN] [2024-03-19 03:37:35] Names to parse: 10000 formatted: 10000 learned: 9758 parsed: 10000
[WARN] [2024-03-19 03:37:43] Names to parse: 10000 formatted: 10000 learned: 9344 parsed: 10000
[WARN] [2024-03-19 03:37:50] Names to parse: 10000 formatted: 10000 learned: 9611 parsed: 10000
[WARN] [2024-03-19 03:37:58] Names to parse: 10000 formatted: 10000 learned: 8790 parsed: 10000
[WARN] [2024-03-19 03:38:06] Names to parse: 10000 formatted: 10000 learned: 9497 parsed: 10000
[WARN] [2024-03-19 03:38:13] Names to parse: 10000 formatted: 10000 learned: 9450 parsed: 10000
[WARN] [2024-03-19 03:38:21] Names to parse: 10000 formatted: 10000 learned: 9431 parsed: 10000
[WARN] [2024-03-19 03:38:28] Names to parse: 10000 formatted: 10000 learned: 9584 parsed: 10000
[WARN] [2024-03-19 03:38:36] Names to parse: 10000 formatted: 10000 learned: 9268 parsed: 10000
[WARN] [2024-03-19 03:38:44] Names to parse: 10000 formatted: 10000 learned: 9935 parsed: 10000
[WARN] [2024-03-19 03:38:50] Names to parse: 10000 formatted: 10000 learned: 9542 parsed: 10000
[WARN] [2024-03-19 03:38:58] Names to parse: 10000 formatted: 10000 learned: 8547 parsed: 10000
[WARN] [2024-03-19 03:39:06] Names to parse: 10000 formatted: 10000 learned: 9649 parsed: 10000
[WARN] [2024-03-19 03:39:14] Names to parse: 10000 formatted: 10000 learned: 9905 parsed: 10000
[WARN] [2024-03-19 03:39:21] Names to parse: 10000 formatted: 10000 learned: 9928 parsed: 10000
[WARN] [2024-03-19 03:39:28] Names to parse: 10000 formatted: 10000 learned: 9924 parsed: 10000
[WARN] [2024-03-19 03:39:35] Names to parse: 10000 formatted: 10000 learned: 9650 parsed: 10000
[WARN] [2024-03-19 03:39:42] Names to parse: 10000 formatted: 10000 learned: 9750 parsed: 10000
[WARN] [2024-03-19 03:39:49] Names to parse: 10000 formatted: 10000 learned: 9737 parsed: 10000
[WARN] [2024-03-19 03:39:57] Names to parse: 10000 formatted: 10000 learned: 9845 parsed: 10000
[WARN] [2024-03-19 03:40:05] Names to parse: 10000 formatted: 10000 learned: 9328 parsed: 10000
[WARN] [2024-03-19 03:40:12] Names to parse: 10000 formatted: 10000 learned: 9356 parsed: 10000
[WARN] [2024-03-19 03:40:20] Names to parse: 10000 formatted: 10000 learned: 9851 parsed: 10000
[WARN] [2024-03-19 03:40:27] Names to parse: 10000 formatted: 10000 learned: 9778 parsed: 10000
[WARN] [2024-03-19 03:40:34] Names to parse: 10000 formatted: 10000 learned: 9857 parsed: 10000
[WARN] [2024-03-19 03:40:41] Names to parse: 10000 formatted: 10000 learned: 9922 parsed: 10000
[WARN] [2024-03-19 03:40:48] Names to parse: 10000 formatted: 10000 learned: 9943 parsed: 10000
[WARN] [2024-03-19 03:40:55] Names to parse: 10000 formatted: 10000 learned: 9934 parsed: 10000
[WARN] [2024-03-19 03:41:02] Names to parse: 10000 formatted: 10000 learned: 9849 parsed: 10000
[WARN] [2024-03-19 03:41:09] Names to parse: 10000 formatted: 10000 learned: 9775 parsed: 10000
[WARN] [2024-03-19 03:41:16] Names to parse: 10000 formatted: 10000 learned: 9360 parsed: 10000
[WARN] [2024-03-19 03:41:24] Names to parse: 10000 formatted: 10000 learned: 9876 parsed: 10000
[WARN] [2024-03-19 03:41:31] Names to parse: 10000 formatted: 10000 learned: 9991 parsed: 10000
[WARN] [2024-03-19 03:41:37] Names to parse: 6866 formatted: 6866 learned: 6677 parsed: 6866
[STOP] [2024-03-19 03:41:44] parse_names
[START] [2024-03-19 03:41:44] denormalize_canonical_names_to_nodes
[STOP] [2024-03-19 03:42:16] denormalize_canonical_names_to_nodes
[START] [2024-03-19 03:42:16] match_nodes
[START] [2024-03-19 03:42:17] map_all_nodes_to_pages
[WARN] [2024-03-19 06:47:08] ActiveRecord::StatementInvalid error mapping node 148324619
[WARN] [2024-03-19 06:47:08] ActiveRecord::StatementInvalid error mapping node 148324618
[WARN] [2024-03-19 06:47:08] ActiveRecord::StatementInvalid error mapping node 148305125
[WARN] [2024-03-19 06:47:08] ActiveRecord::StatementInvalid error mapping node 148212178
[WARN] [2024-03-19 06:47:08] ActiveRecord::StatementInvalid error mapping node 148212118
[WARN] [2024-03-19 06:47:08] ActiveRecord::StatementInvalid error mapping node 148212117
[WARN] [2024-03-19 06:47:08] ActiveRecord::StatementInvalid error mapping node 148198098
[STOP] [2024-03-19 06:47:08] map_all_nodes_to_pages
[INFO] [2024-03-19 06:47:08] 18296 Unmatched nodes (of 496866)! That's too many to output. Full list in /app/public/data/Globi/unmatched_nodes.txt ; First 10: Canonical: Cryniferoides leucogaster; Node#148198081; ResourceID: 00912366-bf69-4a85-96e7-2addb0e243d5; Canonical: Ornithobius atromarginatus; Node#148198082; ResourceID: 00c6dd20-2925-4d41-8094-9b5cf1276fab; Canonical: Noctuelita florialis; Node#148198083; ResourceID: 00d1764b-3ba5-4dbb-a8c5-445ed6a6b4e2; Canonical: Heterodoxus spinigerum; Node#148198084; ResourceID: 01624e88-1ead-4551-b4a8-c681d95c2163; Canonical: Ricinus pronotus pronotus; Node#148198085; ResourceID: 02b32798-5694-423c-9e05-a9ccee425442; Canonical: Stoeberhinus testacea; Node#148198086; ResourceID: 03ee48c8-cc3f-4e92-bfb8-b8f1d7826dc4; Canonical: Craspedorrhynchus triangulifer; Node#148198087; ResourceID: 06d4fc54-bdd8-412f-91d4-5c26caa1ce8c; Canonical: Picicola marginatus; Node#148198088; ResourceID: 076c03dd-2aa7-465e-b59f-fb468fc6d86c; Canonical: Idea agarmarschana; Node#148198089; ResourceID: 085f4f39-a12a-4ada-9d61-90706fe5da1b; Canonical: Ctenomys chasiquensis; Node#148198090; ResourceID: 0a1f330e-61bf-4b86-973f-d049741a2456
[START] [2024-03-19 06:47:08] update_nodes
[STOP] [2024-03-19 06:47:09] match_nodes
[STOP] [2024-03-19 06:47:09] logged process, took 33181.03
[INFO] [2024-03-22 18:16:06] ## HARVEST: type = resume_harvest
[START] [2024-03-22 18:16:10] logged process: 320daa964f6816b4527acd69d8cac2e18b1e7bae Resource#remove_media_from_disk
[INFO] [2024-03-22 18:16:10] Already completed stage create_harvest_instance, skipping...
[INFO] [2024-03-22 18:16:10] Already completed stage fetch_files, skipping...
[INFO] [2024-03-22 18:16:10] Already completed stage validate_each_file, skipping...
[INFO] [2024-03-22 18:16:10] Already completed stage convert_to_csv, skipping...
[INFO] [2024-03-22 18:16:10] Already completed stage calculate_delta, skipping...
[INFO] [2024-03-22 18:16:10] Already completed stage parse_diff_and_store, skipping...
[INFO] [2024-03-22 18:16:10] Already completed stage resolve_keys, skipping...
[INFO] [2024-03-22 18:16:10] Already completed stage hold_for_later_1, skipping...
[INFO] [2024-03-22 18:16:10] Already completed stage hold_for_later_2, skipping...
[INFO] [2024-03-22 18:16:10] Already completed stage resolve_missing_parents, skipping...
[INFO] [2024-03-22 18:16:10] Already completed stage rebuild_nodes, skipping...
[INFO] [2024-03-22 18:16:10] Already completed stage resolve_missing_media_owners, skipping...
[INFO] [2024-03-22 18:16:10] Already completed stage sanitize_media_verbatims, skipping...
[INFO] [2024-03-22 18:16:10] Already completed stage queue_downloads, skipping...
[INFO] [2024-03-22 18:16:10] Already completed stage parse_names, skipping...
[INFO] [2024-03-22 18:16:10] Already completed stage denormalize_canonical_names_to_nodes, skipping...
[START] [2024-03-22 18:16:10] match_nodes
[START] [2024-03-22 18:16:13] map_all_nodes_to_pages
[STOP] [2024-03-22 22:02:44] map_all_nodes_to_pages
[INFO] [2024-03-22 22:02:44] 57021 Unmatched nodes (of 496866)! That's too many to output. Full list in /app/public/data/Globi/unmatched_nodes.txt ; First 10: Canonical: Cryniferoides leucogaster; Node#148198081; ResourceID: 00912366-bf69-4a85-96e7-2addb0e243d5; Canonical: Ornithobius atromarginatus; Node#148198082; ResourceID: 00c6dd20-2925-4d41-8094-9b5cf1276fab; Canonical: Noctuelita florialis; Node#148198083; ResourceID: 00d1764b-3ba5-4dbb-a8c5-445ed6a6b4e2; Canonical: Heterodoxus spinigerum; Node#148198084; ResourceID: 01624e88-1ead-4551-b4a8-c681d95c2163; Canonical: Ricinus pronotus pronotus; Node#148198085; ResourceID: 02b32798-5694-423c-9e05-a9ccee425442; Canonical: Stoeberhinus testacea; Node#148198086; ResourceID: 03ee48c8-cc3f-4e92-bfb8-b8f1d7826dc4; Canonical: Craspedorrhynchus triangulifer; Node#148198087; ResourceID: 06d4fc54-bdd8-412f-91d4-5c26caa1ce8c; Canonical: Picicola marginatus; Node#148198088; ResourceID: 076c03dd-2aa7-465e-b59f-fb468fc6d86c; Canonical: Idea agarmarschana; Node#148198089; ResourceID: 085f4f39-a12a-4ada-9d61-90706fe5da1b; Canonical: Ctenomys chasiquensis; Node#148198090; ResourceID: 0a1f330e-61bf-4b86-973f-d049741a2456
[START] [2024-03-22 22:02:44] update_nodes
[STOP] [2024-03-22 22:02:47] update_nodes
[STOP] [2024-03-22 22:02:47] match_nodes
[START] [2024-03-22 22:02:47] reindex_search
[STOP] [2024-03-22 22:10:47] reindex_search
[START] [2024-03-22 22:10:47] normalize_units
[STOP] [2024-03-22 22:10:47] normalize_units
[START] [2024-03-22 22:10:47] calculate_statistics
[INFO] [2024-03-22 22:12:16] Duplicate page_id count: 482516
[STOP] [2024-03-22 22:12:23] calculate_statistics
[START] [2024-03-22 22:12:23] complete_harvest_instance
[START] [2024-03-22 22:12:23] overall_tsv_creation
[INFO] [2024-03-22 22:12:23] Exporting 496866 nodes as TSV in batches of 10000...
[INFO] [2024-03-22 22:12:23] Processing group of 496866 in 50 batches of 10000
[INFO] [2024-03-22 22:14:01] 0 Traits (unfiltered) and 7736 associations...
[INFO] [2024-03-22 22:14:01] Building Traits map for 10000 nodes (this can take a while)...
[INFO] [2024-03-22 22:14:01] Mapped 0 traits (0 meta) for 10000 nodes.
[INFO] [2024-03-22 22:14:01] Building Associations map (this can take a while)...
[INFO] [2024-03-22 22:14:12] Done. 7736 assocs mapped (0 meta).
[INFO] [2024-03-22 22:14:12] Adding 0 traits...
[INFO] [2024-03-22 22:14:12] 0 metadata added.
[INFO] [2024-03-22 22:14:12] Adding 7736 assocs...
[INFO] [2024-03-22 22:14:14] 7736 metadata added.
[INFO] [2024-03-22 22:15:33] Processed 10000/496866 nodes
[INFO] [2024-03-22 22:17:20] 0 Traits (unfiltered) and 129548 associations...
[INFO] [2024-03-22 22:17:20] Building Traits map for 10000 nodes (this can take a while)...
[INFO] [2024-03-22 22:17:20] Mapped 0 traits (0 meta) for 10000 nodes.
[INFO] [2024-03-22 22:17:20] Building Associations map (this can take a while)...
[INFO] [2024-03-22 22:17:29] 10000 assocs mapped (0 meta)...
[INFO] [2024-03-22 22:17:37] 20000 assocs mapped (0 meta)...
[INFO] [2024-03-22 22:17:43] 30000 assocs mapped (0 meta)...
[INFO] [2024-03-22 22:17:52] 40000 assocs mapped (0 meta)...
[INFO] [2024-03-22 22:18:00] 50000 assocs mapped (0 meta)...
[INFO] [2024-03-22 22:18:10] 60000 assocs mapped (0 meta)...
[INFO] [2024-03-22 22:18:16] 70000 assocs mapped (0 meta)...
[INFO] [2024-03-22 22:18:27] 80000 assocs mapped (0 meta)...
[INFO] [2024-03-22 22:18:35] 90000 assocs mapped (0 meta)...
[INFO] [2024-03-22 22:18:57] 100000 assocs mapped (0 meta)...
[INFO] [2024-03-22 22:19:07] 110000 assocs mapped (0 meta)...
[INFO] [2024-03-22 22:19:16] 120000 assocs mapped (0 meta)...
[INFO] [2024-03-22 22:19:28] Done. 129548 assocs mapped (0 meta).
[INFO] [2024-03-22 22:19:28] Adding 0 traits...
[INFO] [2024-03-22 22:19:28] 0 metadata added.
[INFO] [2024-03-22 22:19:28] Adding 129548 assocs...
[INFO] [2024-03-22 22:19:48] 129548 metadata added.
[INFO] [2024-03-22 22:21:17] Processed 20000/496866 nodes
[INFO] [2024-03-22 22:23:15] 0 Traits (unfiltered) and 29958 associations...
[INFO] [2024-03-22 22:23:15] Building Traits map for 10000 nodes (this can take a while)...
[INFO] [2024-03-22 22:23:15] Mapped 0 traits (0 meta) for 10000 nodes.
[INFO] [2024-03-22 22:23:15] Building Associations map (this can take a while)...
[INFO] [2024-03-22 22:23:25] 10000 assocs mapped (0 meta)...
[INFO] [2024-03-22 22:23:31] 20000 assocs mapped (0 meta)...
[INFO] [2024-03-22 22:23:38] Done. 29958 assocs mapped (0 meta).
[INFO] [2024-03-22 22:23:38] Adding 0 traits...
[INFO] [2024-03-22 22:23:38] 0 metadata added.
[INFO] [2024-03-22 22:23:38] Adding 29958 assocs...
[INFO] [2024-03-22 22:23:42] 29958 metadata added.
[INFO] [2024-03-22 22:24:50] Processed 30000/496866 nodes
[INFO] [2024-03-22 22:26:42] 0 Traits (unfiltered) and 146380 associations...
[INFO] [2024-03-22 22:26:42] Building Traits map for 10000 nodes (this can take a while)...
[INFO] [2024-03-22 22:26:42] Mapped 0 traits (0 meta) for 10000 nodes.
[INFO] [2024-03-22 22:26:42] Building Associations map (this can take a while)...
[INFO] [2024-03-22 22:26:47] 10000 assocs mapped (0 meta)...
[INFO] [2024-03-22 22:26:55] 20000 assocs mapped (0 meta)...
[INFO] [2024-03-22 22:27:00] 30000 assocs mapped (0 meta)...
[INFO] [2024-03-22 22:27:09] 40000 assocs mapped (0 meta)...
[INFO] [2024-03-22 22:27:14] 50000 assocs mapped (0 meta)...
[INFO] [2024-03-22 22:27:23] 60000 assocs mapped (0 meta)...
[INFO] [2024-03-22 22:27:33] 70000 assocs mapped (0 meta)...
[INFO] [2024-03-22 22:27:38] 80000 assocs mapped (0 meta)...
[INFO] [2024-03-22 22:27:48] 90000 assocs mapped (0 meta)...
[INFO] [2024-03-22 22:27:54] 100000 assocs mapped (0 meta)...
[INFO] [2024-03-22 22:28:04] 110000 assocs mapped (0 meta)...
[INFO] [2024-03-22 22:28:11] 120000 assocs mapped (0 meta)...
[INFO] [2024-03-22 22:28:23] 130000 assocs mapped (0 meta)...
[INFO] [2024-03-22 22:28:32] 140000 assocs mapped (0 meta)...
[INFO] [2024-03-22 22:28:40] Done. 146380 assocs mapped (0 meta).
[INFO] [2024-03-22 22:28:40] Adding 0 traits...
[INFO] [2024-03-22 22:28:40] 0 metadata added.
[INFO] [2024-03-22 22:28:40] Adding 146380 assocs...
[INFO] [2024-03-22 22:28:59] 146380 metadata added.
[INFO] [2024-03-22 22:30:33] Processed 40000/496866 nodes
[INFO] [2024-03-22 22:32:30] 0 Traits (unfiltered) and 109383 associations...
[INFO] [2024-03-22 22:32:30] Building Traits map for 10000 nodes (this can take a while)...
[INFO] [2024-03-22 22:32:31] Mapped 0 traits (0 meta) for 10000 nodes.
[INFO] [2024-03-22 22:32:31] Building Associations map (this can take a while)...
[INFO] [2024-03-22 22:32:39] 10000 assocs mapped (0 meta)...
[INFO] [2024-03-22 22:32:46] 20000 assocs mapped (0 meta)...
[INFO] [2024-03-22 22:32:55] 30000 assocs mapped (0 meta)...
[INFO] [2024-03-22 22:33:00] 40000 assocs mapped (0 meta)...
[INFO] [2024-03-22 22:33:09] 50000 assocs mapped (0 meta)...
[INFO] [2024-03-22 22:33:14] 60000 assocs mapped (0 meta)...
[INFO] [2024-03-22 22:33:24] 70000 assocs mapped (0 meta)...
[INFO] [2024-03-22 22:33:33] 80000 assocs mapped (0 meta)...
[INFO] [2024-03-22 22:33:42] 90000 assocs mapped (0 meta)...
[INFO] [2024-03-22 22:33:53] 100000 assocs mapped (0 meta)...
[INFO] [2024-03-22 22:33:58] Done. 109383 assocs mapped (0 meta).
[INFO] [2024-03-22 22:33:58] Adding 0 traits...
[INFO] [2024-03-22 22:33:58] 0 metadata added.
[INFO] [2024-03-22 22:33:58] Adding 109383 assocs...
[INFO] [2024-03-22 22:34:17] 109383 metadata added.
[INFO] [2024-03-22 22:35:35] Processed 50000/496866 nodes
[INFO] [2024-03-22 22:37:35] 0 Traits (unfiltered) and 66419 associations...
[INFO] [2024-03-22 22:37:35] Building Traits map for 10000 nodes (this can take a while)...
[INFO] [2024-03-22 22:37:35] Mapped 0 traits (0 meta) for 10000 nodes.
[INFO] [2024-03-22 22:37:35] Building Associations map (this can take a while)...
[INFO] [2024-03-22 22:37:44] 10000 assocs mapped (0 meta)...
[INFO] [2024-03-22 22:37:50] 20000 assocs mapped (0 meta)...
[INFO] [2024-03-22 22:37:59] 30000 assocs mapped (0 meta)...
[INFO] [2024-03-22 22:38:05] 40000 assocs mapped (0 meta)...
[INFO] [2024-03-22 22:38:14] 50000 assocs mapped (0 meta)...
[INFO] [2024-03-22 22:38:24] 60000 assocs mapped (0 meta)...
[INFO] [2024-03-22 22:38:28] Done. 66419 assocs mapped (0 meta).
[INFO] [2024-03-22 22:38:28] Adding 0 traits...
[INFO] [2024-03-22 22:38:28] 0 metadata added.
[INFO] [2024-03-22 22:38:28] Adding 66419 assocs...
[INFO] [2024-03-22 22:38:35] 66419 metadata added.
[INFO] [2024-03-22 22:39:53] Processed 60000/496866 nodes
[INFO] [2024-03-22 22:41:45] 0 Traits (unfiltered) and 50266 associations...
[INFO] [2024-03-22 22:41:45] Building Traits map for 10000 nodes (this can take a while)...
[INFO] [2024-03-22 22:41:45] Mapped 0 traits (0 meta) for 10000 nodes.
[INFO] [2024-03-22 22:41:45] Building Associations map (this can take a while)...
[INFO] [2024-03-22 22:41:53] 10000 assocs mapped (0 meta)...
[INFO] [2024-03-22 22:42:01] 20000 assocs mapped (0 meta)...
[INFO] [2024-03-22 22:42:10] 30000 assocs mapped (0 meta)...
[INFO] [2024-03-22 22:42:16] 40000 assocs mapped (0 meta)...
[INFO] [2024-03-22 22:42:26] 50000 assocs mapped (0 meta)...
[INFO] [2024-03-22 22:42:26] Done. 50266 assocs mapped (0 meta).
[INFO] [2024-03-22 22:42:26] Adding 0 traits...
[INFO] [2024-03-22 22:42:26] 0 metadata added.
[INFO] [2024-03-22 22:42:26] Adding 50266 assocs...
[INFO] [2024-03-22 22:42:32] 50266 metadata added.
[INFO] [2024-03-22 22:43:42] Processed 70000/496866 nodes
[INFO] [2024-03-22 22:45:35] 0 Traits (unfiltered) and 83501 associations...
[INFO] [2024-03-22 22:45:35] Building Traits map for 10000 nodes (this can take a while)...
[INFO] [2024-03-22 22:45:36] Mapped 0 traits (0 meta) for 10000 nodes.
[INFO] [2024-03-22 22:45:36] Building Associations map (this can take a while)...
[INFO] [2024-03-22 22:45:43] 10000 assocs mapped (0 meta)...
[INFO] [2024-03-22 22:45:49] 20000 assocs mapped (0 meta)...
[INFO] [2024-03-22 22:45:54] 30000 assocs mapped (0 meta)...
[INFO] [2024-03-22 22:46:03] 40000 assocs mapped (0 meta)...
[INFO] [2024-03-22 22:46:08] 50000 assocs mapped (0 meta)...
[INFO] [2024-03-22 22:46:18] 60000 assocs mapped (0 meta)...
[INFO] [2024-03-22 22:46:23] 70000 assocs mapped (0 meta)...
[INFO] [2024-03-22 22:46:33] 80000 assocs mapped (0 meta)...
[INFO] [2024-03-22 22:46:35] Done. 83501 assocs mapped (0 meta).
[INFO] [2024-03-22 22:46:35] Adding 0 traits...
[INFO] [2024-03-22 22:46:35] 0 metadata added.
[INFO] [2024-03-22 22:46:35] Adding 83501 assocs...
[INFO] [2024-03-22 22:46:48] 83501 metadata added.
[INFO] [2024-03-22 22:48:04] Processed 80000/496866 nodes
[INFO] [2024-03-22 22:50:02] 0 Traits (unfiltered) and 131215 associations...
[INFO] [2024-03-22 22:50:02] Building Traits map for 10000 nodes (this can take a while)...
[INFO] [2024-03-22 22:50:02] Mapped 0 traits (0 meta) for 10000 nodes.
[INFO] [2024-03-22 22:50:02] Building Associations map (this can take a while)...
[INFO] [2024-03-22 22:50:07] 10000 assocs mapped (0 meta)...
[INFO] [2024-03-22 22:50:16] 20000 assocs mapped (0 meta)...
[INFO] [2024-03-22 22:50:21] 30000 assocs mapped (0 meta)...
[INFO] [2024-03-22 22:50:30] 40000 assocs mapped (0 meta)...
[INFO] [2024-03-22 22:50:34] 50000 assocs mapped (0 meta)...
[INFO] [2024-03-22 22:50:43] 60000 assocs mapped (0 meta)...
[INFO] [2024-03-22 22:50:48] 70000 assocs mapped (0 meta)...
[INFO] [2024-03-22 22:50:58] 80000 assocs mapped (0 meta)...
[INFO] [2024-03-22 22:51:03] 90000 assocs mapped (0 meta)...
[INFO] [2024-03-22 22:51:14] 100000 assocs mapped (0 meta)...
[INFO] [2024-03-22 22:51:20] 110000 assocs mapped (0 meta)...
[INFO] [2024-03-22 22:51:31] 120000 assocs mapped (0 meta)...
[INFO] [2024-03-22 22:51:36] 130000 assocs mapped (0 meta)...
[INFO] [2024-03-22 22:51:37] Done. 131215 assocs mapped (0 meta).
[INFO] [2024-03-22 22:51:37] Adding 0 traits...
[INFO] [2024-03-22 22:51:37] 0 metadata added.
[INFO] [2024-03-22 22:51:37] Adding 131215 assocs...
[INFO] [2024-03-22 22:52:00] 131215 metadata added.
[INFO] [2024-03-22 22:53:27] Processed 90000/496866 nodes
[INFO] [2024-03-22 22:55:24] 0 Traits (unfiltered) and 183692 associations...
[INFO] [2024-03-22 22:55:24] Building Traits map for 10000 nodes (this can take a while)...
[INFO] [2024-03-22 22:55:24] Mapped 0 traits (0 meta) for 10000 nodes.
[INFO] [2024-03-22 22:55:24] Building Associations map (this can take a while)...
[INFO] [2024-03-22 22:55:29] 10000 assocs mapped (0 meta)...
[INFO] [2024-03-22 22:55:40] 20000 assocs mapped (0 meta)...
[INFO] [2024-03-22 22:55:46] 30000 assocs mapped (0 meta)...
[INFO] [2024-03-22 22:55:53] 40000 assocs mapped (0 meta)...
[INFO] [2024-03-22 22:56:00] 50000 assocs mapped (0 meta)...
[INFO] [2024-03-22 22:56:07] 60000 assocs mapped (0 meta)...
[INFO] [2024-03-22 22:56:14] 70000 assocs mapped (0 meta)...
[INFO] [2024-03-22 22:56:22] 80000 assocs mapped (0 meta)...
[INFO] [2024-03-22 22:56:32] 90000 assocs mapped (0 meta)...
[INFO] [2024-03-22 22:56:37] 100000 assocs mapped (0 meta)...
[INFO] [2024-03-22 22:56:48] 110000 assocs mapped (0 meta)...
[INFO] [2024-03-22 22:56:53] 120000 assocs mapped (0 meta)...
[INFO] [2024-03-22 22:57:04] 130000 assocs mapped (0 meta)...
[INFO] [2024-03-22 22:57:09] 140000 assocs mapped (0 meta)...
[INFO] [2024-03-22 22:57:22] 150000 assocs mapped (0 meta)...
[INFO] [2024-03-22 22:57:28] 160000 assocs mapped (0 meta)...
[INFO] [2024-03-22 22:57:41] 170000 assocs mapped (0 meta)...
[INFO] [2024-03-22 22:57:47] 180000 assocs mapped (0 meta)...
[INFO] [2024-03-22 22:57:49] Done. 183692 assocs mapped (0 meta).
[INFO] [2024-03-22 22:57:49] Adding 0 traits...
[INFO] [2024-03-22 22:57:49] 0 metadata added.
[INFO] [2024-03-22 22:57:49] Adding 183692 assocs...
[INFO] [2024-03-22 22:58:20] 183692 metadata added.
[INFO] [2024-03-22 22:59:56] Processed 100000/496866 nodes
[INFO] [2024-03-22 23:02:05] 0 Traits (unfiltered) and 119230 associations...
[INFO] [2024-03-22 23:02:05] Building Traits map for 10000 nodes (this can take a while)...
[INFO] [2024-03-22 23:02:05] Mapped 0 traits (0 meta) for 10000 nodes.
[INFO] [2024-03-22 23:02:05] Building Associations map (this can take a while)...
[INFO] [2024-03-22 23:02:15] 10000 assocs mapped (0 meta)...
[INFO] [2024-03-22 23:02:21] 20000 assocs mapped (0 meta)...
[INFO] [2024-03-22 23:02:30] 30000 assocs mapped (0 meta)...
[INFO] [2024-03-22 23:02:35] 40000 assocs mapped (0 meta)...
[INFO] [2024-03-22 23:02:44] 50000 assocs mapped (0 meta)...
[INFO] [2024-03-22 23:02:54] 60000 assocs mapped (0 meta)...
[INFO] [2024-03-22 23:03:00] 70000 assocs mapped (0 meta)...
[INFO] [2024-03-22 23:03:10] 80000 assocs mapped (0 meta)...
[INFO] [2024-03-22 23:03:16] 90000 assocs mapped (0 meta)...
[INFO] [2024-03-22 23:03:28] 100000 assocs mapped (0 meta)...
[INFO] [2024-03-22 23:03:34] 110000 assocs mapped (0 meta)...
[INFO] [2024-03-22 23:03:46] Done. 119230 assocs mapped (0 meta).
[INFO] [2024-03-22 23:03:46] Adding 0 traits...
[INFO] [2024-03-22 23:03:46] 0 metadata added.
[INFO] [2024-03-22 23:03:46] Adding 119230 assocs...
[INFO] [2024-03-22 23:04:00] 119230 metadata added.
[INFO] [2024-03-22 23:05:30] Processed 110000/496866 nodes
[INFO] [2024-03-22 23:07:26] 0 Traits (unfiltered) and 71575 associations...
[INFO] [2024-03-22 23:07:26] Building Traits map for 10000 nodes (this can take a while)...
[INFO] [2024-03-22 23:07:26] Mapped 0 traits (0 meta) for 10000 nodes.
[INFO] [2024-03-22 23:07:26] Building Associations map (this can take a while)...
[INFO] [2024-03-22 23:07:35] 10000 assocs mapped (0 meta)...
[INFO] [2024-03-22 23:07:42] 20000 assocs mapped (0 meta)...
[INFO] [2024-03-22 23:07:51] 30000 assocs mapped (0 meta)...
[INFO] [2024-03-22 23:07:56] 40000 assocs mapped (0 meta)...
[INFO] [2024-03-22 23:08:06] 50000 assocs mapped (0 meta)...
[INFO] [2024-03-22 23:08:12] 60000 assocs mapped (0 meta)...
[INFO] [2024-03-22 23:08:22] 70000 assocs mapped (0 meta)...
[INFO] [2024-03-22 23:08:24] Done. 71575 assocs mapped (0 meta).
[INFO] [2024-03-22 23:08:24] Adding 0 traits...
[INFO] [2024-03-22 23:08:24] 0 metadata added.
[INFO] [2024-03-22 23:08:24] Adding 71575 assocs...
[INFO] [2024-03-22 23:08:32] 71575 metadata added.
[INFO] [2024-03-22 23:09:50] Processed 120000/496866 nodes
[INFO] [2024-03-22 23:11:42] 0 Traits (unfiltered) and 134772 associations...
[INFO] [2024-03-22 23:11:42] Building Traits map for 10000 nodes (this can take a while)...
[INFO] [2024-03-22 23:11:42] Mapped 0 traits (0 meta) for 10000 nodes.
[INFO] [2024-03-22 23:11:42] Building Associations map (this can take a while)...
[INFO] [2024-03-22 23:11:47] 10000 assocs mapped (0 meta)...
[INFO] [2024-03-22 23:11:57] 20000 assocs mapped (0 meta)...
[INFO] [2024-03-22 23:12:01] 30000 assocs mapped (0 meta)...
[INFO] [2024-03-22 23:12:10] 40000 assocs mapped (0 meta)...
[INFO] [2024-03-22 23:12:15] 50000 assocs mapped (0 meta)...
[INFO] [2024-03-22 23:12:24] 60000 assocs mapped (0 meta)...
[INFO] [2024-03-22 23:12:31] 70000 assocs mapped (0 meta)...
[INFO] [2024-03-22 23:12:38] 80000 assocs mapped (0 meta)...
[INFO] [2024-03-22 23:12:46] 90000 assocs mapped (0 meta)...
[INFO] [2024-03-22 23:12:54] 100000 assocs mapped (0 meta)...
[INFO] [2024-03-22 23:13:02] 110000 assocs mapped (0 meta)...
[INFO] [2024-03-22 23:13:11] 120000 assocs mapped (0 meta)...
[INFO] [2024-03-22 23:13:20] 130000 assocs mapped (0 meta)...
[INFO] [2024-03-22 23:13:22] Done. 134772 assocs mapped (0 meta).
[INFO] [2024-03-22 23:13:22] Adding 0 traits...
[INFO] [2024-03-22 23:13:22] 0 metadata added.
[INFO] [2024-03-22 23:13:22] Adding 134772 assocs...
[INFO] [2024-03-22 23:13:46] 134772 metadata added.
[INFO] [2024-03-22 23:15:14] Processed 130000/496866 nodes
[INFO] [2024-03-22 23:17:09] 0 Traits (unfiltered) and 28323 associations...
[INFO] [2024-03-22 23:17:09] Building Traits map for 10000 nodes (this can take a while)...
[INFO] [2024-03-22 23:17:09] Mapped 0 traits (0 meta) for 10000 nodes.
[INFO] [2024-03-22 23:17:09] Building Associations map (this can take a while)...
[INFO] [2024-03-22 23:17:15] 10000 assocs mapped (0 meta)...
[INFO] [2024-03-22 23:17:26] 20000 assocs mapped (0 meta)...
[INFO] [2024-03-22 23:17:33] Done. 28323 assocs mapped (0 meta).
[INFO] [2024-03-22 23:17:33] Adding 0 traits...
[INFO] [2024-03-22 23:17:33] 0 metadata added.
[INFO] [2024-03-22 23:17:33] Adding 28323 assocs...
[INFO] [2024-03-22 23:17:38] 28323 metadata added.
[INFO] [2024-03-22 23:18:45] Processed 140000/496866 nodes
[INFO] [2024-03-22 23:20:33] 0 Traits (unfiltered) and 29905 associations...
[INFO] [2024-03-22 23:20:33] Building Traits map for 10000 nodes (this can take a while)...
[INFO] [2024-03-22 23:20:33] Mapped 0 traits (0 meta) for 10000 nodes.
[INFO] [2024-03-22 23:20:33] Building Associations map (this can take a while)...
[INFO] [2024-03-22 23:20:39] 10000 assocs mapped (0 meta)...
[INFO] [2024-03-22 23:20:48] 20000 assocs mapped (0 meta)...
[INFO] [2024-03-22 23:20:55] Done. 29905 assocs mapped (0 meta).
[INFO] [2024-03-22 23:20:55] Adding 0 traits...
[INFO] [2024-03-22 23:20:55] 0 metadata added.
[INFO] [2024-03-22 23:20:55] Adding 29905 assocs...
[INFO] [2024-03-22 23:21:01] 29905 metadata added.
[INFO] [2024-03-22 23:22:08] Processed 150000/496866 nodes
[INFO] [2024-03-22 23:23:57] 0 Traits (unfiltered) and 33327 associations...
[INFO] [2024-03-22 23:23:57] Building Traits map for 10000 nodes (this can take a while)...
[INFO] [2024-03-22 23:23:57] Mapped 0 traits (0 meta) for 10000 nodes.
[INFO] [2024-03-22 23:23:57] Building Associations map (this can take a while)...
[INFO] [2024-03-22 23:24:05] 10000 assocs mapped (0 meta)...
[INFO] [2024-03-22 23:24:13] 20000 assocs mapped (0 meta)...
[INFO] [2024-03-22 23:24:22] 30000 assocs mapped (0 meta)...
[INFO] [2024-03-22 23:24:23] Done. 33327 assocs mapped (0 meta).
[INFO] [2024-03-22 23:24:23] Adding 0 traits...
[INFO] [2024-03-22 23:24:23] 0 metadata added.
[INFO] [2024-03-22 23:24:23] Adding 33327 assocs...
[INFO] [2024-03-22 23:24:27] 33327 metadata added.
[INFO] [2024-03-22 23:25:35] Processed 160000/496866 nodes
[INFO] [2024-03-22 23:27:26] 0 Traits (unfiltered) and 88419 associations...
[INFO] [2024-03-22 23:27:26] Building Traits map for 10000 nodes (this can take a while)...
[INFO] [2024-03-22 23:27:27] Mapped 0 traits (0 meta) for 10000 nodes.
[INFO] [2024-03-22 23:27:27] Building Associations map (this can take a while)...
[INFO] [2024-03-22 23:27:34] 10000 assocs mapped (0 meta)...
[INFO] [2024-03-22 23:27:41] 20000 assocs mapped (0 meta)...
[INFO] [2024-03-22 23:27:50] 30000 assocs mapped (0 meta)...
[INFO] [2024-03-22 23:27:55] 40000 assocs mapped (0 meta)...
[INFO] [2024-03-22 23:28:04] 50000 assocs mapped (0 meta)...
[INFO] [2024-03-22 23:28:10] 60000 assocs mapped (0 meta)...
[INFO] [2024-03-22 23:28:21] 70000 assocs mapped (0 meta)...
[INFO] [2024-03-22 23:28:27] 80000 assocs mapped (0 meta)...
[INFO] [2024-03-22 23:28:37] Done. 88419 assocs mapped (0 meta).
[INFO] [2024-03-22 23:28:37] Adding 0 traits...
[INFO] [2024-03-22 23:28:37] 0 metadata added.
[INFO] [2024-03-22 23:28:37] Adding 88419 assocs...
[INFO] [2024-03-22 23:28:48] 88419 metadata added.
[INFO] [2024-03-22 23:30:05] Processed 170000/496866 nodes
[INFO] [2024-03-22 23:32:03] 0 Traits (unfiltered) and 56835 associations...
[INFO] [2024-03-22 23:32:03] Building Traits map for 10000 nodes (this can take a while)...
[INFO] [2024-03-22 23:32:04] Mapped 0 traits (0 meta) for 10000 nodes.
[INFO] [2024-03-22 23:32:04] Building Associations map (this can take a while)...
[INFO] [2024-03-22 23:32:09] 10000 assocs mapped (0 meta)...
[INFO] [2024-03-22 23:32:19] 20000 assocs mapped (0 meta)...
[INFO] [2024-03-22 23:32:25] 30000 assocs mapped (0 meta)...
[INFO] [2024-03-22 23:32:35] 40000 assocs mapped (0 meta)...
[INFO] [2024-03-22 23:32:41] 50000 assocs mapped (0 meta)...
[INFO] [2024-03-22 23:32:50] Done. 56835 assocs mapped (0 meta).
[INFO] [2024-03-22 23:32:50] Adding 0 traits...
[INFO] [2024-03-22 23:32:50] 0 metadata added.
[INFO] [2024-03-22 23:32:50] Adding 56835 assocs...
[INFO] [2024-03-22 23:32:57] 56835 metadata added.
[INFO] [2024-03-22 23:34:06] Processed 180000/496866 nodes
[INFO] [2024-03-22 23:36:01] 0 Traits (unfiltered) and 36372 associations...
[INFO] [2024-03-22 23:36:01] Building Traits map for 10000 nodes (this can take a while)...
[INFO] [2024-03-22 23:36:01] Mapped 0 traits (0 meta) for 10000 nodes.
[INFO] [2024-03-22 23:36:01] Building Associations map (this can take a while)...
[INFO] [2024-03-22 23:36:11] 10000 assocs mapped (0 meta)...
[INFO] [2024-03-22 23:36:18] 20000 assocs mapped (0 meta)...
[INFO] [2024-03-22 23:36:26] 30000 assocs mapped (0 meta)...
[INFO] [2024-03-22 23:36:30] Done. 36372 assocs mapped (0 meta).
[INFO] [2024-03-22 23:36:30] Adding 0 traits...
[INFO] [2024-03-22 23:36:30] 0 metadata added.
[INFO] [2024-03-22 23:36:30] Adding 36372 assocs...
[INFO] [2024-03-22 23:36:34] 36372 metadata added.
[INFO] [2024-03-22 23:37:44] Processed 190000/496866 nodes
[INFO] [2024-03-22 23:39:32] 0 Traits (unfiltered) and 35183 associations...
[INFO] [2024-03-22 23:39:32] Building Traits map for 10000 nodes (this can take a while)...
[INFO] [2024-03-22 23:39:32] Mapped 0 traits (0 meta) for 10000 nodes.
[INFO] [2024-03-22 23:39:32] Building Associations map (this can take a while)...
[INFO] [2024-03-22 23:39:40] 10000 assocs mapped (0 meta)...
[INFO] [2024-03-22 23:39:47] 20000 assocs mapped (0 meta)...
[INFO] [2024-03-22 23:39:54] 30000 assocs mapped (0 meta)...
[INFO] [2024-03-22 23:39:59] Done. 35183 assocs mapped (0 meta).
[INFO] [2024-03-22 23:39:59] Adding 0 traits...
[INFO] [2024-03-22 23:39:59] 0 metadata added.
[INFO] [2024-03-22 23:39:59] Adding 35183 assocs...
[INFO] [2024-03-22 23:40:03] 35183 metadata added.
[INFO] [2024-03-22 23:41:07] Processed 200000/496866 nodes
[INFO] [2024-03-22 23:42:58] 0 Traits (unfiltered) and 64021 associations...
[INFO] [2024-03-22 23:42:58] Building Traits map for 10000 nodes (this can take a while)...
[INFO] [2024-03-22 23:42:58] Mapped 0 traits (0 meta) for 10000 nodes.
[INFO] [2024-03-22 23:42:58] Building Associations map (this can take a while)...
[INFO] [2024-03-22 23:43:03] 10000 assocs mapped (0 meta)...
[INFO] [2024-03-22 23:43:13] 20000 assocs mapped (0 meta)...
[INFO] [2024-03-22 23:43:18] 30000 assocs mapped (0 meta)...
[INFO] [2024-03-22 23:43:28] 40000 assocs mapped (0 meta)...
[INFO] [2024-03-22 23:43:39] 50000 assocs mapped (0 meta)...
[INFO] [2024-03-22 23:43:44] 60000 assocs mapped (0 meta)...
[INFO] [2024-03-22 23:43:46] Done. 64021 assocs mapped (0 meta).
[INFO] [2024-03-22 23:43:46] Adding 0 traits...
[INFO] [2024-03-22 23:43:46] 0 metadata added.
[INFO] [2024-03-22 23:43:46] Adding 64021 assocs...
[INFO] [2024-03-22 23:43:58] 64021 metadata added.
[INFO] [2024-03-22 23:45:05] Processed 210000/496866 nodes
[INFO] [2024-03-22 23:46:54] 0 Traits (unfiltered) and 207899 associations...
[INFO] [2024-03-22 23:46:54] Building Traits map for 10000 nodes (this can take a while)...
[INFO] [2024-03-22 23:46:54] Mapped 0 traits (0 meta) for 10000 nodes.
[INFO] [2024-03-22 23:46:54] Building Associations map (this can take a while)...
[INFO] [2024-03-22 23:47:03] 10000 assocs mapped (0 meta)...
[INFO] [2024-03-22 23:47:10] 20000 assocs mapped (0 meta)...
[INFO] [2024-03-22 23:47:17] 30000 assocs mapped (0 meta)...
[INFO] [2024-03-22 23:47:27] 40000 assocs mapped (0 meta)...
[INFO] [2024-03-22 23:47:32] 50000 assocs mapped (0 meta)...
[INFO] [2024-03-22 23:47:43] 60000 assocs mapped (0 meta)...
[INFO] [2024-03-22 23:47:48] 70000 assocs mapped (0 meta)...
[INFO] [2024-03-22 23:47:59] 80000 assocs mapped (0 meta)...
[INFO] [2024-03-22 23:48:10] 90000 assocs mapped (0 meta)...
[INFO] [2024-03-22 23:48:16] 100000 assocs mapped (0 meta)...
[INFO] [2024-03-22 23:48:28] 110000 assocs mapped (0 meta)...
[INFO] [2024-03-22 23:48:33] 120000 assocs mapped (0 meta)...
[INFO] [2024-03-22 23:48:46] 130000 assocs mapped (0 meta)...
[INFO] [2024-03-22 23:48:55] 140000 assocs mapped (0 meta)...
[INFO] [2024-03-22 23:49:04] 150000 assocs mapped (0 meta)...
[INFO] [2024-03-22 23:49:18] 160000 assocs mapped (0 meta)...
[INFO] [2024-03-22 23:49:33] 170000 assocs mapped (0 meta)...
[INFO] [2024-03-22 23:49:44] 180000 assocs mapped (0 meta)...
[INFO] [2024-03-22 23:49:50] 190000 assocs mapped (0 meta)...
[INFO] [2024-03-22 23:50:06] 200000 assocs mapped (0 meta)...
[INFO] [2024-03-22 23:50:21] Done. 207899 assocs mapped (0 meta).
[INFO] [2024-03-22 23:50:21] Adding 0 traits...
[INFO] [2024-03-22 23:50:21] 0 metadata added.
[INFO] [2024-03-22 23:50:21] Adding 207899 assocs...
[INFO] [2024-03-22 23:50:53] 207899 metadata added.
[INFO] [2024-03-22 23:52:29] Processed 220000/496866 nodes
[INFO] [2024-03-22 23:54:40] 0 Traits (unfiltered) and 37194 associations...
[INFO] [2024-03-22 23:54:40] Building Traits map for 10000 nodes (this can take a while)...
[INFO] [2024-03-22 23:54:40] Mapped 0 traits (0 meta) for 10000 nodes.
[INFO] [2024-03-22 23:54:40] Building Associations map (this can take a while)...
[INFO] [2024-03-22 23:54:47] 10000 assocs mapped (0 meta)...
[INFO] [2024-03-22 23:54:59] 20000 assocs mapped (0 meta)...
[INFO] [2024-03-22 23:55:05] 30000 assocs mapped (0 meta)...
[INFO] [2024-03-22 23:55:13] Done. 37194 assocs mapped (0 meta).
[INFO] [2024-03-22 23:55:13] Adding 0 traits...
[INFO] [2024-03-22 23:55:13] 0 metadata added.
[INFO] [2024-03-22 23:55:13] Adding 37194 assocs...
[INFO] [2024-03-22 23:55:18] 37194 metadata added.
[INFO] [2024-03-22 23:56:19] Processed 230000/496866 nodes
[INFO] [2024-03-22 23:58:10] 0 Traits (unfiltered) and 1051 associations...
[INFO] [2024-03-22 23:58:10] Building Traits map for 10000 nodes (this can take a while)...
[INFO] [2024-03-22 23:58:10] Mapped 0 traits (0 meta) for 10000 nodes.
[INFO] [2024-03-22 23:58:10] Building Associations map (this can take a while)...
[INFO] [2024-03-22 23:58:15] Done. 1051 assocs mapped (0 meta).
[INFO] [2024-03-22 23:58:15] Adding 0 traits...
[INFO] [2024-03-22 23:58:15] 0 metadata added.
[INFO] [2024-03-22 23:58:15] Adding 1051 assocs...
[INFO] [2024-03-22 23:58:15] 1051 metadata added.
[INFO] [2024-03-22 23:59:12] Processed 240000/496866 nodes
[INFO] [2024-03-23 00:00:57] 0 Traits (unfiltered) and 78892 associations...
[INFO] [2024-03-23 00:00:57] Building Traits map for 10000 nodes (this can take a while)...
[INFO] [2024-03-23 00:00:57] Mapped 0 traits (0 meta) for 10000 nodes.
[INFO] [2024-03-23 00:00:57] Building Associations map (this can take a while)...
[INFO] [2024-03-23 00:01:03] 10000 assocs mapped (0 meta)...
[INFO] [2024-03-23 00:01:10] 20000 assocs mapped (0 meta)...
[INFO] [2024-03-23 00:01:19] 30000 assocs mapped (0 meta)...
[INFO] [2024-03-23 00:01:24] 40000 assocs mapped (0 meta)...
[INFO] [2024-03-23 00:01:34] 50000 assocs mapped (0 meta)...
[INFO] [2024-03-23 00:01:39] 60000 assocs mapped (0 meta)...
[INFO] [2024-03-23 00:01:50] 70000 assocs mapped (0 meta)...
[INFO] [2024-03-23 00:01:57] Done. 78892 assocs mapped (0 meta).
[INFO] [2024-03-23 00:01:57] Adding 0 traits...
[INFO] [2024-03-23 00:01:57] 0 metadata added.
[INFO] [2024-03-23 00:01:57] Adding 78892 assocs...
[INFO] [2024-03-23 00:02:09] 78892 metadata added.
[INFO] [2024-03-23 00:03:18] Processed 250000/496866 nodes
[INFO] [2024-03-23 00:05:06] 0 Traits (unfiltered) and 45371 associations...
[INFO] [2024-03-23 00:05:06] Building Traits map for 10000 nodes (this can take a while)...
[INFO] [2024-03-23 00:05:06] Mapped 0 traits (0 meta) for 10000 nodes.
[INFO] [2024-03-23 00:05:06] Building Associations map (this can take a while)...
[INFO] [2024-03-23 00:05:17] 10000 assocs mapped (0 meta)...
[INFO] [2024-03-23 00:05:23] 20000 assocs mapped (0 meta)...
[INFO] [2024-03-23 00:05:32] 30000 assocs mapped (0 meta)...
[INFO] [2024-03-23 00:05:40] 40000 assocs mapped (0 meta)...
[INFO] [2024-03-23 00:05:46] Done. 45371 assocs mapped (0 meta).
[INFO] [2024-03-23 00:05:46] Adding 0 traits...
[INFO] [2024-03-23 00:05:46] 0 metadata added.
[INFO] [2024-03-23 00:05:46] Adding 45371 assocs...
[INFO] [2024-03-23 00:05:51] 45371 metadata added.
[INFO] [2024-03-23 00:06:53] Processed 260000/496866 nodes
[INFO] [2024-03-23 00:08:45] 0 Traits (unfiltered) and 11670 associations...
[INFO] [2024-03-23 00:08:45] Building Traits map for 10000 nodes (this can take a while)...
[INFO] [2024-03-23 00:08:45] Mapped 0 traits (0 meta) for 10000 nodes.
[INFO] [2024-03-23 00:08:45] Building Associations map (this can take a while)...
[INFO] [2024-03-23 00:08:52] 10000 assocs mapped (0 meta)...
[INFO] [2024-03-23 00:08:55] Done. 11670 assocs mapped (0 meta).
[INFO] [2024-03-23 00:08:55] Adding 0 traits...
[INFO] [2024-03-23 00:08:55] 0 metadata added.
[INFO] [2024-03-23 00:08:55] Adding 11670 assocs...
[INFO] [2024-03-23 00:08:56] 11670 metadata added.
[INFO] [2024-03-23 00:09:54] Processed 270000/496866 nodes
[INFO] [2024-03-23 00:11:39] 0 Traits (unfiltered) and 45855 associations...
[INFO] [2024-03-23 00:11:39] Building Traits map for 10000 nodes (this can take a while)...
[INFO] [2024-03-23 00:11:39] Mapped 0 traits (0 meta) for 10000 nodes.
[INFO] [2024-03-23 00:11:39] Building Associations map (this can take a while)...
[INFO] [2024-03-23 00:11:46] 10000 assocs mapped (0 meta)...
[INFO] [2024-03-23 00:11:54] 20000 assocs mapped (0 meta)...
[INFO] [2024-03-23 00:12:03] 30000 assocs mapped (0 meta)...
[INFO] [2024-03-23 00:12:08] 40000 assocs mapped (0 meta)...
[INFO] [2024-03-23 00:12:15] Done. 45855 assocs mapped (0 meta).
[INFO] [2024-03-23 00:12:15] Adding 0 traits...
[INFO] [2024-03-23 00:12:15] 0 metadata added.
[INFO] [2024-03-23 00:12:15] Adding 45855 assocs...
[INFO] [2024-03-23 00:12:21] 45855 metadata added.
[INFO] [2024-03-23 00:13:23] Processed 280000/496866 nodes
[INFO] [2024-03-23 00:15:14] 0 Traits (unfiltered) and 78466 associations...
[INFO] [2024-03-23 00:15:14] Building Traits map for 10000 nodes (this can take a while)...
[INFO] [2024-03-23 00:15:14] Mapped 0 traits (0 meta) for 10000 nodes.
[INFO] [2024-03-23 00:15:14] Building Associations map (this can take a while)...
[INFO] [2024-03-23 00:15:20] 10000 assocs mapped (0 meta)...
[INFO] [2024-03-23 00:15:29] 20000 assocs mapped (0 meta)...
[INFO] [2024-03-23 00:15:35] 30000 assocs mapped (0 meta)...
[INFO] [2024-03-23 00:15:44] 40000 assocs mapped (0 meta)...
[INFO] [2024-03-23 00:15:50] 50000 assocs mapped (0 meta)...
[INFO] [2024-03-23 00:16:00] 60000 assocs mapped (0 meta)...
[INFO] [2024-03-23 00:16:11] 70000 assocs mapped (0 meta)...
[INFO] [2024-03-23 00:16:16] Done. 78466 assocs mapped (0 meta).
[INFO] [2024-03-23 00:16:16] Adding 0 traits...
[INFO] [2024-03-23 00:16:16] 0 metadata added.
[INFO] [2024-03-23 00:16:16] Adding 78466 assocs...
[INFO] [2024-03-23 00:16:28] 78466 metadata added.
[INFO] [2024-03-23 00:17:41] Processed 290000/496866 nodes
[INFO] [2024-03-23 00:19:30] 0 Traits (unfiltered) and 45959 associations...
[INFO] [2024-03-23 00:19:30] Building Traits map for 10000 nodes (this can take a while)...
[INFO] [2024-03-23 00:19:31] Mapped 0 traits (0 meta) for 10000 nodes.
[INFO] [2024-03-23 00:19:31] Building Associations map (this can take a while)...
[INFO] [2024-03-23 00:19:39] 10000 assocs mapped (0 meta)...
[INFO] [2024-03-23 00:19:47] 20000 assocs mapped (0 meta)...
[INFO] [2024-03-23 00:19:56] 30000 assocs mapped (0 meta)...
[INFO] [2024-03-23 00:20:02] 40000 assocs mapped (0 meta)...
[INFO] [2024-03-23 00:20:07] Done. 45959 assocs mapped (0 meta).
[INFO] [2024-03-23 00:20:07] Adding 0 traits...
[INFO] [2024-03-23 00:20:07] 0 metadata added.
[INFO] [2024-03-23 00:20:07] Adding 45959 assocs...
[INFO] [2024-03-23 00:20:15] 45959 metadata added.
[INFO] [2024-03-23 00:21:17] Processed 300000/496866 nodes
[INFO] [2024-03-23 00:23:07] 0 Traits (unfiltered) and 45673 associations...
[INFO] [2024-03-23 00:23:07] Building Traits map for 10000 nodes (this can take a while)...
[INFO] [2024-03-23 00:23:07] Mapped 0 traits (0 meta) for 10000 nodes.
[INFO] [2024-03-23 00:23:07] Building Associations map (this can take a while)...
[INFO] [2024-03-23 00:23:16] 10000 assocs mapped (0 meta)...
[INFO] [2024-03-23 00:23:26] 20000 assocs mapped (0 meta)...
[INFO] [2024-03-23 00:23:32] 30000 assocs mapped (0 meta)...
[INFO] [2024-03-23 00:23:42] 40000 assocs mapped (0 meta)...
[INFO] [2024-03-23 00:23:45] Done. 45673 assocs mapped (0 meta).
[INFO] [2024-03-23 00:23:45] Adding 0 traits...
[INFO] [2024-03-23 00:23:45] 0 metadata added.
[INFO] [2024-03-23 00:23:45] Adding 45673 assocs...
[INFO] [2024-03-23 00:23:53] 45673 metadata added.
[INFO] [2024-03-23 00:24:58] Processed 310000/496866 nodes
[INFO] [2024-03-23 00:26:46] 0 Traits (unfiltered) and 53683 associations...
[INFO] [2024-03-23 00:26:46] Building Traits map for 10000 nodes (this can take a while)...
[INFO] [2024-03-23 00:26:46] Mapped 0 traits (0 meta) for 10000 nodes.
[INFO] [2024-03-23 00:26:46] Building Associations map (this can take a while)...
[INFO] [2024-03-23 00:26:55] 10000 assocs mapped (0 meta)...
[INFO] [2024-03-23 00:27:01] 20000 assocs mapped (0 meta)...
[INFO] [2024-03-23 00:27:11] 30000 assocs mapped (0 meta)...
[INFO] [2024-03-23 00:27:16] 40000 assocs mapped (0 meta)...
[INFO] [2024-03-23 00:27:26] 50000 assocs mapped (0 meta)...
[INFO] [2024-03-23 00:27:28] Done. 53683 assocs mapped (0 meta).
[INFO] [2024-03-23 00:27:28] Adding 0 traits...
[INFO] [2024-03-23 00:27:28] 0 metadata added.
[INFO] [2024-03-23 00:27:28] Adding 53683 assocs...
[INFO] [2024-03-23 00:27:34] 53683 metadata added.
[INFO] [2024-03-23 00:28:42] Processed 320000/496866 nodes
[INFO] [2024-03-23 00:30:30] 0 Traits (unfiltered) and 44805 associations...
[INFO] [2024-03-23 00:30:30] Building Traits map for 10000 nodes (this can take a while)...
[INFO] [2024-03-23 00:30:30] Mapped 0 traits (0 meta) for 10000 nodes.
[INFO] [2024-03-23 00:30:30] Building Associations map (this can take a while)...
[INFO] [2024-03-23 00:30:40] 10000 assocs mapped (0 meta)...
[INFO] [2024-03-23 00:30:46] 20000 assocs mapped (0 meta)...
[INFO] [2024-03-23 00:30:56] 30000 assocs mapped (0 meta)...
[INFO] [2024-03-23 00:31:04] 40000 assocs mapped (0 meta)...
[INFO] [2024-03-23 00:31:08] Done. 44805 assocs mapped (0 meta).
[INFO] [2024-03-23 00:31:08] Adding 0 traits...
[INFO] [2024-03-23 00:31:08] 0 metadata added.
[INFO] [2024-03-23 00:31:08] Adding 44805 assocs...
[INFO] [2024-03-23 00:31:14] 44805 metadata added.
[INFO] [2024-03-23 00:32:16] Processed 330000/496866 nodes
[INFO] [2024-03-23 00:34:08] 0 Traits (unfiltered) and 41686 associations...
[INFO] [2024-03-23 00:34:08] Building Traits map for 10000 nodes (this can take a while)...
[INFO] [2024-03-23 00:34:08] Mapped 0 traits (0 meta) for 10000 nodes.
[INFO] [2024-03-23 00:34:08] Building Associations map (this can take a while)...
[INFO] [2024-03-23 00:34:14] 10000 assocs mapped (0 meta)...
[INFO] [2024-03-23 00:34:25] 20000 assocs mapped (0 meta)...
[INFO] [2024-03-23 00:34:32] 30000 assocs mapped (0 meta)...
[INFO] [2024-03-23 00:34:40] 40000 assocs mapped (0 meta)...
[INFO] [2024-03-23 00:34:41] Done. 41686 assocs mapped (0 meta).
[INFO] [2024-03-23 00:34:41] Adding 0 traits...
[INFO] [2024-03-23 00:34:41] 0 metadata added.
[INFO] [2024-03-23 00:34:41] Adding 41686 assocs...
[INFO] [2024-03-23 00:34:46] 41686 metadata added.
[INFO] [2024-03-23 00:35:53] Processed 340000/496866 nodes
[INFO] [2024-03-23 00:37:41] 0 Traits (unfiltered) and 78675 associations...
[INFO] [2024-03-23 00:37:41] Building Traits map for 10000 nodes (this can take a while)...
[INFO] [2024-03-23 00:37:41] Mapped 0 traits (0 meta) for 10000 nodes.
[INFO] [2024-03-23 00:37:41] Building Associations map (this can take a while)...
[INFO] [2024-03-23 00:37:49] 10000 assocs mapped (0 meta)...
[INFO] [2024-03-23 00:37:56] 20000 assocs mapped (0 meta)...
[INFO] [2024-03-23 00:38:05] 30000 assocs mapped (0 meta)...
[INFO] [2024-03-23 00:38:10] 40000 assocs mapped (0 meta)...
[INFO] [2024-03-23 00:38:20] 50000 assocs mapped (0 meta)...
[INFO] [2024-03-23 00:38:26] 60000 assocs mapped (0 meta)...
[INFO] [2024-03-23 00:38:37] 70000 assocs mapped (0 meta)...
[INFO] [2024-03-23 00:38:41] Done. 78675 assocs mapped (0 meta).
[INFO] [2024-03-23 00:38:41] Adding 0 traits...
[INFO] [2024-03-23 00:38:41] 0 metadata added.
[INFO] [2024-03-23 00:38:41] Adding 78675 assocs...
[INFO] [2024-03-23 00:38:56] 78675 metadata added.
[INFO] [2024-03-23 00:40:02] Processed 350000/496866 nodes
[INFO] [2024-03-23 00:41:57] 0 Traits (unfiltered) and 106652 associations...
[INFO] [2024-03-23 00:41:57] Building Traits map for 10000 nodes (this can take a while)...
[INFO] [2024-03-23 00:41:57] Mapped 0 traits (0 meta) for 10000 nodes.
[INFO] [2024-03-23 00:41:57] Building Associations map (this can take a while)...
[INFO] [2024-03-23 00:42:03] 10000 assocs mapped (0 meta)...
[INFO] [2024-03-23 00:42:13] 20000 assocs mapped (0 meta)...
[INFO] [2024-03-23 00:42:20] 30000 assocs mapped (0 meta)...
[INFO] [2024-03-23 00:42:28] 40000 assocs mapped (0 meta)...
[INFO] [2024-03-23 00:42:39] 50000 assocs mapped (0 meta)...
[INFO] [2024-03-23 00:42:44] 60000 assocs mapped (0 meta)...
[INFO] [2024-03-23 00:42:55] 70000 assocs mapped (0 meta)...
[INFO] [2024-03-23 00:43:04] 80000 assocs mapped (0 meta)...
[INFO] [2024-03-23 00:43:13] 90000 assocs mapped (0 meta)...
[INFO] [2024-03-23 00:43:26] 100000 assocs mapped (0 meta)...
[INFO] [2024-03-23 00:43:29] Done. 106652 assocs mapped (0 meta).
[INFO] [2024-03-23 00:43:29] Adding 0 traits...
[INFO] [2024-03-23 00:43:29] 0 metadata added.
[INFO] [2024-03-23 00:43:29] Adding 106652 assocs...
[INFO] [2024-03-23 00:43:50] 106652 metadata added.
[INFO] [2024-03-23 00:44:59] Processed 360000/496866 nodes
[INFO] [2024-03-23 00:47:02] 0 Traits (unfiltered) and 45517 associations...
[INFO] [2024-03-23 00:47:02] Building Traits map for 10000 nodes (this can take a while)...
[INFO] [2024-03-23 00:47:02] Mapped 0 traits (0 meta) for 10000 nodes.
[INFO] [2024-03-23 00:47:02] Building Associations map (this can take a while)...
[INFO] [2024-03-23 00:47:08] 10000 assocs mapped (0 meta)...
[INFO] [2024-03-23 00:47:20] 20000 assocs mapped (0 meta)...
[INFO] [2024-03-23 00:47:26] 30000 assocs mapped (0 meta)...
[INFO] [2024-03-23 00:47:35] 40000 assocs mapped (0 meta)...
[INFO] [2024-03-23 00:47:38] Done. 45517 assocs mapped (0 meta).
[INFO] [2024-03-23 00:47:38] Adding 0 traits...
[INFO] [2024-03-23 00:47:38] 0 metadata added.
[INFO] [2024-03-23 00:47:38] Adding 45517 assocs...
[INFO] [2024-03-23 00:47:44] 45517 metadata added.
[INFO] [2024-03-23 00:48:52] Processed 370000/496866 nodes
[INFO] [2024-03-23 00:50:40] 0 Traits (unfiltered) and 8712 associations...
[INFO] [2024-03-23 00:50:40] Building Traits map for 10000 nodes (this can take a while)...
[INFO] [2024-03-23 00:50:40] Mapped 0 traits (0 meta) for 10000 nodes.
[INFO] [2024-03-23 00:50:40] Building Associations map (this can take a while)...
[INFO] [2024-03-23 00:50:45] Done. 8712 assocs mapped (0 meta).
[INFO] [2024-03-23 00:50:45] Adding 0 traits...
[INFO] [2024-03-23 00:50:45] 0 metadata added.
[INFO] [2024-03-23 00:50:45] Adding 8712 assocs...
[INFO] [2024-03-23 00:50:46] 8712 metadata added.
[INFO] [2024-03-23 00:51:46] Processed 380000/496866 nodes
[INFO] [2024-03-23 00:53:31] 0 Traits (unfiltered) and 15238 associations...
[INFO] [2024-03-23 00:53:31] Building Traits map for 10000 nodes (this can take a while)...
[INFO] [2024-03-23 00:53:32] Mapped 0 traits (0 meta) for 10000 nodes.
[INFO] [2024-03-23 00:53:32] Building Associations map (this can take a while)...
[INFO] [2024-03-23 00:53:39] 10000 assocs mapped (0 meta)...
[INFO] [2024-03-23 00:53:42] Done. 15238 assocs mapped (0 meta).
[INFO] [2024-03-23 00:53:42] Adding 0 traits...
[INFO] [2024-03-23 00:53:42] 0 metadata added.
[INFO] [2024-03-23 00:53:42] Adding 15238 assocs...
[INFO] [2024-03-23 00:53:44] 15238 metadata added.
[INFO] [2024-03-23 00:54:42] Processed 390000/496866 nodes
[INFO] [2024-03-23 00:56:29] 0 Traits (unfiltered) and 86805 associations...
[INFO] [2024-03-23 00:56:29] Building Traits map for 10000 nodes (this can take a while)...
[INFO] [2024-03-23 00:56:30] Mapped 0 traits (0 meta) for 10000 nodes.
[INFO] [2024-03-23 00:56:30] Building Associations map (this can take a while)...
[INFO] [2024-03-23 00:56:34] 10000 assocs mapped (0 meta)...
[INFO] [2024-03-23 00:56:42] 20000 assocs mapped (0 meta)...
[INFO] [2024-03-23 00:56:47] 30000 assocs mapped (0 meta)...
[INFO] [2024-03-23 00:56:56] 40000 assocs mapped (0 meta)...
[INFO] [2024-03-23 00:57:01] 50000 assocs mapped (0 meta)...
[INFO] [2024-03-23 00:57:10] 60000 assocs mapped (0 meta)...
[INFO] [2024-03-23 00:57:15] 70000 assocs mapped (0 meta)...
[INFO] [2024-03-23 00:57:25] 80000 assocs mapped (0 meta)...
[INFO] [2024-03-23 00:57:28] Done. 86805 assocs mapped (0 meta).
[INFO] [2024-03-23 00:57:28] Adding 0 traits...
[INFO] [2024-03-23 00:57:28] 0 metadata added.
[INFO] [2024-03-23 00:57:28] Adding 86805 assocs...
[INFO] [2024-03-23 00:57:42] 86805 metadata added.
[INFO] [2024-03-23 00:58:52] Processed 400000/496866 nodes
[INFO] [2024-03-23 01:00:46] 0 Traits (unfiltered) and 42897 associations...
[INFO] [2024-03-23 01:00:46] Building Traits map for 10000 nodes (this can take a while)...
[INFO] [2024-03-23 01:00:46] Mapped 0 traits (0 meta) for 10000 nodes.
[INFO] [2024-03-23 01:00:46] Building Associations map (this can take a while)...
[INFO] [2024-03-23 01:00:52] 10000 assocs mapped (0 meta)...
[INFO] [2024-03-23 01:01:01] 20000 assocs mapped (0 meta)...
[INFO] [2024-03-23 01:01:08] 30000 assocs mapped (0 meta)...
[INFO] [2024-03-23 01:01:16] 40000 assocs mapped (0 meta)...
[INFO] [2024-03-23 01:01:17] Done. 42897 assocs mapped (0 meta).
[INFO] [2024-03-23 01:01:17] Adding 0 traits...
[INFO] [2024-03-23 01:01:17] 0 metadata added.
[INFO] [2024-03-23 01:01:17] Adding 42897 assocs...
[INFO] [2024-03-23 01:01:24] 42897 metadata added.
[INFO] [2024-03-23 01:02:28] Processed 410000/496866 nodes
[INFO] [2024-03-23 01:04:14] 0 Traits (unfiltered) and 47208 associations...
[INFO] [2024-03-23 01:04:14] Building Traits map for 10000 nodes (this can take a while)...
[INFO] [2024-03-23 01:04:14] Mapped 0 traits (0 meta) for 10000 nodes.
[INFO] [2024-03-23 01:04:14] Building Associations map (this can take a while)...
[INFO] [2024-03-23 01:04:19] 10000 assocs mapped (0 meta)...
[INFO] [2024-03-23 01:04:29] 20000 assocs mapped (0 meta)...
[INFO] [2024-03-23 01:04:36] 30000 assocs mapped (0 meta)...
[INFO] [2024-03-23 01:04:43] 40000 assocs mapped (0 meta)...
[INFO] [2024-03-23 01:04:47] Done. 47208 assocs mapped (0 meta).
[INFO] [2024-03-23 01:04:47] Adding 0 traits...
[INFO] [2024-03-23 01:04:47] 0 metadata added.
[INFO] [2024-03-23 01:04:47] Adding 47208 assocs...
[INFO] [2024-03-23 01:04:57] 47208 metadata added.
[INFO] [2024-03-23 01:06:00] Processed 420000/496866 nodes
[INFO] [2024-03-23 01:07:47] 0 Traits (unfiltered) and 23500 associations...
[INFO] [2024-03-23 01:07:47] Building Traits map for 10000 nodes (this can take a while)...
[INFO] [2024-03-23 01:07:47] Mapped 0 traits (0 meta) for 10000 nodes.
[INFO] [2024-03-23 01:07:47] Building Associations map (this can take a while)...
[INFO] [2024-03-23 01:07:52] 10000 assocs mapped (0 meta)...
[INFO] [2024-03-23 01:08:02] 20000 assocs mapped (0 meta)...
[INFO] [2024-03-23 01:08:04] Done. 23500 assocs mapped (0 meta).
[INFO] [2024-03-23 01:08:04] Adding 0 traits...
[INFO] [2024-03-23 01:08:04] 0 metadata added.
[INFO] [2024-03-23 01:08:04] Adding 23500 assocs...
[INFO] [2024-03-23 01:08:07] 23500 metadata added.
[INFO] [2024-03-23 01:09:09] Processed 430000/496866 nodes
[INFO] [2024-03-23 01:10:53] 0 Traits (unfiltered) and 24168 associations...
[INFO] [2024-03-23 01:10:53] Building Traits map for 10000 nodes (this can take a while)...
[INFO] [2024-03-23 01:10:53] Mapped 0 traits (0 meta) for 10000 nodes.
[INFO] [2024-03-23 01:10:53] Building Associations map (this can take a while)...
[INFO] [2024-03-23 01:10:59] 10000 assocs mapped (0 meta)...
[INFO] [2024-03-23 01:11:08] 20000 assocs mapped (0 meta)...
[INFO] [2024-03-23 01:11:10] Done. 24168 assocs mapped (0 meta).
[INFO] [2024-03-23 01:11:10] Adding 0 traits...
[INFO] [2024-03-23 01:11:10] 0 metadata added.
[INFO] [2024-03-23 01:11:10] Adding 24168 assocs...
[INFO] [2024-03-23 01:11:13] 24168 metadata added.
[INFO] [2024-03-23 01:12:12] Processed 440000/496866 nodes
[INFO] [2024-03-23 01:14:01] 0 Traits (unfiltered) and 27148 associations...
[INFO] [2024-03-23 01:14:01] Building Traits map for 10000 nodes (this can take a while)...
[INFO] [2024-03-23 01:14:01] Mapped 0 traits (0 meta) for 10000 nodes.
[INFO] [2024-03-23 01:14:01] Building Associations map (this can take a while)...
[INFO] [2024-03-23 01:14:08] 10000 assocs mapped (0 meta)...
[INFO] [2024-03-23 01:14:14] 20000 assocs mapped (0 meta)...
[INFO] [2024-03-23 01:14:21] Done. 27148 assocs mapped (0 meta).
[INFO] [2024-03-23 01:14:21] Adding 0 traits...
[INFO] [2024-03-23 01:14:21] 0 metadata added.
[INFO] [2024-03-23 01:14:21] Adding 27148 assocs...
[INFO] [2024-03-23 01:14:24] 27148 metadata added.
[INFO] [2024-03-23 01:15:24] Processed 450000/496866 nodes
[INFO] [2024-03-23 01:17:10] 0 Traits (unfiltered) and 46426 associations...
[INFO] [2024-03-23 01:17:10] Building Traits map for 10000 nodes (this can take a while)...
[INFO] [2024-03-23 01:17:10] Mapped 0 traits (0 meta) for 10000 nodes.
[INFO] [2024-03-23 01:17:10] Building Associations map (this can take a while)...
[INFO] [2024-03-23 01:17:19] 10000 assocs mapped (0 meta)...
[INFO] [2024-03-23 01:17:24] 20000 assocs mapped (0 meta)...
[INFO] [2024-03-23 01:17:34] 30000 assocs mapped (0 meta)...
[INFO] [2024-03-23 01:17:39] 40000 assocs mapped (0 meta)...
[INFO] [2024-03-23 01:17:44] Done. 46426 assocs mapped (0 meta).
[INFO] [2024-03-23 01:17:44] Adding 0 traits...
[INFO] [2024-03-23 01:17:44] 0 metadata added.
[INFO] [2024-03-23 01:17:44] Adding 46426 assocs...
[INFO] [2024-03-23 01:17:52] 46426 metadata added.
[INFO] [2024-03-23 01:18:54] Processed 460000/496866 nodes
[INFO] [2024-03-23 01:20:41] 0 Traits (unfiltered) and 23345 associations...
[INFO] [2024-03-23 01:20:41] Building Traits map for 10000 nodes (this can take a while)...
[INFO] [2024-03-23 01:20:41] Mapped 0 traits (0 meta) for 10000 nodes.
[INFO] [2024-03-23 01:20:41] Building Associations map (this can take a while)...
[INFO] [2024-03-23 01:20:50] 10000 assocs mapped (0 meta)...
[INFO] [2024-03-23 01:20:56] 20000 assocs mapped (0 meta)...
[INFO] [2024-03-23 01:20:57] Done. 23345 assocs mapped (0 meta).
[INFO] [2024-03-23 01:20:57] Adding 0 traits...
[INFO] [2024-03-23 01:20:57] 0 metadata added.
[INFO] [2024-03-23 01:20:57] Adding 23345 assocs...
[INFO] [2024-03-23 01:21:04] 23345 metadata added.
[INFO] [2024-03-23 01:22:03] Processed 470000/496866 nodes
[INFO] [2024-03-23 01:23:47] 0 Traits (unfiltered) and 12000 associations...
[INFO] [2024-03-23 01:23:47] Building Traits map for 10000 nodes (this can take a while)...
[INFO] [2024-03-23 01:23:48] Mapped 0 traits (0 meta) for 10000 nodes.
[INFO] [2024-03-23 01:23:48] Building Associations map (this can take a while)...
[INFO] [2024-03-23 01:23:55] 10000 assocs mapped (0 meta)...
[INFO] [2024-03-23 01:23:56] Done. 12000 assocs mapped (0 meta).
[INFO] [2024-03-23 01:23:56] Adding 0 traits...
[INFO] [2024-03-23 01:23:56] 0 metadata added.
[INFO] [2024-03-23 01:23:56] Adding 12000 assocs...
[INFO] [2024-03-23 01:23:58] 12000 metadata added.
[INFO] [2024-03-23 01:24:55] Processed 480000/496866 nodes
[INFO] [2024-03-23 01:26:41] 0 Traits (unfiltered) and 9702 associations...
[INFO] [2024-03-23 01:26:41] Building Traits map for 10000 nodes (this can take a while)...
[INFO] [2024-03-23 01:26:41] Mapped 0 traits (0 meta) for 10000 nodes.
[INFO] [2024-03-23 01:26:41] Building Associations map (this can take a while)...
[INFO] [2024-03-23 01:26:47] Done. 9702 assocs mapped (0 meta).
[INFO] [2024-03-23 01:26:47] Adding 0 traits...
[INFO] [2024-03-23 01:26:47] 0 metadata added.
[INFO] [2024-03-23 01:26:47] Adding 9702 assocs...
[INFO] [2024-03-23 01:26:48] 9702 metadata added.
[INFO] [2024-03-23 01:27:45] Processed 490000/496866 nodes
[INFO] [2024-03-23 01:28:06] 0 Traits (unfiltered) and 7937 associations...
[INFO] [2024-03-23 01:28:06] Building Traits map for 6866 nodes (this can take a while)...
[INFO] [2024-03-23 01:28:06] Mapped 0 traits (0 meta) for 6866 nodes.
[INFO] [2024-03-23 01:28:06] Building Associations map (this can take a while)...
[INFO] [2024-03-23 01:28:11] Done. 7937 assocs mapped (0 meta).
[INFO] [2024-03-23 01:28:11] Adding 0 traits...
[INFO] [2024-03-23 01:28:11] 0 metadata added.
[INFO] [2024-03-23 01:28:11] Adding 7937 assocs...
[INFO] [2024-03-23 01:28:12] 7937 metadata added.
[INFO] [2024-03-23 01:29:08] Processed 496866/496866 nodes
[INFO] [2024-03-23 01:29:08] Average Time: 148.116
[INFO] [2024-03-23 01:29:08] Total Time: 3h16m46s
[INFO] [2024-03-23 01:29:08] last 3 / first 3: 0.52
[INFO] [2024-03-23 01:29:08] Std.Dev: 58.261; Max: 352.25
[STOP] [2024-03-23 01:29:08] overall_tsv_creation
[INFO] [2024-03-23 01:29:08] Done. Check your files:
[INFO] [2024-03-23 01:29:09] (496866 lines) /app/public/data/Globi/publish_nodes.tsv
[INFO] [2024-03-23 01:29:09] (2611606 lines) /app/public/data/Globi/publish_node_ancestors.tsv
[INFO] [2024-03-23 01:29:09] (496866 lines) /app/public/data/Globi/publish_scientific_names.tsv
[INFO] [2024-03-23 01:29:10] (2980195 lines) /app/public/data/Globi/publish_traits.tsv
[INFO] [2024-03-23 01:29:10] (2980195 lines) /app/public/data/Globi/publish_metadata.tsv
[STOP] [2024-03-23 01:29:11] complete_harvest_instance
[START] [2024-03-23 01:29:11] completed
[STOP] [2024-03-23 01:29:11] completed
[STOP] [2024-03-23 01:29:11] logged process, took 25980.34
Latest Process