Stage:
completed
Fetched:
09 Sep 12:12
Validated:
09 Sep 12:12
Deltas Created
09 Sep 12:12
Units Normalized:
09 Sep 23:09
Ancestry Built:
09 Sep 13:52
Nodes Matched:
09 Sep 22:44
Names Parsed:
09 Sep 14:01
New Models Stored:
09 Sep 12:40
Indexed:
09 Sep 23:07
Completed:
10 Sep 03:33
Time to Harvest:
15 minutes
Harvesting Log
(1220 lines)
(showing only the last 1000 lines, see /app/public/data/ncbi_data_covera/process.log for the full file)
[INFO] [2024-09-09 12:27:23] Storing 9999 Occurrences (9999/10000/688907)
[INFO] [2024-09-09 12:27:26] Storing 10000 Occurrences (19999/20000/688907)
[INFO] [2024-09-09 12:27:28] Storing 10000 Occurrences (29999/30000/688907)
[INFO] [2024-09-09 12:27:31] Storing 10000 Occurrences (39999/40000/688907)
[INFO] [2024-09-09 12:27:34] Storing 10000 Occurrences (49999/50000/688907)
[INFO] [2024-09-09 12:27:36] Storing 10000 Occurrences (59999/60000/688907)
[INFO] [2024-09-09 12:27:39] Storing 10000 Occurrences (69999/70000/688907)
[INFO] [2024-09-09 12:27:42] Storing 10000 Occurrences (79999/80000/688907)
[INFO] [2024-09-09 12:27:45] Storing 10000 Occurrences (89999/90000/688907)
[INFO] [2024-09-09 12:27:48] Storing 10000 Occurrences (99999/100000/688907)
[INFO] [2024-09-09 12:27:51] Storing 10000 Occurrences (109999/110000/688907)
[INFO] [2024-09-09 12:27:54] Storing 10000 Occurrences (119999/120000/688907)
[INFO] [2024-09-09 12:27:58] Storing 10000 Occurrences (129999/130000/688907)
[INFO] [2024-09-09 12:28:01] Storing 10000 Occurrences (139999/140000/688907)
[INFO] [2024-09-09 12:28:04] Storing 10000 Occurrences (149999/150000/688907)
[INFO] [2024-09-09 12:28:07] Storing 10000 Occurrences (159999/160000/688907)
[INFO] [2024-09-09 12:28:10] Storing 10000 Occurrences (169999/170000/688907)
[INFO] [2024-09-09 12:28:13] Storing 10000 Occurrences (179999/180000/688907)
[INFO] [2024-09-09 12:28:16] Storing 10000 Occurrences (189999/190000/688907)
[INFO] [2024-09-09 12:28:19] Storing 10000 Occurrences (199999/200000/688907)
[INFO] [2024-09-09 12:28:22] Storing 10000 Occurrences (209999/210000/688907)
[INFO] [2024-09-09 12:28:26] Storing 10000 Occurrences (219999/220000/688907)
[INFO] [2024-09-09 12:28:29] Storing 10000 Occurrences (229999/230000/688907)
[INFO] [2024-09-09 12:28:33] Storing 10000 Occurrences (239999/240000/688907)
[INFO] [2024-09-09 12:28:36] Storing 10000 Occurrences (249999/250000/688907)
[INFO] [2024-09-09 12:28:39] Storing 10000 Occurrences (259999/260000/688907)
[INFO] [2024-09-09 12:28:43] Storing 10000 Occurrences (269999/270000/688907)
[INFO] [2024-09-09 12:28:47] Storing 10000 Occurrences (279999/280000/688907)
[INFO] [2024-09-09 12:28:51] Storing 10000 Occurrences (289999/290000/688907)
[INFO] [2024-09-09 12:28:54] Storing 10000 Occurrences (299999/300000/688907)
[INFO] [2024-09-09 12:28:58] Storing 10000 Occurrences (309999/310000/688907)
[INFO] [2024-09-09 12:29:02] Storing 10000 Occurrences (319999/320000/688907)
[INFO] [2024-09-09 12:29:06] Storing 10000 Occurrences (329999/330000/688907)
[INFO] [2024-09-09 12:29:10] Storing 10000 Occurrences (339999/340000/688907)
[INFO] [2024-09-09 12:29:14] Storing 10000 Occurrences (349999/350000/688907)
[INFO] [2024-09-09 12:29:18] Storing 10000 Occurrences (359999/360000/688907)
[INFO] [2024-09-09 12:29:22] Storing 10000 Occurrences (369999/370000/688907)
[INFO] [2024-09-09 12:29:26] Storing 10000 Occurrences (379999/380000/688907)
[INFO] [2024-09-09 12:29:30] Storing 10000 Occurrences (389999/390000/688907)
[INFO] [2024-09-09 12:29:34] Storing 10000 Occurrences (399999/400000/688907)
[INFO] [2024-09-09 12:29:38] Storing 10000 Occurrences (409999/410000/688907)
[INFO] [2024-09-09 12:29:43] Storing 10000 Occurrences (419999/420000/688907)
[INFO] [2024-09-09 12:29:47] Storing 10000 Occurrences (429999/430000/688907)
[INFO] [2024-09-09 12:29:52] Storing 10000 Occurrences (439999/440000/688907)
[INFO] [2024-09-09 12:29:56] Storing 10000 Occurrences (449999/450000/688907)
[INFO] [2024-09-09 12:30:01] Storing 10000 Occurrences (459999/460000/688907)
[INFO] [2024-09-09 12:30:06] Storing 10000 Occurrences (469999/470000/688907)
[INFO] [2024-09-09 12:30:10] Storing 10000 Occurrences (479999/480000/688907)
[INFO] [2024-09-09 12:30:14] Storing 10000 Occurrences (489999/490000/688907)
[INFO] [2024-09-09 12:30:19] Storing 10000 Occurrences (499999/500000/688907)
[INFO] [2024-09-09 12:30:24] Storing 10000 Occurrences (509999/510000/688907)
[INFO] [2024-09-09 12:30:28] Storing 10000 Occurrences (519999/520000/688907)
[INFO] [2024-09-09 12:30:33] Storing 10000 Occurrences (529999/530000/688907)
[INFO] [2024-09-09 12:30:38] Storing 10000 Occurrences (539999/540000/688907)
[INFO] [2024-09-09 12:30:43] Storing 10000 Occurrences (549999/550000/688907)
[INFO] [2024-09-09 12:30:47] Storing 10000 Occurrences (559999/560000/688907)
[INFO] [2024-09-09 12:30:52] Storing 10000 Occurrences (569999/570000/688907)
[INFO] [2024-09-09 12:30:57] Storing 10000 Occurrences (579999/580000/688907)
[INFO] [2024-09-09 12:31:03] Storing 10000 Occurrences (589999/590000/688907)
[INFO] [2024-09-09 12:31:08] Storing 10000 Occurrences (599999/600000/688907)
[INFO] [2024-09-09 12:31:13] Storing 10000 Occurrences (609999/610000/688907)
[INFO] [2024-09-09 12:31:18] Storing 10000 Occurrences (619999/620000/688907)
[INFO] [2024-09-09 12:31:23] Storing 10000 Occurrences (629999/630000/688907)
[INFO] [2024-09-09 12:31:28] Storing 10000 Occurrences (639999/640000/688907)
[INFO] [2024-09-09 12:31:34] Storing 10000 Occurrences (649999/650000/688907)
[INFO] [2024-09-09 12:31:39] Storing 10000 Occurrences (659999/660000/688907)
[INFO] [2024-09-09 12:31:44] Storing 10000 Occurrences (669999/670000/688907)
[INFO] [2024-09-09 12:31:51] Storing 10000 Occurrences (679999/680000/688907)
[INFO] [2024-09-09 12:31:56] Storing 8906 Occurrences (688905/688905/688907)
[INFO] [2024-09-09 12:31:58] Handling diff: /app/public/data/ncbi_data_covera/diff/ncbi_data_covera_measurements_31199.diff (688907 lines)
[INFO] [2024-09-09 12:31:58] Loading measurements diff file into memory (688907 lines)...
[INFO] [2024-09-09 12:32:02] Storing 9999 Traits (9999/10000/688907)
[INFO] [2024-09-09 12:32:10] Storing 10000 Traits (19999/20000/688907)
[INFO] [2024-09-09 12:32:16] Storing 10000 Traits (29999/30000/688907)
[INFO] [2024-09-09 12:32:23] Storing 10000 Traits (39999/40000/688907)
[INFO] [2024-09-09 12:32:30] Storing 10000 Traits (49999/50000/688907)
[INFO] [2024-09-09 12:32:37] Storing 10000 Traits (59999/60000/688907)
[INFO] [2024-09-09 12:32:43] Storing 10000 Traits (69999/70000/688907)
[INFO] [2024-09-09 12:32:50] Storing 10000 Traits (79999/80000/688907)
[INFO] [2024-09-09 12:32:56] Storing 10000 Traits (89999/90000/688907)
[INFO] [2024-09-09 12:33:03] Storing 10000 Traits (99999/100000/688907)
[INFO] [2024-09-09 12:33:09] Storing 10000 Traits (109999/110000/688907)
[INFO] [2024-09-09 12:33:16] Storing 10000 Traits (119999/120000/688907)
[INFO] [2024-09-09 12:33:22] Storing 10000 Traits (129999/130000/688907)
[INFO] [2024-09-09 12:33:29] Storing 10000 Traits (139999/140000/688907)
[INFO] [2024-09-09 12:33:35] Storing 10000 Traits (149999/150000/688907)
[INFO] [2024-09-09 12:33:41] Storing 10000 Traits (159999/160000/688907)
[INFO] [2024-09-09 12:33:47] Storing 10000 Traits (169999/170000/688907)
[INFO] [2024-09-09 12:33:54] Storing 10000 Traits (179999/180000/688907)
[INFO] [2024-09-09 12:34:00] Storing 10000 Traits (189999/190000/688907)
[INFO] [2024-09-09 12:34:07] Storing 10000 Traits (199999/200000/688907)
[INFO] [2024-09-09 12:34:13] Storing 10000 Traits (209999/210000/688907)
[INFO] [2024-09-09 12:34:20] Storing 10000 Traits (219999/220000/688907)
[INFO] [2024-09-09 12:34:27] Storing 10000 Traits (229999/230000/688907)
[INFO] [2024-09-09 12:34:34] Storing 10000 Traits (239999/240000/688907)
[INFO] [2024-09-09 12:34:41] Storing 10000 Traits (249999/250000/688907)
[INFO] [2024-09-09 12:34:48] Storing 10000 Traits (259999/260000/688907)
[INFO] [2024-09-09 12:34:55] Storing 10000 Traits (269999/270000/688907)
[INFO] [2024-09-09 12:35:02] Storing 10000 Traits (279999/280000/688907)
[INFO] [2024-09-09 12:35:09] Storing 10000 Traits (289999/290000/688907)
[INFO] [2024-09-09 12:35:16] Storing 10000 Traits (299999/300000/688907)
[INFO] [2024-09-09 12:35:23] Storing 10000 Traits (309999/310000/688907)
[INFO] [2024-09-09 12:35:30] Storing 10000 Traits (319999/320000/688907)
[INFO] [2024-09-09 12:35:37] Storing 10000 Traits (329999/330000/688907)
[INFO] [2024-09-09 12:35:44] Storing 10000 Traits (339999/340000/688907)
[INFO] [2024-09-09 12:35:51] Storing 10000 Traits (349999/350000/688907)
[INFO] [2024-09-09 12:35:58] Storing 10000 Traits (359999/360000/688907)
[INFO] [2024-09-09 12:36:05] Storing 10000 Traits (369999/370000/688907)
[INFO] [2024-09-09 12:36:12] Storing 10000 Traits (379999/380000/688907)
[INFO] [2024-09-09 12:36:19] Storing 10000 Traits (389999/390000/688907)
[INFO] [2024-09-09 12:36:26] Storing 10000 Traits (399999/400000/688907)
[INFO] [2024-09-09 12:36:34] Storing 10000 Traits (409999/410000/688907)
[INFO] [2024-09-09 12:36:41] Storing 10000 Traits (419999/420000/688907)
[INFO] [2024-09-09 12:36:49] Storing 10000 Traits (429999/430000/688907)
[INFO] [2024-09-09 12:36:56] Storing 10000 Traits (439999/440000/688907)
[INFO] [2024-09-09 12:37:03] Storing 10000 Traits (449999/450000/688907)
[INFO] [2024-09-09 12:37:11] Storing 10000 Traits (459999/460000/688907)
[INFO] [2024-09-09 12:37:19] Storing 10000 Traits (469999/470000/688907)
[INFO] [2024-09-09 12:37:27] Storing 10000 Traits (479999/480000/688907)
[INFO] [2024-09-09 12:37:34] Storing 10000 Traits (489999/490000/688907)
[INFO] [2024-09-09 12:37:42] Storing 10000 Traits (499999/500000/688907)
[INFO] [2024-09-09 12:37:50] Storing 10000 Traits (509999/510000/688907)
[INFO] [2024-09-09 12:37:58] Storing 10000 Traits (519999/520000/688907)
[INFO] [2024-09-09 12:38:07] Storing 10000 Traits (529999/530000/688907)
[INFO] [2024-09-09 12:38:15] Storing 10000 Traits (539999/540000/688907)
[INFO] [2024-09-09 12:38:23] Storing 10000 Traits (549999/550000/688907)
[INFO] [2024-09-09 12:38:31] Storing 10000 Traits (559999/560000/688907)
[INFO] [2024-09-09 12:38:39] Storing 10000 Traits (569999/570000/688907)
[INFO] [2024-09-09 12:38:47] Storing 10000 Traits (579999/580000/688907)
[INFO] [2024-09-09 12:38:55] Storing 10000 Traits (589999/590000/688907)
[INFO] [2024-09-09 12:39:03] Storing 10000 Traits (599999/600000/688907)
[INFO] [2024-09-09 12:39:12] Storing 10000 Traits (609999/610000/688907)
[INFO] [2024-09-09 12:39:20] Storing 10000 Traits (619999/620000/688907)
[INFO] [2024-09-09 12:39:29] Storing 10000 Traits (629999/630000/688907)
[INFO] [2024-09-09 12:39:37] Storing 10000 Traits (639999/640000/688907)
[INFO] [2024-09-09 12:39:46] Storing 10000 Traits (649999/650000/688907)
[INFO] [2024-09-09 12:39:54] Storing 10000 Traits (659999/660000/688907)
[INFO] [2024-09-09 12:40:03] Storing 10000 Traits (669999/670000/688907)
[INFO] [2024-09-09 12:40:12] Storing 10000 Traits (679999/680000/688907)
[INFO] [2024-09-09 12:40:20] Storing 8906 Traits (688905/688905/688907)
[STOP] [2024-09-09 12:40:24] parse_diff_and_store
[START] [2024-09-09 12:40:24] resolve_keys
[2024-09-09 12:44:51] Resolving downloaded urls (this is not actually downloading them yet)
[INFO] [2024-09-09 12:45:01] Occurrences to nodes (through scientific_names)...
[INFO] [2024-09-09 12:45:43] traits to occurrences...
[INFO] [2024-09-09 12:47:31] traits to nodes (through occurrences)...
[INFO] [2024-09-09 12:48:10] Traits to sex term...
[INFO] [2024-09-09 12:48:21] Traits to lifestage term...
[INFO] [2024-09-09 12:48:32] MetaTraits to traits...
[INFO] [2024-09-09 12:48:32] MetaTraits (simple, measurement row refers to parent) to traits...
[INFO] [2024-09-09 12:48:33] Assocs to occurrences...
[INFO] [2024-09-09 12:48:33] Assocs to nodes...
[INFO] [2024-09-09 12:48:33] Assoc to sex term...
[INFO] [2024-09-09 12:48:33] Assoc to lifestage term...
[INFO] [2024-09-09 12:48:33] MetaAssoc to assocs...
[STOP] [2024-09-09 12:48:34] resolve_keys
[START] [2024-09-09 12:48:34] hold_for_later_1
[STOP] [2024-09-09 12:48:34] hold_for_later_1
[START] [2024-09-09 12:48:34] hold_for_later_2
[STOP] [2024-09-09 12:48:34] hold_for_later_2
[START] [2024-09-09 12:48:34] resolve_missing_parents
[STOP] [2024-09-09 12:48:49] resolve_missing_parents
[START] [2024-09-09 12:48:49] rebuild_nodes
[START] [2024-09-09 12:48:49] Flattener#flatten
[START] [2024-09-09 12:48:49] Flattener#study_resource
[START] [2024-09-09 12:50:20] Flattener#build_ancestry
[STOP] [2024-09-09 13:12:42] Flattener#build_ancestry
[INFO] [2024-09-09 13:12:42] 706834 ancestry keys
[START] [2024-09-09 13:12:42] build_node_ancestors
[INFO] [2024-09-09 13:12:42] old ancestors deleted.
[STOP] [2024-09-09 13:40:18] build_node_ancestors
[START] [2024-09-09 13:40:24] Flattener#propagate_ancestor_ids
[STOP] [2024-09-09 13:52:39] Flattener#propagate_ancestor_ids
[STOP] [2024-09-09 13:52:39] Flattener#flatten
[STOP] [2024-09-09 13:52:39] rebuild_nodes
[START] [2024-09-09 13:52:39] resolve_missing_media_owners
[STOP] [2024-09-09 13:52:39] resolve_missing_media_owners
[START] [2024-09-09 13:52:39] sanitize_media_verbatims
[STOP] [2024-09-09 13:52:39] sanitize_media_verbatims
[START] [2024-09-09 13:52:39] queue_downloads
[STOP] [2024-09-09 13:52:39] queue_downloads
[START] [2024-09-09 13:52:40] parse_names
[WARN] [2024-09-09 13:52:41] I see 706834 names which still need to be parsed.
[WARN] [2024-09-09 13:52:42] Names to parse: 10000 formatted: 10000 learned: 9955 parsed: 10000
[WARN] [2024-09-09 13:52:52] Names to parse: 10000 formatted: 10000 learned: 9979 parsed: 10000
[WARN] [2024-09-09 13:53:01] Names to parse: 10000 formatted: 10000 learned: 9973 parsed: 10000
[WARN] [2024-09-09 13:53:09] Names to parse: 10000 formatted: 10000 learned: 9996 parsed: 10000
[WARN] [2024-09-09 13:53:18] Names to parse: 10000 formatted: 10000 learned: 9973 parsed: 10000
[WARN] [2024-09-09 13:53:26] Names to parse: 10000 formatted: 10000 learned: 9972 parsed: 10000
[WARN] [2024-09-09 13:53:35] Names to parse: 10000 formatted: 10000 learned: 9985 parsed: 10000
[WARN] [2024-09-09 13:53:43] Names to parse: 10000 formatted: 10000 learned: 9977 parsed: 10000
[WARN] [2024-09-09 13:53:51] Names to parse: 10000 formatted: 10000 learned: 9991 parsed: 10000
[WARN] [2024-09-09 13:53:59] Names to parse: 10000 formatted: 10000 learned: 9988 parsed: 10000
[WARN] [2024-09-09 13:54:07] Names to parse: 10000 formatted: 10000 learned: 9991 parsed: 10000
[WARN] [2024-09-09 13:54:15] Names to parse: 10000 formatted: 10000 learned: 9976 parsed: 10000
[WARN] [2024-09-09 13:54:23] Names to parse: 10000 formatted: 10000 learned: 9996 parsed: 10000
[WARN] [2024-09-09 13:54:31] Names to parse: 10000 formatted: 10000 learned: 9996 parsed: 10000
[WARN] [2024-09-09 13:54:38] Names to parse: 10000 formatted: 10000 learned: 9993 parsed: 10000
[WARN] [2024-09-09 13:54:46] Names to parse: 10000 formatted: 10000 learned: 9982 parsed: 10000
[WARN] [2024-09-09 13:54:54] Names to parse: 10000 formatted: 10000 learned: 9998 parsed: 10000
[WARN] [2024-09-09 13:55:02] Names to parse: 10000 formatted: 10000 learned: 9998 parsed: 10000
[WARN] [2024-09-09 13:55:10] Names to parse: 10000 formatted: 10000 learned: 9999 parsed: 10000
[WARN] [2024-09-09 13:55:17] Names to parse: 10000 formatted: 10000 learned: 9996 parsed: 10000
[WARN] [2024-09-09 13:55:25] Names to parse: 10000 formatted: 10000 learned: 9977 parsed: 10000
[WARN] [2024-09-09 13:55:33] Names to parse: 10000 formatted: 10000 learned: 9995 parsed: 10000
[WARN] [2024-09-09 13:55:41] Names to parse: 10000 formatted: 10000 learned: 9999 parsed: 10000
[WARN] [2024-09-09 13:55:48] Names to parse: 10000 formatted: 10000 learned: 9998 parsed: 10000
[WARN] [2024-09-09 13:55:55] Names to parse: 10000 formatted: 10000 learned: 9985 parsed: 10000
[WARN] [2024-09-09 13:56:03] Names to parse: 10000 formatted: 10000 learned: 9954 parsed: 10000
[WARN] [2024-09-09 13:56:11] Names to parse: 10000 formatted: 10000 learned: 9996 parsed: 10000
[WARN] [2024-09-09 13:56:19] Names to parse: 10000 formatted: 10000 learned: 9998 parsed: 10000
[WARN] [2024-09-09 13:56:26] Names to parse: 10000 formatted: 10000 learned: 9976 parsed: 10000
[WARN] [2024-09-09 13:56:34] Names to parse: 10000 formatted: 10000 learned: 9999 parsed: 10000
[WARN] [2024-09-09 13:56:41] Names to parse: 10000 formatted: 10000 learned: 9997 parsed: 10000
[WARN] [2024-09-09 13:56:49] Names to parse: 10000 formatted: 10000 learned: 9998 parsed: 10000
[WARN] [2024-09-09 13:56:56] Names to parse: 10000 formatted: 10000 learned: 9990 parsed: 10000
[WARN] [2024-09-09 13:57:04] Names to parse: 10000 formatted: 10000 learned: 9998 parsed: 10000
[WARN] [2024-09-09 13:57:11] Names to parse: 10000 formatted: 10000 learned: 9952 parsed: 10000
[WARN] [2024-09-09 13:57:20] Names to parse: 10000 formatted: 10000 learned: 9974 parsed: 10000
[WARN] [2024-09-09 13:57:27] Names to parse: 10000 formatted: 10000 learned: 9989 parsed: 10000
[WARN] [2024-09-09 13:57:34] Names to parse: 10000 formatted: 10000 learned: 9997 parsed: 10000
[WARN] [2024-09-09 13:57:42] Names to parse: 10000 formatted: 10000 learned: 9971 parsed: 10000
[WARN] [2024-09-09 13:57:49] Names to parse: 10000 formatted: 10000 learned: 9996 parsed: 10000
[WARN] [2024-09-09 13:57:56] Names to parse: 10000 formatted: 10000 learned: 9944 parsed: 10000
[WARN] [2024-09-09 13:58:05] Names to parse: 10000 formatted: 10000 learned: 9979 parsed: 10000
[WARN] [2024-09-09 13:58:12] Names to parse: 10000 formatted: 10000 learned: 10000 parsed: 10000
[WARN] [2024-09-09 13:58:19] Names to parse: 10000 formatted: 10000 learned: 10000 parsed: 10000
[WARN] [2024-09-09 13:58:27] Names to parse: 10000 formatted: 10000 learned: 10000 parsed: 10000
[WARN] [2024-09-09 13:58:34] Names to parse: 10000 formatted: 10000 learned: 10000 parsed: 10000
[WARN] [2024-09-09 13:58:41] Names to parse: 10000 formatted: 10000 learned: 10000 parsed: 10000
[WARN] [2024-09-09 13:58:48] Names to parse: 10000 formatted: 10000 learned: 9999 parsed: 10000
[WARN] [2024-09-09 13:58:56] Names to parse: 10000 formatted: 10000 learned: 9998 parsed: 10000
[WARN] [2024-09-09 13:59:03] Names to parse: 10000 formatted: 10000 learned: 9999 parsed: 10000
[WARN] [2024-09-09 13:59:10] Names to parse: 10000 formatted: 10000 learned: 9995 parsed: 10000
[WARN] [2024-09-09 13:59:17] Names to parse: 10000 formatted: 10000 learned: 9956 parsed: 10000
[WARN] [2024-09-09 13:59:25] Names to parse: 10000 formatted: 10000 learned: 9993 parsed: 10000
[WARN] [2024-09-09 13:59:32] Names to parse: 10000 formatted: 10000 learned: 9995 parsed: 10000
[WARN] [2024-09-09 13:59:40] Names to parse: 10000 formatted: 10000 learned: 9971 parsed: 10000
[WARN] [2024-09-09 13:59:47] Names to parse: 10000 formatted: 10000 learned: 9988 parsed: 10000
[WARN] [2024-09-09 13:59:54] Names to parse: 10000 formatted: 10000 learned: 9993 parsed: 10000
[WARN] [2024-09-09 14:00:02] Names to parse: 10000 formatted: 10000 learned: 9996 parsed: 10000
[WARN] [2024-09-09 14:00:09] Names to parse: 10000 formatted: 10000 learned: 9994 parsed: 10000
[WARN] [2024-09-09 14:00:16] Names to parse: 10000 formatted: 10000 learned: 9985 parsed: 10000
[WARN] [2024-09-09 14:00:23] Names to parse: 10000 formatted: 10000 learned: 9993 parsed: 10000
[WARN] [2024-09-09 14:00:31] Names to parse: 10000 formatted: 10000 learned: 9997 parsed: 10000
[WARN] [2024-09-09 14:00:38] Names to parse: 10000 formatted: 10000 learned: 9996 parsed: 10000
[WARN] [2024-09-09 14:00:45] Names to parse: 10000 formatted: 10000 learned: 9969 parsed: 10000
[WARN] [2024-09-09 14:00:52] Names to parse: 10000 formatted: 10000 learned: 9981 parsed: 10000
[WARN] [2024-09-09 14:01:00] Names to parse: 10000 formatted: 10000 learned: 9986 parsed: 10000
[WARN] [2024-09-09 14:01:08] Names to parse: 10000 formatted: 10000 learned: 9998 parsed: 10000
[WARN] [2024-09-09 14:01:15] Names to parse: 10000 formatted: 10000 learned: 9992 parsed: 10000
[WARN] [2024-09-09 14:01:22] Names to parse: 10000 formatted: 10000 learned: 9999 parsed: 10000
[WARN] [2024-09-09 14:01:30] Names to parse: 10000 formatted: 10000 learned: 9984 parsed: 10000
[WARN] [2024-09-09 14:01:37] Names to parse: 6834 formatted: 6834 learned: 6807 parsed: 6834
[STOP] [2024-09-09 14:01:43] parse_names
[START] [2024-09-09 14:01:43] denormalize_canonical_names_to_nodes
[STOP] [2024-09-09 14:02:11] denormalize_canonical_names_to_nodes
[START] [2024-09-09 14:02:11] match_nodes
[START] [2024-09-09 14:02:13] map_all_nodes_to_pages
[STOP] [2024-09-09 22:44:06] map_all_nodes_to_pages
[INFO] [2024-09-09 22:44:07] 51128 Unmatched nodes (of 706834)! That's too many to output. Full list in /app/public/data/ncbi_data_covera/unmatched_nodes.txt ; First 10: Canonical: Lake; Node#163436229; ResourceID: 1685724; Canonical: Lake; Node#163436230; ResourceID: 1685725; Canonical: Lake; Node#163436231; ResourceID: 1685726; Canonical: Lake; Node#163436232; ResourceID: 1685727; Canonical: Lake; Node#163436233; ResourceID: 1685728; Canonical: Lake; Node#163436234; ResourceID: 1685729; Canonical: Lake; Node#163436236; ResourceID: 1685730; Canonical: Lake; Node#163436237; ResourceID: 1685731; Canonical: Lake; Node#163436238; ResourceID: 1685732; Canonical: Lake; Node#163436239; ResourceID: 1685733
[START] [2024-09-09 22:44:07] update_nodes
[STOP] [2024-09-09 22:44:10] update_nodes
[STOP] [2024-09-09 22:44:10] match_nodes
[START] [2024-09-09 22:44:10] reindex_search
[STOP] [2024-09-09 23:07:45] reindex_search
[START] [2024-09-09 23:07:45] normalize_units
[STOP] [2024-09-09 23:09:13] normalize_units
[START] [2024-09-09 23:09:13] calculate_statistics
[INFO] [2024-09-09 23:13:19] Duplicate page_id count: 0
[STOP] [2024-09-09 23:13:20] calculate_statistics
[START] [2024-09-09 23:13:20] complete_harvest_instance
[START] [2024-09-09 23:13:20] overall_tsv_creation
[INFO] [2024-09-09 23:13:21] Exporting 706834 nodes as TSV in batches of 10000...
[INFO] [2024-09-09 23:13:21] Processing group of 706834 in 71 batches of 10000
[INFO] [2024-09-09 23:15:44] 9734 Traits (unfiltered) and 0 associations...
[INFO] [2024-09-09 23:15:44] Building Traits map for 10000 nodes (this can take a while)...
[INFO] [2024-09-09 23:15:50] Mapped 9734 traits (0 meta) for 10000 nodes.
[INFO] [2024-09-09 23:15:50] Building Associations map (this can take a while)...
[INFO] [2024-09-09 23:15:56] Done. 0 assocs mapped (0 meta).
[INFO] [2024-09-09 23:15:56] Adding 9734 traits...
[INFO] [2024-09-09 23:15:57] 0 metadata added.
[INFO] [2024-09-09 23:15:57] Adding 0 assocs...
[INFO] [2024-09-09 23:15:57] 0 metadata added.
[INFO] [2024-09-09 23:17:16] Processed 10000/706834 nodes
[INFO] [2024-09-09 23:19:35] 9815 Traits (unfiltered) and 0 associations...
[INFO] [2024-09-09 23:19:35] Building Traits map for 10000 nodes (this can take a while)...
[INFO] [2024-09-09 23:19:42] Mapped 9815 traits (0 meta) for 10000 nodes.
[INFO] [2024-09-09 23:19:42] Building Associations map (this can take a while)...
[INFO] [2024-09-09 23:19:46] Done. 0 assocs mapped (0 meta).
[INFO] [2024-09-09 23:19:46] Adding 9815 traits...
[INFO] [2024-09-09 23:19:47] 0 metadata added.
[INFO] [2024-09-09 23:19:47] Adding 0 assocs...
[INFO] [2024-09-09 23:19:47] 0 metadata added.
[INFO] [2024-09-09 23:21:09] Processed 20000/706834 nodes
[INFO] [2024-09-09 23:23:29] 9847 Traits (unfiltered) and 0 associations...
[INFO] [2024-09-09 23:23:29] Building Traits map for 10000 nodes (this can take a while)...
[INFO] [2024-09-09 23:23:33] Mapped 9847 traits (0 meta) for 10000 nodes.
[INFO] [2024-09-09 23:23:33] Building Associations map (this can take a while)...
[INFO] [2024-09-09 23:23:38] Done. 0 assocs mapped (0 meta).
[INFO] [2024-09-09 23:23:38] Adding 9847 traits...
[INFO] [2024-09-09 23:23:38] 0 metadata added.
[INFO] [2024-09-09 23:23:38] Adding 0 assocs...
[INFO] [2024-09-09 23:23:38] 0 metadata added.
[INFO] [2024-09-09 23:24:58] Processed 30000/706834 nodes
[INFO] [2024-09-09 23:27:17] 9744 Traits (unfiltered) and 0 associations...
[INFO] [2024-09-09 23:27:17] Building Traits map for 10000 nodes (this can take a while)...
[INFO] [2024-09-09 23:27:24] Mapped 9744 traits (0 meta) for 10000 nodes.
[INFO] [2024-09-09 23:27:24] Building Associations map (this can take a while)...
[INFO] [2024-09-09 23:27:29] Done. 0 assocs mapped (0 meta).
[INFO] [2024-09-09 23:27:29] Adding 9744 traits...
[INFO] [2024-09-09 23:27:29] 0 metadata added.
[INFO] [2024-09-09 23:27:29] Adding 0 assocs...
[INFO] [2024-09-09 23:27:29] 0 metadata added.
[INFO] [2024-09-09 23:28:53] Processed 40000/706834 nodes
[INFO] [2024-09-09 23:31:09] 9823 Traits (unfiltered) and 0 associations...
[INFO] [2024-09-09 23:31:09] Building Traits map for 10000 nodes (this can take a while)...
[INFO] [2024-09-09 23:31:13] Mapped 9823 traits (0 meta) for 10000 nodes.
[INFO] [2024-09-09 23:31:13] Building Associations map (this can take a while)...
[INFO] [2024-09-09 23:31:18] Done. 0 assocs mapped (0 meta).
[INFO] [2024-09-09 23:31:18] Adding 9823 traits...
[INFO] [2024-09-09 23:31:18] 0 metadata added.
[INFO] [2024-09-09 23:31:18] Adding 0 assocs...
[INFO] [2024-09-09 23:31:18] 0 metadata added.
[INFO] [2024-09-09 23:32:37] Processed 50000/706834 nodes
[INFO] [2024-09-09 23:34:57] 9833 Traits (unfiltered) and 0 associations...
[INFO] [2024-09-09 23:34:57] Building Traits map for 10000 nodes (this can take a while)...
[INFO] [2024-09-09 23:35:01] Mapped 9833 traits (0 meta) for 10000 nodes.
[INFO] [2024-09-09 23:35:01] Building Associations map (this can take a while)...
[INFO] [2024-09-09 23:35:06] Done. 0 assocs mapped (0 meta).
[INFO] [2024-09-09 23:35:06] Adding 9833 traits...
[INFO] [2024-09-09 23:35:06] 0 metadata added.
[INFO] [2024-09-09 23:35:06] Adding 0 assocs...
[INFO] [2024-09-09 23:35:06] 0 metadata added.
[INFO] [2024-09-09 23:36:26] Processed 60000/706834 nodes
[INFO] [2024-09-09 23:38:47] 9874 Traits (unfiltered) and 0 associations...
[INFO] [2024-09-09 23:38:47] Building Traits map for 10000 nodes (this can take a while)...
[INFO] [2024-09-09 23:38:51] Mapped 9874 traits (0 meta) for 10000 nodes.
[INFO] [2024-09-09 23:38:51] Building Associations map (this can take a while)...
[INFO] [2024-09-09 23:38:56] Done. 0 assocs mapped (0 meta).
[INFO] [2024-09-09 23:38:56] Adding 9874 traits...
[INFO] [2024-09-09 23:38:56] 0 metadata added.
[INFO] [2024-09-09 23:38:56] Adding 0 assocs...
[INFO] [2024-09-09 23:38:56] 0 metadata added.
[INFO] [2024-09-09 23:40:15] Processed 70000/706834 nodes
[INFO] [2024-09-09 23:42:32] 9701 Traits (unfiltered) and 0 associations...
[INFO] [2024-09-09 23:42:32] Building Traits map for 10000 nodes (this can take a while)...
[INFO] [2024-09-09 23:42:36] Mapped 9701 traits (0 meta) for 10000 nodes.
[INFO] [2024-09-09 23:42:36] Building Associations map (this can take a while)...
[INFO] [2024-09-09 23:42:40] Done. 0 assocs mapped (0 meta).
[INFO] [2024-09-09 23:42:40] Adding 9701 traits...
[INFO] [2024-09-09 23:42:41] 0 metadata added.
[INFO] [2024-09-09 23:42:41] Adding 0 assocs...
[INFO] [2024-09-09 23:42:41] 0 metadata added.
[INFO] [2024-09-09 23:44:01] Processed 80000/706834 nodes
[INFO] [2024-09-09 23:46:16] 9809 Traits (unfiltered) and 0 associations...
[INFO] [2024-09-09 23:46:16] Building Traits map for 10000 nodes (this can take a while)...
[INFO] [2024-09-09 23:46:23] Mapped 9809 traits (0 meta) for 10000 nodes.
[INFO] [2024-09-09 23:46:23] Building Associations map (this can take a while)...
[INFO] [2024-09-09 23:46:28] Done. 0 assocs mapped (0 meta).
[INFO] [2024-09-09 23:46:28] Adding 9809 traits...
[INFO] [2024-09-09 23:46:28] 0 metadata added.
[INFO] [2024-09-09 23:46:28] Adding 0 assocs...
[INFO] [2024-09-09 23:46:28] 0 metadata added.
[INFO] [2024-09-09 23:47:49] Processed 90000/706834 nodes
[INFO] [2024-09-09 23:50:03] 9882 Traits (unfiltered) and 0 associations...
[INFO] [2024-09-09 23:50:03] Building Traits map for 10000 nodes (this can take a while)...
[INFO] [2024-09-09 23:50:07] Mapped 9882 traits (0 meta) for 10000 nodes.
[INFO] [2024-09-09 23:50:07] Building Associations map (this can take a while)...
[INFO] [2024-09-09 23:50:12] Done. 0 assocs mapped (0 meta).
[INFO] [2024-09-09 23:50:12] Adding 9882 traits...
[INFO] [2024-09-09 23:50:12] 0 metadata added.
[INFO] [2024-09-09 23:50:12] Adding 0 assocs...
[INFO] [2024-09-09 23:50:12] 0 metadata added.
[INFO] [2024-09-09 23:51:32] Processed 100000/706834 nodes
[INFO] [2024-09-09 23:53:46] 9857 Traits (unfiltered) and 0 associations...
[INFO] [2024-09-09 23:53:46] Building Traits map for 10000 nodes (this can take a while)...
[INFO] [2024-09-09 23:53:52] Mapped 9857 traits (0 meta) for 10000 nodes.
[INFO] [2024-09-09 23:53:52] Building Associations map (this can take a while)...
[INFO] [2024-09-09 23:53:57] Done. 0 assocs mapped (0 meta).
[INFO] [2024-09-09 23:53:57] Adding 9857 traits...
[INFO] [2024-09-09 23:53:57] 0 metadata added.
[INFO] [2024-09-09 23:53:57] Adding 0 assocs...
[INFO] [2024-09-09 23:53:57] 0 metadata added.
[INFO] [2024-09-09 23:55:19] Processed 110000/706834 nodes
[INFO] [2024-09-09 23:57:31] 9712 Traits (unfiltered) and 0 associations...
[INFO] [2024-09-09 23:57:31] Building Traits map for 10000 nodes (this can take a while)...
[INFO] [2024-09-09 23:57:35] Mapped 9712 traits (0 meta) for 10000 nodes.
[INFO] [2024-09-09 23:57:35] Building Associations map (this can take a while)...
[INFO] [2024-09-09 23:57:39] Done. 0 assocs mapped (0 meta).
[INFO] [2024-09-09 23:57:39] Adding 9712 traits...
[INFO] [2024-09-09 23:57:40] 0 metadata added.
[INFO] [2024-09-09 23:57:40] Adding 0 assocs...
[INFO] [2024-09-09 23:57:40] 0 metadata added.
[INFO] [2024-09-09 23:59:00] Processed 120000/706834 nodes
[INFO] [2024-09-10 00:01:15] 9724 Traits (unfiltered) and 0 associations...
[INFO] [2024-09-10 00:01:15] Building Traits map for 10000 nodes (this can take a while)...
[INFO] [2024-09-10 00:01:21] Mapped 9724 traits (0 meta) for 10000 nodes.
[INFO] [2024-09-10 00:01:21] Building Associations map (this can take a while)...
[INFO] [2024-09-10 00:01:26] Done. 0 assocs mapped (0 meta).
[INFO] [2024-09-10 00:01:26] Adding 9724 traits...
[INFO] [2024-09-10 00:01:26] 0 metadata added.
[INFO] [2024-09-10 00:01:26] Adding 0 assocs...
[INFO] [2024-09-10 00:01:26] 0 metadata added.
[INFO] [2024-09-10 00:02:49] Processed 130000/706834 nodes
[INFO] [2024-09-10 00:05:02] 9881 Traits (unfiltered) and 0 associations...
[INFO] [2024-09-10 00:05:02] Building Traits map for 10000 nodes (this can take a while)...
[INFO] [2024-09-10 00:05:06] Mapped 9881 traits (0 meta) for 10000 nodes.
[INFO] [2024-09-10 00:05:06] Building Associations map (this can take a while)...
[INFO] [2024-09-10 00:05:10] Done. 0 assocs mapped (0 meta).
[INFO] [2024-09-10 00:05:10] Adding 9881 traits...
[INFO] [2024-09-10 00:05:11] 0 metadata added.
[INFO] [2024-09-10 00:05:11] Adding 0 assocs...
[INFO] [2024-09-10 00:05:11] 0 metadata added.
[INFO] [2024-09-10 00:06:29] Processed 140000/706834 nodes
[INFO] [2024-09-10 00:08:45] 9804 Traits (unfiltered) and 0 associations...
[INFO] [2024-09-10 00:08:45] Building Traits map for 10000 nodes (this can take a while)...
[INFO] [2024-09-10 00:08:49] Mapped 9804 traits (0 meta) for 10000 nodes.
[INFO] [2024-09-10 00:08:49] Building Associations map (this can take a while)...
[INFO] [2024-09-10 00:08:53] Done. 0 assocs mapped (0 meta).
[INFO] [2024-09-10 00:08:53] Adding 9804 traits...
[INFO] [2024-09-10 00:08:54] 0 metadata added.
[INFO] [2024-09-10 00:08:54] Adding 0 assocs...
[INFO] [2024-09-10 00:08:54] 0 metadata added.
[INFO] [2024-09-10 00:10:15] Processed 150000/706834 nodes
[INFO] [2024-09-10 00:12:27] 9876 Traits (unfiltered) and 0 associations...
[INFO] [2024-09-10 00:12:27] Building Traits map for 10000 nodes (this can take a while)...
[INFO] [2024-09-10 00:12:36] Mapped 9876 traits (0 meta) for 10000 nodes.
[INFO] [2024-09-10 00:12:36] Building Associations map (this can take a while)...
[INFO] [2024-09-10 00:12:41] Done. 0 assocs mapped (0 meta).
[INFO] [2024-09-10 00:12:41] Adding 9876 traits...
[INFO] [2024-09-10 00:12:41] 0 metadata added.
[INFO] [2024-09-10 00:12:41] Adding 0 assocs...
[INFO] [2024-09-10 00:12:41] 0 metadata added.
[INFO] [2024-09-10 00:13:58] Processed 160000/706834 nodes
[INFO] [2024-09-10 00:16:10] 9739 Traits (unfiltered) and 0 associations...
[INFO] [2024-09-10 00:16:10] Building Traits map for 10000 nodes (this can take a while)...
[INFO] [2024-09-10 00:16:14] Mapped 9739 traits (0 meta) for 10000 nodes.
[INFO] [2024-09-10 00:16:14] Building Associations map (this can take a while)...
[INFO] [2024-09-10 00:16:18] Done. 0 assocs mapped (0 meta).
[INFO] [2024-09-10 00:16:18] Adding 9739 traits...
[INFO] [2024-09-10 00:16:19] 0 metadata added.
[INFO] [2024-09-10 00:16:19] Adding 0 assocs...
[INFO] [2024-09-10 00:16:19] 0 metadata added.
[INFO] [2024-09-10 00:17:37] Processed 170000/706834 nodes
[INFO] [2024-09-10 00:19:52] 9713 Traits (unfiltered) and 0 associations...
[INFO] [2024-09-10 00:19:52] Building Traits map for 10000 nodes (this can take a while)...
[INFO] [2024-09-10 00:19:56] Mapped 9713 traits (0 meta) for 10000 nodes.
[INFO] [2024-09-10 00:19:56] Building Associations map (this can take a while)...
[INFO] [2024-09-10 00:20:01] Done. 0 assocs mapped (0 meta).
[INFO] [2024-09-10 00:20:01] Adding 9713 traits...
[INFO] [2024-09-10 00:20:01] 0 metadata added.
[INFO] [2024-09-10 00:20:01] Adding 0 assocs...
[INFO] [2024-09-10 00:20:01] 0 metadata added.
[INFO] [2024-09-10 00:21:19] Processed 180000/706834 nodes
[INFO] [2024-09-10 00:23:34] 9833 Traits (unfiltered) and 0 associations...
[INFO] [2024-09-10 00:23:34] Building Traits map for 10000 nodes (this can take a while)...
[INFO] [2024-09-10 00:23:38] Mapped 9833 traits (0 meta) for 10000 nodes.
[INFO] [2024-09-10 00:23:38] Building Associations map (this can take a while)...
[INFO] [2024-09-10 00:23:43] Done. 0 assocs mapped (0 meta).
[INFO] [2024-09-10 00:23:43] Adding 9833 traits...
[INFO] [2024-09-10 00:23:43] 0 metadata added.
[INFO] [2024-09-10 00:23:43] Adding 0 assocs...
[INFO] [2024-09-10 00:23:43] 0 metadata added.
[INFO] [2024-09-10 00:25:02] Processed 190000/706834 nodes
[INFO] [2024-09-10 00:27:12] 9726 Traits (unfiltered) and 0 associations...
[INFO] [2024-09-10 00:27:12] Building Traits map for 10000 nodes (this can take a while)...
[INFO] [2024-09-10 00:27:16] Mapped 9726 traits (0 meta) for 10000 nodes.
[INFO] [2024-09-10 00:27:16] Building Associations map (this can take a while)...
[INFO] [2024-09-10 00:27:21] Done. 0 assocs mapped (0 meta).
[INFO] [2024-09-10 00:27:21] Adding 9726 traits...
[INFO] [2024-09-10 00:27:24] 0 metadata added.
[INFO] [2024-09-10 00:27:24] Adding 0 assocs...
[INFO] [2024-09-10 00:27:24] 0 metadata added.
[INFO] [2024-09-10 00:28:41] Processed 200000/706834 nodes
[INFO] [2024-09-10 00:30:53] 9842 Traits (unfiltered) and 0 associations...
[INFO] [2024-09-10 00:30:53] Building Traits map for 10000 nodes (this can take a while)...
[INFO] [2024-09-10 00:31:02] Mapped 9842 traits (0 meta) for 10000 nodes.
[INFO] [2024-09-10 00:31:02] Building Associations map (this can take a while)...
[INFO] [2024-09-10 00:31:06] Done. 0 assocs mapped (0 meta).
[INFO] [2024-09-10 00:31:06] Adding 9842 traits...
[INFO] [2024-09-10 00:31:07] 0 metadata added.
[INFO] [2024-09-10 00:31:07] Adding 0 assocs...
[INFO] [2024-09-10 00:31:07] 0 metadata added.
[INFO] [2024-09-10 00:32:24] Processed 210000/706834 nodes
[INFO] [2024-09-10 00:34:35] 9829 Traits (unfiltered) and 0 associations...
[INFO] [2024-09-10 00:34:35] Building Traits map for 10000 nodes (this can take a while)...
[INFO] [2024-09-10 00:34:39] Mapped 9829 traits (0 meta) for 10000 nodes.
[INFO] [2024-09-10 00:34:39] Building Associations map (this can take a while)...
[INFO] [2024-09-10 00:34:43] Done. 0 assocs mapped (0 meta).
[INFO] [2024-09-10 00:34:43] Adding 9829 traits...
[INFO] [2024-09-10 00:34:44] 0 metadata added.
[INFO] [2024-09-10 00:34:44] Adding 0 assocs...
[INFO] [2024-09-10 00:34:44] 0 metadata added.
[INFO] [2024-09-10 00:36:02] Processed 220000/706834 nodes
[INFO] [2024-09-10 00:38:15] 9854 Traits (unfiltered) and 0 associations...
[INFO] [2024-09-10 00:38:15] Building Traits map for 10000 nodes (this can take a while)...
[INFO] [2024-09-10 00:38:21] Mapped 9854 traits (0 meta) for 10000 nodes.
[INFO] [2024-09-10 00:38:21] Building Associations map (this can take a while)...
[INFO] [2024-09-10 00:38:25] Done. 0 assocs mapped (0 meta).
[INFO] [2024-09-10 00:38:25] Adding 9854 traits...
[INFO] [2024-09-10 00:38:26] 0 metadata added.
[INFO] [2024-09-10 00:38:26] Adding 0 assocs...
[INFO] [2024-09-10 00:38:26] 0 metadata added.
[INFO] [2024-09-10 00:39:46] Processed 230000/706834 nodes
[INFO] [2024-09-10 00:41:57] 9778 Traits (unfiltered) and 0 associations...
[INFO] [2024-09-10 00:41:57] Building Traits map for 10000 nodes (this can take a while)...
[INFO] [2024-09-10 00:42:01] Mapped 9778 traits (0 meta) for 10000 nodes.
[INFO] [2024-09-10 00:42:01] Building Associations map (this can take a while)...
[INFO] [2024-09-10 00:42:05] Done. 0 assocs mapped (0 meta).
[INFO] [2024-09-10 00:42:05] Adding 9778 traits...
[INFO] [2024-09-10 00:42:06] 0 metadata added.
[INFO] [2024-09-10 00:42:06] Adding 0 assocs...
[INFO] [2024-09-10 00:42:06] 0 metadata added.
[INFO] [2024-09-10 00:43:23] Processed 240000/706834 nodes
[INFO] [2024-09-10 00:45:38] 9811 Traits (unfiltered) and 0 associations...
[INFO] [2024-09-10 00:45:38] Building Traits map for 10000 nodes (this can take a while)...
[INFO] [2024-09-10 00:45:42] Mapped 9811 traits (0 meta) for 10000 nodes.
[INFO] [2024-09-10 00:45:42] Building Associations map (this can take a while)...
[INFO] [2024-09-10 00:45:46] Done. 0 assocs mapped (0 meta).
[INFO] [2024-09-10 00:45:46] Adding 9811 traits...
[INFO] [2024-09-10 00:45:46] 0 metadata added.
[INFO] [2024-09-10 00:45:46] Adding 0 assocs...
[INFO] [2024-09-10 00:45:46] 0 metadata added.
[INFO] [2024-09-10 00:47:03] Processed 250000/706834 nodes
[INFO] [2024-09-10 00:49:18] 9759 Traits (unfiltered) and 0 associations...
[INFO] [2024-09-10 00:49:18] Building Traits map for 10000 nodes (this can take a while)...
[INFO] [2024-09-10 00:49:22] Mapped 9759 traits (0 meta) for 10000 nodes.
[INFO] [2024-09-10 00:49:22] Building Associations map (this can take a while)...
[INFO] [2024-09-10 00:49:26] Done. 0 assocs mapped (0 meta).
[INFO] [2024-09-10 00:49:26] Adding 9759 traits...
[INFO] [2024-09-10 00:49:27] 0 metadata added.
[INFO] [2024-09-10 00:49:27] Adding 0 assocs...
[INFO] [2024-09-10 00:49:27] 0 metadata added.
[INFO] [2024-09-10 00:50:45] Processed 260000/706834 nodes
[INFO] [2024-09-10 00:52:59] 9750 Traits (unfiltered) and 0 associations...
[INFO] [2024-09-10 00:52:59] Building Traits map for 10000 nodes (this can take a while)...
[INFO] [2024-09-10 00:53:03] Mapped 9750 traits (0 meta) for 10000 nodes.
[INFO] [2024-09-10 00:53:03] Building Associations map (this can take a while)...
[INFO] [2024-09-10 00:53:08] Done. 0 assocs mapped (0 meta).
[INFO] [2024-09-10 00:53:08] Adding 9750 traits...
[INFO] [2024-09-10 00:53:08] 0 metadata added.
[INFO] [2024-09-10 00:53:08] Adding 0 assocs...
[INFO] [2024-09-10 00:53:08] 0 metadata added.
[INFO] [2024-09-10 00:54:27] Processed 270000/706834 nodes
[INFO] [2024-09-10 00:56:39] 9830 Traits (unfiltered) and 0 associations...
[INFO] [2024-09-10 00:56:39] Building Traits map for 10000 nodes (this can take a while)...
[INFO] [2024-09-10 00:56:45] Mapped 9830 traits (0 meta) for 10000 nodes.
[INFO] [2024-09-10 00:56:45] Building Associations map (this can take a while)...
[INFO] [2024-09-10 00:56:49] Done. 0 assocs mapped (0 meta).
[INFO] [2024-09-10 00:56:49] Adding 9830 traits...
[INFO] [2024-09-10 00:56:50] 0 metadata added.
[INFO] [2024-09-10 00:56:50] Adding 0 assocs...
[INFO] [2024-09-10 00:56:50] 0 metadata added.
[INFO] [2024-09-10 00:58:10] Processed 280000/706834 nodes
[INFO] [2024-09-10 01:00:21] 9523 Traits (unfiltered) and 0 associations...
[INFO] [2024-09-10 01:00:21] Building Traits map for 10000 nodes (this can take a while)...
[INFO] [2024-09-10 01:00:25] Mapped 9523 traits (0 meta) for 10000 nodes.
[INFO] [2024-09-10 01:00:25] Building Associations map (this can take a while)...
[INFO] [2024-09-10 01:00:29] Done. 0 assocs mapped (0 meta).
[INFO] [2024-09-10 01:00:29] Adding 9523 traits...
[INFO] [2024-09-10 01:00:30] 0 metadata added.
[INFO] [2024-09-10 01:00:30] Adding 0 assocs...
[INFO] [2024-09-10 01:00:30] 0 metadata added.
[INFO] [2024-09-10 01:01:48] Processed 290000/706834 nodes
[INFO] [2024-09-10 01:04:04] 9576 Traits (unfiltered) and 0 associations...
[INFO] [2024-09-10 01:04:04] Building Traits map for 10000 nodes (this can take a while)...
[INFO] [2024-09-10 01:04:08] Mapped 9576 traits (0 meta) for 10000 nodes.
[INFO] [2024-09-10 01:04:08] Building Associations map (this can take a while)...
[INFO] [2024-09-10 01:04:12] Done. 0 assocs mapped (0 meta).
[INFO] [2024-09-10 01:04:12] Adding 9576 traits...
[INFO] [2024-09-10 01:04:12] 0 metadata added.
[INFO] [2024-09-10 01:04:12] Adding 0 assocs...
[INFO] [2024-09-10 01:04:12] 0 metadata added.
[INFO] [2024-09-10 01:05:30] Processed 300000/706834 nodes
[INFO] [2024-09-10 01:07:42] 9749 Traits (unfiltered) and 0 associations...
[INFO] [2024-09-10 01:07:42] Building Traits map for 10000 nodes (this can take a while)...
[INFO] [2024-09-10 01:07:46] Mapped 9749 traits (0 meta) for 10000 nodes.
[INFO] [2024-09-10 01:07:46] Building Associations map (this can take a while)...
[INFO] [2024-09-10 01:07:50] Done. 0 assocs mapped (0 meta).
[INFO] [2024-09-10 01:07:50] Adding 9749 traits...
[INFO] [2024-09-10 01:07:53] 0 metadata added.
[INFO] [2024-09-10 01:07:53] Adding 0 assocs...
[INFO] [2024-09-10 01:07:53] 0 metadata added.
[INFO] [2024-09-10 01:09:09] Processed 310000/706834 nodes
[INFO] [2024-09-10 01:11:25] 9759 Traits (unfiltered) and 0 associations...
[INFO] [2024-09-10 01:11:25] Building Traits map for 10000 nodes (this can take a while)...
[INFO] [2024-09-10 01:11:29] Mapped 9759 traits (0 meta) for 10000 nodes.
[INFO] [2024-09-10 01:11:29] Building Associations map (this can take a while)...
[INFO] [2024-09-10 01:11:33] Done. 0 assocs mapped (0 meta).
[INFO] [2024-09-10 01:11:33] Adding 9759 traits...
[INFO] [2024-09-10 01:11:33] 0 metadata added.
[INFO] [2024-09-10 01:11:33] Adding 0 assocs...
[INFO] [2024-09-10 01:11:33] 0 metadata added.
[INFO] [2024-09-10 01:12:54] Processed 320000/706834 nodes
[INFO] [2024-09-10 01:15:05] 9826 Traits (unfiltered) and 0 associations...
[INFO] [2024-09-10 01:15:05] Building Traits map for 10000 nodes (this can take a while)...
[INFO] [2024-09-10 01:15:09] Mapped 9826 traits (0 meta) for 10000 nodes.
[INFO] [2024-09-10 01:15:09] Building Associations map (this can take a while)...
[INFO] [2024-09-10 01:15:13] Done. 0 assocs mapped (0 meta).
[INFO] [2024-09-10 01:15:13] Adding 9826 traits...
[INFO] [2024-09-10 01:15:14] 0 metadata added.
[INFO] [2024-09-10 01:15:14] Adding 0 assocs...
[INFO] [2024-09-10 01:15:14] 0 metadata added.
[INFO] [2024-09-10 01:16:33] Processed 330000/706834 nodes
[INFO] [2024-09-10 01:18:44] 9846 Traits (unfiltered) and 0 associations...
[INFO] [2024-09-10 01:18:44] Building Traits map for 10000 nodes (this can take a while)...
[INFO] [2024-09-10 01:18:48] Mapped 9846 traits (0 meta) for 10000 nodes.
[INFO] [2024-09-10 01:18:48] Building Associations map (this can take a while)...
[INFO] [2024-09-10 01:18:55] Done. 0 assocs mapped (0 meta).
[INFO] [2024-09-10 01:18:55] Adding 9846 traits...
[INFO] [2024-09-10 01:18:56] 0 metadata added.
[INFO] [2024-09-10 01:18:56] Adding 0 assocs...
[INFO] [2024-09-10 01:18:56] 0 metadata added.
[INFO] [2024-09-10 01:20:13] Processed 340000/706834 nodes
[INFO] [2024-09-10 01:22:24] 9827 Traits (unfiltered) and 0 associations...
[INFO] [2024-09-10 01:22:24] Building Traits map for 10000 nodes (this can take a while)...
[INFO] [2024-09-10 01:22:28] Mapped 9827 traits (0 meta) for 10000 nodes.
[INFO] [2024-09-10 01:22:28] Building Associations map (this can take a while)...
[INFO] [2024-09-10 01:22:32] Done. 0 assocs mapped (0 meta).
[INFO] [2024-09-10 01:22:32] Adding 9827 traits...
[INFO] [2024-09-10 01:22:33] 0 metadata added.
[INFO] [2024-09-10 01:22:33] Adding 0 assocs...
[INFO] [2024-09-10 01:22:33] 0 metadata added.
[INFO] [2024-09-10 01:23:53] Processed 350000/706834 nodes
[INFO] [2024-09-10 01:26:09] 9558 Traits (unfiltered) and 0 associations...
[INFO] [2024-09-10 01:26:09] Building Traits map for 10000 nodes (this can take a while)...
[INFO] [2024-09-10 01:26:13] Mapped 9558 traits (0 meta) for 10000 nodes.
[INFO] [2024-09-10 01:26:13] Building Associations map (this can take a while)...
[INFO] [2024-09-10 01:26:17] Done. 0 assocs mapped (0 meta).
[INFO] [2024-09-10 01:26:17] Adding 9558 traits...
[INFO] [2024-09-10 01:26:17] 0 metadata added.
[INFO] [2024-09-10 01:26:17] Adding 0 assocs...
[INFO] [2024-09-10 01:26:17] 0 metadata added.
[INFO] [2024-09-10 01:27:37] Processed 360000/706834 nodes
[INFO] [2024-09-10 01:29:47] 9739 Traits (unfiltered) and 0 associations...
[INFO] [2024-09-10 01:29:47] Building Traits map for 10000 nodes (this can take a while)...
[INFO] [2024-09-10 01:29:51] Mapped 9739 traits (0 meta) for 10000 nodes.
[INFO] [2024-09-10 01:29:51] Building Associations map (this can take a while)...
[INFO] [2024-09-10 01:29:58] Done. 0 assocs mapped (0 meta).
[INFO] [2024-09-10 01:29:58] Adding 9739 traits...
[INFO] [2024-09-10 01:29:59] 0 metadata added.
[INFO] [2024-09-10 01:29:59] Adding 0 assocs...
[INFO] [2024-09-10 01:29:59] 0 metadata added.
[INFO] [2024-09-10 01:31:15] Processed 370000/706834 nodes
[INFO] [2024-09-10 01:33:26] 9769 Traits (unfiltered) and 0 associations...
[INFO] [2024-09-10 01:33:26] Building Traits map for 10000 nodes (this can take a while)...
[INFO] [2024-09-10 01:33:30] Mapped 9769 traits (0 meta) for 10000 nodes.
[INFO] [2024-09-10 01:33:30] Building Associations map (this can take a while)...
[INFO] [2024-09-10 01:33:34] Done. 0 assocs mapped (0 meta).
[INFO] [2024-09-10 01:33:34] Adding 9769 traits...
[INFO] [2024-09-10 01:33:34] 0 metadata added.
[INFO] [2024-09-10 01:33:34] Adding 0 assocs...
[INFO] [2024-09-10 01:33:34] 0 metadata added.
[INFO] [2024-09-10 01:34:51] Processed 380000/706834 nodes
[INFO] [2024-09-10 01:37:04] 9670 Traits (unfiltered) and 0 associations...
[INFO] [2024-09-10 01:37:04] Building Traits map for 10000 nodes (this can take a while)...
[INFO] [2024-09-10 01:37:08] Mapped 9670 traits (0 meta) for 10000 nodes.
[INFO] [2024-09-10 01:37:08] Building Associations map (this can take a while)...
[INFO] [2024-09-10 01:37:13] Done. 0 assocs mapped (0 meta).
[INFO] [2024-09-10 01:37:13] Adding 9670 traits...
[INFO] [2024-09-10 01:37:16] 0 metadata added.
[INFO] [2024-09-10 01:37:16] Adding 0 assocs...
[INFO] [2024-09-10 01:37:16] 0 metadata added.
[INFO] [2024-09-10 01:38:32] Processed 390000/706834 nodes
[INFO] [2024-09-10 01:40:45] 9648 Traits (unfiltered) and 0 associations...
[INFO] [2024-09-10 01:40:45] Building Traits map for 10000 nodes (this can take a while)...
[INFO] [2024-09-10 01:40:52] Mapped 9648 traits (0 meta) for 10000 nodes.
[INFO] [2024-09-10 01:40:52] Building Associations map (this can take a while)...
[INFO] [2024-09-10 01:40:56] Done. 0 assocs mapped (0 meta).
[INFO] [2024-09-10 01:40:56] Adding 9648 traits...
[INFO] [2024-09-10 01:40:56] 0 metadata added.
[INFO] [2024-09-10 01:40:56] Adding 0 assocs...
[INFO] [2024-09-10 01:40:56] 0 metadata added.
[INFO] [2024-09-10 01:42:13] Processed 400000/706834 nodes
[INFO] [2024-09-10 01:44:24] 9680 Traits (unfiltered) and 0 associations...
[INFO] [2024-09-10 01:44:24] Building Traits map for 10000 nodes (this can take a while)...
[INFO] [2024-09-10 01:44:28] Mapped 9680 traits (0 meta) for 10000 nodes.
[INFO] [2024-09-10 01:44:28] Building Associations map (this can take a while)...
[INFO] [2024-09-10 01:44:33] Done. 0 assocs mapped (0 meta).
[INFO] [2024-09-10 01:44:33] Adding 9680 traits...
[INFO] [2024-09-10 01:44:33] 0 metadata added.
[INFO] [2024-09-10 01:44:33] Adding 0 assocs...
[INFO] [2024-09-10 01:44:33] 0 metadata added.
[INFO] [2024-09-10 01:45:54] Processed 410000/706834 nodes
[INFO] [2024-09-10 01:48:04] 9652 Traits (unfiltered) and 0 associations...
[INFO] [2024-09-10 01:48:04] Building Traits map for 10000 nodes (this can take a while)...
[INFO] [2024-09-10 01:48:09] Mapped 9652 traits (0 meta) for 10000 nodes.
[INFO] [2024-09-10 01:48:09] Building Associations map (this can take a while)...
[INFO] [2024-09-10 01:48:13] Done. 0 assocs mapped (0 meta).
[INFO] [2024-09-10 01:48:13] Adding 9652 traits...
[INFO] [2024-09-10 01:48:13] 0 metadata added.
[INFO] [2024-09-10 01:48:13] Adding 0 assocs...
[INFO] [2024-09-10 01:48:13] 0 metadata added.
[INFO] [2024-09-10 01:49:29] Processed 420000/706834 nodes
[INFO] [2024-09-10 01:51:44] 9811 Traits (unfiltered) and 0 associations...
[INFO] [2024-09-10 01:51:44] Building Traits map for 10000 nodes (this can take a while)...
[INFO] [2024-09-10 01:51:48] Mapped 9811 traits (0 meta) for 10000 nodes.
[INFO] [2024-09-10 01:51:48] Building Associations map (this can take a while)...
[INFO] [2024-09-10 01:51:52] Done. 0 assocs mapped (0 meta).
[INFO] [2024-09-10 01:51:52] Adding 9811 traits...
[INFO] [2024-09-10 01:51:53] 0 metadata added.
[INFO] [2024-09-10 01:51:53] Adding 0 assocs...
[INFO] [2024-09-10 01:51:53] 0 metadata added.
[INFO] [2024-09-10 01:53:08] Processed 430000/706834 nodes
[INFO] [2024-09-10 01:55:22] 9813 Traits (unfiltered) and 0 associations...
[INFO] [2024-09-10 01:55:22] Building Traits map for 10000 nodes (this can take a while)...
[INFO] [2024-09-10 01:55:26] Mapped 9813 traits (0 meta) for 10000 nodes.
[INFO] [2024-09-10 01:55:26] Building Associations map (this can take a while)...
[INFO] [2024-09-10 01:55:30] Done. 0 assocs mapped (0 meta).
[INFO] [2024-09-10 01:55:30] Adding 9813 traits...
[INFO] [2024-09-10 01:55:30] 0 metadata added.
[INFO] [2024-09-10 01:55:30] Adding 0 assocs...
[INFO] [2024-09-10 01:55:30] 0 metadata added.
[INFO] [2024-09-10 01:56:46] Processed 440000/706834 nodes
[INFO] [2024-09-10 01:59:03] 9638 Traits (unfiltered) and 0 associations...
[INFO] [2024-09-10 01:59:03] Building Traits map for 10000 nodes (this can take a while)...
[INFO] [2024-09-10 01:59:07] Mapped 9638 traits (0 meta) for 10000 nodes.
[INFO] [2024-09-10 01:59:07] Building Associations map (this can take a while)...
[INFO] [2024-09-10 01:59:11] Done. 0 assocs mapped (0 meta).
[INFO] [2024-09-10 01:59:11] Adding 9638 traits...
[INFO] [2024-09-10 01:59:12] 0 metadata added.
[INFO] [2024-09-10 01:59:12] Adding 0 assocs...
[INFO] [2024-09-10 01:59:12] 0 metadata added.
[INFO] [2024-09-10 02:00:28] Processed 450000/706834 nodes
[INFO] [2024-09-10 02:02:44] 9736 Traits (unfiltered) and 0 associations...
[INFO] [2024-09-10 02:02:44] Building Traits map for 10000 nodes (this can take a while)...
[INFO] [2024-09-10 02:02:48] Mapped 9736 traits (0 meta) for 10000 nodes.
[INFO] [2024-09-10 02:02:48] Building Associations map (this can take a while)...
[INFO] [2024-09-10 02:02:52] Done. 0 assocs mapped (0 meta).
[INFO] [2024-09-10 02:02:52] Adding 9736 traits...
[INFO] [2024-09-10 02:02:52] 0 metadata added.
[INFO] [2024-09-10 02:02:52] Adding 0 assocs...
[INFO] [2024-09-10 02:02:52] 0 metadata added.
[INFO] [2024-09-10 02:04:10] Processed 460000/706834 nodes
[INFO] [2024-09-10 02:06:24] 9757 Traits (unfiltered) and 0 associations...
[INFO] [2024-09-10 02:06:24] Building Traits map for 10000 nodes (this can take a while)...
[INFO] [2024-09-10 02:06:28] Mapped 9757 traits (0 meta) for 10000 nodes.
[INFO] [2024-09-10 02:06:28] Building Associations map (this can take a while)...
[INFO] [2024-09-10 02:06:32] Done. 0 assocs mapped (0 meta).
[INFO] [2024-09-10 02:06:32] Adding 9757 traits...
[INFO] [2024-09-10 02:06:32] 0 metadata added.
[INFO] [2024-09-10 02:06:32] Adding 0 assocs...
[INFO] [2024-09-10 02:06:32] 0 metadata added.
[INFO] [2024-09-10 02:07:49] Processed 470000/706834 nodes
[INFO] [2024-09-10 02:10:04] 9710 Traits (unfiltered) and 0 associations...
[INFO] [2024-09-10 02:10:04] Building Traits map for 10000 nodes (this can take a while)...
[INFO] [2024-09-10 02:10:08] Mapped 9710 traits (0 meta) for 10000 nodes.
[INFO] [2024-09-10 02:10:08] Building Associations map (this can take a while)...
[INFO] [2024-09-10 02:10:12] Done. 0 assocs mapped (0 meta).
[INFO] [2024-09-10 02:10:12] Adding 9710 traits...
[INFO] [2024-09-10 02:10:12] 0 metadata added.
[INFO] [2024-09-10 02:10:12] Adding 0 assocs...
[INFO] [2024-09-10 02:10:12] 0 metadata added.
[INFO] [2024-09-10 02:11:28] Processed 480000/706834 nodes
[INFO] [2024-09-10 02:13:43] 9733 Traits (unfiltered) and 0 associations...
[INFO] [2024-09-10 02:13:43] Building Traits map for 10000 nodes (this can take a while)...
[INFO] [2024-09-10 02:13:47] Mapped 9733 traits (0 meta) for 10000 nodes.
[INFO] [2024-09-10 02:13:47] Building Associations map (this can take a while)...
[INFO] [2024-09-10 02:13:51] Done. 0 assocs mapped (0 meta).
[INFO] [2024-09-10 02:13:51] Adding 9733 traits...
[INFO] [2024-09-10 02:13:51] 0 metadata added.
[INFO] [2024-09-10 02:13:51] Adding 0 assocs...
[INFO] [2024-09-10 02:13:51] 0 metadata added.
[INFO] [2024-09-10 02:15:07] Processed 490000/706834 nodes
[INFO] [2024-09-10 02:17:21] 9796 Traits (unfiltered) and 0 associations...
[INFO] [2024-09-10 02:17:22] Building Traits map for 10000 nodes (this can take a while)...
[INFO] [2024-09-10 02:17:26] Mapped 9796 traits (0 meta) for 10000 nodes.
[INFO] [2024-09-10 02:17:26] Building Associations map (this can take a while)...
[INFO] [2024-09-10 02:17:29] Done. 0 assocs mapped (0 meta).
[INFO] [2024-09-10 02:17:29] Adding 9796 traits...
[INFO] [2024-09-10 02:17:30] 0 metadata added.
[INFO] [2024-09-10 02:17:30] Adding 0 assocs...
[INFO] [2024-09-10 02:17:30] 0 metadata added.
[INFO] [2024-09-10 02:18:45] Processed 500000/706834 nodes
[INFO] [2024-09-10 02:21:01] 9763 Traits (unfiltered) and 0 associations...
[INFO] [2024-09-10 02:21:01] Building Traits map for 10000 nodes (this can take a while)...
[INFO] [2024-09-10 02:21:05] Mapped 9763 traits (0 meta) for 10000 nodes.
[INFO] [2024-09-10 02:21:05] Building Associations map (this can take a while)...
[INFO] [2024-09-10 02:21:09] Done. 0 assocs mapped (0 meta).
[INFO] [2024-09-10 02:21:09] Adding 9763 traits...
[INFO] [2024-09-10 02:21:09] 0 metadata added.
[INFO] [2024-09-10 02:21:09] Adding 0 assocs...
[INFO] [2024-09-10 02:21:09] 0 metadata added.
[INFO] [2024-09-10 02:22:25] Processed 510000/706834 nodes
[INFO] [2024-09-10 02:24:40] 9553 Traits (unfiltered) and 0 associations...
[INFO] [2024-09-10 02:24:40] Building Traits map for 10000 nodes (this can take a while)...
[INFO] [2024-09-10 02:24:44] Mapped 9553 traits (0 meta) for 10000 nodes.
[INFO] [2024-09-10 02:24:44] Building Associations map (this can take a while)...
[INFO] [2024-09-10 02:24:48] Done. 0 assocs mapped (0 meta).
[INFO] [2024-09-10 02:24:48] Adding 9553 traits...
[INFO] [2024-09-10 02:24:48] 0 metadata added.
[INFO] [2024-09-10 02:24:48] Adding 0 assocs...
[INFO] [2024-09-10 02:24:48] 0 metadata added.
[INFO] [2024-09-10 02:26:04] Processed 520000/706834 nodes
[INFO] [2024-09-10 02:28:19] 9746 Traits (unfiltered) and 0 associations...
[INFO] [2024-09-10 02:28:19] Building Traits map for 10000 nodes (this can take a while)...
[INFO] [2024-09-10 02:28:23] Mapped 9746 traits (0 meta) for 10000 nodes.
[INFO] [2024-09-10 02:28:23] Building Associations map (this can take a while)...
[INFO] [2024-09-10 02:28:27] Done. 0 assocs mapped (0 meta).
[INFO] [2024-09-10 02:28:27] Adding 9746 traits...
[INFO] [2024-09-10 02:28:27] 0 metadata added.
[INFO] [2024-09-10 02:28:27] Adding 0 assocs...
[INFO] [2024-09-10 02:28:27] 0 metadata added.
[INFO] [2024-09-10 02:29:43] Processed 530000/706834 nodes
[INFO] [2024-09-10 02:31:54] 9854 Traits (unfiltered) and 0 associations...
[INFO] [2024-09-10 02:31:54] Building Traits map for 10000 nodes (this can take a while)...
[INFO] [2024-09-10 02:31:59] Mapped 9854 traits (0 meta) for 10000 nodes.
[INFO] [2024-09-10 02:31:59] Building Associations map (this can take a while)...
[INFO] [2024-09-10 02:32:02] Done. 0 assocs mapped (0 meta).
[INFO] [2024-09-10 02:32:02] Adding 9854 traits...
[INFO] [2024-09-10 02:32:03] 0 metadata added.
[INFO] [2024-09-10 02:32:03] Adding 0 assocs...
[INFO] [2024-09-10 02:32:03] 0 metadata added.
[INFO] [2024-09-10 02:33:18] Processed 540000/706834 nodes
[INFO] [2024-09-10 02:35:31] 9729 Traits (unfiltered) and 0 associations...
[INFO] [2024-09-10 02:35:31] Building Traits map for 10000 nodes (this can take a while)...
[INFO] [2024-09-10 02:35:35] Mapped 9729 traits (0 meta) for 10000 nodes.
[INFO] [2024-09-10 02:35:35] Building Associations map (this can take a while)...
[INFO] [2024-09-10 02:35:38] Done. 0 assocs mapped (0 meta).
[INFO] [2024-09-10 02:35:38] Adding 9729 traits...
[INFO] [2024-09-10 02:35:39] 0 metadata added.
[INFO] [2024-09-10 02:35:39] Adding 0 assocs...
[INFO] [2024-09-10 02:35:39] 0 metadata added.
[INFO] [2024-09-10 02:36:55] Processed 550000/706834 nodes
[INFO] [2024-09-10 02:39:06] 9519 Traits (unfiltered) and 0 associations...
[INFO] [2024-09-10 02:39:06] Building Traits map for 10000 nodes (this can take a while)...
[INFO] [2024-09-10 02:39:11] Mapped 9519 traits (0 meta) for 10000 nodes.
[INFO] [2024-09-10 02:39:11] Building Associations map (this can take a while)...
[INFO] [2024-09-10 02:39:14] Done. 0 assocs mapped (0 meta).
[INFO] [2024-09-10 02:39:14] Adding 9519 traits...
[INFO] [2024-09-10 02:39:15] 0 metadata added.
[INFO] [2024-09-10 02:39:15] Adding 0 assocs...
[INFO] [2024-09-10 02:39:15] 0 metadata added.
[INFO] [2024-09-10 02:40:30] Processed 560000/706834 nodes
[INFO] [2024-09-10 02:42:42] 9457 Traits (unfiltered) and 0 associations...
[INFO] [2024-09-10 02:42:42] Building Traits map for 10000 nodes (this can take a while)...
[INFO] [2024-09-10 02:42:46] Mapped 9457 traits (0 meta) for 10000 nodes.
[INFO] [2024-09-10 02:42:46] Building Associations map (this can take a while)...
[INFO] [2024-09-10 02:42:49] Done. 0 assocs mapped (0 meta).
[INFO] [2024-09-10 02:42:49] Adding 9457 traits...
[INFO] [2024-09-10 02:42:50] 0 metadata added.
[INFO] [2024-09-10 02:42:50] Adding 0 assocs...
[INFO] [2024-09-10 02:42:50] 0 metadata added.
[INFO] [2024-09-10 02:44:06] Processed 570000/706834 nodes
[INFO] [2024-09-10 02:46:18] 9694 Traits (unfiltered) and 0 associations...
[INFO] [2024-09-10 02:46:18] Building Traits map for 10000 nodes (this can take a while)...
[INFO] [2024-09-10 02:46:22] Mapped 9694 traits (0 meta) for 10000 nodes.
[INFO] [2024-09-10 02:46:22] Building Associations map (this can take a while)...
[INFO] [2024-09-10 02:46:26] Done. 0 assocs mapped (0 meta).
[INFO] [2024-09-10 02:46:26] Adding 9694 traits...
[INFO] [2024-09-10 02:46:27] 0 metadata added.
[INFO] [2024-09-10 02:46:27] Adding 0 assocs...
[INFO] [2024-09-10 02:46:27] 0 metadata added.
[INFO] [2024-09-10 02:47:42] Processed 580000/706834 nodes
[INFO] [2024-09-10 02:49:57] 9778 Traits (unfiltered) and 0 associations...
[INFO] [2024-09-10 02:49:57] Building Traits map for 10000 nodes (this can take a while)...
[INFO] [2024-09-10 02:50:01] Mapped 9778 traits (0 meta) for 10000 nodes.
[INFO] [2024-09-10 02:50:01] Building Associations map (this can take a while)...
[INFO] [2024-09-10 02:50:04] Done. 0 assocs mapped (0 meta).
[INFO] [2024-09-10 02:50:04] Adding 9778 traits...
[INFO] [2024-09-10 02:50:08] 0 metadata added.
[INFO] [2024-09-10 02:50:08] Adding 0 assocs...
[INFO] [2024-09-10 02:50:08] 0 metadata added.
[INFO] [2024-09-10 02:51:27] Processed 590000/706834 nodes
[INFO] [2024-09-10 02:53:41] 9760 Traits (unfiltered) and 0 associations...
[INFO] [2024-09-10 02:53:41] Building Traits map for 10000 nodes (this can take a while)...
[INFO] [2024-09-10 02:53:46] Mapped 9760 traits (0 meta) for 10000 nodes.
[INFO] [2024-09-10 02:53:46] Building Associations map (this can take a while)...
[INFO] [2024-09-10 02:53:49] Done. 0 assocs mapped (0 meta).
[INFO] [2024-09-10 02:53:49] Adding 9760 traits...
[INFO] [2024-09-10 02:53:50] 0 metadata added.
[INFO] [2024-09-10 02:53:50] Adding 0 assocs...
[INFO] [2024-09-10 02:53:50] 0 metadata added.
[INFO] [2024-09-10 02:55:06] Processed 600000/706834 nodes
[INFO] [2024-09-10 02:57:18] 9684 Traits (unfiltered) and 0 associations...
[INFO] [2024-09-10 02:57:18] Building Traits map for 10000 nodes (this can take a while)...
[INFO] [2024-09-10 02:57:22] Mapped 9684 traits (0 meta) for 10000 nodes.
[INFO] [2024-09-10 02:57:22] Building Associations map (this can take a while)...
[INFO] [2024-09-10 02:57:26] Done. 0 assocs mapped (0 meta).
[INFO] [2024-09-10 02:57:26] Adding 9684 traits...
[INFO] [2024-09-10 02:57:27] 0 metadata added.
[INFO] [2024-09-10 02:57:27] Adding 0 assocs...
[INFO] [2024-09-10 02:57:27] 0 metadata added.
[INFO] [2024-09-10 02:58:42] Processed 610000/706834 nodes
[INFO] [2024-09-10 03:00:59] 9664 Traits (unfiltered) and 0 associations...
[INFO] [2024-09-10 03:00:59] Building Traits map for 10000 nodes (this can take a while)...
[INFO] [2024-09-10 03:01:03] Mapped 9664 traits (0 meta) for 10000 nodes.
[INFO] [2024-09-10 03:01:03] Building Associations map (this can take a while)...
[INFO] [2024-09-10 03:01:07] Done. 0 assocs mapped (0 meta).
[INFO] [2024-09-10 03:01:07] Adding 9664 traits...
[INFO] [2024-09-10 03:01:07] 0 metadata added.
[INFO] [2024-09-10 03:01:07] Adding 0 assocs...
[INFO] [2024-09-10 03:01:07] 0 metadata added.
[INFO] [2024-09-10 03:02:23] Processed 620000/706834 nodes
[INFO] [2024-09-10 03:04:39] 9760 Traits (unfiltered) and 0 associations...
[INFO] [2024-09-10 03:04:39] Building Traits map for 10000 nodes (this can take a while)...
[INFO] [2024-09-10 03:04:43] Mapped 9760 traits (0 meta) for 10000 nodes.
[INFO] [2024-09-10 03:04:43] Building Associations map (this can take a while)...
[INFO] [2024-09-10 03:04:47] Done. 0 assocs mapped (0 meta).
[INFO] [2024-09-10 03:04:47] Adding 9760 traits...
[INFO] [2024-09-10 03:04:47] 0 metadata added.
[INFO] [2024-09-10 03:04:47] Adding 0 assocs...
[INFO] [2024-09-10 03:04:47] 0 metadata added.
[INFO] [2024-09-10 03:06:03] Processed 630000/706834 nodes
[INFO] [2024-09-10 03:08:19] 9684 Traits (unfiltered) and 0 associations...
[INFO] [2024-09-10 03:08:19] Building Traits map for 10000 nodes (this can take a while)...
[INFO] [2024-09-10 03:08:23] Mapped 9684 traits (0 meta) for 10000 nodes.
[INFO] [2024-09-10 03:08:23] Building Associations map (this can take a while)...
[INFO] [2024-09-10 03:08:26] Done. 0 assocs mapped (0 meta).
[INFO] [2024-09-10 03:08:26] Adding 9684 traits...
[INFO] [2024-09-10 03:08:27] 0 metadata added.
[INFO] [2024-09-10 03:08:27] Adding 0 assocs...
[INFO] [2024-09-10 03:08:27] 0 metadata added.
[INFO] [2024-09-10 03:09:43] Processed 640000/706834 nodes
[INFO] [2024-09-10 03:11:59] 9810 Traits (unfiltered) and 0 associations...
[INFO] [2024-09-10 03:11:59] Building Traits map for 10000 nodes (this can take a while)...
[INFO] [2024-09-10 03:12:03] Mapped 9810 traits (0 meta) for 10000 nodes.
[INFO] [2024-09-10 03:12:03] Building Associations map (this can take a while)...
[INFO] [2024-09-10 03:12:07] Done. 0 assocs mapped (0 meta).
[INFO] [2024-09-10 03:12:07] Adding 9810 traits...
[INFO] [2024-09-10 03:12:07] 0 metadata added.
[INFO] [2024-09-10 03:12:07] Adding 0 assocs...
[INFO] [2024-09-10 03:12:07] 0 metadata added.
[INFO] [2024-09-10 03:13:23] Processed 650000/706834 nodes
[INFO] [2024-09-10 03:15:38] 9674 Traits (unfiltered) and 0 associations...
[INFO] [2024-09-10 03:15:38] Building Traits map for 10000 nodes (this can take a while)...
[INFO] [2024-09-10 03:15:42] Mapped 9674 traits (0 meta) for 10000 nodes.
[INFO] [2024-09-10 03:15:42] Building Associations map (this can take a while)...
[INFO] [2024-09-10 03:15:49] Done. 0 assocs mapped (0 meta).
[INFO] [2024-09-10 03:15:49] Adding 9674 traits...
[INFO] [2024-09-10 03:15:49] 0 metadata added.
[INFO] [2024-09-10 03:15:49] Adding 0 assocs...
[INFO] [2024-09-10 03:15:49] 0 metadata added.
[INFO] [2024-09-10 03:17:08] Processed 660000/706834 nodes
[INFO] [2024-09-10 03:19:18] 9706 Traits (unfiltered) and 0 associations...
[INFO] [2024-09-10 03:19:18] Building Traits map for 10000 nodes (this can take a while)...
[INFO] [2024-09-10 03:19:26] Mapped 9706 traits (0 meta) for 10000 nodes.
[INFO] [2024-09-10 03:19:26] Building Associations map (this can take a while)...
[INFO] [2024-09-10 03:19:29] Done. 0 assocs mapped (0 meta).
[INFO] [2024-09-10 03:19:29] Adding 9706 traits...
[INFO] [2024-09-10 03:19:30] 0 metadata added.
[INFO] [2024-09-10 03:19:30] Adding 0 assocs...
[INFO] [2024-09-10 03:19:30] 0 metadata added.
[INFO] [2024-09-10 03:20:45] Processed 670000/706834 nodes
[INFO] [2024-09-10 03:22:57] 9685 Traits (unfiltered) and 0 associations...
[INFO] [2024-09-10 03:22:57] Building Traits map for 10000 nodes (this can take a while)...
[INFO] [2024-09-10 03:23:01] Mapped 9685 traits (0 meta) for 10000 nodes.
[INFO] [2024-09-10 03:23:01] Building Associations map (this can take a while)...
[INFO] [2024-09-10 03:23:05] Done. 0 assocs mapped (0 meta).
[INFO] [2024-09-10 03:23:05] Adding 9685 traits...
[INFO] [2024-09-10 03:23:05] 0 metadata added.
[INFO] [2024-09-10 03:23:05] Adding 0 assocs...
[INFO] [2024-09-10 03:23:05] 0 metadata added.
[INFO] [2024-09-10 03:24:20] Processed 680000/706834 nodes
[INFO] [2024-09-10 03:26:33] 9789 Traits (unfiltered) and 0 associations...
[INFO] [2024-09-10 03:26:33] Building Traits map for 10000 nodes (this can take a while)...
[INFO] [2024-09-10 03:26:37] Mapped 9789 traits (0 meta) for 10000 nodes.
[INFO] [2024-09-10 03:26:37] Building Associations map (this can take a while)...
[INFO] [2024-09-10 03:26:41] Done. 0 assocs mapped (0 meta).
[INFO] [2024-09-10 03:26:41] Adding 9789 traits...
[INFO] [2024-09-10 03:26:42] 0 metadata added.
[INFO] [2024-09-10 03:26:42] Adding 0 assocs...
[INFO] [2024-09-10 03:26:42] 0 metadata added.
[INFO] [2024-09-10 03:27:57] Processed 690000/706834 nodes
[INFO] [2024-09-10 03:30:10] 9743 Traits (unfiltered) and 0 associations...
[INFO] [2024-09-10 03:30:10] Building Traits map for 10000 nodes (this can take a while)...
[INFO] [2024-09-10 03:30:15] Mapped 9743 traits (0 meta) for 10000 nodes.
[INFO] [2024-09-10 03:30:15] Building Associations map (this can take a while)...
[INFO] [2024-09-10 03:30:18] Done. 0 assocs mapped (0 meta).
[INFO] [2024-09-10 03:30:18] Adding 9743 traits...
[INFO] [2024-09-10 03:30:19] 0 metadata added.
[INFO] [2024-09-10 03:30:19] Adding 0 assocs...
[INFO] [2024-09-10 03:30:19] 0 metadata added.
[INFO] [2024-09-10 03:31:34] Processed 700000/706834 nodes
[INFO] [2024-09-10 03:32:04] 6657 Traits (unfiltered) and 0 associations...
[INFO] [2024-09-10 03:32:04] Building Traits map for 6834 nodes (this can take a while)...
[INFO] [2024-09-10 03:32:09] Mapped 6657 traits (0 meta) for 6834 nodes.
[INFO] [2024-09-10 03:32:09] Building Associations map (this can take a while)...
[INFO] [2024-09-10 03:32:13] Done. 0 assocs mapped (0 meta).
[INFO] [2024-09-10 03:32:13] Adding 6657 traits...
[INFO] [2024-09-10 03:32:13] 0 metadata added.
[INFO] [2024-09-10 03:32:13] Adding 0 assocs...
[INFO] [2024-09-10 03:32:13] 0 metadata added.
[INFO] [2024-09-10 03:33:22] Processed 706834/706834 nodes
[INFO] [2024-09-10 03:33:22] Average Time: 110.783
[INFO] [2024-09-10 03:33:22] Total Time: 4h20m2s
[INFO] [2024-09-10 03:33:22] last 3 / first 3: 0.92
[INFO] [2024-09-10 03:33:22] Std.Dev: 2.716; Max: 115.84
[STOP] [2024-09-10 03:33:22] overall_tsv_creation
[INFO] [2024-09-10 03:33:22] Done. Check your files:
[INFO] [2024-09-10 03:33:22] (706834 lines) /app/public/data/ncbi_data_covera/publish_nodes.tsv
[INFO] [2024-09-10 03:33:22] (15080100 lines) /app/public/data/ncbi_data_covera/publish_node_ancestors.tsv
[INFO] [2024-09-10 03:33:22] (706834 lines) /app/public/data/ncbi_data_covera/publish_scientific_names.tsv
[INFO] [2024-09-10 03:33:23] (688906 lines) /app/public/data/ncbi_data_covera/publish_traits.tsv
[INFO] [2024-09-10 03:33:23] (1 lines) /app/public/data/ncbi_data_covera/publish_metadata.tsv
[STOP] [2024-09-10 03:33:25] complete_harvest_instance
[START] [2024-09-10 03:33:25] completed
[STOP] [2024-09-10 03:33:25] completed
[STOP] [2024-09-10 03:33:25] logged process, took 55280.42
Latest Process