Harvest for Wildfinder (WWF) Created 19 May 16:18

Harvesting Log

[INFO] [2021-05-19 16:18:42] Created harvest instance #3883
[STOP] [2021-05-19 16:18:42] create_harvest_instance
[START] [2021-05-19 16:18:43] fetch_files
[STOP] [2021-05-19 16:18:43] fetch_files
[START] [2021-05-19 16:18:43] validate_each_file
[INFO] [2021-05-19 16:18:43] Looping over 8 formats...
[INFO] [2021-05-19 16:18:43] ...agents (/app/public/data/WWF/agents.txt)
[INFO] [2021-05-19 16:18:43] Valid: /app/public/converted_csv/WWF_agents_3883.csv (0 lines)
[INFO] [2021-05-19 16:18:43] ...refs (/app/public/data/WWF/references.txt)
[INFO] [2021-05-19 16:18:43] Valid: /app/public/converted_csv/WWF_refs_3883.csv (0 lines)
[INFO] [2021-05-19 16:18:43] ...nodes (/app/public/data/WWF/taxa.txt)
[INFO] [2021-05-19 16:18:44] Valid: /app/public/converted_csv/WWF_nodes_3883.csv (29823 lines)
[INFO] [2021-05-19 16:18:44] ...media (/app/public/data/WWF/media.txt)
[INFO] [2021-05-19 16:18:44] Valid: /app/public/converted_csv/WWF_media_3883.csv (0 lines)
[INFO] [2021-05-19 16:18:44] ...vernaculars (/app/public/data/WWF/common names.txt)
[INFO] [2021-05-19 16:18:44] Valid: /app/public/converted_csv/WWF_vernaculars_3883.csv (0 lines)
[INFO] [2021-05-19 16:18:44] ...occurrences (/app/public/data/WWF/occurrences.txt)
[INFO] [2021-05-19 16:19:34] Valid: /app/public/converted_csv/WWF_occurrences_3883.csv (455229 lines)
[INFO] [2021-05-19 16:19:34] ...assocs (/app/public/data/WWF/associations.txt)
[INFO] [2021-05-19 16:19:34] Valid: /app/public/converted_csv/WWF_assocs_3883.csv (0 lines)
[INFO] [2021-05-19 16:19:34] ...measurements (/app/public/data/WWF/measurements or facts.txt)
[INFO] [2021-05-19 16:20:04] Valid: /app/public/converted_csv/WWF_measurements_3883.csv (382308 lines)
[STOP] [2021-05-19 16:20:04] validate_each_file
[START] [2021-05-19 16:20:04] convert_to_csv
[INFO] [2021-05-19 16:20:04] Looping over 8 formats...
[INFO] [2021-05-19 16:20:04] ...agents (/app/public/data/WWF/agents.txt)
[CMD] [2021-05-19 16:20:04] /usr/bin/sort /app/public/converted_csv/WWF_agents_3883.csv > /app/public/converted_csv/WWF_agents_3883.csv_sorted
[INFO] [2021-05-19 16:20:04] Converted: /app/public/converted_csv/WWF_agents_3883.csv (0 lines)
[INFO] [2021-05-19 16:20:04] ...refs (/app/public/data/WWF/references.txt)
[CMD] [2021-05-19 16:20:04] /usr/bin/sort /app/public/converted_csv/WWF_refs_3883.csv > /app/public/converted_csv/WWF_refs_3883.csv_sorted
[INFO] [2021-05-19 16:20:04] Converted: /app/public/converted_csv/WWF_refs_3883.csv (0 lines)
[INFO] [2021-05-19 16:20:04] ...nodes (/app/public/data/WWF/taxa.txt)
[CMD] [2021-05-19 16:20:04] /usr/bin/sort /app/public/converted_csv/WWF_nodes_3883.csv > /app/public/converted_csv/WWF_nodes_3883.csv_sorted
[INFO] [2021-05-19 16:20:04] Converted: /app/public/converted_csv/WWF_nodes_3883.csv (29823 lines)
[INFO] [2021-05-19 16:20:04] ...media (/app/public/data/WWF/media.txt)
[CMD] [2021-05-19 16:20:04] /usr/bin/sort /app/public/converted_csv/WWF_media_3883.csv > /app/public/converted_csv/WWF_media_3883.csv_sorted
[INFO] [2021-05-19 16:20:04] Converted: /app/public/converted_csv/WWF_media_3883.csv (0 lines)
[INFO] [2021-05-19 16:20:04] ...vernaculars (/app/public/data/WWF/common names.txt)
[CMD] [2021-05-19 16:20:04] /usr/bin/sort /app/public/converted_csv/WWF_vernaculars_3883.csv > /app/public/converted_csv/WWF_vernaculars_3883.csv_sorted
[INFO] [2021-05-19 16:20:04] Converted: /app/public/converted_csv/WWF_vernaculars_3883.csv (0 lines)
[INFO] [2021-05-19 16:20:04] ...occurrences (/app/public/data/WWF/occurrences.txt)
[CMD] [2021-05-19 16:20:04] /usr/bin/sort /app/public/converted_csv/WWF_occurrences_3883.csv > /app/public/converted_csv/WWF_occurrences_3883.csv_sorted
[INFO] [2021-05-19 16:20:05] Converted: /app/public/converted_csv/WWF_occurrences_3883.csv (455229 lines)
[INFO] [2021-05-19 16:20:05] ...assocs (/app/public/data/WWF/associations.txt)
[CMD] [2021-05-19 16:20:05] /usr/bin/sort /app/public/converted_csv/WWF_assocs_3883.csv > /app/public/converted_csv/WWF_assocs_3883.csv_sorted
[INFO] [2021-05-19 16:20:05] Converted: /app/public/converted_csv/WWF_assocs_3883.csv (0 lines)
[INFO] [2021-05-19 16:20:05] ...measurements (/app/public/data/WWF/measurements or facts.txt)
[CMD] [2021-05-19 16:20:05] /usr/bin/sort /app/public/converted_csv/WWF_measurements_3883.csv > /app/public/converted_csv/WWF_measurements_3883.csv_sorted
[INFO] [2021-05-19 16:20:05] Converted: /app/public/converted_csv/WWF_measurements_3883.csv (382308 lines)
[STOP] [2021-05-19 16:20:05] convert_to_csv
[START] [2021-05-19 16:20:05] calculate_delta
[INFO] [2021-05-19 16:20:05] Looping over 8 formats...
[INFO] [2021-05-19 16:20:05] ...agents (/app/public/data/WWF/agents.txt)
[CMD] [2021-05-19 16:20:05] echo "0a" > /app/public/diff/WWF_agents_3883.diff
[CMD] [2021-05-19 16:20:05] tail -n +1 /app/public/converted_csv/WWF_agents_3883.csv >> /app/public/diff/WWF_agents_3883.diff
[CMD] [2021-05-19 16:20:05] echo "." >> /app/public/diff/WWF_agents_3883.diff
[INFO] [2021-05-19 16:20:05] Created diff: /app/public/diff/WWF_agents_3883.diff (2 lines)
[INFO] [2021-05-19 16:20:05] ...refs (/app/public/data/WWF/references.txt)
[CMD] [2021-05-19 16:20:05] echo "0a" > /app/public/diff/WWF_refs_3883.diff
[CMD] [2021-05-19 16:20:05] tail -n +1 /app/public/converted_csv/WWF_refs_3883.csv >> /app/public/diff/WWF_refs_3883.diff
[CMD] [2021-05-19 16:20:05] echo "." >> /app/public/diff/WWF_refs_3883.diff
[INFO] [2021-05-19 16:20:05] Created diff: /app/public/diff/WWF_refs_3883.diff (2 lines)
[INFO] [2021-05-19 16:20:05] ...nodes (/app/public/data/WWF/taxa.txt)
[CMD] [2021-05-19 16:20:05] echo "0a" > /app/public/diff/WWF_nodes_3883.diff
[CMD] [2021-05-19 16:20:05] tail -n +1 /app/public/converted_csv/WWF_nodes_3883.csv >> /app/public/diff/WWF_nodes_3883.diff
[CMD] [2021-05-19 16:20:05] echo "." >> /app/public/diff/WWF_nodes_3883.diff
[INFO] [2021-05-19 16:20:05] Created diff: /app/public/diff/WWF_nodes_3883.diff (29825 lines)
[INFO] [2021-05-19 16:20:05] ...media (/app/public/data/WWF/media.txt)
[CMD] [2021-05-19 16:20:05] echo "0a" > /app/public/diff/WWF_media_3883.diff
[CMD] [2021-05-19 16:20:06] tail -n +1 /app/public/converted_csv/WWF_media_3883.csv >> /app/public/diff/WWF_media_3883.diff
[CMD] [2021-05-19 16:20:06] echo "." >> /app/public/diff/WWF_media_3883.diff
[INFO] [2021-05-19 16:20:06] Created diff: /app/public/diff/WWF_media_3883.diff (2 lines)
[INFO] [2021-05-19 16:20:06] ...vernaculars (/app/public/data/WWF/common names.txt)
[CMD] [2021-05-19 16:20:06] echo "0a" > /app/public/diff/WWF_vernaculars_3883.diff
[CMD] [2021-05-19 16:20:06] tail -n +1 /app/public/converted_csv/WWF_vernaculars_3883.csv >> /app/public/diff/WWF_vernaculars_3883.diff
[CMD] [2021-05-19 16:20:06] echo "." >> /app/public/diff/WWF_vernaculars_3883.diff
[INFO] [2021-05-19 16:20:06] Created diff: /app/public/diff/WWF_vernaculars_3883.diff (2 lines)
[INFO] [2021-05-19 16:20:06] ...occurrences (/app/public/data/WWF/occurrences.txt)
[CMD] [2021-05-19 16:20:06] echo "0a" > /app/public/diff/WWF_occurrences_3883.diff
[CMD] [2021-05-19 16:20:06] tail -n +1 /app/public/converted_csv/WWF_occurrences_3883.csv >> /app/public/diff/WWF_occurrences_3883.diff
[CMD] [2021-05-19 16:20:06] echo "." >> /app/public/diff/WWF_occurrences_3883.diff
[INFO] [2021-05-19 16:20:06] Created diff: /app/public/diff/WWF_occurrences_3883.diff (455231 lines)
[INFO] [2021-05-19 16:20:06] ...assocs (/app/public/data/WWF/associations.txt)
[CMD] [2021-05-19 16:20:06] echo "0a" > /app/public/diff/WWF_assocs_3883.diff
[CMD] [2021-05-19 16:20:06] tail -n +1 /app/public/converted_csv/WWF_assocs_3883.csv >> /app/public/diff/WWF_assocs_3883.diff
[CMD] [2021-05-19 16:20:06] echo "." >> /app/public/diff/WWF_assocs_3883.diff
[INFO] [2021-05-19 16:20:06] Created diff: /app/public/diff/WWF_assocs_3883.diff (2 lines)
[INFO] [2021-05-19 16:20:06] ...measurements (/app/public/data/WWF/measurements or facts.txt)
[CMD] [2021-05-19 16:20:06] echo "0a" > /app/public/diff/WWF_measurements_3883.diff
[CMD] [2021-05-19 16:20:06] tail -n +1 /app/public/converted_csv/WWF_measurements_3883.csv >> /app/public/diff/WWF_measurements_3883.diff
[CMD] [2021-05-19 16:20:06] echo "." >> /app/public/diff/WWF_measurements_3883.diff
[INFO] [2021-05-19 16:20:07] Created diff: /app/public/diff/WWF_measurements_3883.diff (382310 lines)
[STOP] [2021-05-19 16:20:07] calculate_delta
[START] [2021-05-19 16:20:07] parse_diff_and_store
[INFO] [2021-05-19 16:20:07] Handling diff: /app/public/diff/WWF_agents_3883.diff (2 lines)
[INFO] [2021-05-19 16:20:07] Loading agents diff file into memory (2 /app/public/diff/WWF_agents_3883.diff lines)...
[INFO] [2021-05-19 16:20:07] Handling diff: /app/public/diff/WWF_refs_3883.diff (2 lines)
[INFO] [2021-05-19 16:20:07] Loading refs diff file into memory (2 /app/public/diff/WWF_refs_3883.diff lines)...
[INFO] [2021-05-19 16:20:07] Handling diff: /app/public/diff/WWF_nodes_3883.diff (29825 lines)
[INFO] [2021-05-19 16:20:07] Loading nodes diff file into memory (29825 /app/public/diff/WWF_nodes_3883.diff lines)...
[WARN] [2021-05-19 16:20:09] Filtered Scientific Name `Cyclemys atripons/pulchristriata` to `Cyclemys atriponspulchristriata`
[WARN] [2021-05-19 16:20:09] Filtered Scientific Name `Cyclemys oldhamii / tcheponensis` to `Cyclemys oldhamii tcheponensis`
[INFO] [2021-05-19 16:20:17] Handling diff: /app/public/diff/WWF_media_3883.diff (2 lines)
[INFO] [2021-05-19 16:20:17] Loading media diff file into memory (2 /app/public/diff/WWF_media_3883.diff lines)...
[INFO] [2021-05-19 16:20:17] Handling diff: /app/public/diff/WWF_vernaculars_3883.diff (2 lines)
[INFO] [2021-05-19 16:20:17] Loading vernaculars diff file into memory (2 /app/public/diff/WWF_vernaculars_3883.diff lines)...
[INFO] [2021-05-19 16:20:17] Handling diff: /app/public/diff/WWF_occurrences_3883.diff (455231 lines)
[INFO] [2021-05-19 16:20:17] Loading occurrences diff file into memory (455231 /app/public/diff/WWF_occurrences_3883.diff lines)...
[INFO] [2021-05-19 16:21:21] Handling diff: /app/public/diff/WWF_assocs_3883.diff (2 lines)
[INFO] [2021-05-19 16:21:22] Loading assocs diff file into memory (2 /app/public/diff/WWF_assocs_3883.diff lines)...
[INFO] [2021-05-19 16:21:24] Handling diff: /app/public/diff/WWF_measurements_3883.diff (382310 lines)
[INFO] [2021-05-19 16:21:24] Loading measurements diff file into memory (382310 /app/public/diff/WWF_measurements_3883.diff lines)...
[INFO] [2021-05-19 16:26:49] Storing 35098 ScientificNames
[INFO] [2021-05-19 16:26:49] Processing group of 35098 in 36 groups of 1000
[INFO] [2021-05-19 16:27:00] Average Time: 0.3
[INFO] [2021-05-19 16:27:00] Total Time: 11s
[INFO] [2021-05-19 16:27:00] last 3 / first 3: 0.68
[INFO] [2021-05-19 16:27:00] Std.Dev: 0.07071067811865475; Max: 0.49
[INFO] [2021-05-19 16:27:00] Storing 35098 Nodes
[INFO] [2021-05-19 16:27:00] Processing group of 35098 in 36 groups of 1000
[INFO] [2021-05-19 16:27:12] Average Time: 0.344
[INFO] [2021-05-19 16:27:12] Total Time: 13s
[INFO] [2021-05-19 16:27:12] last 3 / first 3: 4.25
[INFO] [2021-05-19 16:27:12] Std.Dev: 0.382099463490856; Max: 2.54
[INFO] [2021-05-19 16:27:12] Storing 455229 Occurrences
[INFO] [2021-05-19 16:27:12] Processing group of 455229 in 456 groups of 1000
[INFO] [2021-05-19 16:28:28] Average Time: 0.163
[INFO] [2021-05-19 16:28:28] Total Time: 1m16s
[INFO] [2021-05-19 16:28:28] last 3 / first 3: 0.08
[INFO] [2021-05-19 16:28:28] Std.Dev: 0.3; Max: 4.96
[INFO] [2021-05-19 16:28:28] Storing 382308 Traits
[INFO] [2021-05-19 16:28:28] Processing group of 382308 in 383 groups of 1000
[INFO] [2021-05-19 16:31:00] Average Time: 0.391
[INFO] [2021-05-19 16:31:00] Total Time: 2m32s
[INFO] [2021-05-19 16:31:00] last 3 / first 3: 0.78
[INFO] [2021-05-19 16:31:00] Std.Dev: 0.4538722287164087; Max: 3.81
[INFO] [2021-05-19 16:31:00] Storing 764616 MetaTraits
[INFO] [2021-05-19 16:31:00] Processing group of 764616 in 765 groups of 1000
[INFO] [2021-05-19 16:33:03] Average Time: 0.155
[INFO] [2021-05-19 16:33:03] Total Time: 2m4s
[INFO] [2021-05-19 16:33:03] last 3 / first 3: 1.29
[INFO] [2021-05-19 16:33:03] Std.Dev: 0.22583179581272428; Max: 2.42
[STOP] [2021-05-19 16:33:03] parse_diff_and_store
[START] [2021-05-19 16:33:03] resolve_keys
[INFO] [2021-05-19 16:33:24] Occurrences to nodes (through scientific_names)...
[INFO] [2021-05-19 16:33:39] traits to occurrences...
[INFO] [2021-05-19 16:33:51] traits to nodes (through occurrences)...
[INFO] [2021-05-19 16:33:59] Traits to sex term...
[INFO] [2021-05-19 16:34:04] Traits to lifestage term...
[INFO] [2021-05-19 16:34:08] MetaTraits to traits...
[INFO] [2021-05-19 16:34:27] MetaTraits (simple, measurement row refers to parent) to traits...
[INFO] [2021-05-19 16:34:27] Assocs to occurrences...
[INFO] [2021-05-19 16:34:27] Assocs to nodes...
[INFO] [2021-05-19 16:34:27] Assoc to sex term...
[INFO] [2021-05-19 16:34:27] Assoc to lifestage term...
[INFO] [2021-05-19 16:34:27] MetaAssoc to assocs...
[STOP] [2021-05-19 16:34:27] resolve_keys
[START] [2021-05-19 16:34:27] hold_for_later_1
[STOP] [2021-05-19 16:34:27] hold_for_later_1
[START] [2021-05-19 16:34:27] hold_for_later_2
[STOP] [2021-05-19 16:34:27] hold_for_later_2
[START] [2021-05-19 16:34:27] resolve_missing_parents
[STOP] [2021-05-19 16:34:28] resolve_missing_parents
[START] [2021-05-19 16:34:28] rebuild_nodes
[START] [2021-05-19 16:34:29] Flattener#flatten
[START] [2021-05-19 16:34:29] Flattener#study_resource
[START] [2021-05-19 16:34:29] Flattener#build_ancestry
[STOP] [2021-05-19 16:34:40] Flattener#build_ancestry
[INFO] [2021-05-19 16:34:40] 35098 ancestry keys
[START] [2021-05-19 16:34:40] build_node_ancestors
[INFO] [2021-05-19 16:34:40] old ancestors deleted.
[STOP] [2021-05-19 16:35:04] build_node_ancestors
[START] [2021-05-19 16:35:07] Flattener#propagate_ancestor_ids
[STOP] [2021-05-19 16:35:11] Flattener#propagate_ancestor_ids
[STOP] [2021-05-19 16:35:11] Flattener#flatten
[STOP] [2021-05-19 16:35:11] rebuild_nodes
[START] [2021-05-19 16:35:11] resolve_missing_media_owners
[STOP] [2021-05-19 16:35:11] resolve_missing_media_owners
[START] [2021-05-19 16:35:11] sanitize_media_verbatims
[STOP] [2021-05-19 16:35:11] sanitize_media_verbatims
[START] [2021-05-19 16:35:11] queue_downloads
[STOP] [2021-05-19 16:35:11] queue_downloads
[START] [2021-05-19 16:35:11] parse_names
[WARN] [2021-05-19 16:35:11] I see 35098 names which still need to be parsed.
[WARN] [2021-05-19 16:35:35] I see 33 names which still need to be parsed.
[STOP] [2021-05-19 16:35:36] parse_names
[START] [2021-05-19 16:35:36] denormalize_canonical_names_to_nodes
[STOP] [2021-05-19 16:35:37] denormalize_canonical_names_to_nodes
[START] [2021-05-19 16:35:37] match_nodes
[START] [2021-05-19 16:35:37] map_all_nodes_to_pages
[STOP] [2021-05-19 16:41:55] map_all_nodes_to_pages
[INFO] [2021-05-19 16:41:55] 2461 Unmatched nodes (of 35098)! That's too many to output. Full list in /app/public/data/WWF/unmatched_nodes.txt ; First 10: Canonical: Leptotyphlops; Node#94511651; ResourceID: Leptotyphlops_Ethiopia; Canonical: Leptotyphlops; Node#94511652; ResourceID: Leptotyphlops_Tana; Canonical: Leptotyphlops albifrons; Node#94511655; ResourceID: Leptotyphlops_albifrons; Canonical: Leptotyphlops blanfordii blanfordii; Node#94511666; ResourceID: Leptotyphlops_blanfordii_blanfordii; Canonical: Leptotyphlops dulcishumilis; Node#94511691; ResourceID: Leptotyphlops_dulcishumilis; Canonical: Leptotyphlops koppesi; Node#94511701; ResourceID: Leptotyphlops_koppesi; Canonical: Leptotyphlops melanotermus; Node#94511710; ResourceID: Leptotyphlops_melanotermus; Canonical: Leptotyphlops nasalis; Node#94511714; ResourceID: Leptotyphlops_nasalis; Canonical: Leptotyphlops nigroterminatus; Node#94511718; ResourceID: Leptotyphlops_nigroterminatus; Canonical: Ablepharus boutonii; Node#94494158; ResourceID: Ablepharus_boutonii
[START] [2021-05-19 16:41:55] update_nodes
[STOP] [2021-05-19 16:42:09] update_nodes
[STOP] [2021-05-19 16:42:09] match_nodes
[START] [2021-05-19 16:42:09] reindex_search
[STOP] [2021-05-19 16:42:41] reindex_search
[START] [2021-05-19 16:42:41] normalize_units
[STOP] [2021-05-19 16:43:12] normalize_units
[START] [2021-05-19 16:43:12] calculate_statistics
[2021-05-19 16:43:17] (NEAR) DUPLICATE TRAITS FOUND! There are only 382301 (of 382308 total) unique traits.
[2021-05-21 04:11:25] (Near) duplicate trait pairs (up to 100):
[2021-05-21 04:11:25] (resource_pk: M_00045058, id: 207441895), (resource_pk: M_00045060, id: 207441897)
[2021-05-21 04:11:25] (resource_pk: M_00178277, id: 207575114), (resource_pk: M_00178279, id: 207575116)
[2021-05-21 04:11:25] (resource_pk: M_00178278, id: 207575115), (resource_pk: M_00178280, id: 207575117)
[2021-05-21 04:11:25] (resource_pk: M_00262824, id: 207659661), (resource_pk: M_00262827, id: 207659664)
[2021-05-21 04:11:25] (resource_pk: M_00354781, id: 207751618), (resource_pk: M_00374211, id: 207771048)
[2021-05-21 04:11:25] (resource_pk: M_00360952, id: 207757789), (resource_pk: M_00360953, id: 207757790)
[2021-05-21 04:11:25] (resource_pk: M_00366506, id: 207763343), (resource_pk: M_00366507, id: 207763344)
[STOP] [2021-05-21 04:11:26] calculate_statistics
[START] [2021-05-21 04:11:26] complete_harvest_instance
[START] [2021-05-21 04:11:26] overall_tsv_creation
[INFO] [2021-05-21 04:11:26] Processing group of 35098 in 4 batches of 10000
[INFO] [2021-05-21 04:14:21] 116718 Traits (unfiltered)...
[INFO] [2021-05-21 04:27:22] 116718 Traits (filtered)...
[INFO] [2021-05-21 04:27:26] 0 Associations (filtered)...
[INFO] [2021-05-21 04:27:37] 0 metadata added.
[INFO] [2021-05-21 04:27:37] 0 metadata added.
[INFO] [2021-05-21 04:30:01] 97909 Traits (unfiltered)...
[INFO] [2021-05-21 04:40:58] 97909 Traits (filtered)...
[INFO] [2021-05-21 04:41:01] 0 Associations (filtered)...
[INFO] [2021-05-21 04:41:10] 0 metadata added.
[INFO] [2021-05-21 04:41:10] 0 metadata added.
[INFO] [2021-05-21 04:43:14] 108158 Traits (unfiltered)...
[INFO] [2021-05-21 04:55:24] 108158 Traits (filtered)...
[INFO] [2021-05-21 04:55:27] 0 Associations (filtered)...
[INFO] [2021-05-21 04:55:37] 0 metadata added.
[INFO] [2021-05-21 04:55:37] 0 metadata added.
[INFO] [2021-05-21 04:57:28] 59511 Traits (unfiltered)...
[INFO] [2021-05-21 05:04:20] 59511 Traits (filtered)...
[INFO] [2021-05-21 05:04:23] 0 Associations (filtered)...
[INFO] [2021-05-21 05:04:30] 0 metadata added.
[INFO] [2021-05-21 05:04:30] 0 metadata added.
[INFO] [2021-05-21 05:05:11] Average Time: 745.49
[INFO] [2021-05-21 05:05:11] Total Time: 53m45s
[STOP] [2021-05-21 05:05:11] overall_tsv_creation
[INFO] [2021-05-21 05:05:11] Done. Check your files:
[INFO] [2021-05-21 05:05:11] (35098 lines) /app/public/data/WWF/publish_nodes.tsv
[INFO] [2021-05-21 05:05:11] (134549 lines) /app/public/data/WWF/publish_node_ancestors.tsv
[INFO] [2021-05-21 05:05:12] (35098 lines) /app/public/data/WWF/publish_scientific_names.tsv
[INFO] [2021-05-21 05:05:12] (382297 lines) /app/public/data/WWF/publish_traits.tsv
[INFO] [2021-05-21 05:05:12] (1 lines) /app/public/data/WWF/publish_metadata.tsv
[STOP] [2021-05-21 05:05:13] complete_harvest_instance
[START] [2021-05-21 05:05:13] completed
[STOP] [2021-05-21 05:05:13] completed
[STOP] [2021-05-21 05:05:13] logged process, took 132390.32

Latest Process

19 May 16:18 EXITED currently processing 0