Harvest for Alaskan Arthropods Created 13 Oct 09:28

Harvesting Log

[INFO] [2023-10-13 09:28:11] Created harvest instance #4421
[STOP] [2023-10-13 09:28:11] create_harvest_instance
[START] [2023-10-13 09:28:11] fetch_files
[STOP] [2023-10-13 09:28:11] fetch_files
[START] [2023-10-13 09:28:11] validate_each_file
[INFO] [2023-10-13 09:28:11] Looping over 8 formats...
[INFO] [2023-10-13 09:28:11] ...agents (/app/public/data/Alaskan_Arthropo/agents.txt)
[INFO] [2023-10-13 09:28:11] Valid: /app/public/data/Alaskan_Arthropo/converted_csv/Alaskan_Arthropo_agents_30637.csv (0 lines)
[INFO] [2023-10-13 09:28:11] ...refs (/app/public/data/Alaskan_Arthropo/references.txt)
[INFO] [2023-10-13 09:28:11] Valid: /app/public/data/Alaskan_Arthropo/converted_csv/Alaskan_Arthropo_refs_30636.csv (443 lines)
[INFO] [2023-10-13 09:28:11] ...nodes (/app/public/data/Alaskan_Arthropo/taxa.txt)
[INFO] [2023-10-13 09:28:11] Valid: /app/public/data/Alaskan_Arthropo/converted_csv/Alaskan_Arthropo_nodes_30634.csv (7682 lines)
[INFO] [2023-10-13 09:28:11] ...media (/app/public/data/Alaskan_Arthropo/media.txt)
[INFO] [2023-10-13 09:28:11] Valid: /app/public/data/Alaskan_Arthropo/converted_csv/Alaskan_Arthropo_media_30633.csv (0 lines)
[INFO] [2023-10-13 09:28:11] ...vernaculars (/app/public/data/Alaskan_Arthropo/common names.txt)
[INFO] [2023-10-13 09:28:11] Valid: /app/public/data/Alaskan_Arthropo/converted_csv/Alaskan_Arthropo_vernaculars_30635.csv (0 lines)
[INFO] [2023-10-13 09:28:11] ...occurrences (/app/public/data/Alaskan_Arthropo/occurrences.txt)
[INFO] [2023-10-13 09:28:12] Valid: /app/public/data/Alaskan_Arthropo/converted_csv/Alaskan_Arthropo_occurrences_30638.csv (7682 lines)
[INFO] [2023-10-13 09:28:12] ...assocs (/app/public/data/Alaskan_Arthropo/associations.txt)
[INFO] [2023-10-13 09:28:12] Valid: /app/public/data/Alaskan_Arthropo/converted_csv/Alaskan_Arthropo_assocs_30640.csv (0 lines)
[INFO] [2023-10-13 09:28:12] ...measurements (/app/public/data/Alaskan_Arthropo/measurements or facts.txt)
[INFO] [2023-10-13 09:28:13] Valid: /app/public/data/Alaskan_Arthropo/converted_csv/Alaskan_Arthropo_measurements_30639.csv (7923 lines)
[STOP] [2023-10-13 09:28:13] validate_each_file
[START] [2023-10-13 09:28:13] convert_to_csv
[INFO] [2023-10-13 09:28:13] Looping over 8 formats...
[INFO] [2023-10-13 09:28:13] ...agents (/app/public/data/Alaskan_Arthropo/agents.txt)
[CMD] [2023-10-13 09:28:13] /usr/bin/sort /app/public/data/Alaskan_Arthropo/converted_csv/Alaskan_Arthropo_agents_30637.csv > /app/public/data/Alaskan_Arthropo/converted_csv/Alaskan_Arthropo_agents_30637.csv_sorted
[INFO] [2023-10-13 09:28:13] Converted: /app/public/data/Alaskan_Arthropo/converted_csv/Alaskan_Arthropo_agents_30637.csv (0 lines)
[INFO] [2023-10-13 09:28:13] ...refs (/app/public/data/Alaskan_Arthropo/references.txt)
[CMD] [2023-10-13 09:28:13] /usr/bin/sort /app/public/data/Alaskan_Arthropo/converted_csv/Alaskan_Arthropo_refs_30636.csv > /app/public/data/Alaskan_Arthropo/converted_csv/Alaskan_Arthropo_refs_30636.csv_sorted
[INFO] [2023-10-13 09:28:13] Converted: /app/public/data/Alaskan_Arthropo/converted_csv/Alaskan_Arthropo_refs_30636.csv (443 lines)
[INFO] [2023-10-13 09:28:13] ...nodes (/app/public/data/Alaskan_Arthropo/taxa.txt)
[CMD] [2023-10-13 09:28:13] /usr/bin/sort /app/public/data/Alaskan_Arthropo/converted_csv/Alaskan_Arthropo_nodes_30634.csv > /app/public/data/Alaskan_Arthropo/converted_csv/Alaskan_Arthropo_nodes_30634.csv_sorted
[INFO] [2023-10-13 09:28:13] Converted: /app/public/data/Alaskan_Arthropo/converted_csv/Alaskan_Arthropo_nodes_30634.csv (7682 lines)
[INFO] [2023-10-13 09:28:13] ...media (/app/public/data/Alaskan_Arthropo/media.txt)
[CMD] [2023-10-13 09:28:13] /usr/bin/sort /app/public/data/Alaskan_Arthropo/converted_csv/Alaskan_Arthropo_media_30633.csv > /app/public/data/Alaskan_Arthropo/converted_csv/Alaskan_Arthropo_media_30633.csv_sorted
[INFO] [2023-10-13 09:28:13] Converted: /app/public/data/Alaskan_Arthropo/converted_csv/Alaskan_Arthropo_media_30633.csv (0 lines)
[INFO] [2023-10-13 09:28:13] ...vernaculars (/app/public/data/Alaskan_Arthropo/common names.txt)
[CMD] [2023-10-13 09:28:13] /usr/bin/sort /app/public/data/Alaskan_Arthropo/converted_csv/Alaskan_Arthropo_vernaculars_30635.csv > /app/public/data/Alaskan_Arthropo/converted_csv/Alaskan_Arthropo_vernaculars_30635.csv_sorted
[INFO] [2023-10-13 09:28:13] Converted: /app/public/data/Alaskan_Arthropo/converted_csv/Alaskan_Arthropo_vernaculars_30635.csv (0 lines)
[INFO] [2023-10-13 09:28:13] ...occurrences (/app/public/data/Alaskan_Arthropo/occurrences.txt)
[CMD] [2023-10-13 09:28:13] /usr/bin/sort /app/public/data/Alaskan_Arthropo/converted_csv/Alaskan_Arthropo_occurrences_30638.csv > /app/public/data/Alaskan_Arthropo/converted_csv/Alaskan_Arthropo_occurrences_30638.csv_sorted
[INFO] [2023-10-13 09:28:13] Converted: /app/public/data/Alaskan_Arthropo/converted_csv/Alaskan_Arthropo_occurrences_30638.csv (7682 lines)
[INFO] [2023-10-13 09:28:13] ...assocs (/app/public/data/Alaskan_Arthropo/associations.txt)
[CMD] [2023-10-13 09:28:13] /usr/bin/sort /app/public/data/Alaskan_Arthropo/converted_csv/Alaskan_Arthropo_assocs_30640.csv > /app/public/data/Alaskan_Arthropo/converted_csv/Alaskan_Arthropo_assocs_30640.csv_sorted
[INFO] [2023-10-13 09:28:14] Converted: /app/public/data/Alaskan_Arthropo/converted_csv/Alaskan_Arthropo_assocs_30640.csv (0 lines)
[INFO] [2023-10-13 09:28:14] ...measurements (/app/public/data/Alaskan_Arthropo/measurements or facts.txt)
[CMD] [2023-10-13 09:28:14] /usr/bin/sort /app/public/data/Alaskan_Arthropo/converted_csv/Alaskan_Arthropo_measurements_30639.csv > /app/public/data/Alaskan_Arthropo/converted_csv/Alaskan_Arthropo_measurements_30639.csv_sorted
[INFO] [2023-10-13 09:28:14] Converted: /app/public/data/Alaskan_Arthropo/converted_csv/Alaskan_Arthropo_measurements_30639.csv (7923 lines)
[STOP] [2023-10-13 09:28:14] convert_to_csv
[START] [2023-10-13 09:28:14] calculate_delta
[INFO] [2023-10-13 09:28:14] Looping over 8 formats...
[INFO] [2023-10-13 09:28:14] ...agents (/app/public/data/Alaskan_Arthropo/agents.txt)
[CMD] [2023-10-13 09:28:14] echo "0a" > /app/public/data/Alaskan_Arthropo/diff/Alaskan_Arthropo_agents_30637.diff
[CMD] [2023-10-13 09:28:14] tail -n +1 /app/public/data/Alaskan_Arthropo/converted_csv/Alaskan_Arthropo_agents_30637.csv >> /app/public/data/Alaskan_Arthropo/diff/Alaskan_Arthropo_agents_30637.diff
[CMD] [2023-10-13 09:28:14] echo "." >> /app/public/data/Alaskan_Arthropo/diff/Alaskan_Arthropo_agents_30637.diff
[INFO] [2023-10-13 09:28:14] Created diff: /app/public/data/Alaskan_Arthropo/diff/Alaskan_Arthropo_agents_30637.diff (2 lines)
[INFO] [2023-10-13 09:28:14] ...refs (/app/public/data/Alaskan_Arthropo/references.txt)
[CMD] [2023-10-13 09:28:14] echo "0a" > /app/public/data/Alaskan_Arthropo/diff/Alaskan_Arthropo_refs_30636.diff
[CMD] [2023-10-13 09:28:14] tail -n +1 /app/public/data/Alaskan_Arthropo/converted_csv/Alaskan_Arthropo_refs_30636.csv >> /app/public/data/Alaskan_Arthropo/diff/Alaskan_Arthropo_refs_30636.diff
[CMD] [2023-10-13 09:28:14] echo "." >> /app/public/data/Alaskan_Arthropo/diff/Alaskan_Arthropo_refs_30636.diff
[INFO] [2023-10-13 09:28:14] Created diff: /app/public/data/Alaskan_Arthropo/diff/Alaskan_Arthropo_refs_30636.diff (445 lines)
[INFO] [2023-10-13 09:28:14] ...nodes (/app/public/data/Alaskan_Arthropo/taxa.txt)
[CMD] [2023-10-13 09:28:14] echo "0a" > /app/public/data/Alaskan_Arthropo/diff/Alaskan_Arthropo_nodes_30634.diff
[CMD] [2023-10-13 09:28:14] tail -n +1 /app/public/data/Alaskan_Arthropo/converted_csv/Alaskan_Arthropo_nodes_30634.csv >> /app/public/data/Alaskan_Arthropo/diff/Alaskan_Arthropo_nodes_30634.diff
[CMD] [2023-10-13 09:28:14] echo "." >> /app/public/data/Alaskan_Arthropo/diff/Alaskan_Arthropo_nodes_30634.diff
[INFO] [2023-10-13 09:28:14] Created diff: /app/public/data/Alaskan_Arthropo/diff/Alaskan_Arthropo_nodes_30634.diff (7684 lines)
[INFO] [2023-10-13 09:28:14] ...media (/app/public/data/Alaskan_Arthropo/media.txt)
[CMD] [2023-10-13 09:28:14] echo "0a" > /app/public/data/Alaskan_Arthropo/diff/Alaskan_Arthropo_media_30633.diff
[CMD] [2023-10-13 09:28:14] tail -n +1 /app/public/data/Alaskan_Arthropo/converted_csv/Alaskan_Arthropo_media_30633.csv >> /app/public/data/Alaskan_Arthropo/diff/Alaskan_Arthropo_media_30633.diff
[CMD] [2023-10-13 09:28:14] echo "." >> /app/public/data/Alaskan_Arthropo/diff/Alaskan_Arthropo_media_30633.diff
[INFO] [2023-10-13 09:28:15] Created diff: /app/public/data/Alaskan_Arthropo/diff/Alaskan_Arthropo_media_30633.diff (2 lines)
[INFO] [2023-10-13 09:28:15] ...vernaculars (/app/public/data/Alaskan_Arthropo/common names.txt)
[CMD] [2023-10-13 09:28:15] echo "0a" > /app/public/data/Alaskan_Arthropo/diff/Alaskan_Arthropo_vernaculars_30635.diff
[CMD] [2023-10-13 09:28:15] tail -n +1 /app/public/data/Alaskan_Arthropo/converted_csv/Alaskan_Arthropo_vernaculars_30635.csv >> /app/public/data/Alaskan_Arthropo/diff/Alaskan_Arthropo_vernaculars_30635.diff
[CMD] [2023-10-13 09:28:15] echo "." >> /app/public/data/Alaskan_Arthropo/diff/Alaskan_Arthropo_vernaculars_30635.diff
[INFO] [2023-10-13 09:28:15] Created diff: /app/public/data/Alaskan_Arthropo/diff/Alaskan_Arthropo_vernaculars_30635.diff (2 lines)
[INFO] [2023-10-13 09:28:15] ...occurrences (/app/public/data/Alaskan_Arthropo/occurrences.txt)
[CMD] [2023-10-13 09:28:15] echo "0a" > /app/public/data/Alaskan_Arthropo/diff/Alaskan_Arthropo_occurrences_30638.diff
[CMD] [2023-10-13 09:28:15] tail -n +1 /app/public/data/Alaskan_Arthropo/converted_csv/Alaskan_Arthropo_occurrences_30638.csv >> /app/public/data/Alaskan_Arthropo/diff/Alaskan_Arthropo_occurrences_30638.diff
[CMD] [2023-10-13 09:28:15] echo "." >> /app/public/data/Alaskan_Arthropo/diff/Alaskan_Arthropo_occurrences_30638.diff
[INFO] [2023-10-13 09:28:15] Created diff: /app/public/data/Alaskan_Arthropo/diff/Alaskan_Arthropo_occurrences_30638.diff (7684 lines)
[INFO] [2023-10-13 09:28:15] ...assocs (/app/public/data/Alaskan_Arthropo/associations.txt)
[CMD] [2023-10-13 09:28:15] echo "0a" > /app/public/data/Alaskan_Arthropo/diff/Alaskan_Arthropo_assocs_30640.diff
[CMD] [2023-10-13 09:28:15] tail -n +1 /app/public/data/Alaskan_Arthropo/converted_csv/Alaskan_Arthropo_assocs_30640.csv >> /app/public/data/Alaskan_Arthropo/diff/Alaskan_Arthropo_assocs_30640.diff
[CMD] [2023-10-13 09:28:15] echo "." >> /app/public/data/Alaskan_Arthropo/diff/Alaskan_Arthropo_assocs_30640.diff
[INFO] [2023-10-13 09:28:15] Created diff: /app/public/data/Alaskan_Arthropo/diff/Alaskan_Arthropo_assocs_30640.diff (2 lines)
[INFO] [2023-10-13 09:28:15] ...measurements (/app/public/data/Alaskan_Arthropo/measurements or facts.txt)
[CMD] [2023-10-13 09:28:15] echo "0a" > /app/public/data/Alaskan_Arthropo/diff/Alaskan_Arthropo_measurements_30639.diff
[CMD] [2023-10-13 09:28:15] tail -n +1 /app/public/data/Alaskan_Arthropo/converted_csv/Alaskan_Arthropo_measurements_30639.csv >> /app/public/data/Alaskan_Arthropo/diff/Alaskan_Arthropo_measurements_30639.diff
[CMD] [2023-10-13 09:28:15] echo "." >> /app/public/data/Alaskan_Arthropo/diff/Alaskan_Arthropo_measurements_30639.diff
[INFO] [2023-10-13 09:28:15] Created diff: /app/public/data/Alaskan_Arthropo/diff/Alaskan_Arthropo_measurements_30639.diff (7925 lines)
[STOP] [2023-10-13 09:28:15] calculate_delta
[START] [2023-10-13 09:28:15] parse_diff_and_store
[INFO] [2023-10-13 09:28:15] Handling diff: /app/public/data/Alaskan_Arthropo/diff/Alaskan_Arthropo_agents_30637.diff (2 lines)
[INFO] [2023-10-13 09:28:16] Loading agents diff file into memory (2 lines)...
[INFO] [2023-10-13 09:28:16] Handling diff: /app/public/data/Alaskan_Arthropo/diff/Alaskan_Arthropo_refs_30636.diff (445 lines)
[INFO] [2023-10-13 09:28:16] Loading refs diff file into memory (445 lines)...
[INFO] [2023-10-13 09:28:16] Storing 443 References (443/443/445)
[INFO] [2023-10-13 09:28:16] Handling diff: /app/public/data/Alaskan_Arthropo/diff/Alaskan_Arthropo_nodes_30634.diff (7684 lines)
[INFO] [2023-10-13 09:28:16] Loading nodes diff file into memory (7684 lines)...
[INFO] [2023-10-13 09:28:19] Storing 11116 ScientificNames (22232/7682/7684)
[INFO] [2023-10-13 09:28:23] Storing 11116 Nodes (22232/7682/7684)
[INFO] [2023-10-13 09:28:28] Handling diff: /app/public/data/Alaskan_Arthropo/diff/Alaskan_Arthropo_media_30633.diff (2 lines)
[INFO] [2023-10-13 09:28:28] Loading media diff file into memory (2 lines)...
[INFO] [2023-10-13 09:28:28] Handling diff: /app/public/data/Alaskan_Arthropo/diff/Alaskan_Arthropo_vernaculars_30635.diff (2 lines)
[INFO] [2023-10-13 09:28:28] Loading vernaculars diff file into memory (2 lines)...
[INFO] [2023-10-13 09:28:28] Handling diff: /app/public/data/Alaskan_Arthropo/diff/Alaskan_Arthropo_occurrences_30638.diff (7684 lines)
[INFO] [2023-10-13 09:28:28] Loading occurrences diff file into memory (7684 lines)...
[INFO] [2023-10-13 09:28:29] Storing 7682 Occurrences (7682/7682/7684)
[INFO] [2023-10-13 09:28:30] Handling diff: /app/public/data/Alaskan_Arthropo/diff/Alaskan_Arthropo_assocs_30640.diff (2 lines)
[INFO] [2023-10-13 09:28:30] Loading assocs diff file into memory (2 lines)...
[INFO] [2023-10-13 09:28:30] Handling diff: /app/public/data/Alaskan_Arthropo/diff/Alaskan_Arthropo_measurements_30639.diff (7925 lines)
[INFO] [2023-10-13 09:28:30] Loading measurements diff file into memory (7925 lines)...
[INFO] [2023-10-13 09:28:33] Storing 8258 TraitsReferences (17376/7923/7925)
[INFO] [2023-10-13 09:28:34] Storing 7923 Traits (17376/7923/7925)
[INFO] [2023-10-13 09:28:36] Storing 1195 MetaTraits (17376/7923/7925)
[STOP] [2023-10-13 09:28:36] parse_diff_and_store
[START] [2023-10-13 09:28:36] resolve_keys
[2023-10-13 09:28:40] Resolving downloaded urls (this is not actually downloading them yet)
[INFO] [2023-10-13 09:28:47] Occurrences to nodes (through scientific_names)...
[INFO] [2023-10-13 09:28:48] traits to occurrences...
[INFO] [2023-10-13 09:28:48] traits to nodes (through occurrences)...
[INFO] [2023-10-13 09:28:48] Traits to sex term...
[INFO] [2023-10-13 09:28:48] Traits to lifestage term...
[INFO] [2023-10-13 09:28:49] MetaTraits to traits...
[INFO] [2023-10-13 09:28:49] MetaTraits (simple, measurement row refers to parent) to traits...
[INFO] [2023-10-13 09:28:49] Assocs to occurrences...
[INFO] [2023-10-13 09:28:49] Assocs to nodes...
[INFO] [2023-10-13 09:28:49] Assoc to sex term...
[INFO] [2023-10-13 09:28:49] Assoc to lifestage term...
[INFO] [2023-10-13 09:28:49] MetaAssoc to assocs...
[STOP] [2023-10-13 09:28:49] resolve_keys
[START] [2023-10-13 09:28:49] hold_for_later_1
[STOP] [2023-10-13 09:28:49] hold_for_later_1
[START] [2023-10-13 09:28:49] hold_for_later_2
[STOP] [2023-10-13 09:28:49] hold_for_later_2
[START] [2023-10-13 09:28:49] resolve_missing_parents
[STOP] [2023-10-13 09:28:49] resolve_missing_parents
[START] [2023-10-13 09:28:49] rebuild_nodes
[START] [2023-10-13 09:28:49] Flattener#flatten
[START] [2023-10-13 09:28:49] Flattener#study_resource
[START] [2023-10-13 09:28:49] Flattener#build_ancestry
[STOP] [2023-10-13 09:28:50] Flattener#build_ancestry
[INFO] [2023-10-13 09:28:50] 11116 ancestry keys
[START] [2023-10-13 09:28:50] build_node_ancestors
[INFO] [2023-10-13 09:28:50] old ancestors deleted.
[STOP] [2023-10-13 09:28:51] build_node_ancestors
[START] [2023-10-13 09:28:55] Flattener#propagate_ancestor_ids
[STOP] [2023-10-13 09:28:56] Flattener#propagate_ancestor_ids
[STOP] [2023-10-13 09:28:56] Flattener#flatten
[STOP] [2023-10-13 09:28:56] rebuild_nodes
[START] [2023-10-13 09:28:56] resolve_missing_media_owners
[STOP] [2023-10-13 09:28:56] resolve_missing_media_owners
[START] [2023-10-13 09:28:56] sanitize_media_verbatims
[STOP] [2023-10-13 09:28:56] sanitize_media_verbatims
[START] [2023-10-13 09:28:56] queue_downloads
[STOP] [2023-10-13 09:28:56] queue_downloads
[START] [2023-10-13 09:28:56] parse_names
[WARN] [2023-10-13 09:28:56] I see 11116 names which still need to be parsed.
[WARN] [2023-10-13 09:28:57] Names to parse: 10000 formatted: 10000 learned: 9952 parsed: 10000
[WARN] [2023-10-13 09:29:03] Names to parse: 1116 formatted: 1116 learned: 1110 parsed: 1116
[STOP] [2023-10-13 09:29:05] parse_names
[START] [2023-10-13 09:29:05] denormalize_canonical_names_to_nodes
[STOP] [2023-10-13 09:29:05] denormalize_canonical_names_to_nodes
[START] [2023-10-13 09:29:05] match_nodes
[START] [2023-10-13 09:29:05] map_all_nodes_to_pages
[STOP] [2023-10-13 09:31:54] map_all_nodes_to_pages
[INFO] [2023-10-13 09:31:54] 1094 Unmatched nodes (of 11116)! That's too many to output. Full list in /app/public/data/Alaskan_Arthropo/unmatched_nodes.txt ; First 10: Canonical: Acronicta lupini; Node#136983591; ResourceID: Acronicta lupini; Canonical: Acronicta vulpina; Node#136983593; ResourceID: Acronicta vulpina; Canonical: Actebia balanitis; Node#136983619; ResourceID: Actebia balanitis; Canonical: Alypia langtoni; Node#136984009; ResourceID: Alypia langtoni; Canonical: Anarta nigrolunata; Node#136984158; ResourceID: Anarta nigrolunata; Canonical: Anarta trifolii; Node#136984159; ResourceID: Anarta trifolii; Canonical: Androloma; Node#136984210; ResourceID: Arthropoda/Insecta/Lepidoptera/Noctuidae/Androloma; Canonical: Androloma maccullochii; Node#136984211; ResourceID: Androloma maccullochii; Canonical: Apamea amputatrix; Node#136984355; ResourceID: Apamea amputatrix; Canonical: Apamea cogitata; Node#136984357; ResourceID: Apamea cogitata
[START] [2023-10-13 09:31:54] update_nodes
[STOP] [2023-10-13 09:31:58] update_nodes
[STOP] [2023-10-13 09:31:58] match_nodes
[START] [2023-10-13 09:31:58] reindex_search
[STOP] [2023-10-13 09:32:08] reindex_search
[START] [2023-10-13 09:32:08] normalize_units
[STOP] [2023-10-13 09:32:14] normalize_units
[START] [2023-10-13 09:32:14] calculate_statistics
[INFO] [2023-10-13 09:32:47] Duplicate page_id count: 0
[STOP] [2023-10-13 09:32:47] calculate_statistics
[START] [2023-10-13 09:32:47] complete_harvest_instance
[START] [2023-10-13 09:32:47] overall_tsv_creation
[INFO] [2023-10-13 09:32:47] Exporting 11116 nodes as TSV in batches of 10000...
[INFO] [2023-10-13 09:32:47] Processing group of 11116 in 2 batches of 10000
[INFO] [2023-10-13 09:33:07] 7145 Traits (unfiltered) and 0 associations...
[INFO] [2023-10-13 09:33:07] Building Traits map for 10000 nodes (this can take a while)...
[INFO] [2023-10-13 09:33:13] Mapped 7145 traits (1105 meta) for 10000 nodes.
[INFO] [2023-10-13 09:33:13] Building Associations map (this can take a while)...
[INFO] [2023-10-13 09:33:15] Done. 0 assocs mapped (0 meta).
[INFO] [2023-10-13 09:33:15] Adding 7145 traits...
[INFO] [2023-10-13 09:33:16] 6941 metadata added.
[INFO] [2023-10-13 09:33:16] Adding 0 assocs...
[INFO] [2023-10-13 09:33:16] 0 metadata added.
[INFO] [2023-10-13 09:34:02] Processed 10000/11116 nodes
[INFO] [2023-10-13 09:34:04] 735 Traits (unfiltered) and 0 associations...
[INFO] [2023-10-13 09:34:04] Building Traits map for 1116 nodes (this can take a while)...
[INFO] [2023-10-13 09:34:04] Mapped 735 traits (90 meta) for 1116 nodes.
[INFO] [2023-10-13 09:34:04] Building Associations map (this can take a while)...
[INFO] [2023-10-13 09:34:04] Done. 0 assocs mapped (0 meta).
[INFO] [2023-10-13 09:34:04] Adding 735 traits...
[INFO] [2023-10-13 09:34:04] 685 metadata added.
[INFO] [2023-10-13 09:34:04] Adding 0 assocs...
[INFO] [2023-10-13 09:34:04] 0 metadata added.
[INFO] [2023-10-13 09:34:49] Processed 11116/11116 nodes
[INFO] [2023-10-13 09:34:49] Average Time: 58.095
[INFO] [2023-10-13 09:34:49] Total Time: 2m2s
[STOP] [2023-10-13 09:34:49] overall_tsv_creation
[INFO] [2023-10-13 09:34:49] Done. Check your files:
[INFO] [2023-10-13 09:34:49] (11116 lines) /app/public/data/Alaskan_Arthropo/publish_nodes.tsv
[INFO] [2023-10-13 09:34:49] (50852 lines) /app/public/data/Alaskan_Arthropo/publish_node_ancestors.tsv
[INFO] [2023-10-13 09:34:49] (11116 lines) /app/public/data/Alaskan_Arthropo/publish_scientific_names.tsv
[INFO] [2023-10-13 09:34:50] (7881 lines) /app/public/data/Alaskan_Arthropo/publish_traits.tsv
[INFO] [2023-10-13 09:34:50] (7627 lines) /app/public/data/Alaskan_Arthropo/publish_metadata.tsv
[STOP] [2023-10-13 09:34:50] complete_harvest_instance
[START] [2023-10-13 09:34:50] completed
[STOP] [2023-10-13 09:34:50] completed
[STOP] [2023-10-13 09:34:50] logged process, took 399.19

Latest Process

13 Oct 09:28 EXITED currently processing 0