Harvest for AmphibiaWeb articles Created 25 Oct 06:46

Harvesting Log

[INFO] [2023-10-25 06:46:41] Created harvest instance #4490
[STOP] [2023-10-25 06:46:41] create_harvest_instance
[START] [2023-10-25 06:46:41] fetch_files
[STOP] [2023-10-25 06:46:41] fetch_files
[START] [2023-10-25 06:46:41] validate_each_file
[INFO] [2023-10-25 06:46:41] Looping over 7 formats...
[INFO] [2023-10-25 06:46:41] ...agents (/app/public/data/amphibia_web_txt/agent.tab)
[INFO] [2023-10-25 06:46:41] Valid: /app/public/data/amphibia_web_txt/converted_csv/amphibia_web_txt_agents_30958.csv (777 lines)
[INFO] [2023-10-25 06:46:41] ...refs (/app/public/data/amphibia_web_txt/reference.tab)
[INFO] [2023-10-25 06:46:41] Valid: /app/public/data/amphibia_web_txt/converted_csv/amphibia_web_txt_refs_30957.csv (5799 lines)
[INFO] [2023-10-25 06:46:41] ...nodes (/app/public/data/amphibia_web_txt/taxon.tab)
[INFO] [2023-10-25 06:46:41] Valid: /app/public/data/amphibia_web_txt/converted_csv/amphibia_web_txt_nodes_30960.csv (2346 lines)
[INFO] [2023-10-25 06:46:41] ...media (/app/public/data/amphibia_web_txt/media_resource.tab)
[INFO] [2023-10-25 06:46:42] Valid: /app/public/data/amphibia_web_txt/converted_csv/amphibia_web_txt_media_30959.csv (8454 lines)
[INFO] [2023-10-25 06:46:42] ...vernaculars (/app/public/data/amphibia_web_txt/vernacular_name.tab)
[INFO] [2023-10-25 06:46:43] Valid: /app/public/data/amphibia_web_txt/converted_csv/amphibia_web_txt_vernaculars_30956.csv (2320 lines)
[INFO] [2023-10-25 06:46:43] ...occurrences (/app/public/data/amphibia_web_txt/occurrence_specific.tab)
[INFO] [2023-10-25 06:46:43] Valid: /app/public/data/amphibia_web_txt/converted_csv/amphibia_web_txt_occurrences_30961.csv (2513 lines)
[INFO] [2023-10-25 06:46:43] ...measurements (/app/public/data/amphibia_web_txt/measurement_or_fact_specific.tab)
[INFO] [2023-10-25 06:46:43] Valid: /app/public/data/amphibia_web_txt/converted_csv/amphibia_web_txt_measurements_30962.csv (3689 lines)
[STOP] [2023-10-25 06:46:43] validate_each_file
[START] [2023-10-25 06:46:43] convert_to_csv
[INFO] [2023-10-25 06:46:43] Looping over 7 formats...
[INFO] [2023-10-25 06:46:43] ...agents (/app/public/data/amphibia_web_txt/agent.tab)
[CMD] [2023-10-25 06:46:43] /usr/bin/sort /app/public/data/amphibia_web_txt/converted_csv/amphibia_web_txt_agents_30958.csv > /app/public/data/amphibia_web_txt/converted_csv/amphibia_web_txt_agents_30958.csv_sorted
[INFO] [2023-10-25 06:46:43] Converted: /app/public/data/amphibia_web_txt/converted_csv/amphibia_web_txt_agents_30958.csv (777 lines)
[INFO] [2023-10-25 06:46:43] ...refs (/app/public/data/amphibia_web_txt/reference.tab)
[CMD] [2023-10-25 06:46:43] /usr/bin/sort /app/public/data/amphibia_web_txt/converted_csv/amphibia_web_txt_refs_30957.csv > /app/public/data/amphibia_web_txt/converted_csv/amphibia_web_txt_refs_30957.csv_sorted
[INFO] [2023-10-25 06:46:43] Converted: /app/public/data/amphibia_web_txt/converted_csv/amphibia_web_txt_refs_30957.csv (5799 lines)
[INFO] [2023-10-25 06:46:43] ...nodes (/app/public/data/amphibia_web_txt/taxon.tab)
[CMD] [2023-10-25 06:46:43] /usr/bin/sort /app/public/data/amphibia_web_txt/converted_csv/amphibia_web_txt_nodes_30960.csv > /app/public/data/amphibia_web_txt/converted_csv/amphibia_web_txt_nodes_30960.csv_sorted
[INFO] [2023-10-25 06:46:43] Converted: /app/public/data/amphibia_web_txt/converted_csv/amphibia_web_txt_nodes_30960.csv (2346 lines)
[INFO] [2023-10-25 06:46:43] ...media (/app/public/data/amphibia_web_txt/media_resource.tab)
[CMD] [2023-10-25 06:46:43] /usr/bin/sort /app/public/data/amphibia_web_txt/converted_csv/amphibia_web_txt_media_30959.csv > /app/public/data/amphibia_web_txt/converted_csv/amphibia_web_txt_media_30959.csv_sorted
[INFO] [2023-10-25 06:46:44] Converted: /app/public/data/amphibia_web_txt/converted_csv/amphibia_web_txt_media_30959.csv (8454 lines)
[INFO] [2023-10-25 06:46:44] ...vernaculars (/app/public/data/amphibia_web_txt/vernacular_name.tab)
[CMD] [2023-10-25 06:46:44] /usr/bin/sort /app/public/data/amphibia_web_txt/converted_csv/amphibia_web_txt_vernaculars_30956.csv > /app/public/data/amphibia_web_txt/converted_csv/amphibia_web_txt_vernaculars_30956.csv_sorted
[INFO] [2023-10-25 06:46:44] Converted: /app/public/data/amphibia_web_txt/converted_csv/amphibia_web_txt_vernaculars_30956.csv (2320 lines)
[INFO] [2023-10-25 06:46:44] ...occurrences (/app/public/data/amphibia_web_txt/occurrence_specific.tab)
[CMD] [2023-10-25 06:46:44] /usr/bin/sort /app/public/data/amphibia_web_txt/converted_csv/amphibia_web_txt_occurrences_30961.csv > /app/public/data/amphibia_web_txt/converted_csv/amphibia_web_txt_occurrences_30961.csv_sorted
[INFO] [2023-10-25 06:46:44] Converted: /app/public/data/amphibia_web_txt/converted_csv/amphibia_web_txt_occurrences_30961.csv (2513 lines)
[INFO] [2023-10-25 06:46:44] ...measurements (/app/public/data/amphibia_web_txt/measurement_or_fact_specific.tab)
[CMD] [2023-10-25 06:46:44] /usr/bin/sort /app/public/data/amphibia_web_txt/converted_csv/amphibia_web_txt_measurements_30962.csv > /app/public/data/amphibia_web_txt/converted_csv/amphibia_web_txt_measurements_30962.csv_sorted
[INFO] [2023-10-25 06:46:44] Converted: /app/public/data/amphibia_web_txt/converted_csv/amphibia_web_txt_measurements_30962.csv (3689 lines)
[STOP] [2023-10-25 06:46:44] convert_to_csv
[START] [2023-10-25 06:46:44] calculate_delta
[INFO] [2023-10-25 06:46:44] Looping over 7 formats...
[INFO] [2023-10-25 06:46:44] ...agents (/app/public/data/amphibia_web_txt/agent.tab)
[CMD] [2023-10-25 06:46:44] echo "0a" > /app/public/data/amphibia_web_txt/diff/amphibia_web_txt_agents_30958.diff
[CMD] [2023-10-25 06:46:44] tail -n +1 /app/public/data/amphibia_web_txt/converted_csv/amphibia_web_txt_agents_30958.csv >> /app/public/data/amphibia_web_txt/diff/amphibia_web_txt_agents_30958.diff
[CMD] [2023-10-25 06:46:44] echo "." >> /app/public/data/amphibia_web_txt/diff/amphibia_web_txt_agents_30958.diff
[INFO] [2023-10-25 06:46:44] Created diff: /app/public/data/amphibia_web_txt/diff/amphibia_web_txt_agents_30958.diff (779 lines)
[INFO] [2023-10-25 06:46:44] ...refs (/app/public/data/amphibia_web_txt/reference.tab)
[CMD] [2023-10-25 06:46:44] echo "0a" > /app/public/data/amphibia_web_txt/diff/amphibia_web_txt_refs_30957.diff
[CMD] [2023-10-25 06:46:45] tail -n +1 /app/public/data/amphibia_web_txt/converted_csv/amphibia_web_txt_refs_30957.csv >> /app/public/data/amphibia_web_txt/diff/amphibia_web_txt_refs_30957.diff
[CMD] [2023-10-25 06:46:45] echo "." >> /app/public/data/amphibia_web_txt/diff/amphibia_web_txt_refs_30957.diff
[INFO] [2023-10-25 06:46:45] Created diff: /app/public/data/amphibia_web_txt/diff/amphibia_web_txt_refs_30957.diff (5801 lines)
[INFO] [2023-10-25 06:46:45] ...nodes (/app/public/data/amphibia_web_txt/taxon.tab)
[CMD] [2023-10-25 06:46:45] echo "0a" > /app/public/data/amphibia_web_txt/diff/amphibia_web_txt_nodes_30960.diff
[CMD] [2023-10-25 06:46:45] tail -n +1 /app/public/data/amphibia_web_txt/converted_csv/amphibia_web_txt_nodes_30960.csv >> /app/public/data/amphibia_web_txt/diff/amphibia_web_txt_nodes_30960.diff
[CMD] [2023-10-25 06:46:45] echo "." >> /app/public/data/amphibia_web_txt/diff/amphibia_web_txt_nodes_30960.diff
[INFO] [2023-10-25 06:46:45] Created diff: /app/public/data/amphibia_web_txt/diff/amphibia_web_txt_nodes_30960.diff (2348 lines)
[INFO] [2023-10-25 06:46:45] ...media (/app/public/data/amphibia_web_txt/media_resource.tab)
[CMD] [2023-10-25 06:46:45] echo "0a" > /app/public/data/amphibia_web_txt/diff/amphibia_web_txt_media_30959.diff
[CMD] [2023-10-25 06:46:45] tail -n +1 /app/public/data/amphibia_web_txt/converted_csv/amphibia_web_txt_media_30959.csv >> /app/public/data/amphibia_web_txt/diff/amphibia_web_txt_media_30959.diff
[CMD] [2023-10-25 06:46:45] echo "." >> /app/public/data/amphibia_web_txt/diff/amphibia_web_txt_media_30959.diff
[INFO] [2023-10-25 06:46:46] Created diff: /app/public/data/amphibia_web_txt/diff/amphibia_web_txt_media_30959.diff (8456 lines)
[INFO] [2023-10-25 06:46:46] ...vernaculars (/app/public/data/amphibia_web_txt/vernacular_name.tab)
[CMD] [2023-10-25 06:46:46] echo "0a" > /app/public/data/amphibia_web_txt/diff/amphibia_web_txt_vernaculars_30956.diff
[CMD] [2023-10-25 06:46:46] tail -n +1 /app/public/data/amphibia_web_txt/converted_csv/amphibia_web_txt_vernaculars_30956.csv >> /app/public/data/amphibia_web_txt/diff/amphibia_web_txt_vernaculars_30956.diff
[CMD] [2023-10-25 06:46:46] echo "." >> /app/public/data/amphibia_web_txt/diff/amphibia_web_txt_vernaculars_30956.diff
[INFO] [2023-10-25 06:46:46] Created diff: /app/public/data/amphibia_web_txt/diff/amphibia_web_txt_vernaculars_30956.diff (2322 lines)
[INFO] [2023-10-25 06:46:46] ...occurrences (/app/public/data/amphibia_web_txt/occurrence_specific.tab)
[CMD] [2023-10-25 06:46:46] echo "0a" > /app/public/data/amphibia_web_txt/diff/amphibia_web_txt_occurrences_30961.diff
[CMD] [2023-10-25 06:46:46] tail -n +1 /app/public/data/amphibia_web_txt/converted_csv/amphibia_web_txt_occurrences_30961.csv >> /app/public/data/amphibia_web_txt/diff/amphibia_web_txt_occurrences_30961.diff
[CMD] [2023-10-25 06:46:46] echo "." >> /app/public/data/amphibia_web_txt/diff/amphibia_web_txt_occurrences_30961.diff
[INFO] [2023-10-25 06:46:46] Created diff: /app/public/data/amphibia_web_txt/diff/amphibia_web_txt_occurrences_30961.diff (2515 lines)
[INFO] [2023-10-25 06:46:46] ...measurements (/app/public/data/amphibia_web_txt/measurement_or_fact_specific.tab)
[CMD] [2023-10-25 06:46:46] echo "0a" > /app/public/data/amphibia_web_txt/diff/amphibia_web_txt_measurements_30962.diff
[CMD] [2023-10-25 06:46:46] tail -n +1 /app/public/data/amphibia_web_txt/converted_csv/amphibia_web_txt_measurements_30962.csv >> /app/public/data/amphibia_web_txt/diff/amphibia_web_txt_measurements_30962.diff
[CMD] [2023-10-25 06:46:46] echo "." >> /app/public/data/amphibia_web_txt/diff/amphibia_web_txt_measurements_30962.diff
[INFO] [2023-10-25 06:46:47] Created diff: /app/public/data/amphibia_web_txt/diff/amphibia_web_txt_measurements_30962.diff (3691 lines)
[STOP] [2023-10-25 06:46:47] calculate_delta
[START] [2023-10-25 06:46:47] parse_diff_and_store
[INFO] [2023-10-25 06:46:47] Handling diff: /app/public/data/amphibia_web_txt/diff/amphibia_web_txt_agents_30958.diff (779 lines)
[INFO] [2023-10-25 06:46:47] Loading agents diff file into memory (779 lines)...
[INFO] [2023-10-25 06:46:47] Storing 777 Attributions (777/777/779)
[INFO] [2023-10-25 06:46:47] Handling diff: /app/public/data/amphibia_web_txt/diff/amphibia_web_txt_refs_30957.diff (5801 lines)
[INFO] [2023-10-25 06:46:47] Loading refs diff file into memory (5801 lines)...
[INFO] [2023-10-25 06:46:48] Storing 5799 References (5799/5799/5801)
[INFO] [2023-10-25 06:46:49] Handling diff: /app/public/data/amphibia_web_txt/diff/amphibia_web_txt_nodes_30960.diff (2348 lines)
[INFO] [2023-10-25 06:46:49] Loading nodes diff file into memory (2348 lines)...
[INFO] [2023-10-25 06:46:50] Storing 2424 ScientificNames (4848/2346/2348)
[INFO] [2023-10-25 06:46:51] Storing 2424 Nodes (4848/2346/2348)
[INFO] [2023-10-25 06:46:52] Handling diff: /app/public/data/amphibia_web_txt/diff/amphibia_web_txt_media_30959.diff (8456 lines)
[INFO] [2023-10-25 06:46:52] Loading media diff file into memory (8456 lines)...
[WARN] [2023-10-25 06:46:52] Could not find a media subtype (format) of "text/plain"
[INFO] [2023-10-25 06:47:04] Storing 12174 ContentAttributions (68838/8454/8456)
[INFO] [2023-10-25 06:47:05] Storing 8454 ArticlesSections (68838/8454/8456)
[INFO] [2023-10-25 06:47:06] Storing 8454 Articles (68838/8454/8456)
[INFO] [2023-10-25 06:47:10] Storing 39756 ArticlesReferences (68838/8454/8456)
[INFO] [2023-10-25 06:47:13] Handling diff: /app/public/data/amphibia_web_txt/diff/amphibia_web_txt_vernaculars_30956.diff (2322 lines)
[INFO] [2023-10-25 06:47:13] Loading vernaculars diff file into memory (2322 lines)...
[INFO] [2023-10-25 06:47:13] Storing 2320 Vernaculars (2320/2320/2322)
[INFO] [2023-10-25 06:47:14] Handling diff: /app/public/data/amphibia_web_txt/diff/amphibia_web_txt_occurrences_30961.diff (2515 lines)
[INFO] [2023-10-25 06:47:14] Loading occurrences diff file into memory (2515 lines)...
[INFO] [2023-10-25 06:47:14] Storing 2513 Occurrences (2513/2513/2515)
[INFO] [2023-10-25 06:47:14] Handling diff: /app/public/data/amphibia_web_txt/diff/amphibia_web_txt_measurements_30962.diff (3691 lines)
[INFO] [2023-10-25 06:47:14] Loading measurements diff file into memory (3691 lines)...
[INFO] [2023-10-25 06:47:17] Storing 15036 TraitsReferences (21238/3689/3691)
[INFO] [2023-10-25 06:47:18] Storing 3689 Traits (21238/3689/3691)
[INFO] [2023-10-25 06:47:19] Storing 2513 MetaTraits (21238/3689/3691)
[STOP] [2023-10-25 06:47:19] parse_diff_and_store
[START] [2023-10-25 06:47:19] resolve_keys
[2023-10-25 06:47:24] Resolving downloaded urls (this is not actually downloading them yet)
[INFO] [2023-10-25 06:47:49] Occurrences to nodes (through scientific_names)...
[INFO] [2023-10-25 06:47:50] traits to occurrences...
[INFO] [2023-10-25 06:47:50] traits to nodes (through occurrences)...
[INFO] [2023-10-25 06:47:50] Traits to sex term...
[INFO] [2023-10-25 06:47:50] Traits to lifestage term...
[INFO] [2023-10-25 06:47:50] MetaTraits to traits...
[INFO] [2023-10-25 06:47:50] MetaTraits (simple, measurement row refers to parent) to traits...
[INFO] [2023-10-25 06:47:51] Assocs to occurrences...
[INFO] [2023-10-25 06:47:51] Assocs to nodes...
[INFO] [2023-10-25 06:47:51] Assoc to sex term...
[INFO] [2023-10-25 06:47:51] Assoc to lifestage term...
[INFO] [2023-10-25 06:47:51] MetaAssoc to assocs...
[STOP] [2023-10-25 06:47:52] resolve_keys
[START] [2023-10-25 06:47:52] hold_for_later_1
[STOP] [2023-10-25 06:47:52] hold_for_later_1
[START] [2023-10-25 06:47:52] hold_for_later_2
[STOP] [2023-10-25 06:47:52] hold_for_later_2
[START] [2023-10-25 06:47:52] resolve_missing_parents
[STOP] [2023-10-25 06:47:52] resolve_missing_parents
[START] [2023-10-25 06:47:52] rebuild_nodes
[START] [2023-10-25 06:47:52] Flattener#flatten
[START] [2023-10-25 06:47:52] Flattener#study_resource
[START] [2023-10-25 06:47:52] Flattener#build_ancestry
[STOP] [2023-10-25 06:47:52] Flattener#build_ancestry
[INFO] [2023-10-25 06:47:52] 2424 ancestry keys
[START] [2023-10-25 06:47:52] build_node_ancestors
[INFO] [2023-10-25 06:47:52] old ancestors deleted.
[STOP] [2023-10-25 06:47:52] build_node_ancestors
[START] [2023-10-25 06:47:53] Flattener#propagate_ancestor_ids
[STOP] [2023-10-25 06:47:53] Flattener#propagate_ancestor_ids
[STOP] [2023-10-25 06:47:53] Flattener#flatten
[STOP] [2023-10-25 06:47:53] rebuild_nodes
[START] [2023-10-25 06:47:53] resolve_missing_media_owners
[STOP] [2023-10-25 06:47:53] resolve_missing_media_owners
[START] [2023-10-25 06:47:53] sanitize_media_verbatims
[STOP] [2023-10-25 06:47:53] sanitize_media_verbatims
[START] [2023-10-25 06:47:53] queue_downloads
[STOP] [2023-10-25 06:47:54] queue_downloads
[START] [2023-10-25 06:47:54] parse_names
[WARN] [2023-10-25 06:47:54] I see 2424 names which still need to be parsed.
[WARN] [2023-10-25 06:47:54] Names to parse: 2424 formatted: 2424 learned: 2424 parsed: 2424
[STOP] [2023-10-25 06:47:57] parse_names
[START] [2023-10-25 06:47:57] denormalize_canonical_names_to_nodes
[STOP] [2023-10-25 06:47:57] denormalize_canonical_names_to_nodes
[START] [2023-10-25 06:47:57] match_nodes
[START] [2023-10-25 06:47:57] map_all_nodes_to_pages
[STOP] [2023-10-25 06:49:34] map_all_nodes_to_pages
[INFO] [2023-10-25 06:49:34] 20 Unmatched nodes (of 2424)! That's too many to output. Full list in /app/public/data/amphibia_web_txt/unmatched_nodes.txt ; First 10: Canonical: Hyla japonica; Node#137240346; ResourceID: 832; Canonical: Leptopelis broadleyi; Node#137238786; ResourceID: 3641; Canonical: Pelobatrachus ligayae; Node#137239841; ResourceID: 6177; Canonical: Panophrys tuberogranulatus; Node#137240207; ResourceID: 7511; Canonical: Leptobrachella neangi; Node#137240440; ResourceID: 9251; Canonical: Craugastoridae; Node#137238547; ResourceID: Animalia/Chordata/Amphibia/Anura/Craugastoridae; Canonical: Neobatrachus sudellae; Node#137238698; ResourceID: 3532; Canonical: Uperoleia rugosa; Node#137238773; ResourceID: 3622; Canonical: Hyperolius ferreirai; Node#137239514; ResourceID: 526; Canonical: Hyperolius platyceps; Node#137239675; ResourceID: 566
[START] [2023-10-25 06:49:34] update_nodes
[STOP] [2023-10-25 06:49:35] update_nodes
[STOP] [2023-10-25 06:49:35] match_nodes
[START] [2023-10-25 06:49:35] reindex_search
[STOP] [2023-10-25 06:49:38] reindex_search
[START] [2023-10-25 06:49:38] normalize_units
[STOP] [2023-10-25 06:49:38] normalize_units
[START] [2023-10-25 06:49:38] calculate_statistics
[INFO] [2023-10-25 06:49:55] Duplicate page_id count: 0
[STOP] [2023-10-25 06:49:55] calculate_statistics
[START] [2023-10-25 06:49:55] complete_harvest_instance
[START] [2023-10-25 06:49:55] overall_tsv_creation
[INFO] [2023-10-25 06:49:55] Exporting 2424 nodes as TSV in batches of 10000...
[INFO] [2023-10-25 06:49:55] Processing group of 2424 in 1 batches of 10000
[INFO] [2023-10-25 06:50:15] 2513 Traits (unfiltered) and 0 associations...
[INFO] [2023-10-25 06:50:15] Building Traits map for 2424 nodes (this can take a while)...
[INFO] [2023-10-25 06:50:17] Mapped 2513 traits (2513 meta) for 2424 nodes.
[INFO] [2023-10-25 06:50:17] Building Associations map (this can take a while)...
[INFO] [2023-10-25 06:50:17] Done. 0 assocs mapped (0 meta).
[INFO] [2023-10-25 06:50:17] Adding 2513 traits...
[INFO] [2023-10-25 06:50:17] Trait #291944096 in key 291944096 has 29 metadata... that seems high?
[INFO] [2023-10-25 06:50:17] Trait #291944139 in key 291944139 has 21 metadata... that seems high?
[INFO] [2023-10-25 06:50:17] Trait #291944148 in key 291944148 has 48 metadata... that seems high?
[INFO] [2023-10-25 06:50:17] Trait #291944171 in key 291944171 has 45 metadata... that seems high?
[INFO] [2023-10-25 06:50:17] Trait #291944282 in key 291944282 has 24 metadata... that seems high?
[INFO] [2023-10-25 06:50:17] Trait #291944359 in key 291944359 has 37 metadata... that seems high?
[INFO] [2023-10-25 06:50:17] Trait #291944440 in key 291944440 has 21 metadata... that seems high?
[INFO] [2023-10-25 06:50:17] Trait #291944494 in key 291944494 has 24 metadata... that seems high?
[INFO] [2023-10-25 06:50:17] Trait #291944511 in key 291944511 has 34 metadata... that seems high?
[INFO] [2023-10-25 06:50:17] Trait #291944514 in key 291944514 has 27 metadata... that seems high?
[INFO] [2023-10-25 06:50:17] Trait #291944556 in key 291944556 has 21 metadata... that seems high?
[INFO] [2023-10-25 06:50:17] Trait #291944615 in key 291944615 has 36 metadata... that seems high?
[INFO] [2023-10-25 06:50:17] Trait #291944631 in key 291944631 has 26 metadata... that seems high?
[INFO] [2023-10-25 06:50:17] Trait #291944677 in key 291944677 has 21 metadata... that seems high?
[INFO] [2023-10-25 06:50:17] Trait #291944684 in key 291944684 has 29 metadata... that seems high?
[INFO] [2023-10-25 06:50:17] Trait #291944703 in key 291944703 has 21 metadata... that seems high?
[INFO] [2023-10-25 06:50:17] Trait #291944828 in key 291944828 has 29 metadata... that seems high?
[INFO] [2023-10-25 06:50:17] Trait #291944885 in key 291944885 has 23 metadata... that seems high?
[INFO] [2023-10-25 06:50:17] Trait #291944939 in key 291944939 has 21 metadata... that seems high?
[INFO] [2023-10-25 06:50:17] Trait #291944965 in key 291944965 has 21 metadata... that seems high?
[INFO] [2023-10-25 06:50:17] Trait #291945039 in key 291945039 has 23 metadata... that seems high?
[INFO] [2023-10-25 06:50:17] Trait #291945045 in key 291945045 has 21 metadata... that seems high?
[INFO] [2023-10-25 06:50:17] Trait #291945047 in key 291945047 has 31 metadata... that seems high?
[INFO] [2023-10-25 06:50:17] Trait #291945084 in key 291945084 has 31 metadata... that seems high?
[INFO] [2023-10-25 06:50:17] Trait #291945088 in key 291945088 has 22 metadata... that seems high?
[INFO] [2023-10-25 06:50:18] Trait #291945118 in key 291945118 has 29 metadata... that seems high?
[INFO] [2023-10-25 06:50:18] Trait #291945125 in key 291945125 has 48 metadata... that seems high?
[INFO] [2023-10-25 06:50:18] Trait #291945182 in key 291945182 has 22 metadata... that seems high?
[INFO] [2023-10-25 06:50:18] Trait #291945200 in key 291945200 has 24 metadata... that seems high?
[INFO] [2023-10-25 06:50:18] Trait #291945204 in key 291945204 has 28 metadata... that seems high?
[INFO] [2023-10-25 06:50:18] Trait #291945208 in key 291945208 has 29 metadata... that seems high?
[INFO] [2023-10-25 06:50:18] Trait #291945265 in key 291945265 has 38 metadata... that seems high?
[INFO] [2023-10-25 06:50:18] Trait #291945288 in key 291945288 has 23 metadata... that seems high?
[INFO] [2023-10-25 06:50:18] Trait #291945292 in key 291945292 has 29 metadata... that seems high?
[INFO] [2023-10-25 06:50:18] Trait #291945343 in key 291945343 has 23 metadata... that seems high?
[INFO] [2023-10-25 06:50:18] Trait #291945396 in key 291945396 has 21 metadata... that seems high?
[INFO] [2023-10-25 06:50:18] Trait #291945436 in key 291945436 has 22 metadata... that seems high?
[INFO] [2023-10-25 06:50:18] Trait #291945502 in key 291945502 has 21 metadata... that seems high?
[INFO] [2023-10-25 06:50:18] Trait #291945542 in key 291945542 has 22 metadata... that seems high?
[INFO] [2023-10-25 06:50:18] Trait #291945546 in key 291945546 has 22 metadata... that seems high?
[INFO] [2023-10-25 06:50:18] Trait #291945591 in key 291945591 has 24 metadata... that seems high?
[INFO] [2023-10-25 06:50:18] Trait #291945628 in key 291945628 has 26 metadata... that seems high?
[INFO] [2023-10-25 06:50:18] Trait #291945629 in key 291945629 has 29 metadata... that seems high?
[INFO] [2023-10-25 06:50:18] Trait #291945640 in key 291945640 has 28 metadata... that seems high?
[INFO] [2023-10-25 06:50:18] Trait #291945641 in key 291945641 has 21 metadata... that seems high?
[INFO] [2023-10-25 06:50:18] Trait #291945667 in key 291945667 has 29 metadata... that seems high?
[INFO] [2023-10-25 06:50:18] Trait #291945712 in key 291945712 has 24 metadata... that seems high?
[INFO] [2023-10-25 06:50:18] Trait #291945721 in key 291945721 has 22 metadata... that seems high?
[INFO] [2023-10-25 06:50:18] Trait #291945753 in key 291945753 has 34 metadata... that seems high?
[INFO] [2023-10-25 06:50:18] Trait #291945775 in key 291945775 has 26 metadata... that seems high?
[INFO] [2023-10-25 06:50:18] Trait #291945806 in key 291945806 has 27 metadata... that seems high?
[INFO] [2023-10-25 06:50:18] Trait #291945818 in key 291945818 has 24 metadata... that seems high?
[INFO] [2023-10-25 06:50:18] Trait #291945972 in key 291945972 has 22 metadata... that seems high?
[INFO] [2023-10-25 06:50:18] Trait #291945979 in key 291945979 has 26 metadata... that seems high?
[INFO] [2023-10-25 06:50:18] Trait #291945994 in key 291945994 has 36 metadata... that seems high?
[INFO] [2023-10-25 06:50:18] Trait #291946035 in key 291946035 has 21 metadata... that seems high?
[INFO] [2023-10-25 06:50:18] Trait #291946070 in key 291946070 has 24 metadata... that seems high?
[INFO] [2023-10-25 06:50:18] Trait #291946167 in key 291946167 has 29 metadata... that seems high?
[INFO] [2023-10-25 06:50:18] Trait #291946209 in key 291946209 has 40 metadata... that seems high?
[INFO] [2023-10-25 06:50:18] Trait #291946285 in key 291946285 has 23 metadata... that seems high?
[INFO] [2023-10-25 06:50:18] Trait #291946291 in key 291946291 has 45 metadata... that seems high?
[INFO] [2023-10-25 06:50:18] Trait #291946292 in key 291946292 has 24 metadata... that seems high?
[INFO] [2023-10-25 06:50:18] Trait #291946304 in key 291946304 has 27 metadata... that seems high?
[INFO] [2023-10-25 06:50:18] Trait #291946315 in key 291946315 has 23 metadata... that seems high?
[INFO] [2023-10-25 06:50:18] Trait #291946371 in key 291946371 has 75 metadata... that seems high?
[INFO] [2023-10-25 06:50:18] Trait #291946390 in key 291946390 has 27 metadata... that seems high?
[INFO] [2023-10-25 06:50:18] Trait #291946401 in key 291946401 has 23 metadata... that seems high?
[INFO] [2023-10-25 06:50:18] Trait #291946408 in key 291946408 has 23 metadata... that seems high?
[INFO] [2023-10-25 06:50:18] Trait #291946484 in key 291946484 has 23 metadata... that seems high?
[INFO] [2023-10-25 06:50:18] Trait #291946504 in key 291946504 has 31 metadata... that seems high?
[INFO] [2023-10-25 06:50:18] Trait #291946559 in key 291946559 has 34 metadata... that seems high?
[INFO] [2023-10-25 06:50:18] Trait #291946574 in key 291946574 has 22 metadata... that seems high?
[INFO] [2023-10-25 06:50:18] Trait #291946590 in key 291946590 has 26 metadata... that seems high?
[INFO] [2023-10-25 06:50:18] Trait #291946608 in key 291946608 has 31 metadata... that seems high?
[INFO] [2023-10-25 06:50:18] Trait #291946673 in key 291946673 has 22 metadata... that seems high?
[INFO] [2023-10-25 06:50:18] Trait #291946674 in key 291946674 has 75 metadata... that seems high?
[INFO] [2023-10-25 06:50:18] Trait #291946711 in key 291946711 has 21 metadata... that seems high?
[INFO] [2023-10-25 06:50:18] Trait #291946717 in key 291946717 has 29 metadata... that seems high?
[INFO] [2023-10-25 06:50:18] Trait #291946762 in key 291946762 has 36 metadata... that seems high?
[INFO] [2023-10-25 06:50:18] Trait #291946766 in key 291946766 has 36 metadata... that seems high?
[INFO] [2023-10-25 06:50:18] Trait #291946791 in key 291946791 has 23 metadata... that seems high?
[INFO] [2023-10-25 06:50:18] Trait #291946907 in key 291946907 has 23 metadata... that seems high?
[INFO] [2023-10-25 06:50:18] Trait #291946946 in key 291946946 has 34 metadata... that seems high?
[INFO] [2023-10-25 06:50:18] Trait #291946954 in key 291946954 has 22 metadata... that seems high?
[INFO] [2023-10-25 06:50:18] Trait #291946956 in key 291946956 has 24 metadata... that seems high?
[INFO] [2023-10-25 06:50:18] Trait #291946957 in key 291946957 has 22 metadata... that seems high?
[INFO] [2023-10-25 06:50:18] Trait #291946970 in key 291946970 has 48 metadata... that seems high?
[INFO] [2023-10-25 06:50:18] Trait #291946977 in key 291946977 has 22 metadata... that seems high?
[INFO] [2023-10-25 06:50:18] Trait #291946979 in key 291946979 has 24 metadata... that seems high?
[INFO] [2023-10-25 06:50:18] Trait #291946980 in key 291946980 has 26 metadata... that seems high?
[INFO] [2023-10-25 06:50:18] Trait #291947049 in key 291947049 has 21 metadata... that seems high?
[INFO] [2023-10-25 06:50:18] Trait #291947152 in key 291947152 has 26 metadata... that seems high?
[INFO] [2023-10-25 06:50:18] Trait #291947176 in key 291947176 has 29 metadata... that seems high?
[INFO] [2023-10-25 06:50:18] Trait #291947180 in key 291947180 has 26 metadata... that seems high?
[INFO] [2023-10-25 06:50:18] Trait #291947264 in key 291947264 has 26 metadata... that seems high?
[INFO] [2023-10-25 06:50:18] Trait #291947281 in key 291947281 has 24 metadata... that seems high?
[INFO] [2023-10-25 06:50:18] Trait #291947291 in key 291947291 has 24 metadata... that seems high?
[INFO] [2023-10-25 06:50:18] Trait #291947297 in key 291947297 has 24 metadata... that seems high?
[INFO] [2023-10-25 06:50:18] Trait #291947309 in key 291947309 has 27 metadata... that seems high?
[INFO] [2023-10-25 06:50:18] Trait #291947352 in key 291947352 has 31 metadata... that seems high?
[INFO] [2023-10-25 06:50:18] Trait #291947374 in key 291947374 has 34 metadata... that seems high?
[INFO] [2023-10-25 06:50:18] Trait #291947409 in key 291947409 has 36 metadata... that seems high?
[INFO] [2023-10-25 06:50:18] Trait #291947444 in key 291947444 has 35 metadata... that seems high?
[INFO] [2023-10-25 06:50:18] Trait #291947517 in key 291947517 has 29 metadata... that seems high?
[INFO] [2023-10-25 06:50:18] Trait #291947578 in key 291947578 has 23 metadata... that seems high?
[INFO] [2023-10-25 06:50:18] Trait #291947594 in key 291947594 has 21 metadata... that seems high?
[INFO] [2023-10-25 06:50:18] Trait #291947609 in key 291947609 has 36 metadata... that seems high?
[INFO] [2023-10-25 06:50:18] Trait #291947626 in key 291947626 has 29 metadata... that seems high?
[INFO] [2023-10-25 06:50:18] 16212 metadata added.
[INFO] [2023-10-25 06:50:18] Adding 0 assocs...
[INFO] [2023-10-25 06:50:18] 0 metadata added.
[INFO] [2023-10-25 06:51:01] Processed 2424/2424 nodes
[INFO] [2023-10-25 06:51:01] Average Time: 53.83
[INFO] [2023-10-25 06:51:01] Total Time: 1m6s
[STOP] [2023-10-25 06:51:01] overall_tsv_creation
[INFO] [2023-10-25 06:51:01] Done. Check your files:
[INFO] [2023-10-25 06:51:01] (2424 lines) /app/public/data/amphibia_web_txt/publish_nodes.tsv
[INFO] [2023-10-25 06:51:01] (12030 lines) /app/public/data/amphibia_web_txt/publish_node_ancestors.tsv
[INFO] [2023-10-25 06:51:01] (2424 lines) /app/public/data/amphibia_web_txt/publish_scientific_names.tsv
[INFO] [2023-10-25 06:51:01] (8454 lines) /app/public/data/amphibia_web_txt/publish_articles.tsv
[INFO] [2023-10-25 06:51:01] (2320 lines) /app/public/data/amphibia_web_txt/publish_vernaculars.tsv
[INFO] [2023-10-25 06:51:01] (5799 lines) /app/public/data/amphibia_web_txt/publish_references.tsv
[INFO] [2023-10-25 06:51:01] (12174 lines) /app/public/data/amphibia_web_txt/publish_attributions.tsv
[INFO] [2023-10-25 06:51:01] (8454 lines) /app/public/data/amphibia_web_txt/publish_content_sections.tsv
[INFO] [2023-10-25 06:51:02] (5799 lines) /app/public/data/amphibia_web_txt/publish_referents.tsv
[INFO] [2023-10-25 06:51:02] (2514 lines) /app/public/data/amphibia_web_txt/publish_traits.tsv
[INFO] [2023-10-25 06:51:02] (16213 lines) /app/public/data/amphibia_web_txt/publish_metadata.tsv
[STOP] [2023-10-25 06:51:02] complete_harvest_instance
[START] [2023-10-25 06:51:02] completed
[STOP] [2023-10-25 06:51:02] completed
[STOP] [2023-10-25 06:51:02] logged process, took 261.31

Latest Process

25 Oct 06:46 EXITED currently processing 0