Harvest for AmphibiaWeb articles Created 09 Jun 10:57

Stage: completed
Fetched: 09 Jun 10:57
Validated: 09 Jun 10:57
Deltas Created 09 Jun 10:57
Units Normalized: 09 Jun 11:00
Ancestry Built: 09 Jun 10:58
Nodes Matched: 09 Jun 11:00
Names Parsed: 09 Jun 10:58
New Models Stored: 09 Jun 10:57
Indexed: 09 Jun 11:00
Completed: 09 Jun 11:03
Time to Harvest: less than a minute

Harvesting Log

(253 lines)
[INFO] [2021-06-09 10:57:01] Created harvest instance #4005
[STOP] [2021-06-09 10:57:01] create_harvest_instance
[START] [2021-06-09 10:57:01] fetch_files
[STOP] [2021-06-09 10:57:01] fetch_files
[START] [2021-06-09 10:57:01] validate_each_file
[INFO] [2021-06-09 10:57:01] Looping over 7 formats...
[INFO] [2021-06-09 10:57:01] ...agents (/app/public/data/amphibia_web_txt/agent.tab)
[INFO] [2021-06-09 10:57:01] Valid: /app/public/converted_csv/amphibia_web_txt_agents_4005.csv (777 lines)
[INFO] [2021-06-09 10:57:01] ...refs (/app/public/data/amphibia_web_txt/reference.tab)
[INFO] [2021-06-09 10:57:01] Valid: /app/public/converted_csv/amphibia_web_txt_refs_4005.csv (5799 lines)
[INFO] [2021-06-09 10:57:01] ...nodes (/app/public/data/amphibia_web_txt/taxon.tab)
[INFO] [2021-06-09 10:57:01] Valid: /app/public/converted_csv/amphibia_web_txt_nodes_4005.csv (2346 lines)
[INFO] [2021-06-09 10:57:01] ...media (/app/public/data/amphibia_web_txt/media_resource.tab)
[INFO] [2021-06-09 10:57:02] Valid: /app/public/converted_csv/amphibia_web_txt_media_4005.csv (8454 lines)
[INFO] [2021-06-09 10:57:02] ...vernaculars (/app/public/data/amphibia_web_txt/vernacular_name.tab)
[INFO] [2021-06-09 10:57:02] Valid: /app/public/converted_csv/amphibia_web_txt_vernaculars_4005.csv (2321 lines)
[INFO] [2021-06-09 10:57:02] ...occurrences (/app/public/data/amphibia_web_txt/occurrence_specific.tab)
[INFO] [2021-06-09 10:57:02] Valid: /app/public/converted_csv/amphibia_web_txt_occurrences_4005.csv (2094 lines)
[INFO] [2021-06-09 10:57:02] ...measurements (/app/public/data/amphibia_web_txt/measurement_or_fact_specific.tab)
[INFO] [2021-06-09 10:57:02] Valid: /app/public/converted_csv/amphibia_web_txt_measurements_4005.csv (3021 lines)
[STOP] [2021-06-09 10:57:02] validate_each_file
[START] [2021-06-09 10:57:02] convert_to_csv
[INFO] [2021-06-09 10:57:02] Looping over 7 formats...
[INFO] [2021-06-09 10:57:02] ...agents (/app/public/data/amphibia_web_txt/agent.tab)
[CMD] [2021-06-09 10:57:02] /usr/bin/sort /app/public/converted_csv/amphibia_web_txt_agents_4005.csv > /app/public/converted_csv/amphibia_web_txt_agents_4005.csv_sorted
[INFO] [2021-06-09 10:57:02] Converted: /app/public/converted_csv/amphibia_web_txt_agents_4005.csv (777 lines)
[INFO] [2021-06-09 10:57:02] ...refs (/app/public/data/amphibia_web_txt/reference.tab)
[CMD] [2021-06-09 10:57:02] /usr/bin/sort /app/public/converted_csv/amphibia_web_txt_refs_4005.csv > /app/public/converted_csv/amphibia_web_txt_refs_4005.csv_sorted
[INFO] [2021-06-09 10:57:03] Converted: /app/public/converted_csv/amphibia_web_txt_refs_4005.csv (5799 lines)
[INFO] [2021-06-09 10:57:03] ...nodes (/app/public/data/amphibia_web_txt/taxon.tab)
[CMD] [2021-06-09 10:57:03] /usr/bin/sort /app/public/converted_csv/amphibia_web_txt_nodes_4005.csv > /app/public/converted_csv/amphibia_web_txt_nodes_4005.csv_sorted
[INFO] [2021-06-09 10:57:03] Converted: /app/public/converted_csv/amphibia_web_txt_nodes_4005.csv (2346 lines)
[INFO] [2021-06-09 10:57:03] ...media (/app/public/data/amphibia_web_txt/media_resource.tab)
[CMD] [2021-06-09 10:57:03] /usr/bin/sort /app/public/converted_csv/amphibia_web_txt_media_4005.csv > /app/public/converted_csv/amphibia_web_txt_media_4005.csv_sorted
[INFO] [2021-06-09 10:57:03] Converted: /app/public/converted_csv/amphibia_web_txt_media_4005.csv (8454 lines)
[INFO] [2021-06-09 10:57:03] ...vernaculars (/app/public/data/amphibia_web_txt/vernacular_name.tab)
[CMD] [2021-06-09 10:57:03] /usr/bin/sort /app/public/converted_csv/amphibia_web_txt_vernaculars_4005.csv > /app/public/converted_csv/amphibia_web_txt_vernaculars_4005.csv_sorted
[INFO] [2021-06-09 10:57:03] Converted: /app/public/converted_csv/amphibia_web_txt_vernaculars_4005.csv (2321 lines)
[INFO] [2021-06-09 10:57:03] ...occurrences (/app/public/data/amphibia_web_txt/occurrence_specific.tab)
[CMD] [2021-06-09 10:57:03] /usr/bin/sort /app/public/converted_csv/amphibia_web_txt_occurrences_4005.csv > /app/public/converted_csv/amphibia_web_txt_occurrences_4005.csv_sorted
[INFO] [2021-06-09 10:57:03] Converted: /app/public/converted_csv/amphibia_web_txt_occurrences_4005.csv (2094 lines)
[INFO] [2021-06-09 10:57:03] ...measurements (/app/public/data/amphibia_web_txt/measurement_or_fact_specific.tab)
[CMD] [2021-06-09 10:57:03] /usr/bin/sort /app/public/converted_csv/amphibia_web_txt_measurements_4005.csv > /app/public/converted_csv/amphibia_web_txt_measurements_4005.csv_sorted
[INFO] [2021-06-09 10:57:03] Converted: /app/public/converted_csv/amphibia_web_txt_measurements_4005.csv (3021 lines)
[STOP] [2021-06-09 10:57:03] convert_to_csv
[START] [2021-06-09 10:57:03] calculate_delta
[INFO] [2021-06-09 10:57:03] Looping over 7 formats...
[INFO] [2021-06-09 10:57:03] ...agents (/app/public/data/amphibia_web_txt/agent.tab)
[CMD] [2021-06-09 10:57:03] echo "0a" > /app/public/diff/amphibia_web_txt_agents_4005.diff
[CMD] [2021-06-09 10:57:03] tail -n +1 /app/public/converted_csv/amphibia_web_txt_agents_4005.csv >> /app/public/diff/amphibia_web_txt_agents_4005.diff
[CMD] [2021-06-09 10:57:03] echo "." >> /app/public/diff/amphibia_web_txt_agents_4005.diff
[INFO] [2021-06-09 10:57:03] Created diff: /app/public/diff/amphibia_web_txt_agents_4005.diff (779 lines)
[INFO] [2021-06-09 10:57:03] ...refs (/app/public/data/amphibia_web_txt/reference.tab)
[CMD] [2021-06-09 10:57:03] echo "0a" > /app/public/diff/amphibia_web_txt_refs_4005.diff
[CMD] [2021-06-09 10:57:04] tail -n +1 /app/public/converted_csv/amphibia_web_txt_refs_4005.csv >> /app/public/diff/amphibia_web_txt_refs_4005.diff
[CMD] [2021-06-09 10:57:04] echo "." >> /app/public/diff/amphibia_web_txt_refs_4005.diff
[INFO] [2021-06-09 10:57:04] Created diff: /app/public/diff/amphibia_web_txt_refs_4005.diff (5801 lines)
[INFO] [2021-06-09 10:57:04] ...nodes (/app/public/data/amphibia_web_txt/taxon.tab)
[CMD] [2021-06-09 10:57:04] echo "0a" > /app/public/diff/amphibia_web_txt_nodes_4005.diff
[CMD] [2021-06-09 10:57:04] tail -n +1 /app/public/converted_csv/amphibia_web_txt_nodes_4005.csv >> /app/public/diff/amphibia_web_txt_nodes_4005.diff
[CMD] [2021-06-09 10:57:04] echo "." >> /app/public/diff/amphibia_web_txt_nodes_4005.diff
[INFO] [2021-06-09 10:57:04] Created diff: /app/public/diff/amphibia_web_txt_nodes_4005.diff (2348 lines)
[INFO] [2021-06-09 10:57:04] ...media (/app/public/data/amphibia_web_txt/media_resource.tab)
[CMD] [2021-06-09 10:57:04] echo "0a" > /app/public/diff/amphibia_web_txt_media_4005.diff
[CMD] [2021-06-09 10:57:04] tail -n +1 /app/public/converted_csv/amphibia_web_txt_media_4005.csv >> /app/public/diff/amphibia_web_txt_media_4005.diff
[CMD] [2021-06-09 10:57:04] echo "." >> /app/public/diff/amphibia_web_txt_media_4005.diff
[INFO] [2021-06-09 10:57:05] Created diff: /app/public/diff/amphibia_web_txt_media_4005.diff (8456 lines)
[INFO] [2021-06-09 10:57:05] ...vernaculars (/app/public/data/amphibia_web_txt/vernacular_name.tab)
[CMD] [2021-06-09 10:57:05] echo "0a" > /app/public/diff/amphibia_web_txt_vernaculars_4005.diff
[CMD] [2021-06-09 10:57:05] tail -n +1 /app/public/converted_csv/amphibia_web_txt_vernaculars_4005.csv >> /app/public/diff/amphibia_web_txt_vernaculars_4005.diff
[CMD] [2021-06-09 10:57:05] echo "." >> /app/public/diff/amphibia_web_txt_vernaculars_4005.diff
[INFO] [2021-06-09 10:57:05] Created diff: /app/public/diff/amphibia_web_txt_vernaculars_4005.diff (2323 lines)
[INFO] [2021-06-09 10:57:05] ...occurrences (/app/public/data/amphibia_web_txt/occurrence_specific.tab)
[CMD] [2021-06-09 10:57:05] echo "0a" > /app/public/diff/amphibia_web_txt_occurrences_4005.diff
[CMD] [2021-06-09 10:57:05] tail -n +1 /app/public/converted_csv/amphibia_web_txt_occurrences_4005.csv >> /app/public/diff/amphibia_web_txt_occurrences_4005.diff
[CMD] [2021-06-09 10:57:05] echo "." >> /app/public/diff/amphibia_web_txt_occurrences_4005.diff
[INFO] [2021-06-09 10:57:05] Created diff: /app/public/diff/amphibia_web_txt_occurrences_4005.diff (2096 lines)
[INFO] [2021-06-09 10:57:05] ...measurements (/app/public/data/amphibia_web_txt/measurement_or_fact_specific.tab)
[CMD] [2021-06-09 10:57:05] echo "0a" > /app/public/diff/amphibia_web_txt_measurements_4005.diff
[CMD] [2021-06-09 10:57:05] tail -n +1 /app/public/converted_csv/amphibia_web_txt_measurements_4005.csv >> /app/public/diff/amphibia_web_txt_measurements_4005.diff
[CMD] [2021-06-09 10:57:05] echo "." >> /app/public/diff/amphibia_web_txt_measurements_4005.diff
[INFO] [2021-06-09 10:57:05] Created diff: /app/public/diff/amphibia_web_txt_measurements_4005.diff (3023 lines)
[STOP] [2021-06-09 10:57:05] calculate_delta
[START] [2021-06-09 10:57:05] parse_diff_and_store
[INFO] [2021-06-09 10:57:05] Handling diff: /app/public/diff/amphibia_web_txt_agents_4005.diff (779 lines)
[INFO] [2021-06-09 10:57:06] Loading agents diff file into memory (779 /app/public/diff/amphibia_web_txt_agents_4005.diff lines)...
[INFO] [2021-06-09 10:57:06] Handling diff: /app/public/diff/amphibia_web_txt_refs_4005.diff (5801 lines)
[INFO] [2021-06-09 10:57:06] Loading refs diff file into memory (5801 /app/public/diff/amphibia_web_txt_refs_4005.diff lines)...
[INFO] [2021-06-09 10:57:08] Handling diff: /app/public/diff/amphibia_web_txt_nodes_4005.diff (2348 lines)
[INFO] [2021-06-09 10:57:08] Loading nodes diff file into memory (2348 /app/public/diff/amphibia_web_txt_nodes_4005.diff lines)...
[INFO] [2021-06-09 10:57:09] Handling diff: /app/public/diff/amphibia_web_txt_media_4005.diff (8456 lines)
[INFO] [2021-06-09 10:57:09] Loading media diff file into memory (8456 /app/public/diff/amphibia_web_txt_media_4005.diff lines)...
[WARN] [2021-06-09 10:57:09] Could not find a media subtype (format) of "text/plain"
[INFO] [2021-06-09 10:57:23] Handling diff: /app/public/diff/amphibia_web_txt_vernaculars_4005.diff (2323 lines)
[INFO] [2021-06-09 10:57:23] Loading vernaculars diff file into memory (2323 /app/public/diff/amphibia_web_txt_vernaculars_4005.diff lines)...
[INFO] [2021-06-09 10:57:24] Handling diff: /app/public/diff/amphibia_web_txt_occurrences_4005.diff (2096 lines)
[INFO] [2021-06-09 10:57:24] Loading occurrences diff file into memory (2096 /app/public/diff/amphibia_web_txt_occurrences_4005.diff lines)...
[INFO] [2021-06-09 10:57:24] Handling diff: /app/public/diff/amphibia_web_txt_measurements_4005.diff (3023 lines)
[INFO] [2021-06-09 10:57:24] Loading measurements diff file into memory (3023 /app/public/diff/amphibia_web_txt_measurements_4005.diff lines)...
[INFO] [2021-06-09 10:57:26] Storing 777 Attributions
[INFO] [2021-06-09 10:57:26] Processing group of 777 in 1 groups of 1000
[INFO] [2021-06-09 10:57:26] Average Time: 0.15
[INFO] [2021-06-09 10:57:26] Total Time: 1s
[INFO] [2021-06-09 10:57:26] Storing 5799 References
[INFO] [2021-06-09 10:57:26] Processing group of 5799 in 6 groups of 1000
[INFO] [2021-06-09 10:57:28] Average Time: 0.193
[INFO] [2021-06-09 10:57:28] Total Time: 2s
[INFO] [2021-06-09 10:57:28] Storing 2424 ScientificNames
[INFO] [2021-06-09 10:57:28] Processing group of 2424 in 3 groups of 1000
[INFO] [2021-06-09 10:57:29] Average Time: 0.357
[INFO] [2021-06-09 10:57:29] Total Time: 2s
[INFO] [2021-06-09 10:57:29] Storing 2424 Nodes
[INFO] [2021-06-09 10:57:29] Processing group of 2424 in 3 groups of 1000
[INFO] [2021-06-09 10:57:30] Average Time: 0.303
[INFO] [2021-06-09 10:57:30] Total Time: 1s
[INFO] [2021-06-09 10:57:30] Storing 12174 ContentAttributions
[INFO] [2021-06-09 10:57:30] Processing group of 12174 in 13 groups of 1000
[INFO] [2021-06-09 10:57:32] Average Time: 0.183
[INFO] [2021-06-09 10:57:32] Total Time: 3s
[INFO] [2021-06-09 10:57:32] last 3 / first 3: 0.49
[INFO] [2021-06-09 10:57:32] Std.Dev: 0.08366600265340755; Max: 0.41
[INFO] [2021-06-09 10:57:32] Storing 8454 ArticlesSections
[INFO] [2021-06-09 10:57:32] Processing group of 8454 in 9 groups of 1000
[INFO] [2021-06-09 10:57:33] Average Time: 0.104
[INFO] [2021-06-09 10:57:33] Total Time: 1s
[INFO] [2021-06-09 10:57:33] last 3 / first 3: 3.28
[INFO] [2021-06-09 10:57:33] Std.Dev: 0.15811388300841897; Max: 0.52
[INFO] [2021-06-09 10:57:33] Storing 8454 Articles
[INFO] [2021-06-09 10:57:33] Processing group of 8454 in 9 groups of 1000
[INFO] [2021-06-09 10:57:37] Average Time: 0.426
[INFO] [2021-06-09 10:57:37] Total Time: 4s
[INFO] [2021-06-09 10:57:37] last 3 / first 3: 0.84
[INFO] [2021-06-09 10:57:37] Std.Dev: 0.08944271909999159; Max: 0.5
[INFO] [2021-06-09 10:57:37] Storing 39756 ArticlesReferences
[INFO] [2021-06-09 10:57:37] Processing group of 39756 in 40 groups of 1000
[INFO] [2021-06-09 10:57:40] Average Time: 0.071
[INFO] [2021-06-09 10:57:40] Total Time: 4s
[INFO] [2021-06-09 10:57:40] last 3 / first 3: 0.56
[INFO] [2021-06-09 10:57:40] Std.Dev: 0.03162277660168379; Max: 0.21
[INFO] [2021-06-09 10:57:40] Storing 2321 Vernaculars
[INFO] [2021-06-09 10:57:40] Processing group of 2321 in 3 groups of 1000
[INFO] [2021-06-09 10:57:41] Average Time: 0.123
[INFO] [2021-06-09 10:57:41] Total Time: 1s
[INFO] [2021-06-09 10:57:41] Storing 2094 Occurrences
[INFO] [2021-06-09 10:57:41] Processing group of 2094 in 3 groups of 1000
[INFO] [2021-06-09 10:57:41] Average Time: 0.113
[INFO] [2021-06-09 10:57:41] Total Time: 1s
[INFO] [2021-06-09 10:57:41] Storing 11964 TraitsReferences
[INFO] [2021-06-09 10:57:41] Processing group of 11964 in 12 groups of 1000
[INFO] [2021-06-09 10:57:42] Average Time: 0.072
[INFO] [2021-06-09 10:57:42] Total Time: 1s
[INFO] [2021-06-09 10:57:42] last 3 / first 3: 0.77
[INFO] [2021-06-09 10:57:42] Std.Dev: 0.03162277660168379; Max: 0.14
[INFO] [2021-06-09 10:57:42] Storing 3021 Traits
[INFO] [2021-06-09 10:57:42] Processing group of 3021 in 4 groups of 1000
[INFO] [2021-06-09 10:57:43] Average Time: 0.348
[INFO] [2021-06-09 10:57:43] Total Time: 2s
[INFO] [2021-06-09 10:57:43] Storing 2094 MetaTraits
[INFO] [2021-06-09 10:57:43] Processing group of 2094 in 3 groups of 1000
[INFO] [2021-06-09 10:57:44] Average Time: 0.113
[INFO] [2021-06-09 10:57:44] Total Time: 1s
[STOP] [2021-06-09 10:57:44] parse_diff_and_store
[START] [2021-06-09 10:57:44] resolve_keys
[INFO] [2021-06-09 10:58:21] Occurrences to nodes (through scientific_names)...
[INFO] [2021-06-09 10:58:32] traits to occurrences...
[INFO] [2021-06-09 10:58:34] traits to nodes (through occurrences)...
[INFO] [2021-06-09 10:58:34] Traits to sex term...
[INFO] [2021-06-09 10:58:34] Traits to lifestage term...
[INFO] [2021-06-09 10:58:34] MetaTraits to traits...
[INFO] [2021-06-09 10:58:34] MetaTraits (simple, measurement row refers to parent) to traits...
[INFO] [2021-06-09 10:58:35] Assocs to occurrences...
[INFO] [2021-06-09 10:58:35] Assocs to nodes...
[INFO] [2021-06-09 10:58:35] Assoc to sex term...
[INFO] [2021-06-09 10:58:35] Assoc to lifestage term...
[INFO] [2021-06-09 10:58:35] MetaAssoc to assocs...
[STOP] [2021-06-09 10:58:35] resolve_keys
[START] [2021-06-09 10:58:35] hold_for_later_1
[STOP] [2021-06-09 10:58:35] hold_for_later_1
[START] [2021-06-09 10:58:35] hold_for_later_2
[STOP] [2021-06-09 10:58:35] hold_for_later_2
[START] [2021-06-09 10:58:36] resolve_missing_parents
[STOP] [2021-06-09 10:58:36] resolve_missing_parents
[START] [2021-06-09 10:58:36] rebuild_nodes
[START] [2021-06-09 10:58:36] Flattener#flatten
[START] [2021-06-09 10:58:36] Flattener#study_resource
[START] [2021-06-09 10:58:36] Flattener#build_ancestry
[STOP] [2021-06-09 10:58:36] Flattener#build_ancestry
[INFO] [2021-06-09 10:58:36] 2424 ancestry keys
[START] [2021-06-09 10:58:36] build_node_ancestors
[INFO] [2021-06-09 10:58:36] old ancestors deleted.
[STOP] [2021-06-09 10:58:36] build_node_ancestors
[START] [2021-06-09 10:58:37] Flattener#propagate_ancestor_ids
[STOP] [2021-06-09 10:58:37] Flattener#propagate_ancestor_ids
[STOP] [2021-06-09 10:58:37] Flattener#flatten
[STOP] [2021-06-09 10:58:37] rebuild_nodes
[START] [2021-06-09 10:58:37] resolve_missing_media_owners
[STOP] [2021-06-09 10:58:37] resolve_missing_media_owners
[START] [2021-06-09 10:58:37] sanitize_media_verbatims
[STOP] [2021-06-09 10:58:37] sanitize_media_verbatims
[START] [2021-06-09 10:58:37] queue_downloads
[STOP] [2021-06-09 10:58:37] queue_downloads
[START] [2021-06-09 10:58:37] parse_names
[WARN] [2021-06-09 10:58:37] I see 2424 names which still need to be parsed.
[STOP] [2021-06-09 10:58:40] parse_names
[START] [2021-06-09 10:58:40] denormalize_canonical_names_to_nodes
[STOP] [2021-06-09 10:58:40] denormalize_canonical_names_to_nodes
[START] [2021-06-09 10:58:40] match_nodes
[START] [2021-06-09 10:58:40] map_all_nodes_to_pages
[STOP] [2021-06-09 11:00:37] map_all_nodes_to_pages
[INFO] [2021-06-09 11:00:37] 21 Unmatched nodes (of 2424)! That's too many to output. Full list in /app/public/data/amphibia_web_txt/unmatched_nodes.txt ; First 10: Canonical: Rhinella pombali; Node#95867268; ResourceID: 6616; Canonical: Amazophrynella gardai; Node#95867725; ResourceID: 9260; Canonical: Litoria infrafrenata; Node#95865394; ResourceID: 1257; Canonical: Stumpffia be; Node#95867495; ResourceID: 7541; Canonical: Pelobatrachus ligayae; Node#95867125; ResourceID: 6177; Canonical: Panophrys tuberogranulatus; Node#95867491; ResourceID: 7511; Canonical: Leptobrachella neangi; Node#95867724; ResourceID: 9251; Canonical: Strabomantidae; Node#95865795; ResourceID: Strabomantidae; Canonical: Nyctixalus spinosum; Node#95866455; ResourceID: 4381; Canonical: Leptomantis malkmusi; Node#95867642; ResourceID: 8386
[START] [2021-06-09 11:00:37] update_nodes
[STOP] [2021-06-09 11:00:38] update_nodes
[STOP] [2021-06-09 11:00:38] match_nodes
[START] [2021-06-09 11:00:38] reindex_search
[STOP] [2021-06-09 11:00:40] reindex_search
[START] [2021-06-09 11:00:40] normalize_units
[STOP] [2021-06-09 11:00:40] normalize_units
[START] [2021-06-09 11:00:40] calculate_statistics
[2021-06-09 11:00:40] (NEAR) DUPLICATE TRAITS FOUND! There are only 2089 (of 2094 total) unique traits.
[2021-06-09 11:00:45] (Near) duplicate trait pairs (up to 100):
[2021-06-09 11:00:45] (resource_pk: 089c4ab534d678f336f5ee70bccc7e2a_21_ENV, id: 219322366), (resource_pk: 322817c5914e58f951c1e31626ae5ad1_21_ENV, id: 219322897)
[2021-06-09 11:00:45] (resource_pk: 229073a5fd2ce9b7c406b454a5c72ea9_21_ENV, id: 219322706), (resource_pk: d82b313d4bf4d51525d9967fecde196f_21_ENV, id: 219324832)
[2021-06-09 11:00:45] (resource_pk: 261aee7b03b013dc4820613d4a9a7530_21_ENV, id: 219322749), (resource_pk: 44c48d952e2e426ed7d6fba43cccd429_21_ENV, id: 219323121)
[2021-06-09 11:00:45] (resource_pk: 485b0a4ae2d8bb13eabe219b3281362d_21_ENV, id: 219323162), (resource_pk: ea3e584946dd27cc8e0022beba02a718_21_ENV, id: 219325041)
[2021-06-09 11:00:45] (resource_pk: 84033338e9959cbbcada1b9c0e8b888f_21_ENV, id: 219323833), (resource_pk: a21c824a027911757767a7bb6ba9f715_21_ENV, id: 219324182)
[STOP] [2021-06-09 11:00:45] calculate_statistics
[START] [2021-06-09 11:00:45] complete_harvest_instance
[START] [2021-06-09 11:00:45] overall_tsv_creation
[INFO] [2021-06-09 11:00:45] Processing group of 2424 in 1 batches of 10000
[INFO] [2021-06-09 11:01:42] 2094 Traits (unfiltered)...
[INFO] [2021-06-09 11:02:30] 2094 Traits (filtered)...
[INFO] [2021-06-09 11:02:30] 0 Associations (filtered)...
[INFO] [2021-06-09 11:02:31] 12891 metadata added.
[INFO] [2021-06-09 11:02:31] 0 metadata added.
[INFO] [2021-06-09 11:02:59] Average Time: 101.3
[INFO] [2021-06-09 11:02:59] Total Time: 2m15s
[STOP] [2021-06-09 11:02:59] overall_tsv_creation
[INFO] [2021-06-09 11:02:59] Done. Check your files:
[INFO] [2021-06-09 11:02:59] (2424 lines) /app/public/data/amphibia_web_txt/publish_nodes.tsv
[INFO] [2021-06-09 11:02:59] (12030 lines) /app/public/data/amphibia_web_txt/publish_node_ancestors.tsv
[INFO] [2021-06-09 11:02:59] (2424 lines) /app/public/data/amphibia_web_txt/publish_scientific_names.tsv
[INFO] [2021-06-09 11:02:59] (8485 lines) /app/public/data/amphibia_web_txt/publish_articles.tsv
[INFO] [2021-06-09 11:02:59] (2321 lines) /app/public/data/amphibia_web_txt/publish_vernaculars.tsv
[INFO] [2021-06-09 11:03:00] (5799 lines) /app/public/data/amphibia_web_txt/publish_references.tsv
[INFO] [2021-06-09 11:03:00] (12174 lines) /app/public/data/amphibia_web_txt/publish_attributions.tsv
[INFO] [2021-06-09 11:03:00] (8454 lines) /app/public/data/amphibia_web_txt/publish_content_sections.tsv
[INFO] [2021-06-09 11:03:00] (5799 lines) /app/public/data/amphibia_web_txt/publish_referents.tsv
[INFO] [2021-06-09 11:03:00] (2095 lines) /app/public/data/amphibia_web_txt/publish_traits.tsv
[INFO] [2021-06-09 11:03:00] (12892 lines) /app/public/data/amphibia_web_txt/publish_metadata.tsv
[STOP] [2021-06-09 11:03:00] complete_harvest_instance
[START] [2021-06-09 11:03:00] completed
[STOP] [2021-06-09 11:03:00] completed
[STOP] [2021-06-09 11:03:00] logged process, took 359.52

Latest Process