Harvest for 3I: Cicadellinae Created 11 Oct 18:03

Harvesting Log

[INFO] [2023-10-11 18:03:39] Created harvest instance #4404
[STOP] [2023-10-11 18:03:39] create_harvest_instance
[START] [2023-10-11 18:03:39] fetch_files
[STOP] [2023-10-11 18:03:39] fetch_files
[START] [2023-10-11 18:03:39] validate_each_file
[INFO] [2023-10-11 18:03:39] Looping over 7 formats...
[INFO] [2023-10-11 18:03:39] ...agents (/app/public/data/cicadellinae/agent.tab)
[INFO] [2023-10-11 18:03:39] Valid: /app/public/data/cicadellinae/converted_csv/cicadellinae_agents_30562.csv (1 lines)
[INFO] [2023-10-11 18:03:39] ...refs (/app/public/data/cicadellinae/reference.tab)
[INFO] [2023-10-11 18:03:39] Valid: /app/public/data/cicadellinae/converted_csv/cicadellinae_refs_30558.csv (57 lines)
[INFO] [2023-10-11 18:03:39] ...nodes (/app/public/data/cicadellinae/taxon.tab)
[INFO] [2023-10-11 18:03:39] Valid: /app/public/data/cicadellinae/converted_csv/cicadellinae_nodes_30559.csv (3788 lines)
[INFO] [2023-10-11 18:03:39] ...media (/app/public/data/cicadellinae/media_resource.tab)
[INFO] [2023-10-11 18:03:39] Valid: /app/public/data/cicadellinae/converted_csv/cicadellinae_media_30563.csv (443 lines)
[INFO] [2023-10-11 18:03:39] ...vernaculars (/app/public/data/cicadellinae/vernacular_name.tab)
[INFO] [2023-10-11 18:03:39] Valid: /app/public/data/cicadellinae/converted_csv/cicadellinae_vernaculars_30561.csv (9 lines)
[INFO] [2023-10-11 18:03:39] ...occurrences (/app/public/data/cicadellinae/occurrence.tab)
[INFO] [2023-10-11 18:03:39] Valid: /app/public/data/cicadellinae/converted_csv/cicadellinae_occurrences_30560.csv (258 lines)
[INFO] [2023-10-11 18:03:39] ...measurements (/app/public/data/cicadellinae/measurement_or_fact_specific.tab)
[INFO] [2023-10-11 18:03:39] Valid: /app/public/data/cicadellinae/converted_csv/cicadellinae_measurements_30564.csv (516 lines)
[STOP] [2023-10-11 18:03:39] validate_each_file
[START] [2023-10-11 18:03:39] convert_to_csv
[INFO] [2023-10-11 18:03:39] Looping over 7 formats...
[INFO] [2023-10-11 18:03:39] ...agents (/app/public/data/cicadellinae/agent.tab)
[CMD] [2023-10-11 18:03:39] /usr/bin/sort /app/public/data/cicadellinae/converted_csv/cicadellinae_agents_30562.csv > /app/public/data/cicadellinae/converted_csv/cicadellinae_agents_30562.csv_sorted
[INFO] [2023-10-11 18:03:39] Converted: /app/public/data/cicadellinae/converted_csv/cicadellinae_agents_30562.csv (1 lines)
[INFO] [2023-10-11 18:03:39] ...refs (/app/public/data/cicadellinae/reference.tab)
[CMD] [2023-10-11 18:03:39] /usr/bin/sort /app/public/data/cicadellinae/converted_csv/cicadellinae_refs_30558.csv > /app/public/data/cicadellinae/converted_csv/cicadellinae_refs_30558.csv_sorted
[INFO] [2023-10-11 18:03:39] Converted: /app/public/data/cicadellinae/converted_csv/cicadellinae_refs_30558.csv (57 lines)
[INFO] [2023-10-11 18:03:39] ...nodes (/app/public/data/cicadellinae/taxon.tab)
[CMD] [2023-10-11 18:03:39] /usr/bin/sort /app/public/data/cicadellinae/converted_csv/cicadellinae_nodes_30559.csv > /app/public/data/cicadellinae/converted_csv/cicadellinae_nodes_30559.csv_sorted
[INFO] [2023-10-11 18:03:39] Converted: /app/public/data/cicadellinae/converted_csv/cicadellinae_nodes_30559.csv (3788 lines)
[INFO] [2023-10-11 18:03:39] ...media (/app/public/data/cicadellinae/media_resource.tab)
[CMD] [2023-10-11 18:03:39] /usr/bin/sort /app/public/data/cicadellinae/converted_csv/cicadellinae_media_30563.csv > /app/public/data/cicadellinae/converted_csv/cicadellinae_media_30563.csv_sorted
[INFO] [2023-10-11 18:03:39] Converted: /app/public/data/cicadellinae/converted_csv/cicadellinae_media_30563.csv (443 lines)
[INFO] [2023-10-11 18:03:39] ...vernaculars (/app/public/data/cicadellinae/vernacular_name.tab)
[CMD] [2023-10-11 18:03:39] /usr/bin/sort /app/public/data/cicadellinae/converted_csv/cicadellinae_vernaculars_30561.csv > /app/public/data/cicadellinae/converted_csv/cicadellinae_vernaculars_30561.csv_sorted
[INFO] [2023-10-11 18:03:39] Converted: /app/public/data/cicadellinae/converted_csv/cicadellinae_vernaculars_30561.csv (9 lines)
[INFO] [2023-10-11 18:03:39] ...occurrences (/app/public/data/cicadellinae/occurrence.tab)
[CMD] [2023-10-11 18:03:39] /usr/bin/sort /app/public/data/cicadellinae/converted_csv/cicadellinae_occurrences_30560.csv > /app/public/data/cicadellinae/converted_csv/cicadellinae_occurrences_30560.csv_sorted
[INFO] [2023-10-11 18:03:39] Converted: /app/public/data/cicadellinae/converted_csv/cicadellinae_occurrences_30560.csv (258 lines)
[INFO] [2023-10-11 18:03:39] ...measurements (/app/public/data/cicadellinae/measurement_or_fact_specific.tab)
[CMD] [2023-10-11 18:03:39] /usr/bin/sort /app/public/data/cicadellinae/converted_csv/cicadellinae_measurements_30564.csv > /app/public/data/cicadellinae/converted_csv/cicadellinae_measurements_30564.csv_sorted
[INFO] [2023-10-11 18:03:39] Converted: /app/public/data/cicadellinae/converted_csv/cicadellinae_measurements_30564.csv (516 lines)
[STOP] [2023-10-11 18:03:39] convert_to_csv
[START] [2023-10-11 18:03:39] calculate_delta
[INFO] [2023-10-11 18:03:39] Looping over 7 formats...
[INFO] [2023-10-11 18:03:39] ...agents (/app/public/data/cicadellinae/agent.tab)
[CMD] [2023-10-11 18:03:39] echo "0a" > /app/public/data/cicadellinae/diff/cicadellinae_agents_30562.diff
[CMD] [2023-10-11 18:03:39] tail -n +1 /app/public/data/cicadellinae/converted_csv/cicadellinae_agents_30562.csv >> /app/public/data/cicadellinae/diff/cicadellinae_agents_30562.diff
[CMD] [2023-10-11 18:03:40] echo "." >> /app/public/data/cicadellinae/diff/cicadellinae_agents_30562.diff
[INFO] [2023-10-11 18:03:40] Created diff: /app/public/data/cicadellinae/diff/cicadellinae_agents_30562.diff (3 lines)
[INFO] [2023-10-11 18:03:40] ...refs (/app/public/data/cicadellinae/reference.tab)
[CMD] [2023-10-11 18:03:40] echo "0a" > /app/public/data/cicadellinae/diff/cicadellinae_refs_30558.diff
[CMD] [2023-10-11 18:03:40] tail -n +1 /app/public/data/cicadellinae/converted_csv/cicadellinae_refs_30558.csv >> /app/public/data/cicadellinae/diff/cicadellinae_refs_30558.diff
[CMD] [2023-10-11 18:03:40] echo "." >> /app/public/data/cicadellinae/diff/cicadellinae_refs_30558.diff
[INFO] [2023-10-11 18:03:40] Created diff: /app/public/data/cicadellinae/diff/cicadellinae_refs_30558.diff (59 lines)
[INFO] [2023-10-11 18:03:40] ...nodes (/app/public/data/cicadellinae/taxon.tab)
[CMD] [2023-10-11 18:03:40] echo "0a" > /app/public/data/cicadellinae/diff/cicadellinae_nodes_30559.diff
[CMD] [2023-10-11 18:03:40] tail -n +1 /app/public/data/cicadellinae/converted_csv/cicadellinae_nodes_30559.csv >> /app/public/data/cicadellinae/diff/cicadellinae_nodes_30559.diff
[CMD] [2023-10-11 18:03:40] echo "." >> /app/public/data/cicadellinae/diff/cicadellinae_nodes_30559.diff
[INFO] [2023-10-11 18:03:40] Created diff: /app/public/data/cicadellinae/diff/cicadellinae_nodes_30559.diff (3790 lines)
[INFO] [2023-10-11 18:03:40] ...media (/app/public/data/cicadellinae/media_resource.tab)
[CMD] [2023-10-11 18:03:40] echo "0a" > /app/public/data/cicadellinae/diff/cicadellinae_media_30563.diff
[CMD] [2023-10-11 18:03:40] tail -n +1 /app/public/data/cicadellinae/converted_csv/cicadellinae_media_30563.csv >> /app/public/data/cicadellinae/diff/cicadellinae_media_30563.diff
[CMD] [2023-10-11 18:03:40] echo "." >> /app/public/data/cicadellinae/diff/cicadellinae_media_30563.diff
[INFO] [2023-10-11 18:03:40] Created diff: /app/public/data/cicadellinae/diff/cicadellinae_media_30563.diff (445 lines)
[INFO] [2023-10-11 18:03:40] ...vernaculars (/app/public/data/cicadellinae/vernacular_name.tab)
[CMD] [2023-10-11 18:03:40] echo "0a" > /app/public/data/cicadellinae/diff/cicadellinae_vernaculars_30561.diff
[CMD] [2023-10-11 18:03:40] tail -n +1 /app/public/data/cicadellinae/converted_csv/cicadellinae_vernaculars_30561.csv >> /app/public/data/cicadellinae/diff/cicadellinae_vernaculars_30561.diff
[CMD] [2023-10-11 18:03:40] echo "." >> /app/public/data/cicadellinae/diff/cicadellinae_vernaculars_30561.diff
[INFO] [2023-10-11 18:03:40] Created diff: /app/public/data/cicadellinae/diff/cicadellinae_vernaculars_30561.diff (11 lines)
[INFO] [2023-10-11 18:03:40] ...occurrences (/app/public/data/cicadellinae/occurrence.tab)
[CMD] [2023-10-11 18:03:40] echo "0a" > /app/public/data/cicadellinae/diff/cicadellinae_occurrences_30560.diff
[CMD] [2023-10-11 18:03:40] tail -n +1 /app/public/data/cicadellinae/converted_csv/cicadellinae_occurrences_30560.csv >> /app/public/data/cicadellinae/diff/cicadellinae_occurrences_30560.diff
[CMD] [2023-10-11 18:03:41] echo "." >> /app/public/data/cicadellinae/diff/cicadellinae_occurrences_30560.diff
[INFO] [2023-10-11 18:03:41] Created diff: /app/public/data/cicadellinae/diff/cicadellinae_occurrences_30560.diff (260 lines)
[INFO] [2023-10-11 18:03:41] ...measurements (/app/public/data/cicadellinae/measurement_or_fact_specific.tab)
[CMD] [2023-10-11 18:03:41] echo "0a" > /app/public/data/cicadellinae/diff/cicadellinae_measurements_30564.diff
[CMD] [2023-10-11 18:03:41] tail -n +1 /app/public/data/cicadellinae/converted_csv/cicadellinae_measurements_30564.csv >> /app/public/data/cicadellinae/diff/cicadellinae_measurements_30564.diff
[CMD] [2023-10-11 18:03:41] echo "." >> /app/public/data/cicadellinae/diff/cicadellinae_measurements_30564.diff
[INFO] [2023-10-11 18:03:41] Created diff: /app/public/data/cicadellinae/diff/cicadellinae_measurements_30564.diff (518 lines)
[STOP] [2023-10-11 18:03:41] calculate_delta
[START] [2023-10-11 18:03:41] parse_diff_and_store
[INFO] [2023-10-11 18:03:41] Handling diff: /app/public/data/cicadellinae/diff/cicadellinae_agents_30562.diff (3 lines)
[INFO] [2023-10-11 18:03:41] Loading agents diff file into memory (3 lines)...
[INFO] [2023-10-11 18:03:41] Storing 1 Attributions (1/1/3)
[INFO] [2023-10-11 18:03:41] Handling diff: /app/public/data/cicadellinae/diff/cicadellinae_refs_30558.diff (59 lines)
[INFO] [2023-10-11 18:03:41] Loading refs diff file into memory (59 lines)...
[INFO] [2023-10-11 18:03:41] Storing 57 References (57/57/59)
[INFO] [2023-10-11 18:03:41] Handling diff: /app/public/data/cicadellinae/diff/cicadellinae_nodes_30559.diff (3790 lines)
[INFO] [2023-10-11 18:03:41] Loading nodes diff file into memory (3790 lines)...
[INFO] [2023-10-11 18:03:42] Storing 3788 ScientificNames (6337/3788/3790)
[INFO] [2023-10-11 18:03:43] Storing 2492 Nodes (6337/3788/3790)
[INFO] [2023-10-11 18:03:44] Storing 57 NodesReferences (6337/3788/3790)
[INFO] [2023-10-11 18:03:44] Handling diff: /app/public/data/cicadellinae/diff/cicadellinae_media_30563.diff (445 lines)
[INFO] [2023-10-11 18:03:44] Loading media diff file into memory (445 lines)...
[INFO] [2023-10-11 18:03:44] Storing 443 ContentAttributions (1329/443/445)
[INFO] [2023-10-11 18:03:45] Storing 443 ArticlesSections (1329/443/445)
[INFO] [2023-10-11 18:03:45] Storing 443 Articles (1329/443/445)
[INFO] [2023-10-11 18:03:45] Handling diff: /app/public/data/cicadellinae/diff/cicadellinae_vernaculars_30561.diff (11 lines)
[INFO] [2023-10-11 18:03:45] Loading vernaculars diff file into memory (11 lines)...
[INFO] [2023-10-11 18:03:45] Storing 9 Vernaculars (9/9/11)
[INFO] [2023-10-11 18:03:45] Handling diff: /app/public/data/cicadellinae/diff/cicadellinae_occurrences_30560.diff (260 lines)
[INFO] [2023-10-11 18:03:45] Loading occurrences diff file into memory (260 lines)...
[INFO] [2023-10-11 18:03:45] Storing 258 Occurrences (516/258/260)
[INFO] [2023-10-11 18:03:45] Storing 258 OccurrenceMetadata (516/258/260)
[INFO] [2023-10-11 18:03:45] Handling diff: /app/public/data/cicadellinae/diff/cicadellinae_measurements_30564.diff (518 lines)
[INFO] [2023-10-11 18:03:45] Loading measurements diff file into memory (518 lines)...
[INFO] [2023-10-11 18:03:45] Storing 47 TraitsReferences (563/516/518)
[INFO] [2023-10-11 18:03:45] Storing 258 Traits (563/516/518)
[INFO] [2023-10-11 18:03:46] Storing 258 OccurrenceMetadata (563/516/518)
[STOP] [2023-10-11 18:03:46] parse_diff_and_store
[START] [2023-10-11 18:03:46] resolve_keys
[2023-10-11 18:04:03] Resolving downloaded urls (this is not actually downloading them yet)
[INFO] [2023-10-11 18:04:26] Occurrences to nodes (through scientific_names)...
[INFO] [2023-10-11 18:04:26] traits to occurrences...
[INFO] [2023-10-11 18:04:26] traits to nodes (through occurrences)...
[INFO] [2023-10-11 18:04:26] Traits to sex term...
[INFO] [2023-10-11 18:04:26] Traits to lifestage term...
[INFO] [2023-10-11 18:04:26] MetaTraits to traits...
[INFO] [2023-10-11 18:04:26] MetaTraits (simple, measurement row refers to parent) to traits...
[INFO] [2023-10-11 18:04:26] Assocs to occurrences...
[INFO] [2023-10-11 18:04:26] Assocs to nodes...
[INFO] [2023-10-11 18:04:26] Assoc to sex term...
[INFO] [2023-10-11 18:04:26] Assoc to lifestage term...
[INFO] [2023-10-11 18:04:26] MetaAssoc to assocs...
[STOP] [2023-10-11 18:04:26] resolve_keys
[START] [2023-10-11 18:04:26] hold_for_later_1
[STOP] [2023-10-11 18:04:26] hold_for_later_1
[START] [2023-10-11 18:04:26] hold_for_later_2
[STOP] [2023-10-11 18:04:26] hold_for_later_2
[START] [2023-10-11 18:04:26] resolve_missing_parents
[STOP] [2023-10-11 18:04:26] resolve_missing_parents
[START] [2023-10-11 18:04:26] rebuild_nodes
[START] [2023-10-11 18:04:26] Flattener#flatten
[START] [2023-10-11 18:04:26] Flattener#study_resource
[START] [2023-10-11 18:04:26] Flattener#build_ancestry
[STOP] [2023-10-11 18:04:26] Flattener#build_ancestry
[INFO] [2023-10-11 18:04:26] 2492 ancestry keys
[START] [2023-10-11 18:04:26] build_node_ancestors
[INFO] [2023-10-11 18:04:26] old ancestors deleted.
[STOP] [2023-10-11 18:04:26] build_node_ancestors
[WARN] [2023-10-11 18:04:26] Flattener: nothing to flatten! (Completely flat resource?)
[STOP] [2023-10-11 18:04:26] Flattener#flatten
[STOP] [2023-10-11 18:04:26] rebuild_nodes
[START] [2023-10-11 18:04:26] resolve_missing_media_owners
[STOP] [2023-10-11 18:04:26] resolve_missing_media_owners
[START] [2023-10-11 18:04:26] sanitize_media_verbatims
[STOP] [2023-10-11 18:04:26] sanitize_media_verbatims
[START] [2023-10-11 18:04:26] queue_downloads
[STOP] [2023-10-11 18:04:26] queue_downloads
[START] [2023-10-11 18:04:26] parse_names
[WARN] [2023-10-11 18:04:26] I see 3788 names which still need to be parsed.
[WARN] [2023-10-11 18:04:27] Names to parse: 3788 formatted: 3788 learned: 3774 parsed: 3788
[STOP] [2023-10-11 18:04:29] parse_names
[START] [2023-10-11 18:04:29] denormalize_canonical_names_to_nodes
[STOP] [2023-10-11 18:04:30] denormalize_canonical_names_to_nodes
[START] [2023-10-11 18:04:30] match_nodes
[START] [2023-10-11 18:04:30] map_all_nodes_to_pages
[STOP] [2023-10-11 18:04:51] map_all_nodes_to_pages
[INFO] [2023-10-11 18:04:51] 91 Unmatched nodes (of 2492)! That's too many to output. Full list in /app/public/data/cicadellinae/unmatched_nodes.txt ; First 10: Canonical: Platygonia ignifer; Node#136972544; ResourceID: 1081; Canonical: Dilobopterus hyalinatula; Node#136972560; ResourceID: 1097; Canonical: Apogonalia histrio baraguensis; Node#136972570; ResourceID: 1106; Canonical: Sibovia taenigtifrons; Node#136972580; ResourceID: 1120; Canonical: Cicadella amaena; Node#136972652; ResourceID: 1211; Canonical: Sailerana; Node#136972672; ResourceID: 124; Canonical: Cicadellini; Node#136972714; ResourceID: 1287; Canonical: Graphocephala virgaticeps; Node#136972766; ResourceID: 1346; Canonical: Cicadellinae; Node#136972835; ResourceID: 1425; Canonical: Proconiini; Node#136972836; ResourceID: 1426
[START] [2023-10-11 18:04:51] update_nodes
[STOP] [2023-10-11 18:04:52] update_nodes
[STOP] [2023-10-11 18:04:52] match_nodes
[START] [2023-10-11 18:04:52] reindex_search
[STOP] [2023-10-11 18:04:53] reindex_search
[START] [2023-10-11 18:04:53] normalize_units
[STOP] [2023-10-11 18:04:53] normalize_units
[START] [2023-10-11 18:04:53] calculate_statistics
[2023-10-11 18:04:53] ZERO NODE ANCESTORS. Is this actually a completely flat resource?
[INFO] [2023-10-11 18:04:54] Duplicate page_id count: 0
[2023-10-11 18:04:54] WARNING: 219 trait(s) without source found! Please confirm that this is intentional.
[2023-10-11 18:04:54] traits w/o source (up to 100):
[2023-10-11 18:04:54] (resource_pk: 05033c4640267faa58e76fdc556c06d5_Cicadellinae_meta_recoded, id: 291075475)
[2023-10-11 18:04:54] (resource_pk: 05f33e80e1135ee549d3fa1a7c6a3dfc_Cicadellinae_meta_recoded, id: 291075477)
[2023-10-11 18:04:54] (resource_pk: 065a430a43b8821aab06db7ab118cb68_Cicadellinae_meta_recoded, id: 291075478)
[2023-10-11 18:04:54] (resource_pk: 06707051fde26d7a63bb5a2150b126ca_Cicadellinae_meta_recoded, id: 291075479)
[2023-10-11 18:04:54] (resource_pk: 071f4231563b495135effeb2105e2695_Cicadellinae_meta_recoded, id: 291075480)
[2023-10-11 18:04:54] (resource_pk: 096a4dc8f424c21a058716aa681c66e3_Cicadellinae_meta_recoded, id: 291075482)
[2023-10-11 18:04:54] (resource_pk: 0a2e924283326189107f74c9fad0711a_Cicadellinae_meta_recoded, id: 291075483)
[2023-10-11 18:04:54] (resource_pk: 0b53fb453025721f959c106b333c9c1c_Cicadellinae_meta_recoded, id: 291075484)
[2023-10-11 18:04:54] (resource_pk: 0b71229d2db1fd902551c7e259867c08_Cicadellinae_meta_recoded, id: 291075485)
[2023-10-11 18:04:54] (resource_pk: 0da39e9ef7e9441dd3a31f6c3359bd7d_Cicadellinae_meta_recoded, id: 291075486)
[2023-10-11 18:04:54] (resource_pk: 0e3518b6627d9ac121b8e3802ebd2ca9_Cicadellinae_meta_recoded, id: 291075487)
[2023-10-11 18:04:54] (resource_pk: 0e8d5deead287c08908cc42acf0fde15_Cicadellinae_meta_recoded, id: 291075488)
[2023-10-11 18:04:54] (resource_pk: 14fe6e4aa32c7c0c307c033aa2261745_Cicadellinae_meta_recoded, id: 291075490)
[2023-10-11 18:04:54] (resource_pk: 15bac119d007eef0f27186fcf24f4713_Cicadellinae_meta_recoded, id: 291075491)
[2023-10-11 18:04:54] (resource_pk: 170f2d378ddf2bfc0a78992ffabe4236_Cicadellinae_meta_recoded, id: 291075492)
[2023-10-11 18:04:54] (resource_pk: 173f52870725b7ca57edaf5ecdbff84f_Cicadellinae_meta_recoded, id: 291075493)
[2023-10-11 18:04:54] (resource_pk: 198a1a8e633b6e9fd32e5a14cb054f2c_Cicadellinae_meta_recoded, id: 291075494)
[2023-10-11 18:04:54] (resource_pk: 19b4f10933b74dd053ff42af1d8fc806_Cicadellinae_meta_recoded, id: 291075495)
[2023-10-11 18:04:54] (resource_pk: 19d71a4ba2c80a71f2e74a467f8e3366_Cicadellinae_meta_recoded, id: 291075496)
[2023-10-11 18:04:54] (resource_pk: 1a783153ba5cd41e1c310b3980dbe654_Cicadellinae_meta_recoded, id: 291075497)
[2023-10-11 18:04:54] (resource_pk: 1cb93fe5b96c040ca5bd29735838555b_Cicadellinae_meta_recoded, id: 291075498)
[2023-10-11 18:04:54] (resource_pk: 1d4e72d6cbdf2fc74e1571fdac54002b_Cicadellinae_meta_recoded, id: 291075499)
[2023-10-11 18:04:54] (resource_pk: 1eb39773ec17a8ac315c11609221a3fc_Cicadellinae_meta_recoded, id: 291075500)
[2023-10-11 18:04:54] (resource_pk: 1f95444a5a5d8c7f8d3fb297f6ca46b2_Cicadellinae_meta_recoded, id: 291075501)
[2023-10-11 18:04:54] (resource_pk: 21b6aeb9d93fb0b6229a3ff719f335a9_Cicadellinae_meta_recoded, id: 291075502)
[2023-10-11 18:04:54] (resource_pk: 230ee26627b999ff87e67e575d099070_Cicadellinae_meta_recoded, id: 291075503)
[2023-10-11 18:04:54] (resource_pk: 231fd68303eec65c51847112878e20ca_Cicadellinae_meta_recoded, id: 291075504)
[2023-10-11 18:04:54] (resource_pk: 233b10bf7e003196110921021e10fc35_Cicadellinae_meta_recoded, id: 291075505)
[2023-10-11 18:04:54] (resource_pk: 236901e9487c181f70fe7b2b3e94c00c_Cicadellinae_meta_recoded, id: 291075506)
[2023-10-11 18:04:54] (resource_pk: 23fa445119864bad92e93a065603480f_Cicadellinae_meta_recoded, id: 291075507)
[2023-10-11 18:04:54] (resource_pk: 24512020b44b0d4493ca1a2d10dd585a_Cicadellinae_meta_recoded, id: 291075508)
[2023-10-11 18:04:54] (resource_pk: 25142b32c9905c127bae4b2a441cef42_Cicadellinae_meta_recoded, id: 291075509)
[2023-10-11 18:04:54] (resource_pk: 25c32d443dfe0bba0093d32856f931b1_Cicadellinae_meta_recoded, id: 291075510)
[2023-10-11 18:04:54] (resource_pk: 26ae3410b3504566d054f470afabd95c_Cicadellinae_meta_recoded, id: 291075511)
[2023-10-11 18:04:54] (resource_pk: 2957a53e39729619bc872a1d5504228e_Cicadellinae_meta_recoded, id: 291075512)
[2023-10-11 18:04:54] (resource_pk: 2a019613123a0bafb28bb7ebf2fee461_Cicadellinae_meta_recoded, id: 291075514)
[2023-10-11 18:04:54] (resource_pk: 2a6db62a021dbe792e63a4e0896982e2_Cicadellinae_meta_recoded, id: 291075515)
[2023-10-11 18:04:54] (resource_pk: 2d8085267b809a24f6e5ca88d2a2a9c1_Cicadellinae_meta_recoded, id: 291075517)
[2023-10-11 18:04:54] (resource_pk: 2e61305457b6ef67a71e297825f0ae0d_Cicadellinae_meta_recoded, id: 291075518)
[2023-10-11 18:04:54] (resource_pk: 2ee147dbe09eb14236e1f2bdb91278fd_Cicadellinae_meta_recoded, id: 291075519)
[2023-10-11 18:04:54] (resource_pk: 2f2ca18682f8688b486890b5d58116c9_Cicadellinae_meta_recoded, id: 291075520)
[2023-10-11 18:04:54] (resource_pk: 2fe7b4f3323c44e68c2dc7ccea7a78b8_Cicadellinae_meta_recoded, id: 291075521)
[2023-10-11 18:04:54] (resource_pk: 329cf5ed6c63417178515d55038d488e_Cicadellinae_meta_recoded, id: 291075523)
[2023-10-11 18:04:54] (resource_pk: 33a59527c104123e4e1904d5ef9c070d_Cicadellinae_meta_recoded, id: 291075524)
[2023-10-11 18:04:54] (resource_pk: 33f061e6df374e9c938caa5917097be5_Cicadellinae_meta_recoded, id: 291075525)
[2023-10-11 18:04:54] (resource_pk: 3422a96e00e9afb68a9c3cefb352d0a6_Cicadellinae_meta_recoded, id: 291075526)
[2023-10-11 18:04:54] (resource_pk: 383d6c84e1ec457a0c7b2d0aa7b5c3f8_Cicadellinae_meta_recoded, id: 291075528)
[2023-10-11 18:04:54] (resource_pk: 38f1052abf09e79632d23c5b2480f0c0_Cicadellinae_meta_recoded, id: 291075529)
[2023-10-11 18:04:54] (resource_pk: 3af91f3ead23d273bd9f59c36d900f2e_Cicadellinae_meta_recoded, id: 291075530)
[2023-10-11 18:04:54] (resource_pk: 3c1665091539a8b7e603beb1360a2170_Cicadellinae_meta_recoded, id: 291075531)
[2023-10-11 18:04:54] (resource_pk: 3f7edeb238c7f12d6bef70274cf1bb40_Cicadellinae_meta_recoded, id: 291075532)
[2023-10-11 18:04:54] (resource_pk: 3fa36c55329b769695770807fa54e9a2_Cicadellinae_meta_recoded, id: 291075533)
[2023-10-11 18:04:54] (resource_pk: 3ffd6d4965f48cb28b857455018ab395_Cicadellinae_meta_recoded, id: 291075534)
[2023-10-11 18:04:54] (resource_pk: 40cb233cef841df46d434691ad9e9d9f_Cicadellinae_meta_recoded, id: 291075535)
[2023-10-11 18:04:54] (resource_pk: 4162e90f30a9e58df631e9276c6253f3_Cicadellinae_meta_recoded, id: 291075536)
[2023-10-11 18:04:54] (resource_pk: 41ad1cf8faa6a82fd12f8031d0444fef_Cicadellinae_meta_recoded, id: 291075537)
[2023-10-11 18:04:54] (resource_pk: 4389947ba0ccc87f684612ef44185d7c_Cicadellinae_meta_recoded, id: 291075539)
[2023-10-11 18:04:54] (resource_pk: 4582af52a443df73ac659e705c82c414_Cicadellinae_meta_recoded, id: 291075541)
[2023-10-11 18:04:54] (resource_pk: 4748ce4a49abb5a32e446056b6f94e05_Cicadellinae_meta_recoded, id: 291075542)
[2023-10-11 18:04:54] (resource_pk: 4778a499ee2ea5920000abd33cb1bb22_Cicadellinae_meta_recoded, id: 291075543)
[2023-10-11 18:04:54] (resource_pk: 485cedaf4a217b1df725b1f7f2978d46_Cicadellinae_meta_recoded, id: 291075544)
[2023-10-11 18:04:54] (resource_pk: 48820fb3f02b8e45c5b7fef875fa35b0_Cicadellinae_meta_recoded, id: 291075545)
[2023-10-11 18:04:54] (resource_pk: 49ba0d147c9098286b6c45037d6ace2e_Cicadellinae_meta_recoded, id: 291075547)
[2023-10-11 18:04:54] (resource_pk: 4a7289026d039a7a4cae3b96c5f91c74_Cicadellinae_meta_recoded, id: 291075548)
[2023-10-11 18:04:54] (resource_pk: 4bf9377f4b76af4eb7ac030ff1d95435_Cicadellinae_meta_recoded, id: 291075549)
[2023-10-11 18:04:54] (resource_pk: 4ca182725fc9e65fcc90149c67de1589_Cicadellinae_meta_recoded, id: 291075550)
[2023-10-11 18:04:54] (resource_pk: 4f036fe1be8ac0f80c852ce92f83f5c9_Cicadellinae_meta_recoded, id: 291075551)
[2023-10-11 18:04:54] (resource_pk: 50154cdcc8ba4fa5f6cb9c77e5936033_Cicadellinae_meta_recoded, id: 291075552)
[2023-10-11 18:04:54] (resource_pk: 51288e88b29b6622882f24a6d6bf3191_Cicadellinae_meta_recoded, id: 291075553)
[2023-10-11 18:04:54] (resource_pk: 52471536169fc4a4e222c9b9687ce5e1_Cicadellinae_meta_recoded, id: 291075554)
[2023-10-11 18:04:54] (resource_pk: 5535ec47eed4f13b59dae875024c3a82_Cicadellinae_meta_recoded, id: 291075556)
[2023-10-11 18:04:54] (resource_pk: 55cccdefc6a5d2db28fe82510b0fa448_Cicadellinae_meta_recoded, id: 291075557)
[2023-10-11 18:04:54] (resource_pk: 55f7ea675113b8302557e9a782c07ebc_Cicadellinae_meta_recoded, id: 291075558)
[2023-10-11 18:04:54] (resource_pk: 566b03a21dfdee3625741f3237900078_Cicadellinae_meta_recoded, id: 291075559)
[2023-10-11 18:04:54] (resource_pk: 567def7a3536687f6da91a23e3da479a_Cicadellinae_meta_recoded, id: 291075560)
[2023-10-11 18:04:54] (resource_pk: 593df20e59760f73aeeab575e057e193_Cicadellinae_meta_recoded, id: 291075562)
[2023-10-11 18:04:54] (resource_pk: 5a3e1023492fc2189997729d30d425ae_Cicadellinae_meta_recoded, id: 291075563)
[2023-10-11 18:04:54] (resource_pk: 5ade10418cda78c049bb5c84d5d0714e_Cicadellinae_meta_recoded, id: 291075564)
[2023-10-11 18:04:54] (resource_pk: 5d0171cb667432258d2239e60f27acb9_Cicadellinae_meta_recoded, id: 291075565)
[2023-10-11 18:04:54] (resource_pk: 5dca55cb71d6643dafeda1047146df3d_Cicadellinae_meta_recoded, id: 291075566)
[2023-10-11 18:04:54] (resource_pk: 5dd21ed71513d90ce0e51b67c90f4f9f_Cicadellinae_meta_recoded, id: 291075567)
[2023-10-11 18:04:54] (resource_pk: 5e557419978155b1baefbb9616f6e3b2_Cicadellinae_meta_recoded, id: 291075568)
[2023-10-11 18:04:54] (resource_pk: 5e7f0610d926f82ad1fdf6f6efc88db4_Cicadellinae_meta_recoded, id: 291075569)
[2023-10-11 18:04:54] (resource_pk: 60e9f374a66ec72cdc70ce61c4fe45c8_Cicadellinae_meta_recoded, id: 291075571)
[2023-10-11 18:04:54] (resource_pk: 61e16299dc021aff50c5730ecb044f1c_Cicadellinae_meta_recoded, id: 291075573)
[2023-10-11 18:04:54] (resource_pk: 643b829b3a1462243f3bccdcbe9b67b6_Cicadellinae_meta_recoded, id: 291075575)
[2023-10-11 18:04:54] (resource_pk: 64fd3be1c0e3824e83fe1f71656cd0c1_Cicadellinae_meta_recoded, id: 291075576)
[2023-10-11 18:04:54] (resource_pk: 651ca160cf4fd3c8e031abb419727cf4_Cicadellinae_meta_recoded, id: 291075577)
[2023-10-11 18:04:54] (resource_pk: 651f7e75fda61a2489d1fe25c9a09bed_Cicadellinae_meta_recoded, id: 291075578)
[2023-10-11 18:04:54] (resource_pk: 659facefa0d7bed56696fcd66823ede4_Cicadellinae_meta_recoded, id: 291075579)
[2023-10-11 18:04:54] (resource_pk: 65a2a9920ed971d157ec3046a6b9f666_Cicadellinae_meta_recoded, id: 291075580)
[2023-10-11 18:04:54] (resource_pk: 6699ad8df4d5aa07af5097a7ea6b7346_Cicadellinae_meta_recoded, id: 291075581)
[2023-10-11 18:04:54] (resource_pk: 66b316dd7405316669ce88cfb574f8e1_Cicadellinae_meta_recoded, id: 291075582)
[2023-10-11 18:04:54] (resource_pk: 672bfda78159b6ce280496044a287a5e_Cicadellinae_meta_recoded, id: 291075583)
[2023-10-11 18:04:54] (resource_pk: 6791c0a5d2c81b5f33ed6b3dcf29ddae_Cicadellinae_meta_recoded, id: 291075584)
[2023-10-11 18:04:54] (resource_pk: 6892956be5e869c318e393e67c54ed16_Cicadellinae_meta_recoded, id: 291075585)
[2023-10-11 18:04:54] (resource_pk: 68fbe13686961d77609d77fc81e72dce_Cicadellinae_meta_recoded, id: 291075586)
[2023-10-11 18:04:54] (resource_pk: 6c10e63c2293dfa58134fc767a6280fe_Cicadellinae_meta_recoded, id: 291075587)
[2023-10-11 18:04:54] (resource_pk: 6d1edb301be58cc2b1c73d2ba1db14f2_Cicadellinae_meta_recoded, id: 291075588)
[2023-10-11 18:04:54] (resource_pk: 6e4916b4f90b8c347c70666dd5a03f0e_Cicadellinae_meta_recoded, id: 291075589)
[STOP] [2023-10-11 18:04:54] calculate_statistics
[START] [2023-10-11 18:04:54] complete_harvest_instance
[START] [2023-10-11 18:04:54] overall_tsv_creation
[INFO] [2023-10-11 18:04:54] Exporting 2492 nodes as TSV in batches of 10000...
[INFO] [2023-10-11 18:04:54] Processing group of 2492 in 1 batches of 10000
[INFO] [2023-10-11 18:05:05] 258 Traits (unfiltered) and 0 associations...
[INFO] [2023-10-11 18:05:05] Building Traits map for 2492 nodes (this can take a while)...
[INFO] [2023-10-11 18:05:06] Mapped 258 traits (0 meta) for 2492 nodes.
[INFO] [2023-10-11 18:05:06] Building Associations map (this can take a while)...
[INFO] [2023-10-11 18:05:06] Done. 0 assocs mapped (0 meta).
[INFO] [2023-10-11 18:05:06] Adding 258 traits...
[INFO] [2023-10-11 18:05:06] 563 metadata added.
[INFO] [2023-10-11 18:05:06] Adding 0 assocs...
[INFO] [2023-10-11 18:05:06] 0 metadata added.
[INFO] [2023-10-11 18:05:57] Processed 2492/2492 nodes
[INFO] [2023-10-11 18:05:57] Average Time: 55.57
[INFO] [2023-10-11 18:05:57] Total Time: 1m3s
[STOP] [2023-10-11 18:05:57] overall_tsv_creation
[INFO] [2023-10-11 18:05:57] Done. Check your files:
[INFO] [2023-10-11 18:05:57] (2492 lines) /app/public/data/cicadellinae/publish_nodes.tsv
[INFO] [2023-10-11 18:05:57] (3788 lines) /app/public/data/cicadellinae/publish_scientific_names.tsv
[INFO] [2023-10-11 18:05:57] (443 lines) /app/public/data/cicadellinae/publish_articles.tsv
[INFO] [2023-10-11 18:05:57] (9 lines) /app/public/data/cicadellinae/publish_vernaculars.tsv
[INFO] [2023-10-11 18:05:57] (57 lines) /app/public/data/cicadellinae/publish_references.tsv
[INFO] [2023-10-11 18:05:57] (443 lines) /app/public/data/cicadellinae/publish_attributions.tsv
[INFO] [2023-10-11 18:05:57] (443 lines) /app/public/data/cicadellinae/publish_content_sections.tsv
[INFO] [2023-10-11 18:05:57] (57 lines) /app/public/data/cicadellinae/publish_referents.tsv
[INFO] [2023-10-11 18:05:57] (259 lines) /app/public/data/cicadellinae/publish_traits.tsv
[INFO] [2023-10-11 18:05:57] (564 lines) /app/public/data/cicadellinae/publish_metadata.tsv
[STOP] [2023-10-11 18:05:57] complete_harvest_instance
[START] [2023-10-11 18:05:57] completed
[STOP] [2023-10-11 18:05:57] completed
[STOP] [2023-10-11 18:05:57] logged process, took 139.05

Latest Process

11 Oct 18:03 EXITED currently processing 0