Harvest for Morgan Ernest 2003 Created 31 May 03:29

Stage: completed
Fetched: 31 May 03:29
Validated: 31 May 03:29
Deltas Created 31 May 03:29
Units Normalized: 31 May 03:30
Ancestry Built: 31 May 03:29
Nodes Matched: 31 May 03:30
Names Parsed: 31 May 03:29
New Models Stored: 31 May 03:29
Indexed: 31 May 03:30
Completed: 31 May 03:33
Time to Harvest: less than a minute

Harvesting Log

(236 lines)
[INFO] [2021-05-31 03:29:00] Created harvest instance #3911
[STOP] [2021-05-31 03:29:00] create_harvest_instance
[START] [2021-05-31 03:29:00] fetch_files
[STOP] [2021-05-31 03:29:00] fetch_files
[START] [2021-05-31 03:29:00] validate_each_file
[INFO] [2021-05-31 03:29:00] Looping over 8 formats...
[INFO] [2021-05-31 03:29:00] ...agents (/app/public/data/morgan_ernest_mo/agents.txt)
[INFO] [2021-05-31 03:29:00] Valid: /app/public/converted_csv/morgan_ernest_mo_agents_3911.csv (0 lines)
[INFO] [2021-05-31 03:29:00] ...refs (/app/public/data/morgan_ernest_mo/references.txt)
[INFO] [2021-05-31 03:29:00] Valid: /app/public/converted_csv/morgan_ernest_mo_refs_3911.csv (29 lines)
[INFO] [2021-05-31 03:29:00] ...nodes (/app/public/data/morgan_ernest_mo/taxa.txt)
[INFO] [2021-05-31 03:29:01] Valid: /app/public/converted_csv/morgan_ernest_mo_nodes_3911.csv (1440 lines)
[INFO] [2021-05-31 03:29:01] ...media (/app/public/data/morgan_ernest_mo/media.txt)
[INFO] [2021-05-31 03:29:01] Valid: /app/public/converted_csv/morgan_ernest_mo_media_3911.csv (0 lines)
[INFO] [2021-05-31 03:29:01] ...vernaculars (/app/public/data/morgan_ernest_mo/common names.txt)
[INFO] [2021-05-31 03:29:01] Valid: /app/public/converted_csv/morgan_ernest_mo_vernaculars_3911.csv (0 lines)
[INFO] [2021-05-31 03:29:01] ...occurrences (/app/public/data/morgan_ernest_mo/occurrences.tsv)
[INFO] [2021-05-31 03:29:01] Valid: /app/public/converted_csv/morgan_ernest_mo_occurrences_3911.csv (4041 lines)
[INFO] [2021-05-31 03:29:01] ...assocs (/app/public/data/morgan_ernest_mo/associations.txt)
[INFO] [2021-05-31 03:29:01] Valid: /app/public/converted_csv/morgan_ernest_mo_assocs_3911.csv (0 lines)
[INFO] [2021-05-31 03:29:01] ...measurements (/app/public/data/morgan_ernest_mo/measurements_or_facts.tsv)
[INFO] [2021-05-31 03:29:01] Valid: /app/public/converted_csv/morgan_ernest_mo_measurements_3911.csv (9338 lines)
[STOP] [2021-05-31 03:29:01] validate_each_file
[START] [2021-05-31 03:29:01] convert_to_csv
[INFO] [2021-05-31 03:29:01] Looping over 8 formats...
[INFO] [2021-05-31 03:29:01] ...agents (/app/public/data/morgan_ernest_mo/agents.txt)
[CMD] [2021-05-31 03:29:01] /usr/bin/sort /app/public/converted_csv/morgan_ernest_mo_agents_3911.csv > /app/public/converted_csv/morgan_ernest_mo_agents_3911.csv_sorted
[INFO] [2021-05-31 03:29:02] Converted: /app/public/converted_csv/morgan_ernest_mo_agents_3911.csv (0 lines)
[INFO] [2021-05-31 03:29:02] ...refs (/app/public/data/morgan_ernest_mo/references.txt)
[CMD] [2021-05-31 03:29:02] /usr/bin/sort /app/public/converted_csv/morgan_ernest_mo_refs_3911.csv > /app/public/converted_csv/morgan_ernest_mo_refs_3911.csv_sorted
[INFO] [2021-05-31 03:29:02] Converted: /app/public/converted_csv/morgan_ernest_mo_refs_3911.csv (29 lines)
[INFO] [2021-05-31 03:29:02] ...nodes (/app/public/data/morgan_ernest_mo/taxa.txt)
[CMD] [2021-05-31 03:29:02] /usr/bin/sort /app/public/converted_csv/morgan_ernest_mo_nodes_3911.csv > /app/public/converted_csv/morgan_ernest_mo_nodes_3911.csv_sorted
[INFO] [2021-05-31 03:29:02] Converted: /app/public/converted_csv/morgan_ernest_mo_nodes_3911.csv (1440 lines)
[INFO] [2021-05-31 03:29:02] ...media (/app/public/data/morgan_ernest_mo/media.txt)
[CMD] [2021-05-31 03:29:02] /usr/bin/sort /app/public/converted_csv/morgan_ernest_mo_media_3911.csv > /app/public/converted_csv/morgan_ernest_mo_media_3911.csv_sorted
[INFO] [2021-05-31 03:29:03] Converted: /app/public/converted_csv/morgan_ernest_mo_media_3911.csv (0 lines)
[INFO] [2021-05-31 03:29:03] ...vernaculars (/app/public/data/morgan_ernest_mo/common names.txt)
[CMD] [2021-05-31 03:29:03] /usr/bin/sort /app/public/converted_csv/morgan_ernest_mo_vernaculars_3911.csv > /app/public/converted_csv/morgan_ernest_mo_vernaculars_3911.csv_sorted
[INFO] [2021-05-31 03:29:03] Converted: /app/public/converted_csv/morgan_ernest_mo_vernaculars_3911.csv (0 lines)
[INFO] [2021-05-31 03:29:03] ...occurrences (/app/public/data/morgan_ernest_mo/occurrences.tsv)
[CMD] [2021-05-31 03:29:03] /usr/bin/sort /app/public/converted_csv/morgan_ernest_mo_occurrences_3911.csv > /app/public/converted_csv/morgan_ernest_mo_occurrences_3911.csv_sorted
[INFO] [2021-05-31 03:29:04] Converted: /app/public/converted_csv/morgan_ernest_mo_occurrences_3911.csv (4041 lines)
[INFO] [2021-05-31 03:29:04] ...assocs (/app/public/data/morgan_ernest_mo/associations.txt)
[CMD] [2021-05-31 03:29:04] /usr/bin/sort /app/public/converted_csv/morgan_ernest_mo_assocs_3911.csv > /app/public/converted_csv/morgan_ernest_mo_assocs_3911.csv_sorted
[INFO] [2021-05-31 03:29:04] Converted: /app/public/converted_csv/morgan_ernest_mo_assocs_3911.csv (0 lines)
[INFO] [2021-05-31 03:29:04] ...measurements (/app/public/data/morgan_ernest_mo/measurements_or_facts.tsv)
[CMD] [2021-05-31 03:29:04] /usr/bin/sort /app/public/converted_csv/morgan_ernest_mo_measurements_3911.csv > /app/public/converted_csv/morgan_ernest_mo_measurements_3911.csv_sorted
[INFO] [2021-05-31 03:29:04] Converted: /app/public/converted_csv/morgan_ernest_mo_measurements_3911.csv (9338 lines)
[STOP] [2021-05-31 03:29:04] convert_to_csv
[START] [2021-05-31 03:29:04] calculate_delta
[INFO] [2021-05-31 03:29:04] Looping over 8 formats...
[INFO] [2021-05-31 03:29:04] ...agents (/app/public/data/morgan_ernest_mo/agents.txt)
[CMD] [2021-05-31 03:29:04] echo "0a" > /app/public/diff/morgan_ernest_mo_agents_3911.diff
[CMD] [2021-05-31 03:29:05] tail -n +1 /app/public/converted_csv/morgan_ernest_mo_agents_3911.csv >> /app/public/diff/morgan_ernest_mo_agents_3911.diff
[CMD] [2021-05-31 03:29:05] echo "." >> /app/public/diff/morgan_ernest_mo_agents_3911.diff
[INFO] [2021-05-31 03:29:06] Created diff: /app/public/diff/morgan_ernest_mo_agents_3911.diff (2 lines)
[INFO] [2021-05-31 03:29:06] ...refs (/app/public/data/morgan_ernest_mo/references.txt)
[CMD] [2021-05-31 03:29:06] echo "0a" > /app/public/diff/morgan_ernest_mo_refs_3911.diff
[CMD] [2021-05-31 03:29:06] tail -n +1 /app/public/converted_csv/morgan_ernest_mo_refs_3911.csv >> /app/public/diff/morgan_ernest_mo_refs_3911.diff
[CMD] [2021-05-31 03:29:06] echo "." >> /app/public/diff/morgan_ernest_mo_refs_3911.diff
[INFO] [2021-05-31 03:29:07] Created diff: /app/public/diff/morgan_ernest_mo_refs_3911.diff (31 lines)
[INFO] [2021-05-31 03:29:07] ...nodes (/app/public/data/morgan_ernest_mo/taxa.txt)
[CMD] [2021-05-31 03:29:07] echo "0a" > /app/public/diff/morgan_ernest_mo_nodes_3911.diff
[CMD] [2021-05-31 03:29:07] tail -n +1 /app/public/converted_csv/morgan_ernest_mo_nodes_3911.csv >> /app/public/diff/morgan_ernest_mo_nodes_3911.diff
[CMD] [2021-05-31 03:29:07] echo "." >> /app/public/diff/morgan_ernest_mo_nodes_3911.diff
[INFO] [2021-05-31 03:29:08] Created diff: /app/public/diff/morgan_ernest_mo_nodes_3911.diff (1442 lines)
[INFO] [2021-05-31 03:29:08] ...media (/app/public/data/morgan_ernest_mo/media.txt)
[CMD] [2021-05-31 03:29:08] echo "0a" > /app/public/diff/morgan_ernest_mo_media_3911.diff
[CMD] [2021-05-31 03:29:08] tail -n +1 /app/public/converted_csv/morgan_ernest_mo_media_3911.csv >> /app/public/diff/morgan_ernest_mo_media_3911.diff
[CMD] [2021-05-31 03:29:09] echo "." >> /app/public/diff/morgan_ernest_mo_media_3911.diff
[INFO] [2021-05-31 03:29:09] Created diff: /app/public/diff/morgan_ernest_mo_media_3911.diff (2 lines)
[INFO] [2021-05-31 03:29:09] ...vernaculars (/app/public/data/morgan_ernest_mo/common names.txt)
[CMD] [2021-05-31 03:29:09] echo "0a" > /app/public/diff/morgan_ernest_mo_vernaculars_3911.diff
[CMD] [2021-05-31 03:29:09] tail -n +1 /app/public/converted_csv/morgan_ernest_mo_vernaculars_3911.csv >> /app/public/diff/morgan_ernest_mo_vernaculars_3911.diff
[CMD] [2021-05-31 03:29:10] echo "." >> /app/public/diff/morgan_ernest_mo_vernaculars_3911.diff
[INFO] [2021-05-31 03:29:10] Created diff: /app/public/diff/morgan_ernest_mo_vernaculars_3911.diff (2 lines)
[INFO] [2021-05-31 03:29:10] ...occurrences (/app/public/data/morgan_ernest_mo/occurrences.tsv)
[CMD] [2021-05-31 03:29:10] echo "0a" > /app/public/diff/morgan_ernest_mo_occurrences_3911.diff
[CMD] [2021-05-31 03:29:10] tail -n +1 /app/public/converted_csv/morgan_ernest_mo_occurrences_3911.csv >> /app/public/diff/morgan_ernest_mo_occurrences_3911.diff
[CMD] [2021-05-31 03:29:11] echo "." >> /app/public/diff/morgan_ernest_mo_occurrences_3911.diff
[INFO] [2021-05-31 03:29:11] Created diff: /app/public/diff/morgan_ernest_mo_occurrences_3911.diff (4043 lines)
[INFO] [2021-05-31 03:29:11] ...assocs (/app/public/data/morgan_ernest_mo/associations.txt)
[CMD] [2021-05-31 03:29:11] echo "0a" > /app/public/diff/morgan_ernest_mo_assocs_3911.diff
[CMD] [2021-05-31 03:29:12] tail -n +1 /app/public/converted_csv/morgan_ernest_mo_assocs_3911.csv >> /app/public/diff/morgan_ernest_mo_assocs_3911.diff
[CMD] [2021-05-31 03:29:12] echo "." >> /app/public/diff/morgan_ernest_mo_assocs_3911.diff
[INFO] [2021-05-31 03:29:12] Created diff: /app/public/diff/morgan_ernest_mo_assocs_3911.diff (2 lines)
[INFO] [2021-05-31 03:29:12] ...measurements (/app/public/data/morgan_ernest_mo/measurements_or_facts.tsv)
[CMD] [2021-05-31 03:29:12] echo "0a" > /app/public/diff/morgan_ernest_mo_measurements_3911.diff
[CMD] [2021-05-31 03:29:13] tail -n +1 /app/public/converted_csv/morgan_ernest_mo_measurements_3911.csv >> /app/public/diff/morgan_ernest_mo_measurements_3911.diff
[CMD] [2021-05-31 03:29:13] echo "." >> /app/public/diff/morgan_ernest_mo_measurements_3911.diff
[INFO] [2021-05-31 03:29:13] Created diff: /app/public/diff/morgan_ernest_mo_measurements_3911.diff (9340 lines)
[STOP] [2021-05-31 03:29:14] calculate_delta
[START] [2021-05-31 03:29:14] parse_diff_and_store
[INFO] [2021-05-31 03:29:14] Handling diff: /app/public/diff/morgan_ernest_mo_agents_3911.diff (2 lines)
[INFO] [2021-05-31 03:29:14] Loading agents diff file into memory (2 /app/public/diff/morgan_ernest_mo_agents_3911.diff lines)...
[INFO] [2021-05-31 03:29:14] Handling diff: /app/public/diff/morgan_ernest_mo_refs_3911.diff (31 lines)
[INFO] [2021-05-31 03:29:15] Loading refs diff file into memory (31 /app/public/diff/morgan_ernest_mo_refs_3911.diff lines)...
[INFO] [2021-05-31 03:29:15] Handling diff: /app/public/diff/morgan_ernest_mo_nodes_3911.diff (1442 lines)
[INFO] [2021-05-31 03:29:15] Loading nodes diff file into memory (1442 /app/public/diff/morgan_ernest_mo_nodes_3911.diff lines)...
[WARN] [2021-05-31 03:29:16] Filtered Scientific Name `Uromys  caudimaculatus` to `Uromys caudimaculatus`
[INFO] [2021-05-31 03:29:16] Handling diff: /app/public/diff/morgan_ernest_mo_media_3911.diff (2 lines)
[INFO] [2021-05-31 03:29:17] Loading media diff file into memory (2 /app/public/diff/morgan_ernest_mo_media_3911.diff lines)...
[INFO] [2021-05-31 03:29:17] Handling diff: /app/public/diff/morgan_ernest_mo_vernaculars_3911.diff (2 lines)
[INFO] [2021-05-31 03:29:17] Loading vernaculars diff file into memory (2 /app/public/diff/morgan_ernest_mo_vernaculars_3911.diff lines)...
[INFO] [2021-05-31 03:29:18] Handling diff: /app/public/diff/morgan_ernest_mo_occurrences_3911.diff (4043 lines)
[INFO] [2021-05-31 03:29:18] Loading occurrences diff file into memory (4043 /app/public/diff/morgan_ernest_mo_occurrences_3911.diff lines)...
[INFO] [2021-05-31 03:29:20] Handling diff: /app/public/diff/morgan_ernest_mo_assocs_3911.diff (2 lines)
[INFO] [2021-05-31 03:29:20] Loading assocs diff file into memory (2 /app/public/diff/morgan_ernest_mo_assocs_3911.diff lines)...
[INFO] [2021-05-31 03:29:20] Handling diff: /app/public/diff/morgan_ernest_mo_measurements_3911.diff (9340 lines)
[INFO] [2021-05-31 03:29:21] Loading measurements diff file into memory (9340 /app/public/diff/morgan_ernest_mo_measurements_3911.diff lines)...
[INFO] [2021-05-31 03:29:27] Storing 29 References
[INFO] [2021-05-31 03:29:27] Processing group of 29 in 1 groups of 1000
[INFO] [2021-05-31 03:29:27] Average Time: 0.01
[INFO] [2021-05-31 03:29:27] Total Time: 1s
[INFO] [2021-05-31 03:29:27] Storing 2175 ScientificNames
[INFO] [2021-05-31 03:29:27] Processing group of 2175 in 3 groups of 1000
[INFO] [2021-05-31 03:29:28] Average Time: 0.203
[INFO] [2021-05-31 03:29:28] Total Time: 1s
[INFO] [2021-05-31 03:29:28] Storing 2175 Nodes
[INFO] [2021-05-31 03:29:28] Processing group of 2175 in 3 groups of 1000
[INFO] [2021-05-31 03:29:28] Average Time: 0.187
[INFO] [2021-05-31 03:29:28] Total Time: 1s
[INFO] [2021-05-31 03:29:28] Storing 4041 Occurrences
[INFO] [2021-05-31 03:29:28] Processing group of 4041 in 5 groups of 1000
[INFO] [2021-05-31 03:29:29] Average Time: 0.114
[INFO] [2021-05-31 03:29:29] Total Time: 1s
[INFO] [2021-05-31 03:29:29] Storing 3956 OccurrenceMetadata
[INFO] [2021-05-31 03:29:29] Processing group of 3956 in 4 groups of 1000
[INFO] [2021-05-31 03:29:29] Average Time: 0.11
[INFO] [2021-05-31 03:29:29] Total Time: 1s
[INFO] [2021-05-31 03:29:29] Storing 9338 Traits
[INFO] [2021-05-31 03:29:29] Processing group of 9338 in 10 groups of 1000
[INFO] [2021-05-31 03:29:32] Average Time: 0.276
[INFO] [2021-05-31 03:29:32] Total Time: 3s
[INFO] [2021-05-31 03:29:32] last 3 / first 3: 0.73
[INFO] [2021-05-31 03:29:32] Std.Dev: 0.06324555320336758; Max: 0.36
[INFO] [2021-05-31 03:29:32] Storing 31194 TraitsReferences
[INFO] [2021-05-31 03:29:32] Processing group of 31194 in 32 groups of 1000
[INFO] [2021-05-31 03:29:34] Average Time: 0.062
[INFO] [2021-05-31 03:29:34] Total Time: 3s
[INFO] [2021-05-31 03:29:34] last 3 / first 3: 0.72
[INFO] [2021-05-31 03:29:34] Std.Dev: 0.0; Max: 0.15
[INFO] [2021-05-31 03:29:34] Storing 15966 MetaTraits
[INFO] [2021-05-31 03:29:34] Processing group of 15966 in 16 groups of 1000
[INFO] [2021-05-31 03:29:36] Average Time: 0.12
[INFO] [2021-05-31 03:29:36] Total Time: 3s
[INFO] [2021-05-31 03:29:36] last 3 / first 3: 0.92
[INFO] [2021-05-31 03:29:36] Std.Dev: 0.03162277660168379; Max: 0.23
[STOP] [2021-05-31 03:29:36] parse_diff_and_store
[START] [2021-05-31 03:29:36] resolve_keys
[INFO] [2021-05-31 03:29:43] Occurrences to nodes (through scientific_names)...
[INFO] [2021-05-31 03:29:43] traits to occurrences...
[INFO] [2021-05-31 03:29:44] traits to nodes (through occurrences)...
[INFO] [2021-05-31 03:29:44] Traits to sex term...
[INFO] [2021-05-31 03:29:44] Traits to lifestage term...
[INFO] [2021-05-31 03:29:44] MetaTraits to traits...
[INFO] [2021-05-31 03:29:44] MetaTraits (simple, measurement row refers to parent) to traits...
[INFO] [2021-05-31 03:29:46] Assocs to occurrences...
[INFO] [2021-05-31 03:29:46] Assocs to nodes...
[INFO] [2021-05-31 03:29:46] Assoc to sex term...
[INFO] [2021-05-31 03:29:46] Assoc to lifestage term...
[INFO] [2021-05-31 03:29:46] MetaAssoc to assocs...
[STOP] [2021-05-31 03:29:46] resolve_keys
[START] [2021-05-31 03:29:46] hold_for_later_1
[STOP] [2021-05-31 03:29:46] hold_for_later_1
[START] [2021-05-31 03:29:46] hold_for_later_2
[STOP] [2021-05-31 03:29:46] hold_for_later_2
[START] [2021-05-31 03:29:46] resolve_missing_parents
[STOP] [2021-05-31 03:29:46] resolve_missing_parents
[START] [2021-05-31 03:29:46] rebuild_nodes
[START] [2021-05-31 03:29:46] Flattener#flatten
[START] [2021-05-31 03:29:46] Flattener#study_resource
[START] [2021-05-31 03:29:46] Flattener#build_ancestry
[STOP] [2021-05-31 03:29:46] Flattener#build_ancestry
[INFO] [2021-05-31 03:29:46] 2175 ancestry keys
[START] [2021-05-31 03:29:46] build_node_ancestors
[INFO] [2021-05-31 03:29:46] old ancestors deleted.
[STOP] [2021-05-31 03:29:46] build_node_ancestors
[START] [2021-05-31 03:29:46] Flattener#propagate_ancestor_ids
[STOP] [2021-05-31 03:29:47] Flattener#propagate_ancestor_ids
[STOP] [2021-05-31 03:29:47] Flattener#flatten
[STOP] [2021-05-31 03:29:47] rebuild_nodes
[START] [2021-05-31 03:29:47] resolve_missing_media_owners
[STOP] [2021-05-31 03:29:47] resolve_missing_media_owners
[START] [2021-05-31 03:29:47] sanitize_media_verbatims
[STOP] [2021-05-31 03:29:47] sanitize_media_verbatims
[START] [2021-05-31 03:29:47] queue_downloads
[STOP] [2021-05-31 03:29:47] queue_downloads
[START] [2021-05-31 03:29:47] parse_names
[WARN] [2021-05-31 03:29:47] I see 2175 names which still need to be parsed.
[WARN] [2021-05-31 03:29:49] I see 4 names which still need to be parsed.
[STOP] [2021-05-31 03:29:50] parse_names
[START] [2021-05-31 03:29:50] denormalize_canonical_names_to_nodes
[STOP] [2021-05-31 03:29:50] denormalize_canonical_names_to_nodes
[START] [2021-05-31 03:29:50] match_nodes
[START] [2021-05-31 03:29:50] map_all_nodes_to_pages
[STOP] [2021-05-31 03:30:16] map_all_nodes_to_pages
[INFO] [2021-05-31 03:30:16] 23 Unmatched nodes (of 2175)! That's too many to output. Full list in /app/public/data/morgan_ernest_mo/unmatched_nodes.txt ; First 10: Canonical: Abrocoma bennetti; Node#95080752; ResourceID: Abrocoma_bennetti; Canonical: Bolomys; Node#95080971; ResourceID: Bolomys; Canonical: Clethrionomys; Node#95081182; ResourceID: Clethrionomys; Canonical: Myomys; Node#95082037; ResourceID: Myomys; Canonical: Nannospalax; Node#95082068; ResourceID: Nannospalax; Canonical: Agouti; Node#95080776; ResourceID: Agouti; Canonical: Spermophilus nayaritensis; Node#95082659; ResourceID: Spermophilus_nayaritensis; Canonical: Aplodontidae; Node#95080859; ResourceID: Aplodontidae; Canonical: Myoxus; Node#95082053; ResourceID: Myoxus; Canonical: Hydrochaeridae; Node#95081634; ResourceID: Hydrochaeridae
[START] [2021-05-31 03:30:16] update_nodes
[STOP] [2021-05-31 03:30:17] update_nodes
[STOP] [2021-05-31 03:30:17] match_nodes
[START] [2021-05-31 03:30:17] reindex_search
[STOP] [2021-05-31 03:30:19] reindex_search
[START] [2021-05-31 03:30:19] normalize_units
[STOP] [2021-05-31 03:30:40] normalize_units
[START] [2021-05-31 03:30:40] calculate_statistics
[2021-05-31 03:30:40] (NEAR) DUPLICATE TRAITS FOUND! There are only 7978 (of 7983 total) unique traits.
[2021-05-31 03:31:28] (Near) duplicate trait pairs (up to 100):
[2021-05-31 03:31:28] (resource_pk: M_00118, id: 214623617), (resource_pk: M_03386, id: 214626865)
[2021-05-31 03:31:28] (resource_pk: M_04910, id: 214628389), (resource_pk: M_05914, id: 214629393)
[2021-05-31 03:31:28] (resource_pk: M_04948, id: 214628427), (resource_pk: M_05909, id: 214629388)
[2021-05-31 03:31:28] (resource_pk: M_05091, id: 214628570), (resource_pk: M_05634, id: 214629113)
[2021-05-31 03:31:28] (resource_pk: M_06504, id: 214629983), (resource_pk: M_06730, id: 214630209)
[STOP] [2021-05-31 03:31:28] calculate_statistics
[START] [2021-05-31 03:31:28] complete_harvest_instance
[START] [2021-05-31 03:31:28] overall_tsv_creation
[INFO] [2021-05-31 03:31:28] Processing group of 2175 in 1 batches of 10000
[INFO] [2021-05-31 03:32:09] 7983 Traits (unfiltered)...
[INFO] [2021-05-31 03:32:55] 7983 Traits (filtered)...
[INFO] [2021-05-31 03:32:55] 0 Associations (filtered)...
[INFO] [2021-05-31 03:32:58] 31194 metadata added.
[INFO] [2021-05-31 03:32:58] 0 metadata added.
[INFO] [2021-05-31 03:33:22] Average Time: 88.85
[INFO] [2021-05-31 03:33:22] Total Time: 1m55s
[STOP] [2021-05-31 03:33:22] overall_tsv_creation
[INFO] [2021-05-31 03:33:22] Done. Check your files:
[INFO] [2021-05-31 03:33:23] (2174 lines) /app/public/data/morgan_ernest_mo/publish_nodes.tsv
[INFO] [2021-05-31 03:33:23] (5655 lines) /app/public/data/morgan_ernest_mo/publish_node_ancestors.tsv
[INFO] [2021-05-31 03:33:23] (2175 lines) /app/public/data/morgan_ernest_mo/publish_scientific_names.tsv
[INFO] [2021-05-31 03:33:24] (7984 lines) /app/public/data/morgan_ernest_mo/publish_traits.tsv
[INFO] [2021-05-31 03:33:24] (31195 lines) /app/public/data/morgan_ernest_mo/publish_metadata.tsv
[STOP] [2021-05-31 03:33:24] complete_harvest_instance
[START] [2021-05-31 03:33:24] completed
[STOP] [2021-05-31 03:33:24] completed
[STOP] [2021-05-31 03:33:24] logged process, took 264.26

Latest Process