Harvest for Syracuse U and Siefert 2014 Created 31 May 13:45

Harvesting Log

[INFO] [2021-05-31 13:45:13] Created harvest instance #3920
[STOP] [2021-05-31 13:45:13] create_harvest_instance
[START] [2021-05-31 13:45:13] fetch_files
[STOP] [2021-05-31 13:45:13] fetch_files
[START] [2021-05-31 13:45:13] validate_each_file
[INFO] [2021-05-31 13:45:13] Looping over 8 formats...
[INFO] [2021-05-31 13:45:13] ...agents (/app/public/data/syracuse_syracus/agents.txt)
[INFO] [2021-05-31 13:45:13] Valid: /app/public/converted_csv/syracuse_syracus_agents_3920.csv (0 lines)
[INFO] [2021-05-31 13:45:13] ...refs (/app/public/data/syracuse_syracus/references.txt)
[INFO] [2021-05-31 13:45:13] Valid: /app/public/converted_csv/syracuse_syracus_refs_3920.csv (0 lines)
[INFO] [2021-05-31 13:45:13] ...nodes (/app/public/data/syracuse_syracus/taxa.txt)
[INFO] [2021-05-31 13:45:13] Valid: /app/public/converted_csv/syracuse_syracus_nodes_3920.csv (50 lines)
[INFO] [2021-05-31 13:45:13] ...media (/app/public/data/syracuse_syracus/media.txt)
[INFO] [2021-05-31 13:45:13] Valid: /app/public/converted_csv/syracuse_syracus_media_3920.csv (0 lines)
[INFO] [2021-05-31 13:45:13] ...vernaculars (/app/public/data/syracuse_syracus/common names.txt)
[INFO] [2021-05-31 13:45:13] Valid: /app/public/converted_csv/syracuse_syracus_vernaculars_3920.csv (0 lines)
[INFO] [2021-05-31 13:45:13] ...occurrences (/app/public/data/syracuse_syracus/occurrences.txt)
[INFO] [2021-05-31 13:45:13] Valid: /app/public/converted_csv/syracuse_syracus_occurrences_3920.csv (662 lines)
[INFO] [2021-05-31 13:45:13] ...assocs (/app/public/data/syracuse_syracus/associations.txt)
[INFO] [2021-05-31 13:45:13] Valid: /app/public/converted_csv/syracuse_syracus_assocs_3920.csv (0 lines)
[INFO] [2021-05-31 13:45:13] ...measurements (/app/public/data/syracuse_syracus/measurements or facts.txt)
[INFO] [2021-05-31 13:45:13] Valid: /app/public/converted_csv/syracuse_syracus_measurements_3920.csv (2643 lines)
[STOP] [2021-05-31 13:45:13] validate_each_file
[START] [2021-05-31 13:45:13] convert_to_csv
[INFO] [2021-05-31 13:45:13] Looping over 8 formats...
[INFO] [2021-05-31 13:45:13] ...agents (/app/public/data/syracuse_syracus/agents.txt)
[CMD] [2021-05-31 13:45:13] /usr/bin/sort /app/public/converted_csv/syracuse_syracus_agents_3920.csv > /app/public/converted_csv/syracuse_syracus_agents_3920.csv_sorted
[INFO] [2021-05-31 13:45:13] Converted: /app/public/converted_csv/syracuse_syracus_agents_3920.csv (0 lines)
[INFO] [2021-05-31 13:45:13] ...refs (/app/public/data/syracuse_syracus/references.txt)
[CMD] [2021-05-31 13:45:13] /usr/bin/sort /app/public/converted_csv/syracuse_syracus_refs_3920.csv > /app/public/converted_csv/syracuse_syracus_refs_3920.csv_sorted
[INFO] [2021-05-31 13:45:14] Converted: /app/public/converted_csv/syracuse_syracus_refs_3920.csv (0 lines)
[INFO] [2021-05-31 13:45:14] ...nodes (/app/public/data/syracuse_syracus/taxa.txt)
[CMD] [2021-05-31 13:45:14] /usr/bin/sort /app/public/converted_csv/syracuse_syracus_nodes_3920.csv > /app/public/converted_csv/syracuse_syracus_nodes_3920.csv_sorted
[INFO] [2021-05-31 13:45:14] Converted: /app/public/converted_csv/syracuse_syracus_nodes_3920.csv (50 lines)
[INFO] [2021-05-31 13:45:14] ...media (/app/public/data/syracuse_syracus/media.txt)
[CMD] [2021-05-31 13:45:14] /usr/bin/sort /app/public/converted_csv/syracuse_syracus_media_3920.csv > /app/public/converted_csv/syracuse_syracus_media_3920.csv_sorted
[INFO] [2021-05-31 13:45:15] Converted: /app/public/converted_csv/syracuse_syracus_media_3920.csv (0 lines)
[INFO] [2021-05-31 13:45:15] ...vernaculars (/app/public/data/syracuse_syracus/common names.txt)
[CMD] [2021-05-31 13:45:15] /usr/bin/sort /app/public/converted_csv/syracuse_syracus_vernaculars_3920.csv > /app/public/converted_csv/syracuse_syracus_vernaculars_3920.csv_sorted
[INFO] [2021-05-31 13:45:15] Converted: /app/public/converted_csv/syracuse_syracus_vernaculars_3920.csv (0 lines)
[INFO] [2021-05-31 13:45:15] ...occurrences (/app/public/data/syracuse_syracus/occurrences.txt)
[CMD] [2021-05-31 13:45:15] /usr/bin/sort /app/public/converted_csv/syracuse_syracus_occurrences_3920.csv > /app/public/converted_csv/syracuse_syracus_occurrences_3920.csv_sorted
[INFO] [2021-05-31 13:45:15] Converted: /app/public/converted_csv/syracuse_syracus_occurrences_3920.csv (662 lines)
[INFO] [2021-05-31 13:45:15] ...assocs (/app/public/data/syracuse_syracus/associations.txt)
[CMD] [2021-05-31 13:45:15] /usr/bin/sort /app/public/converted_csv/syracuse_syracus_assocs_3920.csv > /app/public/converted_csv/syracuse_syracus_assocs_3920.csv_sorted
[INFO] [2021-05-31 13:45:16] Converted: /app/public/converted_csv/syracuse_syracus_assocs_3920.csv (0 lines)
[INFO] [2021-05-31 13:45:16] ...measurements (/app/public/data/syracuse_syracus/measurements or facts.txt)
[CMD] [2021-05-31 13:45:16] /usr/bin/sort /app/public/converted_csv/syracuse_syracus_measurements_3920.csv > /app/public/converted_csv/syracuse_syracus_measurements_3920.csv_sorted
[INFO] [2021-05-31 13:45:16] Converted: /app/public/converted_csv/syracuse_syracus_measurements_3920.csv (2643 lines)
[STOP] [2021-05-31 13:45:16] convert_to_csv
[START] [2021-05-31 13:45:16] calculate_delta
[INFO] [2021-05-31 13:45:16] Looping over 8 formats...
[INFO] [2021-05-31 13:45:16] ...agents (/app/public/data/syracuse_syracus/agents.txt)
[CMD] [2021-05-31 13:45:16] echo "0a" > /app/public/diff/syracuse_syracus_agents_3920.diff
[CMD] [2021-05-31 13:45:17] tail -n +1 /app/public/converted_csv/syracuse_syracus_agents_3920.csv >> /app/public/diff/syracuse_syracus_agents_3920.diff
[CMD] [2021-05-31 13:45:17] echo "." >> /app/public/diff/syracuse_syracus_agents_3920.diff
[INFO] [2021-05-31 13:45:17] Created diff: /app/public/diff/syracuse_syracus_agents_3920.diff (2 lines)
[INFO] [2021-05-31 13:45:17] ...refs (/app/public/data/syracuse_syracus/references.txt)
[CMD] [2021-05-31 13:45:17] echo "0a" > /app/public/diff/syracuse_syracus_refs_3920.diff
[CMD] [2021-05-31 13:45:18] tail -n +1 /app/public/converted_csv/syracuse_syracus_refs_3920.csv >> /app/public/diff/syracuse_syracus_refs_3920.diff
[CMD] [2021-05-31 13:45:18] echo "." >> /app/public/diff/syracuse_syracus_refs_3920.diff
[INFO] [2021-05-31 13:45:19] Created diff: /app/public/diff/syracuse_syracus_refs_3920.diff (2 lines)
[INFO] [2021-05-31 13:45:19] ...nodes (/app/public/data/syracuse_syracus/taxa.txt)
[CMD] [2021-05-31 13:45:19] echo "0a" > /app/public/diff/syracuse_syracus_nodes_3920.diff
[CMD] [2021-05-31 13:45:19] tail -n +1 /app/public/converted_csv/syracuse_syracus_nodes_3920.csv >> /app/public/diff/syracuse_syracus_nodes_3920.diff
[CMD] [2021-05-31 13:45:19] echo "." >> /app/public/diff/syracuse_syracus_nodes_3920.diff
[INFO] [2021-05-31 13:45:20] Created diff: /app/public/diff/syracuse_syracus_nodes_3920.diff (52 lines)
[INFO] [2021-05-31 13:45:20] ...media (/app/public/data/syracuse_syracus/media.txt)
[CMD] [2021-05-31 13:45:20] echo "0a" > /app/public/diff/syracuse_syracus_media_3920.diff
[CMD] [2021-05-31 13:45:20] tail -n +1 /app/public/converted_csv/syracuse_syracus_media_3920.csv >> /app/public/diff/syracuse_syracus_media_3920.diff
[CMD] [2021-05-31 13:45:20] echo "." >> /app/public/diff/syracuse_syracus_media_3920.diff
[INFO] [2021-05-31 13:45:21] Created diff: /app/public/diff/syracuse_syracus_media_3920.diff (2 lines)
[INFO] [2021-05-31 13:45:21] ...vernaculars (/app/public/data/syracuse_syracus/common names.txt)
[CMD] [2021-05-31 13:45:21] echo "0a" > /app/public/diff/syracuse_syracus_vernaculars_3920.diff
[CMD] [2021-05-31 13:45:21] tail -n +1 /app/public/converted_csv/syracuse_syracus_vernaculars_3920.csv >> /app/public/diff/syracuse_syracus_vernaculars_3920.diff
[CMD] [2021-05-31 13:45:22] echo "." >> /app/public/diff/syracuse_syracus_vernaculars_3920.diff
[INFO] [2021-05-31 13:45:22] Created diff: /app/public/diff/syracuse_syracus_vernaculars_3920.diff (2 lines)
[INFO] [2021-05-31 13:45:22] ...occurrences (/app/public/data/syracuse_syracus/occurrences.txt)
[CMD] [2021-05-31 13:45:22] echo "0a" > /app/public/diff/syracuse_syracus_occurrences_3920.diff
[CMD] [2021-05-31 13:45:22] tail -n +1 /app/public/converted_csv/syracuse_syracus_occurrences_3920.csv >> /app/public/diff/syracuse_syracus_occurrences_3920.diff
[CMD] [2021-05-31 13:45:23] echo "." >> /app/public/diff/syracuse_syracus_occurrences_3920.diff
[INFO] [2021-05-31 13:45:23] Created diff: /app/public/diff/syracuse_syracus_occurrences_3920.diff (664 lines)
[INFO] [2021-05-31 13:45:23] ...assocs (/app/public/data/syracuse_syracus/associations.txt)
[CMD] [2021-05-31 13:45:23] echo "0a" > /app/public/diff/syracuse_syracus_assocs_3920.diff
[CMD] [2021-05-31 13:45:24] tail -n +1 /app/public/converted_csv/syracuse_syracus_assocs_3920.csv >> /app/public/diff/syracuse_syracus_assocs_3920.diff
[CMD] [2021-05-31 13:45:24] echo "." >> /app/public/diff/syracuse_syracus_assocs_3920.diff
[INFO] [2021-05-31 13:45:24] Created diff: /app/public/diff/syracuse_syracus_assocs_3920.diff (2 lines)
[INFO] [2021-05-31 13:45:24] ...measurements (/app/public/data/syracuse_syracus/measurements or facts.txt)
[CMD] [2021-05-31 13:45:24] echo "0a" > /app/public/diff/syracuse_syracus_measurements_3920.diff
[CMD] [2021-05-31 13:45:25] tail -n +1 /app/public/converted_csv/syracuse_syracus_measurements_3920.csv >> /app/public/diff/syracuse_syracus_measurements_3920.diff
[CMD] [2021-05-31 13:45:25] echo "." >> /app/public/diff/syracuse_syracus_measurements_3920.diff
[INFO] [2021-05-31 13:45:26] Created diff: /app/public/diff/syracuse_syracus_measurements_3920.diff (2645 lines)
[STOP] [2021-05-31 13:45:26] calculate_delta
[START] [2021-05-31 13:45:26] parse_diff_and_store
[INFO] [2021-05-31 13:45:26] Handling diff: /app/public/diff/syracuse_syracus_agents_3920.diff (2 lines)
[INFO] [2021-05-31 13:45:26] Loading agents diff file into memory (2 /app/public/diff/syracuse_syracus_agents_3920.diff lines)...
[INFO] [2021-05-31 13:45:26] Handling diff: /app/public/diff/syracuse_syracus_refs_3920.diff (2 lines)
[INFO] [2021-05-31 13:45:27] Loading refs diff file into memory (2 /app/public/diff/syracuse_syracus_refs_3920.diff lines)...
[INFO] [2021-05-31 13:45:27] Handling diff: /app/public/diff/syracuse_syracus_nodes_3920.diff (52 lines)
[INFO] [2021-05-31 13:45:28] Loading nodes diff file into memory (52 /app/public/diff/syracuse_syracus_nodes_3920.diff lines)...
[INFO] [2021-05-31 13:45:28] Handling diff: /app/public/diff/syracuse_syracus_media_3920.diff (2 lines)
[INFO] [2021-05-31 13:45:28] Loading media diff file into memory (2 /app/public/diff/syracuse_syracus_media_3920.diff lines)...
[INFO] [2021-05-31 13:45:29] Handling diff: /app/public/diff/syracuse_syracus_vernaculars_3920.diff (2 lines)
[INFO] [2021-05-31 13:45:29] Loading vernaculars diff file into memory (2 /app/public/diff/syracuse_syracus_vernaculars_3920.diff lines)...
[INFO] [2021-05-31 13:45:29] Handling diff: /app/public/diff/syracuse_syracus_occurrences_3920.diff (664 lines)
[INFO] [2021-05-31 13:45:30] Loading occurrences diff file into memory (664 /app/public/diff/syracuse_syracus_occurrences_3920.diff lines)...
[INFO] [2021-05-31 13:45:31] Handling diff: /app/public/diff/syracuse_syracus_assocs_3920.diff (2 lines)
[INFO] [2021-05-31 13:45:31] Loading assocs diff file into memory (2 /app/public/diff/syracuse_syracus_assocs_3920.diff lines)...
[INFO] [2021-05-31 13:45:31] Handling diff: /app/public/diff/syracuse_syracus_measurements_3920.diff (2645 lines)
[INFO] [2021-05-31 13:45:32] Loading measurements diff file into memory (2645 /app/public/diff/syracuse_syracus_measurements_3920.diff lines)...
[INFO] [2021-05-31 13:45:34] Storing 91 ScientificNames
[INFO] [2021-05-31 13:45:34] Processing group of 91 in 1 groups of 1000
[INFO] [2021-05-31 13:45:34] Average Time: 0.03
[INFO] [2021-05-31 13:45:34] Total Time: 1s
[INFO] [2021-05-31 13:45:34] Storing 91 Nodes
[INFO] [2021-05-31 13:45:34] Processing group of 91 in 1 groups of 1000
[INFO] [2021-05-31 13:45:34] Average Time: 0.02
[INFO] [2021-05-31 13:45:34] Total Time: 1s
[INFO] [2021-05-31 13:45:34] Storing 662 Occurrences
[INFO] [2021-05-31 13:45:34] Processing group of 662 in 1 groups of 1000
[INFO] [2021-05-31 13:45:34] Average Time: 0.07
[INFO] [2021-05-31 13:45:34] Total Time: 1s
[INFO] [2021-05-31 13:45:34] Storing 2648 OccurrenceMetadata
[INFO] [2021-05-31 13:45:34] Processing group of 2648 in 3 groups of 1000
[INFO] [2021-05-31 13:45:35] Average Time: 0.097
[INFO] [2021-05-31 13:45:35] Total Time: 1s
[INFO] [2021-05-31 13:45:35] Storing 2643 Traits
[INFO] [2021-05-31 13:45:35] Processing group of 2643 in 3 groups of 1000
[INFO] [2021-05-31 13:45:35] Average Time: 0.247
[INFO] [2021-05-31 13:45:35] Total Time: 1s
[INFO] [2021-05-31 13:45:35] Storing 9520 MetaTraits
[INFO] [2021-05-31 13:45:35] Processing group of 9520 in 10 groups of 1000
[INFO] [2021-05-31 13:45:37] Average Time: 0.112
[INFO] [2021-05-31 13:45:37] Total Time: 2s
[INFO] [2021-05-31 13:45:37] last 3 / first 3: 0.7
[INFO] [2021-05-31 13:45:37] Std.Dev: 0.03162277660168379; Max: 0.18
[STOP] [2021-05-31 13:45:37] parse_diff_and_store
[START] [2021-05-31 13:45:37] resolve_keys
[INFO] [2021-05-31 13:45:43] Occurrences to nodes (through scientific_names)...
[INFO] [2021-05-31 13:45:43] traits to occurrences...
[INFO] [2021-05-31 13:45:43] traits to nodes (through occurrences)...
[INFO] [2021-05-31 13:45:43] Traits to sex term...
[INFO] [2021-05-31 13:45:43] Traits to lifestage term...
[INFO] [2021-05-31 13:45:43] MetaTraits to traits...
[INFO] [2021-05-31 13:45:43] MetaTraits (simple, measurement row refers to parent) to traits...
[INFO] [2021-05-31 13:45:43] Assocs to occurrences...
[INFO] [2021-05-31 13:45:43] Assocs to nodes...
[INFO] [2021-05-31 13:45:43] Assoc to sex term...
[INFO] [2021-05-31 13:45:43] Assoc to lifestage term...
[INFO] [2021-05-31 13:45:43] MetaAssoc to assocs...
[STOP] [2021-05-31 13:45:43] resolve_keys
[START] [2021-05-31 13:45:43] hold_for_later_1
[STOP] [2021-05-31 13:45:43] hold_for_later_1
[START] [2021-05-31 13:45:43] hold_for_later_2
[STOP] [2021-05-31 13:45:43] hold_for_later_2
[START] [2021-05-31 13:45:43] resolve_missing_parents
[STOP] [2021-05-31 13:45:43] resolve_missing_parents
[START] [2021-05-31 13:45:43] rebuild_nodes
[START] [2021-05-31 13:45:43] Flattener#flatten
[START] [2021-05-31 13:45:43] Flattener#study_resource
[START] [2021-05-31 13:45:43] Flattener#build_ancestry
[STOP] [2021-05-31 13:45:43] Flattener#build_ancestry
[INFO] [2021-05-31 13:45:43] 91 ancestry keys
[START] [2021-05-31 13:45:43] build_node_ancestors
[INFO] [2021-05-31 13:45:43] old ancestors deleted.
[STOP] [2021-05-31 13:45:43] build_node_ancestors
[START] [2021-05-31 13:45:43] Flattener#propagate_ancestor_ids
[STOP] [2021-05-31 13:45:43] Flattener#propagate_ancestor_ids
[STOP] [2021-05-31 13:45:43] Flattener#flatten
[STOP] [2021-05-31 13:45:43] rebuild_nodes
[START] [2021-05-31 13:45:43] resolve_missing_media_owners
[STOP] [2021-05-31 13:45:43] resolve_missing_media_owners
[START] [2021-05-31 13:45:43] sanitize_media_verbatims
[STOP] [2021-05-31 13:45:43] sanitize_media_verbatims
[START] [2021-05-31 13:45:43] queue_downloads
[STOP] [2021-05-31 13:45:43] queue_downloads
[START] [2021-05-31 13:45:43] parse_names
[WARN] [2021-05-31 13:45:43] I see 91 names which still need to be parsed.
[STOP] [2021-05-31 13:45:45] parse_names
[START] [2021-05-31 13:45:45] denormalize_canonical_names_to_nodes
[STOP] [2021-05-31 13:45:45] denormalize_canonical_names_to_nodes
[START] [2021-05-31 13:45:45] match_nodes
[START] [2021-05-31 13:45:45] map_all_nodes_to_pages
[STOP] [2021-05-31 13:45:46] map_all_nodes_to_pages
[INFO] [2021-05-31 13:45:46] Unmatched nodes (4 of 91): Canonical: Dichanthelium; Node#95099570; ResourceID: Dichanthelium ; Canonical: Helianthemum rosmarinifolium; Node#95099588; ResourceID: Helianthemum_rosmarinifolium; Canonical: Prunella; Node#95099607; ResourceID: Prunella ; Canonical: Schedonorus; Node#95099611; ResourceID: Schedonorus 
[START] [2021-05-31 13:45:46] update_nodes
[STOP] [2021-05-31 13:45:46] update_nodes
[STOP] [2021-05-31 13:45:46] match_nodes
[START] [2021-05-31 13:45:46] reindex_search
[STOP] [2021-05-31 13:45:46] reindex_search
[START] [2021-05-31 13:45:46] normalize_units
[STOP] [2021-05-31 13:45:55] normalize_units
[START] [2021-05-31 13:45:55] calculate_statistics
[2021-05-31 13:45:55] (NEAR) DUPLICATE TRAITS FOUND! There are only 2064 (of 2643 total) unique traits.
[2021-05-31 13:45:56] (Near) duplicate trait pairs (up to 100):
[2021-05-31 13:45:56] (resource_pk: M_0001, id: 214749212), (resource_pk: M_0145, id: 214749356)
[2021-05-31 13:45:56] (resource_pk: M_0001, id: 214749212), (resource_pk: M_0376, id: 214749587)
[2021-05-31 13:45:56] (resource_pk: M_0002, id: 214749213), (resource_pk: M_0018, id: 214749229)
[2021-05-31 13:45:56] (resource_pk: M_0003, id: 214749214), (resource_pk: M_0318, id: 214749529)
[2021-05-31 13:45:56] (resource_pk: M_0005, id: 214749216), (resource_pk: M_0097, id: 214749308)
[2021-05-31 13:45:56] (resource_pk: M_0005, id: 214749216), (resource_pk: M_0193, id: 214749404)
[2021-05-31 13:45:56] (resource_pk: M_0005, id: 214749216), (resource_pk: M_0332, id: 214749543)
[2021-05-31 13:45:56] (resource_pk: M_0006, id: 214749217), (resource_pk: M_0114, id: 214749325)
[2021-05-31 13:45:56] (resource_pk: M_0006, id: 214749217), (resource_pk: M_0158, id: 214749369)
[2021-05-31 13:45:56] (resource_pk: M_0006, id: 214749217), (resource_pk: M_0317, id: 214749528)
[2021-05-31 13:45:56] (resource_pk: M_0009, id: 214749220), (resource_pk: M_0177, id: 214749388)
[2021-05-31 13:45:56] (resource_pk: M_0010, id: 214749221), (resource_pk: M_0202, id: 214749413)
[2021-05-31 13:45:56] (resource_pk: M_0010, id: 214749221), (resource_pk: M_0377, id: 214749588)
[2021-05-31 13:45:56] (resource_pk: M_0013, id: 214749224), (resource_pk: M_0117, id: 214749328)
[2021-05-31 13:45:56] (resource_pk: M_0013, id: 214749224), (resource_pk: M_0129, id: 214749340)
[2021-05-31 13:45:56] (resource_pk: M_0013, id: 214749224), (resource_pk: M_0253, id: 214749464)
[2021-05-31 13:45:56] (resource_pk: M_0013, id: 214749224), (resource_pk: M_0281, id: 214749492)
[2021-05-31 13:45:56] (resource_pk: M_0013, id: 214749224), (resource_pk: M_0289, id: 214749500)
[2021-05-31 13:45:56] (resource_pk: M_0013, id: 214749224), (resource_pk: M_0388, id: 214749599)
[2021-05-31 13:45:56] (resource_pk: M_0014, id: 214749225), (resource_pk: M_0050, id: 214749261)
[2021-05-31 13:45:56] (resource_pk: M_0017, id: 214749228), (resource_pk: M_0109, id: 214749320)
[2021-05-31 13:45:56] (resource_pk: M_0017, id: 214749228), (resource_pk: M_0137, id: 214749348)
[2021-05-31 13:45:56] (resource_pk: M_0019, id: 214749230), (resource_pk: M_0091, id: 214749302)
[2021-05-31 13:45:56] (resource_pk: M_0019, id: 214749230), (resource_pk: M_0175, id: 214749386)
[2021-05-31 13:45:56] (resource_pk: M_0019, id: 214749230), (resource_pk: M_0378, id: 214749589)
[2021-05-31 13:45:56] (resource_pk: M_0022, id: 214749233), (resource_pk: M_0210, id: 214749421)
[2021-05-31 13:45:56] (resource_pk: M_0022, id: 214749233), (resource_pk: M_0345, id: 214749556)
[2021-05-31 13:45:56] (resource_pk: M_0023, id: 214749234), (resource_pk: M_0063, id: 214749274)
[2021-05-31 13:45:56] (resource_pk: M_0025, id: 214749236), (resource_pk: M_0029, id: 214749240)
[2021-05-31 13:45:56] (resource_pk: M_0027, id: 214749238), (resource_pk: M_0031, id: 214749242)
[2021-05-31 13:45:56] (resource_pk: M_0030, id: 214749241), (resource_pk: M_0066, id: 214749277)
[2021-05-31 13:45:56] (resource_pk: M_0033, id: 214749244), (resource_pk: M_0077, id: 214749288)
[2021-05-31 13:45:56] (resource_pk: M_0033, id: 214749244), (resource_pk: M_0161, id: 214749372)
[2021-05-31 13:45:56] (resource_pk: M_0033, id: 214749244), (resource_pk: M_0165, id: 214749376)
[2021-05-31 13:45:56] (resource_pk: M_0033, id: 214749244), (resource_pk: M_0368, id: 214749579)
[2021-05-31 13:45:56] (resource_pk: M_0034, id: 214749245), (resource_pk: M_0353, id: 214749564)
[2021-05-31 13:45:56] (resource_pk: M_0037, id: 214749248), (resource_pk: M_0304, id: 214749515)
[2021-05-31 13:45:56] (resource_pk: M_0041, id: 214749252), (resource_pk: M_0169, id: 214749380)
[2021-05-31 13:45:56] (resource_pk: M_0045, id: 214749256), (resource_pk: M_0278, id: 214749489)
[2021-05-31 13:45:56] (resource_pk: M_0045, id: 214749256), (resource_pk: M_0285, id: 214749496)
[2021-05-31 13:45:56] (resource_pk: M_0047, id: 214749258), (resource_pk: M_0171, id: 214749382)
[2021-05-31 13:45:56] (resource_pk: M_0047, id: 214749258), (resource_pk: M_0231, id: 214749442)
[2021-05-31 13:45:56] (resource_pk: M_0047, id: 214749258), (resource_pk: M_0370, id: 214749581)
[2021-05-31 13:45:56] (resource_pk: M_0049, id: 214749260), (resource_pk: M_0157, id: 214749368)
[2021-05-31 13:45:56] (resource_pk: M_0049, id: 214749260), (resource_pk: M_0296, id: 214749507)
[2021-05-31 13:45:56] (resource_pk: M_0053, id: 214749264), (resource_pk: M_0057, id: 214749268)
[2021-05-31 13:45:56] (resource_pk: M_0053, id: 214749264), (resource_pk: M_0197, id: 214749408)
[2021-05-31 13:45:56] (resource_pk: M_0054, id: 214749265), (resource_pk: M_0214, id: 214749425)
[2021-05-31 13:45:56] (resource_pk: M_0054, id: 214749265), (resource_pk: M_0349, id: 214749560)
[2021-05-31 13:45:56] (resource_pk: M_0057, id: 214749268), (resource_pk: M_0197, id: 214749408)
[2021-05-31 13:45:56] (resource_pk: M_0065, id: 214749276), (resource_pk: M_0201, id: 214749412)
[2021-05-31 13:45:56] (resource_pk: M_0065, id: 214749276), (resource_pk: M_0209, id: 214749420)
[2021-05-31 13:45:56] (resource_pk: M_0065, id: 214749276), (resource_pk: M_0229, id: 214749440)
[2021-05-31 13:45:56] (resource_pk: M_0065, id: 214749276), (resource_pk: M_0261, id: 214749472)
[2021-05-31 13:45:56] (resource_pk: M_0073, id: 214749284), (resource_pk: M_0121, id: 214749332)
[2021-05-31 13:45:56] (resource_pk: M_0073, id: 214749284), (resource_pk: M_0153, id: 214749364)
[2021-05-31 13:45:56] (resource_pk: M_0075, id: 214749286), (resource_pk: M_0107, id: 214749318)
[2021-05-31 13:45:56] (resource_pk: M_0075, id: 214749286), (resource_pk: M_0155, id: 214749366)
[2021-05-31 13:45:56] (resource_pk: M_0075, id: 214749286), (resource_pk: M_0187, id: 214749398)
[2021-05-31 13:45:56] (resource_pk: M_0075, id: 214749286), (resource_pk: M_0255, id: 214749466)
[2021-05-31 13:45:56] (resource_pk: M_0075, id: 214749286), (resource_pk: M_0259, id: 214749470)
[2021-05-31 13:45:56] (resource_pk: M_0077, id: 214749288), (resource_pk: M_0161, id: 214749372)
[2021-05-31 13:45:56] (resource_pk: M_0077, id: 214749288), (resource_pk: M_0165, id: 214749376)
[2021-05-31 13:45:56] (resource_pk: M_0077, id: 214749288), (resource_pk: M_0368, id: 214749579)
[2021-05-31 13:45:56] (resource_pk: M_0079, id: 214749290), (resource_pk: M_0111, id: 214749322)
[2021-05-31 13:45:56] (resource_pk: M_0081, id: 214749292), (resource_pk: M_0217, id: 214749428)
[2021-05-31 13:45:56] (resource_pk: M_0083, id: 214749294), (resource_pk: M_0087, id: 214749298)
[2021-05-31 13:45:56] (resource_pk: M_0083, id: 214749294), (resource_pk: M_0326, id: 214749537)
[2021-05-31 13:45:56] (resource_pk: M_0085, id: 214749296), (resource_pk: M_0181, id: 214749392)
[2021-05-31 13:45:56] (resource_pk: M_0085, id: 214749296), (resource_pk: M_0225, id: 214749436)
[2021-05-31 13:45:56] (resource_pk: M_0086, id: 214749297), (resource_pk: M_0321, id: 214749532)
[2021-05-31 13:45:56] (resource_pk: M_0087, id: 214749298), (resource_pk: M_0326, id: 214749537)
[2021-05-31 13:45:56] (resource_pk: M_0089, id: 214749300), (resource_pk: M_0113, id: 214749324)
[2021-05-31 13:45:56] (resource_pk: M_0089, id: 214749300), (resource_pk: M_0189, id: 214749400)
[2021-05-31 13:45:56] (resource_pk: M_0089, id: 214749300), (resource_pk: M_0205, id: 214749416)
[2021-05-31 13:45:56] (resource_pk: M_0090, id: 214749301), (resource_pk: M_0361, id: 214749572)
[2021-05-31 13:45:56] (resource_pk: M_0091, id: 214749302), (resource_pk: M_0175, id: 214749386)
[2021-05-31 13:45:56] (resource_pk: M_0091, id: 214749302), (resource_pk: M_0378, id: 214749589)
[2021-05-31 13:45:56] (resource_pk: M_0094, id: 214749305), (resource_pk: M_0385, id: 214749596)
[2021-05-31 13:45:56] (resource_pk: M_0097, id: 214749308), (resource_pk: M_0193, id: 214749404)
[2021-05-31 13:45:56] (resource_pk: M_0097, id: 214749308), (resource_pk: M_0332, id: 214749543)
[2021-05-31 13:45:56] (resource_pk: M_0099, id: 214749310), (resource_pk: M_0211, id: 214749422)
[2021-05-31 13:45:56] (resource_pk: M_0102, id: 214749313), (resource_pk: M_0206, id: 214749417)
[2021-05-31 13:45:56] (resource_pk: M_0105, id: 214749316), (resource_pk: M_0360, id: 214749571)
[2021-05-31 13:45:56] (resource_pk: M_0106, id: 214749317), (resource_pk: M_0226, id: 214749437)
[2021-05-31 13:45:56] (resource_pk: M_0107, id: 214749318), (resource_pk: M_0155, id: 214749366)
[2021-05-31 13:45:56] (resource_pk: M_0107, id: 214749318), (resource_pk: M_0187, id: 214749398)
[2021-05-31 13:45:56] (resource_pk: M_0107, id: 214749318), (resource_pk: M_0255, id: 214749466)
[2021-05-31 13:45:56] (resource_pk: M_0107, id: 214749318), (resource_pk: M_0259, id: 214749470)
[2021-05-31 13:45:56] (resource_pk: M_0109, id: 214749320), (resource_pk: M_0137, id: 214749348)
[2021-05-31 13:45:56] (resource_pk: M_0110, id: 214749321), (resource_pk: M_0337, id: 214749548)
[2021-05-31 13:45:56] (resource_pk: M_0113, id: 214749324), (resource_pk: M_0189, id: 214749400)
[2021-05-31 13:45:56] (resource_pk: M_0113, id: 214749324), (resource_pk: M_0205, id: 214749416)
[2021-05-31 13:45:56] (resource_pk: M_0114, id: 214749325), (resource_pk: M_0158, id: 214749369)
[2021-05-31 13:45:56] (resource_pk: M_0114, id: 214749325), (resource_pk: M_0317, id: 214749528)
[2021-05-31 13:45:56] (resource_pk: M_0115, id: 214749326), (resource_pk: M_0263, id: 214749474)
[2021-05-31 13:45:56] (resource_pk: M_0115, id: 214749326), (resource_pk: M_0362, id: 214749573)
[2021-05-31 13:45:56] (resource_pk: M_0115, id: 214749326), (resource_pk: M_0366, id: 214749577)
[2021-05-31 13:45:56] (resource_pk: M_0117, id: 214749328), (resource_pk: M_0129, id: 214749340)
[2021-05-31 13:45:56] (resource_pk: M_0117, id: 214749328), (resource_pk: M_0253, id: 214749464)
[STOP] [2021-05-31 13:45:56] calculate_statistics
[START] [2021-05-31 13:45:56] complete_harvest_instance
[START] [2021-05-31 13:45:56] overall_tsv_creation
[INFO] [2021-05-31 13:45:56] Processing group of 91 in 1 batches of 10000
[INFO] [2021-05-31 13:46:29] 2252 Traits (unfiltered)...
[INFO] [2021-05-31 13:46:59] 2252 Traits (filtered)...
[INFO] [2021-05-31 13:46:59] 0 Associations (filtered)...
[INFO] [2021-05-31 13:47:00] 12949 metadata added.
[INFO] [2021-05-31 13:47:00] 0 metadata added.
[INFO] [2021-05-31 13:47:23] Average Time: 64.82
[INFO] [2021-05-31 13:47:23] Total Time: 1m27s
[STOP] [2021-05-31 13:47:23] overall_tsv_creation
[INFO] [2021-05-31 13:47:23] Done. Check your files:
[INFO] [2021-05-31 13:47:23] (91 lines) /app/public/data/syracuse_syracus/publish_nodes.tsv
[INFO] [2021-05-31 13:47:23] (140 lines) /app/public/data/syracuse_syracus/publish_node_ancestors.tsv
[INFO] [2021-05-31 13:47:24] (91 lines) /app/public/data/syracuse_syracus/publish_scientific_names.tsv
[INFO] [2021-05-31 13:47:24] (2253 lines) /app/public/data/syracuse_syracus/publish_traits.tsv
[INFO] [2021-05-31 13:47:25] (12950 lines) /app/public/data/syracuse_syracus/publish_metadata.tsv
[STOP] [2021-05-31 13:47:25] complete_harvest_instance
[START] [2021-05-31 13:47:25] completed
[STOP] [2021-05-31 13:47:25] completed
[STOP] [2021-05-31 13:47:25] logged process, took 132.56

Latest Process

31 May 13:45 EXITED currently processing 0