Harvest for Queirós et al 2013 Created 28 Jul 16:16

Stage: completed
Fetched: 28 Jul 16:16
Validated: 28 Jul 16:16
Deltas Created 28 Jul 16:16
Units Normalized: 28 Jul 16:17
Ancestry Built: 28 Jul 16:16
Nodes Matched: 28 Jul 16:17
Names Parsed: 28 Jul 16:16
New Models Stored: 28 Jul 16:16
Indexed: 28 Jul 16:17
Completed: 28 Jul 16:19
Time to Harvest: less than a minute

Harvesting Log

(315 lines)
# Logfile created on 2020-03-16 10:44:23 -0400 by logger.rb/56815
[INFO] [2020-03-16 10:44:23] ## HARVEST: type = -harvest
[START] [2020-03-16 10:44:28] logged process
[START] [2020-03-16 10:44:28] create_harvest_instance
[STOP] [2020-03-16 10:44:28] create_harvest_instance
[START] [2020-03-16 10:44:28] fetch_files
[STOP] [2020-03-16 10:44:28] fetch_files
[START] [2020-03-16 10:44:28] validate_each_file
[STOP] [2020-03-16 10:44:28] validate_each_file
[START] [2020-03-16 10:44:28] convert_to_csv
[CMD] [2020-03-16 10:44:28] /usr/bin/sort /app/public/converted_csv/qseaq_nodes_20375.csv > /app/public/converted_csv/qseaq_nodes_20375.csv_sorted
[CMD] [2020-03-16 10:44:29] /usr/bin/sort /app/public/converted_csv/qseaq_occurrences_20376.csv > /app/public/converted_csv/qseaq_occurrences_20376.csv_sorted
[CMD] [2020-03-16 10:44:29] /usr/bin/sort /app/public/converted_csv/qseaq_measurements_20377.csv > /app/public/converted_csv/qseaq_measurements_20377.csv_sorted
[STOP] [2020-03-16 10:44:30] convert_to_csv
[START] [2020-03-16 10:44:30] calculate_delta
[CMD] [2020-03-16 10:44:30] echo "0a" > /app/public/diff/qseaq_nodes_20375.diff
[CMD] [2020-03-16 10:44:31] tail -n +1 /app/public/converted_csv/qseaq_nodes_20375.csv >> /app/public/diff/qseaq_nodes_20375.diff
[CMD] [2020-03-16 10:44:31] echo "." >> /app/public/diff/qseaq_nodes_20375.diff
[CMD] [2020-03-16 10:44:32] echo "0a" > /app/public/diff/qseaq_occurrences_20376.diff
[CMD] [2020-03-16 10:44:32] tail -n +1 /app/public/converted_csv/qseaq_occurrences_20376.csv >> /app/public/diff/qseaq_occurrences_20376.diff
[CMD] [2020-03-16 10:44:33] echo "." >> /app/public/diff/qseaq_occurrences_20376.diff
[CMD] [2020-03-16 10:44:33] echo "0a" > /app/public/diff/qseaq_measurements_20377.diff
[CMD] [2020-03-16 10:44:34] tail -n +1 /app/public/converted_csv/qseaq_measurements_20377.csv >> /app/public/diff/qseaq_measurements_20377.diff
[CMD] [2020-03-16 10:44:34] echo "." >> /app/public/diff/qseaq_measurements_20377.diff
[STOP] [2020-03-16 10:44:35] calculate_delta
[START] [2020-03-16 10:44:35] parse_diff_and_store
[INFO] [2020-03-16 10:44:35] Loading nodes diff file into memory (true lines)...
[INFO] [2020-03-16 10:44:36] Loading occurrences diff file into memory (true lines)...
[INFO] [2020-03-16 10:44:37] Loading measurements diff file into memory (true lines)...
[INFO] [2020-03-16 10:44:43] Storing 773 ScientificNames
[INFO] [2020-03-16 10:44:43] Processing group of 773 in 1 groups of 1000
[INFO] [2020-03-16 10:44:43] Average Time: 0.45
[INFO] [2020-03-16 10:44:43] Total Time: 1s
[INFO] [2020-03-16 10:44:43] Storing 773 Nodes
[INFO] [2020-03-16 10:44:43] Processing group of 773 in 1 groups of 1000
[INFO] [2020-03-16 10:44:43] Average Time: 0.34
[INFO] [2020-03-16 10:44:43] Total Time: 1s
[INFO] [2020-03-16 10:44:43] Storing 450 Occurrences
[INFO] [2020-03-16 10:44:43] Processing group of 450 in 1 groups of 1000
[INFO] [2020-03-16 10:44:44] Average Time: 0.35
[INFO] [2020-03-16 10:44:44] Total Time: 1s
[INFO] [2020-03-16 10:44:44] Storing 1195 Traits
[INFO] [2020-03-16 10:44:44] Processing group of 1195 in 2 groups of 1000
[INFO] [2020-03-16 10:44:45] Average Time: 0.445
[INFO] [2020-03-16 10:44:45] Total Time: 1s
[INFO] [2020-03-16 10:44:45] Storing 2622 MetaTraits
[INFO] [2020-03-16 10:44:45] Processing group of 2622 in 3 groups of 1000
[INFO] [2020-03-16 10:44:45] Average Time: 0.147
[INFO] [2020-03-16 10:44:45] Total Time: 1s
[STOP] [2020-03-16 10:44:45] parse_diff_and_store
[START] [2020-03-16 10:44:45] resolve_keys
[INFO] [2020-03-16 10:44:52] Occurrences to nodes (through scientific_names)...
[INFO] [2020-03-16 10:44:52] traits to occurrences...
[INFO] [2020-03-16 10:44:52] traits to nodes (through occurrences)...
[INFO] [2020-03-16 10:44:52] Traits to sex term...
[INFO] [2020-03-16 10:44:52] Traits to lifestage term...
[INFO] [2020-03-16 10:44:52] MetaTraits to traits...
[INFO] [2020-03-16 10:44:52] MetaTraits (simple, measurement row refers to parent) to traits...
[INFO] [2020-03-16 10:44:53] Assocs to occurrences...
[INFO] [2020-03-16 10:44:53] Assocs to nodes...
[INFO] [2020-03-16 10:44:53] Assoc to sex term...
[INFO] [2020-03-16 10:44:53] Assoc to lifestage term...
[STOP] [2020-03-16 10:44:53] resolve_keys
[START] [2020-03-16 10:44:53] hold_for_later_1
[STOP] [2020-03-16 10:44:53] hold_for_later_1
[START] [2020-03-16 10:44:53] hold_for_later_2
[STOP] [2020-03-16 10:44:53] hold_for_later_2
[START] [2020-03-16 10:44:53] resolve_missing_parents
[STOP] [2020-03-16 10:44:53] resolve_missing_parents
[START] [2020-03-16 10:44:53] rebuild_nodes
[START] [2020-03-16 10:44:53] Flattener#flatten
[START] [2020-03-16 10:44:53] Flattener#study_resource
[START] [2020-03-16 10:44:53] Flattener#build_ancestry
[STOP] [2020-03-16 10:44:53] Flattener#build_ancestry
[INFO] [2020-03-16 10:44:53] 773 ancestry keys
[START] [2020-03-16 10:44:53] build_node_ancestors
[INFO] [2020-03-16 10:44:53] old ancestors deleted.
[STOP] [2020-03-16 10:44:53] build_node_ancestors
[START] [2020-03-16 10:44:53] Flattener#propagate_ancestor_ids
[STOP] [2020-03-16 10:44:53] Flattener#propagate_ancestor_ids
[STOP] [2020-03-16 10:44:53] Flattener#flatten
[STOP] [2020-03-16 10:44:53] rebuild_nodes
[START] [2020-03-16 10:44:53] resolve_missing_media_owners
[STOP] [2020-03-16 10:44:53] resolve_missing_media_owners
[START] [2020-03-16 10:44:53] sanitize_media_verbatims
[STOP] [2020-03-16 10:44:53] sanitize_media_verbatims
[START] [2020-03-16 10:44:53] queue_downloads
[STOP] [2020-03-16 10:44:53] queue_downloads
[START] [2020-03-16 10:44:53] parse_names
[WARN] [2020-03-16 10:44:53] I see 773 names which still need to be parsed.
[WARN] [2020-03-16 10:44:55] I see 58 names which still need to be parsed.
[STOP] [2020-03-16 10:44:56] parse_names
[START] [2020-03-16 10:44:56] denormalize_canonical_names_to_nodes
[STOP] [2020-03-16 10:44:56] denormalize_canonical_names_to_nodes
[START] [2020-03-16 10:44:56] match_nodes
[START] [2020-03-16 10:44:56] map_all_nodes_to_pages
[STOP] [2020-03-16 10:46:13] map_all_nodes_to_pages
[INFO] [2020-03-16 10:46:13] 34 Unmatched nodes (of 773)! That's too many to output. First 10: Tellina nitida (#67167920); Montacutidae (#67167437); Turtoniidae (#67167948); Pectinoida (#67167264); Carditoida (#67167295); Lucinoida (#67167334); Anomalodesmata (#67167402); Myoida (#67167406); Mytiloida (#67167418); [unassigned] Euheterodonta (#67167463)
[START] [2020-03-16 10:46:13] update_nodes
[STOP] [2020-03-16 10:46:13] update_nodes
[STOP] [2020-03-16 10:46:13] match_nodes
[START] [2020-03-16 10:46:13] reindex_search
[STOP] [2020-03-16 10:46:14] reindex_search
[START] [2020-03-16 10:46:14] normalize_units
[STOP] [2020-03-16 10:46:14] normalize_units
[START] [2020-03-16 10:46:14] calculate_statistics
[STOP] [2020-03-16 10:46:14] calculate_statistics
[START] [2020-03-16 10:46:14] complete_harvest_instance
[START] [2020-03-16 10:46:14] overall_tsv_creation
[INFO] [2020-03-16 10:46:14] Processing group of 773 in 1 batches of 10000
[INFO] [2020-03-16 10:47:48] 870 Traits (unfiltered)...
[INFO] [2020-03-16 10:48:01] 870 Traits (filtered)...
[INFO] [2020-03-16 10:48:01] 0 Associations (filtered)...
[INFO] [2020-03-16 10:48:41] 2929 metadata added.
[INFO] [2020-03-16 10:48:41] 0 metadata added.
[INFO] [2020-03-16 10:48:41] Average Time: 86.8
[INFO] [2020-03-16 10:48:41] Total Time: 2m28s
[STOP] [2020-03-16 10:48:41] overall_tsv_creation
[INFO] [2020-03-16 10:48:41] Done. Check your files:
[INFO] [2020-03-16 10:48:42] (715 lines) /app/public/data/qseaq/publish_nodes.tsv
[INFO] [2020-03-16 10:48:42] (2313 lines) /app/public/data/qseaq/publish_node_ancestors.tsv
[INFO] [2020-03-16 10:48:43] (773 lines) /app/public/data/qseaq/publish_scientific_names.tsv
[INFO] [2020-03-16 10:48:43] (871 lines) /app/public/data/qseaq/publish_traits.tsv
[INFO] [2020-03-16 10:48:44] (2930 lines) /app/public/data/qseaq/publish_metadata.tsv
[STOP] [2020-03-16 10:48:44] complete_harvest_instance
[START] [2020-03-16 10:48:44] completed
[STOP] [2020-03-16 10:48:44] completed
[STOP] [2020-03-16 10:48:44] logged process, took 256.39
[INFO] [2020-07-28 16:16:06] ## HARVEST: type = re_download_opendata_-harvest
[INFO] [2020-07-28 16:16:07] ## remove_type: ScientificName
[INFO] [2020-07-28 16:16:07] ++ Calling delete_all on 773 instances...
[INFO] [2020-07-28 16:16:07] [16:16:07.543] Removed 773 Scientificnames
[INFO] [2020-07-28 16:16:07] ## remove_type: Vernacular
[INFO] [2020-07-28 16:16:07] ++ Calling delete_all on 0 instances...
[INFO] [2020-07-28 16:16:07] [16:16:07.546] Removed 0 Vernaculars
[INFO] [2020-07-28 16:16:07] ## remove_type: Article
[INFO] [2020-07-28 16:16:07] ++ Calling delete_all on 0 instances...
[INFO] [2020-07-28 16:16:07] [16:16:07.549] Removed 0 Articles
[INFO] [2020-07-28 16:16:07] ## remove_type: Medium
[INFO] [2020-07-28 16:16:07] ++ Calling delete_all on 0 instances...
[INFO] [2020-07-28 16:16:07] [16:16:07.552] Removed 0 Media
[INFO] [2020-07-28 16:16:07] ## remove_type: Trait
[INFO] [2020-07-28 16:16:07] ++ Calling delete_all on 1195 instances...
[INFO] [2020-07-28 16:16:07] [16:16:07.823] Removed 1195 Traits
[INFO] [2020-07-28 16:16:07] ## remove_type: MetaTrait
[INFO] [2020-07-28 16:16:07] ++ Calling delete_all on 2622 instances...
[INFO] [2020-07-28 16:16:07] [16:16:07.971] Removed 2622 Metatraits
[INFO] [2020-07-28 16:16:07] ## remove_type: OccurrenceMetadatum
[INFO] [2020-07-28 16:16:07] ++ Calling delete_all on 0 instances...
[INFO] [2020-07-28 16:16:07] [16:16:07.976] Removed 0 Occurrencemetadata
[INFO] [2020-07-28 16:16:07] ## remove_type: Assoc
[INFO] [2020-07-28 16:16:07] ++ Calling delete_all on 0 instances...
[INFO] [2020-07-28 16:16:07] [16:16:07.979] Removed 0 Assocs
[INFO] [2020-07-28 16:16:07] ## remove_type: MetaAssoc
[INFO] [2020-07-28 16:16:07] ++ Calling delete_all on 0 instances...
[INFO] [2020-07-28 16:16:07] [16:16:07.981] Removed 0 Metaassocs
[INFO] [2020-07-28 16:16:07] ## remove_type: Identifier
[INFO] [2020-07-28 16:16:08] ++ Calling delete_all on 0 instances...
[INFO] [2020-07-28 16:16:08] [16:16:08.029] Removed 0 Identifiers
[INFO] [2020-07-28 16:16:08] ## remove_type: Reference
[INFO] [2020-07-28 16:16:08] ++ Calling delete_all on 0 instances...
[INFO] [2020-07-28 16:16:08] [16:16:08.032] Removed 0 References
[INFO] [2020-07-28 16:16:12] Starting batch with ID 67167197...
[INFO] [2020-07-28 16:16:14] Starting batch with ID 67167197...
[INFO] [2020-07-28 16:16:14] Starting batch with ID 67167197...
[INFO] [2020-07-28 16:16:14] Starting batch with ID 67167197...
[INFO] [2020-07-28 16:16:14] Starting batch with ID 67167197...
[INFO] [2020-07-28 16:16:14] Starting batch with ID 67167197...
[INFO] [2020-07-28 16:16:14] Starting batch with ID 67167197...
[INFO] [2020-07-28 16:16:15] Starting batch with ID 67167197...
[INFO] [2020-07-28 16:16:15] Starting batch with ID 67167197...
[INFO] [2020-07-28 16:16:15] Starting batch with ID 67167197...
[INFO] [2020-07-28 16:16:15] Starting batch with ID 67167197...
[INFO] [2020-07-28 16:16:15] Starting batch with ID 67167197...
[INFO] [2020-07-28 16:16:15] Starting batch with ID 67167197...
[INFO] [2020-07-28 16:16:15] Starting batch with ID 67167197...
[INFO] [2020-07-28 16:16:15] Starting batch with ID 67167197...
[INFO] [2020-07-28 16:16:15] Starting batch with ID 67167197...
[INFO] [2020-07-28 16:16:15] Starting batch with ID 67167197...
[INFO] [2020-07-28 16:16:16] Starting batch with ID 67167197...
[INFO] [2020-07-28 16:16:16] ## remove_type: Node
[INFO] [2020-07-28 16:16:16] ++ Calling delete_all on 773 instances...
[INFO] [2020-07-28 16:16:16] [16:16:16.324] Removed 773 Nodes
[START] [2020-07-28 16:16:17] logged process
[START] [2020-07-28 16:16:17] Creating resource from OpenData
[START] [2020-07-28 16:16:17] logged process
[START] [2020-07-28 16:16:17] Parse meta.xml file and create formats with fields
[STOP] [2020-07-28 16:16:17] Parse meta.xml file and create formats with fields
[STOP] [2020-07-28 16:16:17] Creating resource from OpenData
[START] [2020-07-28 16:16:17] logged process
[START] [2020-07-28 16:16:17] create_harvest_instance
[STOP] [2020-07-28 16:16:18] create_harvest_instance
[START] [2020-07-28 16:16:18] fetch_files
[STOP] [2020-07-28 16:16:18] fetch_files
[START] [2020-07-28 16:16:18] validate_each_file
[STOP] [2020-07-28 16:16:19] validate_each_file
[START] [2020-07-28 16:16:19] convert_to_csv
[CMD] [2020-07-28 16:16:19] /usr/bin/sort /app/public/converted_csv/qseaq_nodes_22141.csv > /app/public/converted_csv/qseaq_nodes_22141.csv_sorted
[CMD] [2020-07-28 16:16:19] /usr/bin/sort /app/public/converted_csv/qseaq_occurrences_22142.csv > /app/public/converted_csv/qseaq_occurrences_22142.csv_sorted
[CMD] [2020-07-28 16:16:19] /usr/bin/sort /app/public/converted_csv/qseaq_measurements_22143.csv > /app/public/converted_csv/qseaq_measurements_22143.csv_sorted
[STOP] [2020-07-28 16:16:19] convert_to_csv
[START] [2020-07-28 16:16:19] calculate_delta
[CMD] [2020-07-28 16:16:19] echo "0a" > /app/public/diff/qseaq_nodes_22141.diff
[CMD] [2020-07-28 16:16:19] tail -n +1 /app/public/converted_csv/qseaq_nodes_22141.csv >> /app/public/diff/qseaq_nodes_22141.diff
[CMD] [2020-07-28 16:16:19] echo "." >> /app/public/diff/qseaq_nodes_22141.diff
[CMD] [2020-07-28 16:16:19] echo "0a" > /app/public/diff/qseaq_occurrences_22142.diff
[CMD] [2020-07-28 16:16:19] tail -n +1 /app/public/converted_csv/qseaq_occurrences_22142.csv >> /app/public/diff/qseaq_occurrences_22142.diff
[CMD] [2020-07-28 16:16:19] echo "." >> /app/public/diff/qseaq_occurrences_22142.diff
[CMD] [2020-07-28 16:16:19] echo "0a" > /app/public/diff/qseaq_measurements_22143.diff
[CMD] [2020-07-28 16:16:19] tail -n +1 /app/public/converted_csv/qseaq_measurements_22143.csv >> /app/public/diff/qseaq_measurements_22143.diff
[CMD] [2020-07-28 16:16:19] echo "." >> /app/public/diff/qseaq_measurements_22143.diff
[STOP] [2020-07-28 16:16:19] calculate_delta
[START] [2020-07-28 16:16:19] parse_diff_and_store
[INFO] [2020-07-28 16:16:19] Loading nodes diff file into memory (true lines)...
[INFO] [2020-07-28 16:16:19] Loading occurrences diff file into memory (true lines)...
[INFO] [2020-07-28 16:16:19] Loading measurements diff file into memory (true lines)...
[INFO] [2020-07-28 16:16:25] Storing 667 ScientificNames
[INFO] [2020-07-28 16:16:25] Processing group of 667 in 1 groups of 1000
[INFO] [2020-07-28 16:16:25] Average Time: 0.29
[INFO] [2020-07-28 16:16:25] Total Time: 1s
[INFO] [2020-07-28 16:16:25] Storing 667 Nodes
[INFO] [2020-07-28 16:16:25] Processing group of 667 in 1 groups of 1000
[INFO] [2020-07-28 16:16:25] Average Time: 0.32
[INFO] [2020-07-28 16:16:25] Total Time: 1s
[INFO] [2020-07-28 16:16:25] Storing 450 Occurrences
[INFO] [2020-07-28 16:16:25] Processing group of 450 in 1 groups of 1000
[INFO] [2020-07-28 16:16:25] Average Time: 0.06
[INFO] [2020-07-28 16:16:25] Total Time: 1s
[INFO] [2020-07-28 16:16:25] Storing 1187 Traits
[INFO] [2020-07-28 16:16:25] Processing group of 1187 in 2 groups of 1000
[INFO] [2020-07-28 16:16:26] Average Time: 0.215
[INFO] [2020-07-28 16:16:26] Total Time: 1s
[INFO] [2020-07-28 16:16:26] Storing 2616 MetaTraits
[INFO] [2020-07-28 16:16:26] Processing group of 2616 in 3 groups of 1000
[INFO] [2020-07-28 16:16:26] Average Time: 0.1
[INFO] [2020-07-28 16:16:26] Total Time: 1s
[STOP] [2020-07-28 16:16:26] parse_diff_and_store
[START] [2020-07-28 16:16:26] resolve_keys
[INFO] [2020-07-28 16:16:35] Occurrences to nodes (through scientific_names)...
[INFO] [2020-07-28 16:16:35] traits to occurrences...
[INFO] [2020-07-28 16:16:35] traits to nodes (through occurrences)...
[INFO] [2020-07-28 16:16:35] Traits to sex term...
[INFO] [2020-07-28 16:16:35] Traits to lifestage term...
[INFO] [2020-07-28 16:16:35] MetaTraits to traits...
[INFO] [2020-07-28 16:16:35] MetaTraits (simple, measurement row refers to parent) to traits...
[INFO] [2020-07-28 16:16:35] Assocs to occurrences...
[INFO] [2020-07-28 16:16:35] Assocs to nodes...
[INFO] [2020-07-28 16:16:35] Assoc to sex term...
[INFO] [2020-07-28 16:16:35] Assoc to lifestage term...
[STOP] [2020-07-28 16:16:35] resolve_keys
[START] [2020-07-28 16:16:35] hold_for_later_1
[STOP] [2020-07-28 16:16:35] hold_for_later_1
[START] [2020-07-28 16:16:35] hold_for_later_2
[STOP] [2020-07-28 16:16:35] hold_for_later_2
[START] [2020-07-28 16:16:35] resolve_missing_parents
[STOP] [2020-07-28 16:16:35] resolve_missing_parents
[START] [2020-07-28 16:16:35] rebuild_nodes
[START] [2020-07-28 16:16:35] Flattener#flatten
[START] [2020-07-28 16:16:35] Flattener#study_resource
[START] [2020-07-28 16:16:35] Flattener#build_ancestry
[STOP] [2020-07-28 16:16:35] Flattener#build_ancestry
[INFO] [2020-07-28 16:16:35] 667 ancestry keys
[START] [2020-07-28 16:16:35] build_node_ancestors
[INFO] [2020-07-28 16:16:35] old ancestors deleted.
[STOP] [2020-07-28 16:16:36] build_node_ancestors
[START] [2020-07-28 16:16:36] Flattener#propagate_ancestor_ids
[STOP] [2020-07-28 16:16:36] Flattener#propagate_ancestor_ids
[STOP] [2020-07-28 16:16:36] Flattener#flatten
[STOP] [2020-07-28 16:16:36] rebuild_nodes
[START] [2020-07-28 16:16:36] resolve_missing_media_owners
[STOP] [2020-07-28 16:16:36] resolve_missing_media_owners
[START] [2020-07-28 16:16:36] sanitize_media_verbatims
[STOP] [2020-07-28 16:16:36] sanitize_media_verbatims
[START] [2020-07-28 16:16:36] queue_downloads
[STOP] [2020-07-28 16:16:36] queue_downloads
[START] [2020-07-28 16:16:36] parse_names
[WARN] [2020-07-28 16:16:36] I see 667 names which still need to be parsed.
[WARN] [2020-07-28 16:16:37] I see 23 names which still need to be parsed.
[STOP] [2020-07-28 16:16:39] parse_names
[START] [2020-07-28 16:16:39] denormalize_canonical_names_to_nodes
[STOP] [2020-07-28 16:16:39] denormalize_canonical_names_to_nodes
[START] [2020-07-28 16:16:39] match_nodes
[START] [2020-07-28 16:16:39] map_all_nodes_to_pages
[STOP] [2020-07-28 16:17:45] map_all_nodes_to_pages
[INFO] [2020-07-28 16:17:45] Unmatched nodes (3 of 667): Cirolana cranchi (#80633882); Odostomia scalaris (#80634165); Tellina nitida (#80634336)
[START] [2020-07-28 16:17:45] update_nodes
[STOP] [2020-07-28 16:17:46] update_nodes
[STOP] [2020-07-28 16:17:46] match_nodes
[START] [2020-07-28 16:17:46] reindex_search
[STOP] [2020-07-28 16:17:46] reindex_search
[START] [2020-07-28 16:17:46] normalize_units
[STOP] [2020-07-28 16:17:46] normalize_units
[START] [2020-07-28 16:17:46] calculate_statistics
[STOP] [2020-07-28 16:17:46] calculate_statistics
[START] [2020-07-28 16:17:46] complete_harvest_instance
[START] [2020-07-28 16:17:46] overall_tsv_creation
[INFO] [2020-07-28 16:17:47] Processing group of 667 in 1 batches of 10000
[INFO] [2020-07-28 16:18:46] 868 Traits (unfiltered)...
[INFO] [2020-07-28 16:19:24] 868 Traits (filtered)...
[INFO] [2020-07-28 16:19:24] 0 Associations (filtered)...
[INFO] [2020-07-28 16:19:24] 2917 metadata added.
[INFO] [2020-07-28 16:19:24] 0 metadata added.
[INFO] [2020-07-28 16:19:24] Average Time: 62.35
[INFO] [2020-07-28 16:19:24] Total Time: 1m38s
[STOP] [2020-07-28 16:19:24] overall_tsv_creation
[INFO] [2020-07-28 16:19:24] Done. Check your files:
[INFO] [2020-07-28 16:19:24] (644 lines) /app/public/data/qseaq/publish_nodes.tsv
[INFO] [2020-07-28 16:19:24] (1551 lines) /app/public/data/qseaq/publish_node_ancestors.tsv
[INFO] [2020-07-28 16:19:24] (667 lines) /app/public/data/qseaq/publish_scientific_names.tsv
[INFO] [2020-07-28 16:19:24] (869 lines) /app/public/data/qseaq/publish_traits.tsv
[INFO] [2020-07-28 16:19:24] (1182 lines) /app/public/data/qseaq/publish_metadata.tsv
[STOP] [2020-07-28 16:19:24] complete_harvest_instance
[START] [2020-07-28 16:19:24] completed
[STOP] [2020-07-28 16:19:24] completed
[STOP] [2020-07-28 16:19:24] logged process, took 187.52

Latest Process