harvested resources
sign in

Harvest for United States Species List Created 15 Jun 07:58

Stage: completed
Fetched: 15 Jun 07:58
Validated: 15 Jun 07:59
Deltas Created 15 Jun 07:59
Units Normalized: 15 Jun 10:09
Ancestry Built: 15 Jun 08:23
Nodes Matched: 15 Jun 10:04
Names Parsed: 15 Jun 08:26
New Models Stored: 15 Jun 08:10
Indexed: 15 Jun 10:08
Completed: 15 Jun 11:22
Time to Harvest: 3 minutes

Harvesting Log

(300 lines) 
[INFO] [2021-06-15 07:58:40] Created harvest instance #4033
[STOP] [2021-06-15 07:58:40] create_harvest_instance
[START] [2021-06-15 07:58:40] fetch_files
[STOP] [2021-06-15 07:58:40] fetch_files
[START] [2021-06-15 07:58:40] validate_each_file
[INFO] [2021-06-15 07:58:40] Looping over 4 formats...
[INFO] [2021-06-15 07:58:40] ...refs (/app/public/data/u_s_sp_list/reference.tab)
[INFO] [2021-06-15 07:58:40] Valid: /app/public/converted_csv/u_s_sp_list_refs_4033.csv (2 lines)
[INFO] [2021-06-15 07:58:40] ...nodes (/app/public/data/u_s_sp_list/taxon.tab)
[INFO] [2021-06-15 07:58:45] Valid: /app/public/converted_csv/u_s_sp_list_nodes_4033.csv (215560 lines)
[INFO] [2021-06-15 07:58:45] ...occurrences (/app/public/data/u_s_sp_list/occurrence.tab)
[INFO] [2021-06-15 07:58:46] Valid: /app/public/converted_csv/u_s_sp_list_occurrences_4033.csv (168817 lines)
[INFO] [2021-06-15 07:58:46] ...measurements (/app/public/data/u_s_sp_list/measurement_or_fact_specific.tab)
[INFO] [2021-06-15 07:59:04] Valid: /app/public/converted_csv/u_s_sp_list_measurements_4033.csv (337634 lines)
[STOP] [2021-06-15 07:59:04] validate_each_file
[START] [2021-06-15 07:59:04] convert_to_csv
[INFO] [2021-06-15 07:59:04] Looping over 4 formats...
[INFO] [2021-06-15 07:59:04] ...refs (/app/public/data/u_s_sp_list/reference.tab)
[CMD] [2021-06-15 07:59:04] /usr/bin/sort /app/public/converted_csv/u_s_sp_list_refs_4033.csv > /app/public/converted_csv/u_s_sp_list_refs_4033.csv_sorted
[INFO] [2021-06-15 07:59:06] Converted: /app/public/converted_csv/u_s_sp_list_refs_4033.csv (2 lines)
[INFO] [2021-06-15 07:59:06] ...nodes (/app/public/data/u_s_sp_list/taxon.tab)
[CMD] [2021-06-15 07:59:06] /usr/bin/sort /app/public/converted_csv/u_s_sp_list_nodes_4033.csv > /app/public/converted_csv/u_s_sp_list_nodes_4033.csv_sorted
[INFO] [2021-06-15 07:59:07] Converted: /app/public/converted_csv/u_s_sp_list_nodes_4033.csv (215560 lines)
[INFO] [2021-06-15 07:59:07] ...occurrences (/app/public/data/u_s_sp_list/occurrence.tab)
[CMD] [2021-06-15 07:59:07] /usr/bin/sort /app/public/converted_csv/u_s_sp_list_occurrences_4033.csv > /app/public/converted_csv/u_s_sp_list_occurrences_4033.csv_sorted
[INFO] [2021-06-15 07:59:09] Converted: /app/public/converted_csv/u_s_sp_list_occurrences_4033.csv (168817 lines)
[INFO] [2021-06-15 07:59:09] ...measurements (/app/public/data/u_s_sp_list/measurement_or_fact_specific.tab)
[CMD] [2021-06-15 07:59:09] /usr/bin/sort /app/public/converted_csv/u_s_sp_list_measurements_4033.csv > /app/public/converted_csv/u_s_sp_list_measurements_4033.csv_sorted
[INFO] [2021-06-15 07:59:11] Converted: /app/public/converted_csv/u_s_sp_list_measurements_4033.csv (337634 lines)
[STOP] [2021-06-15 07:59:11] convert_to_csv
[START] [2021-06-15 07:59:11] calculate_delta
[INFO] [2021-06-15 07:59:11] Looping over 4 formats...
[INFO] [2021-06-15 07:59:11] ...refs (/app/public/data/u_s_sp_list/reference.tab)
[CMD] [2021-06-15 07:59:11] echo "0a" > /app/public/diff/u_s_sp_list_refs_4033.diff
[CMD] [2021-06-15 07:59:12] tail -n +1 /app/public/converted_csv/u_s_sp_list_refs_4033.csv >> /app/public/diff/u_s_sp_list_refs_4033.diff
[CMD] [2021-06-15 07:59:14] echo "." >> /app/public/diff/u_s_sp_list_refs_4033.diff
[INFO] [2021-06-15 07:59:15] Created diff: /app/public/diff/u_s_sp_list_refs_4033.diff (4 lines)
[INFO] [2021-06-15 07:59:15] ...nodes (/app/public/data/u_s_sp_list/taxon.tab)
[CMD] [2021-06-15 07:59:15] echo "0a" > /app/public/diff/u_s_sp_list_nodes_4033.diff
[CMD] [2021-06-15 07:59:16] tail -n +1 /app/public/converted_csv/u_s_sp_list_nodes_4033.csv >> /app/public/diff/u_s_sp_list_nodes_4033.diff
[CMD] [2021-06-15 07:59:18] echo "." >> /app/public/diff/u_s_sp_list_nodes_4033.diff
[INFO] [2021-06-15 07:59:19] Created diff: /app/public/diff/u_s_sp_list_nodes_4033.diff (215562 lines)
[INFO] [2021-06-15 07:59:19] ...occurrences (/app/public/data/u_s_sp_list/occurrence.tab)
[CMD] [2021-06-15 07:59:19] echo "0a" > /app/public/diff/u_s_sp_list_occurrences_4033.diff
[CMD] [2021-06-15 07:59:21] tail -n +1 /app/public/converted_csv/u_s_sp_list_occurrences_4033.csv >> /app/public/diff/u_s_sp_list_occurrences_4033.diff
[CMD] [2021-06-15 07:59:22] echo "." >> /app/public/diff/u_s_sp_list_occurrences_4033.diff
[INFO] [2021-06-15 07:59:24] Created diff: /app/public/diff/u_s_sp_list_occurrences_4033.diff (168819 lines)
[INFO] [2021-06-15 07:59:24] ...measurements (/app/public/data/u_s_sp_list/measurement_or_fact_specific.tab)
[CMD] [2021-06-15 07:59:24] echo "0a" > /app/public/diff/u_s_sp_list_measurements_4033.diff
[CMD] [2021-06-15 07:59:25] tail -n +1 /app/public/converted_csv/u_s_sp_list_measurements_4033.csv >> /app/public/diff/u_s_sp_list_measurements_4033.diff
[CMD] [2021-06-15 07:59:26] echo "." >> /app/public/diff/u_s_sp_list_measurements_4033.diff
[INFO] [2021-06-15 07:59:28] Created diff: /app/public/diff/u_s_sp_list_measurements_4033.diff (337636 lines)
[STOP] [2021-06-15 07:59:28] calculate_delta
[START] [2021-06-15 07:59:28] parse_diff_and_store
[INFO] [2021-06-15 07:59:28] Handling diff: /app/public/diff/u_s_sp_list_refs_4033.diff (4 lines)
[INFO] [2021-06-15 07:59:30] Loading refs diff file into memory (4 /app/public/diff/u_s_sp_list_refs_4033.diff lines)...
[INFO] [2021-06-15 07:59:31] Handling diff: /app/public/diff/u_s_sp_list_nodes_4033.diff (215562 lines)
[INFO] [2021-06-15 07:59:33] Loading nodes diff file into memory (215562 /app/public/diff/u_s_sp_list_nodes_4033.diff lines)...
[WARN] [2021-06-15 07:59:46] Filtered Scientific Name `Stenopelmatus ""mahogany"""` to `Stenopelmatus mahogany`
[WARN] [2021-06-15 08:00:01] Filtered Scientific Name `Neoprocris  floridana` to `Neoprocris floridana`
[WARN] [2021-06-15 08:00:01] Filtered Scientific Name `Entzia  macrescens` to `Entzia macrescens`
[WARN] [2021-06-15 08:00:06] Filtered Scientific Name `Ollarianus  armus` to `Ollarianus armus`
[WARN] [2021-06-15 08:00:10] Filtered Scientific Name `Punctularia  strigosozonata` to `Punctularia strigosozonata`
[WARN] [2021-06-15 08:00:11] Filtered Scientific Name `Magnoliopsida ""` to `Magnoliopsida `
[WARN] [2021-06-15 08:00:12] Filtered Scientific Name `Tetragonocephala  flava` to `Tetragonocephala flava`
[WARN] [2021-06-15 08:00:12] Filtered Scientific Name `Craneiobia  tuba` to `Craneiobia tuba`
[WARN] [2021-06-15 08:00:12] Filtered Scientific Name `Odonata Nick."` to `Odonata Nick.`
[WARN] [2021-06-15 08:00:17] Filtered Scientific Name `"" Then That Looks Complete` to ` Then That Looks Complete`
[WARN] [2021-06-15 08:00:17] Filtered Scientific Name `Stenopelmatus "mahogany"` to `Stenopelmatus mahogany`
[WARN] [2021-06-15 08:00:17] Filtered Scientific Name `Isopoda rounded."` to `Isopoda rounded.`
[WARN] [2021-06-15 08:00:17] Filtered Scientific Name `Ovaticoccus  agavium` to `Ovaticoccus agavium`
[WARN] [2021-06-15 08:00:19] Filtered Scientific Name `Squamata etc."""` to `Squamata etc.`
[WARN] [2021-06-15 08:00:20] Filtered Scientific Name `Megasyrphus  laxus` to `Megasyrphus laxus`
[WARN] [2021-06-15 08:00:29] Filtered Scientific Name `Aphalaroida  pithecolobia` to `Aphalaroida pithecolobia`
[WARN] [2021-06-15 08:00:30] Filtered Scientific Name `Asterales rwp84"` to `Asterales rwp84`
[WARN] [2021-06-15 08:00:32] Filtered Scientific Name `Aphalaroida  inermis` to `Aphalaroida inermis`
[INFO] [2021-06-15 08:00:44] Handling diff: /app/public/diff/u_s_sp_list_occurrences_4033.diff (168819 lines)
[INFO] [2021-06-15 08:00:45] Loading occurrences diff file into memory (168819 /app/public/diff/u_s_sp_list_occurrences_4033.diff lines)...
[INFO] [2021-06-15 08:01:08] Handling diff: /app/public/diff/u_s_sp_list_measurements_4033.diff (337636 lines)
[INFO] [2021-06-15 08:01:09] Loading measurements diff file into memory (337636 /app/public/diff/u_s_sp_list_measurements_4033.diff lines)...
[INFO] [2021-06-15 08:04:43] Storing 2 References
[INFO] [2021-06-15 08:04:43] Processing group of 2 in 1 groups of 1000
[INFO] [2021-06-15 08:04:43] Average Time: 0.0
[INFO] [2021-06-15 08:04:43] Total Time: 1s
[INFO] [2021-06-15 08:04:43] Storing 215560 ScientificNames
[INFO] [2021-06-15 08:04:43] Processing group of 215560 in 216 groups of 1000
[INFO] [2021-06-15 08:06:06] Average Time: 0.382
[INFO] [2021-06-15 08:06:06] Total Time: 1m24s
[INFO] [2021-06-15 08:06:06] last 3 / first 3: 0.66
[INFO] [2021-06-15 08:06:06] Std.Dev: 0.23664319132398465; Max: 2.1
[INFO] [2021-06-15 08:06:06] Storing 215560 Nodes
[INFO] [2021-06-15 08:06:06] Processing group of 215560 in 216 groups of 1000
[INFO] [2021-06-15 08:07:55] Average Time: 0.499
[INFO] [2021-06-15 08:07:55] Total Time: 1m49s
[INFO] [2021-06-15 08:07:55] last 3 / first 3: 0.48
[INFO] [2021-06-15 08:07:55] Std.Dev: 0.9465727652959386; Max: 7.8
[INFO] [2021-06-15 08:07:55] Storing 168817 Occurrences
[INFO] [2021-06-15 08:07:55] Processing group of 168817 in 169 groups of 1000
[INFO] [2021-06-15 08:08:23] Average Time: 0.158
[INFO] [2021-06-15 08:08:23] Total Time: 28s
[INFO] [2021-06-15 08:08:23] last 3 / first 3: 0.7
[INFO] [2021-06-15 08:08:23] Std.Dev: 0.2073644135332772; Max: 1.31
[INFO] [2021-06-15 08:08:23] Storing 337634 TraitsReferences
[INFO] [2021-06-15 08:08:23] Processing group of 337634 in 338 groups of 1000
[INFO] [2021-06-15 08:08:54] Average Time: 0.09
[INFO] [2021-06-15 08:08:54] Total Time: 32s
[INFO] [2021-06-15 08:08:54] last 3 / first 3: 0.3
[INFO] [2021-06-15 08:08:54] Std.Dev: 0.10954451150103323; Max: 0.61
[INFO] [2021-06-15 08:08:54] Storing 337634 Traits
[INFO] [2021-06-15 08:08:54] Processing group of 337634 in 338 groups of 1000
[INFO] [2021-06-15 08:10:58] Average Time: 0.363
[INFO] [2021-06-15 08:10:58] Total Time: 2m5s
[INFO] [2021-06-15 08:10:58] last 3 / first 3: 0.76
[INFO] [2021-06-15 08:10:58] Std.Dev: 0.3478505426185217; Max: 3.22
[STOP] [2021-06-15 08:10:58] parse_diff_and_store
[START] [2021-06-15 08:10:58] resolve_keys
[INFO] [2021-06-15 08:12:34] Occurrences to nodes (through scientific_names)...
[INFO] [2021-06-15 08:12:43] traits to occurrences...
[INFO] [2021-06-15 08:12:53] traits to nodes (through occurrences)...
[INFO] [2021-06-15 08:12:57] Traits to sex term...
[INFO] [2021-06-15 08:13:02] Traits to lifestage term...
[INFO] [2021-06-15 08:13:07] MetaTraits to traits...
[INFO] [2021-06-15 08:13:07] MetaTraits (simple, measurement row refers to parent) to traits...
[INFO] [2021-06-15 08:13:28] Assocs to occurrences...
[INFO] [2021-06-15 08:13:28] Assocs to nodes...
[INFO] [2021-06-15 08:13:28] Assoc to sex term...
[INFO] [2021-06-15 08:13:28] Assoc to lifestage term...
[INFO] [2021-06-15 08:13:28] MetaAssoc to assocs...
[STOP] [2021-06-15 08:13:28] resolve_keys
[START] [2021-06-15 08:13:28] hold_for_later_1
[STOP] [2021-06-15 08:13:28] hold_for_later_1
[START] [2021-06-15 08:13:28] hold_for_later_2
[STOP] [2021-06-15 08:13:28] hold_for_later_2
[START] [2021-06-15 08:13:28] resolve_missing_parents
[STOP] [2021-06-15 08:14:03] resolve_missing_parents
[START] [2021-06-15 08:14:03] rebuild_nodes
[START] [2021-06-15 08:14:03] Flattener#flatten
[START] [2021-06-15 08:14:03] Flattener#study_resource
[START] [2021-06-15 08:14:24] Flattener#build_ancestry
[STOP] [2021-06-15 08:21:01] Flattener#build_ancestry
[INFO] [2021-06-15 08:21:01] 215560 ancestry keys
[START] [2021-06-15 08:21:01] build_node_ancestors
[INFO] [2021-06-15 08:21:01] old ancestors deleted.
[STOP] [2021-06-15 08:23:14] build_node_ancestors
[START] [2021-06-15 08:23:15] Flattener#propagate_ancestor_ids
[STOP] [2021-06-15 08:23:49] Flattener#propagate_ancestor_ids
[STOP] [2021-06-15 08:23:49] Flattener#flatten
[STOP] [2021-06-15 08:23:49] rebuild_nodes
[START] [2021-06-15 08:23:49] resolve_missing_media_owners
[STOP] [2021-06-15 08:23:49] resolve_missing_media_owners
[START] [2021-06-15 08:23:49] sanitize_media_verbatims
[STOP] [2021-06-15 08:23:49] sanitize_media_verbatims
[START] [2021-06-15 08:23:49] queue_downloads
[STOP] [2021-06-15 08:23:49] queue_downloads
[START] [2021-06-15 08:23:49] parse_names
[WARN] [2021-06-15 08:23:49] I see 215560 names which still need to be parsed.
[STOP] [2021-06-15 08:26:20] parse_names
[START] [2021-06-15 08:26:20] denormalize_canonical_names_to_nodes
[STOP] [2021-06-15 08:26:34] denormalize_canonical_names_to_nodes
[START] [2021-06-15 08:26:34] match_nodes
[START] [2021-06-15 08:26:34] map_all_nodes_to_pages
[STOP] [2021-06-15 10:04:52] map_all_nodes_to_pages
[INFO] [2021-06-15 10:04:52] 28082 Unmatched nodes (of 215560)! That's too many to output. Full list in /app/public/data/u_s_sp_list/unmatched_nodes.txt ; First 10: Canonical: Ptilogonatidae; Node#96576636; ResourceID: T100614; Canonical: Ptilogonys; Node#96619857; ResourceID: T143890; Canonical: Ptilogonys caudatus; Node#96619856; ResourceID: T143889; Canonical: Ptilogonys cinereus; Node#96644626; ResourceID: T168662; Canonical: Mycetozoa; Node#96577559; ResourceID: T101555; Canonical: Protosteliomycetes; Node#96577558; ResourceID: T101554; Canonical: Protosteliales; Node#96577557; ResourceID: T101553; Canonical: Protosteliaceae; Node#96577556; ResourceID: T101552; Canonical: Protostelium pyriforme; Node#96581526; ResourceID: T105545; Canonical: Schizoplasmodiopsis micropunctata; Node#96614129; ResourceID: T138161
[START] [2021-06-15 10:04:52] update_nodes
[STOP] [2021-06-15 10:04:58] update_nodes
[STOP] [2021-06-15 10:04:58] match_nodes
[START] [2021-06-15 10:04:58] reindex_search
[STOP] [2021-06-15 10:08:38] reindex_search
[START] [2021-06-15 10:08:38] normalize_units
[STOP] [2021-06-15 10:09:08] normalize_units
[START] [2021-06-15 10:09:08] calculate_statistics
[STOP] [2021-06-15 10:09:11] calculate_statistics
[START] [2021-06-15 10:09:11] complete_harvest_instance
[START] [2021-06-15 10:09:11] overall_tsv_creation
[INFO] [2021-06-15 10:09:11] Processing group of 215560 in 22 batches of 10000
[INFO] [2021-06-15 10:10:23] 5904 Traits (unfiltered)...
[INFO] [2021-06-15 10:11:43] 5904 Traits (filtered)...
[INFO] [2021-06-15 10:11:47] 0 Associations (filtered)...
[INFO] [2021-06-15 10:11:48] 11808 metadata added.
[INFO] [2021-06-15 10:11:48] 0 metadata added.
[INFO] [2021-06-15 10:13:29] 6889 Traits (unfiltered)...
[INFO] [2021-06-15 10:14:53] 6889 Traits (filtered)...
[INFO] [2021-06-15 10:14:56] 0 Associations (filtered)...
[INFO] [2021-06-15 10:14:57] 13778 metadata added.
[INFO] [2021-06-15 10:14:57] 0 metadata added.
[INFO] [2021-06-15 10:16:39] 7225 Traits (unfiltered)...
[INFO] [2021-06-15 10:18:11] 7225 Traits (filtered)...
[INFO] [2021-06-15 10:18:14] 0 Associations (filtered)...
[INFO] [2021-06-15 10:18:15] 14450 metadata added.
[INFO] [2021-06-15 10:18:15] 0 metadata added.
[INFO] [2021-06-15 10:20:00] 7420 Traits (unfiltered)...
[INFO] [2021-06-15 10:21:31] 7420 Traits (filtered)...
[INFO] [2021-06-15 10:21:34] 0 Associations (filtered)...
[INFO] [2021-06-15 10:21:35] 14840 metadata added.
[INFO] [2021-06-15 10:21:35] 0 metadata added.
[INFO] [2021-06-15 10:23:16] 7613 Traits (unfiltered)...
[INFO] [2021-06-15 10:24:47] 7613 Traits (filtered)...
[INFO] [2021-06-15 10:24:50] 0 Associations (filtered)...
[INFO] [2021-06-15 10:24:51] 15226 metadata added.
[INFO] [2021-06-15 10:24:51] 0 metadata added.
[INFO] [2021-06-15 10:26:36] 7698 Traits (unfiltered)...
[INFO] [2021-06-15 10:28:07] 7698 Traits (filtered)...
[INFO] [2021-06-15 10:28:10] 0 Associations (filtered)...
[INFO] [2021-06-15 10:28:12] 15396 metadata added.
[INFO] [2021-06-15 10:28:12] 0 metadata added.
[INFO] [2021-06-15 10:29:53] 7801 Traits (unfiltered)...
[INFO] [2021-06-15 10:31:24] 7801 Traits (filtered)...
[INFO] [2021-06-15 10:31:27] 0 Associations (filtered)...
[INFO] [2021-06-15 10:31:28] 15602 metadata added.
[INFO] [2021-06-15 10:31:28] 0 metadata added.
[INFO] [2021-06-15 10:33:14] 7815 Traits (unfiltered)...
[INFO] [2021-06-15 10:34:44] 7815 Traits (filtered)...
[INFO] [2021-06-15 10:34:47] 0 Associations (filtered)...
[INFO] [2021-06-15 10:34:49] 15630 metadata added.
[INFO] [2021-06-15 10:34:49] 0 metadata added.
[INFO] [2021-06-15 10:36:32] 7826 Traits (unfiltered)...
[INFO] [2021-06-15 10:38:02] 7826 Traits (filtered)...
[INFO] [2021-06-15 10:38:05] 0 Associations (filtered)...
[INFO] [2021-06-15 10:38:07] 15652 metadata added.
[INFO] [2021-06-15 10:38:07] 0 metadata added.
[INFO] [2021-06-15 10:39:52] 7866 Traits (unfiltered)...
[INFO] [2021-06-15 10:41:23] 7866 Traits (filtered)...
[INFO] [2021-06-15 10:41:26] 0 Associations (filtered)...
[INFO] [2021-06-15 10:41:27] 15732 metadata added.
[INFO] [2021-06-15 10:41:27] 0 metadata added.
[INFO] [2021-06-15 10:43:10] 7943 Traits (unfiltered)...
[INFO] [2021-06-15 10:44:41] 7943 Traits (filtered)...
[INFO] [2021-06-15 10:44:44] 0 Associations (filtered)...
[INFO] [2021-06-15 10:44:45] 15886 metadata added.
[INFO] [2021-06-15 10:44:45] 0 metadata added.
[INFO] [2021-06-15 10:46:30] 7975 Traits (unfiltered)...
[INFO] [2021-06-15 10:48:01] 7975 Traits (filtered)...
[INFO] [2021-06-15 10:48:04] 0 Associations (filtered)...
[INFO] [2021-06-15 10:48:05] 15950 metadata added.
[INFO] [2021-06-15 10:48:05] 0 metadata added.
[INFO] [2021-06-15 10:49:48] 8015 Traits (unfiltered)...
[INFO] [2021-06-15 10:51:25] 8015 Traits (filtered)...
[INFO] [2021-06-15 10:51:28] 0 Associations (filtered)...
[INFO] [2021-06-15 10:51:29] 16030 metadata added.
[INFO] [2021-06-15 10:51:29] 0 metadata added.
[INFO] [2021-06-15 10:53:14] 8004 Traits (unfiltered)...
[INFO] [2021-06-15 10:54:52] 8004 Traits (filtered)...
[INFO] [2021-06-15 10:54:55] 0 Associations (filtered)...
[INFO] [2021-06-15 10:54:56] 16008 metadata added.
[INFO] [2021-06-15 10:54:56] 0 metadata added.
[INFO] [2021-06-15 10:56:38] 8074 Traits (unfiltered)...
[INFO] [2021-06-15 10:58:16] 8074 Traits (filtered)...
[INFO] [2021-06-15 10:58:19] 0 Associations (filtered)...
[INFO] [2021-06-15 10:58:20] 16148 metadata added.
[INFO] [2021-06-15 10:58:20] 0 metadata added.
[INFO] [2021-06-15 11:00:06] 8137 Traits (unfiltered)...
[INFO] [2021-06-15 11:01:44] 8137 Traits (filtered)...
[INFO] [2021-06-15 11:01:47] 0 Associations (filtered)...
[INFO] [2021-06-15 11:01:48] 16274 metadata added.
[INFO] [2021-06-15 11:01:48] 0 metadata added.
[INFO] [2021-06-15 11:03:31] 8285 Traits (unfiltered)...
[INFO] [2021-06-15 11:05:09] 8285 Traits (filtered)...
[INFO] [2021-06-15 11:05:12] 0 Associations (filtered)...
[INFO] [2021-06-15 11:05:13] 16570 metadata added.
[INFO] [2021-06-15 11:05:13] 0 metadata added.
[INFO] [2021-06-15 11:06:59] 8298 Traits (unfiltered)...
[INFO] [2021-06-15 11:08:37] 8298 Traits (filtered)...
[INFO] [2021-06-15 11:08:40] 0 Associations (filtered)...
[INFO] [2021-06-15 11:08:41] 16596 metadata added.
[INFO] [2021-06-15 11:08:41] 0 metadata added.
[INFO] [2021-06-15 11:10:24] 8276 Traits (unfiltered)...
[INFO] [2021-06-15 11:12:03] 8276 Traits (filtered)...
[INFO] [2021-06-15 11:12:06] 0 Associations (filtered)...
[INFO] [2021-06-15 11:12:10] 16552 metadata added.
[INFO] [2021-06-15 11:12:10] 0 metadata added.
[INFO] [2021-06-15 11:13:54] 8446 Traits (unfiltered)...
[INFO] [2021-06-15 11:15:32] 8446 Traits (filtered)...
[INFO] [2021-06-15 11:15:35] 0 Associations (filtered)...
[INFO] [2021-06-15 11:15:37] 16892 metadata added.
[INFO] [2021-06-15 11:15:37] 0 metadata added.
[INFO] [2021-06-15 11:17:20] 8526 Traits (unfiltered)...
[INFO] [2021-06-15 11:18:58] 8526 Traits (filtered)...
[INFO] [2021-06-15 11:19:01] 0 Associations (filtered)...
[INFO] [2021-06-15 11:19:04] 17052 metadata added.
[INFO] [2021-06-15 11:19:04] 0 metadata added.
[INFO] [2021-06-15 11:20:34] 4781 Traits (unfiltered)...
[INFO] [2021-06-15 11:21:42] 4781 Traits (filtered)...
[INFO] [2021-06-15 11:21:45] 0 Associations (filtered)...
[INFO] [2021-06-15 11:21:46] 9562 metadata added.
[INFO] [2021-06-15 11:21:46] 0 metadata added.
[INFO] [2021-06-15 11:22:16] Average Time: 167.412
[INFO] [2021-06-15 11:22:16] Total Time: 1h13m5s
[INFO] [2021-06-15 11:22:16] last 3 / first 3: 1.01
[INFO] [2021-06-15 11:22:16] Std.Dev: 9.97767507989712; Max: 177.34
[STOP] [2021-06-15 11:22:16] overall_tsv_creation
[INFO] [2021-06-15 11:22:16] Done. Check your files:
[INFO] [2021-06-15 11:22:17] (215560 lines) /app/public/data/u_s_sp_list/publish_nodes.tsv
[INFO] [2021-06-15 11:22:19] (1208618 lines) /app/public/data/u_s_sp_list/publish_node_ancestors.tsv
[INFO] [2021-06-15 11:22:20] (215560 lines) /app/public/data/u_s_sp_list/publish_scientific_names.tsv
[INFO] [2021-06-15 11:22:22] (168818 lines) /app/public/data/u_s_sp_list/publish_traits.tsv
[INFO] [2021-06-15 11:22:23] (337635 lines) /app/public/data/u_s_sp_list/publish_metadata.tsv
[STOP] [2021-06-15 11:22:23] complete_harvest_instance
[START] [2021-06-15 11:22:23] completed
[STOP] [2021-06-15 11:22:23] completed
[STOP] [2021-06-15 11:22:23] logged process, took 12225.25

Latest Process