Harvest for IUCN Created 07 Jun 12:46

Stage: completed
Fetched: 07 Jun 12:46
Validated: 07 Jun 12:46
Deltas Created 07 Jun 12:46
Units Normalized: 07 Jun 14:33
Ancestry Built: 07 Jun 13:13
Nodes Matched: 07 Jun 14:31
Names Parsed: 07 Jun 13:15
New Models Stored: 07 Jun 13:05
Indexed: 07 Jun 14:33
Completed: 07 Jun 15:42
Time to Harvest: 3 minutes

Harvesting Log (most recent first)

[INFO] [2021-06-07 12:46:01] Created harvest instance #3996
[STOP] [2021-06-07 12:46:01] create_harvest_instance
[START] [2021-06-07 12:46:01] fetch_files
[STOP] [2021-06-07 12:46:02] fetch_files
[START] [2021-06-07 12:46:02] validate_each_file
[INFO] [2021-06-07 12:46:02] Looping over 3 formats...
[INFO] [2021-06-07 12:46:02] ...nodes (/app/public/data/IUCN-SD/taxon.tab)
[INFO] [2021-06-07 12:46:06] Valid: /app/public/converted_csv/IUCN-SD_nodes_3996.csv (118716 lines)
[INFO] [2021-06-07 12:46:06] ...occurrences (/app/public/data/IUCN-SD/occurrence.tab)
[INFO] [2021-06-07 12:46:11] Valid: /app/public/converted_csv/IUCN-SD_occurrences_3996.csv (359367 lines)
[INFO] [2021-06-07 12:46:11] ...measurements (/app/public/data/IUCN-SD/measurement_or_fact.tab)
[INFO] [2021-06-07 12:46:48] Valid: /app/public/converted_csv/IUCN-SD_measurements_3996.csv (921181 lines)
[STOP] [2021-06-07 12:46:48] validate_each_file
[START] [2021-06-07 12:46:48] convert_to_csv
[INFO] [2021-06-07 12:46:48] Looping over 3 formats...
[INFO] [2021-06-07 12:46:48] ...nodes (/app/public/data/IUCN-SD/taxon.tab)
[CMD] [2021-06-07 12:46:48] /usr/bin/sort /app/public/converted_csv/IUCN-SD_nodes_3996.csv > /app/public/converted_csv/IUCN-SD_nodes_3996.csv_sorted
[INFO] [2021-06-07 12:46:48] Converted: /app/public/converted_csv/IUCN-SD_nodes_3996.csv (118716 lines)
[INFO] [2021-06-07 12:46:48] ...occurrences (/app/public/data/IUCN-SD/occurrence.tab)
[CMD] [2021-06-07 12:46:48] /usr/bin/sort /app/public/converted_csv/IUCN-SD_occurrences_3996.csv > /app/public/converted_csv/IUCN-SD_occurrences_3996.csv_sorted
[INFO] [2021-06-07 12:46:49] Converted: /app/public/converted_csv/IUCN-SD_occurrences_3996.csv (359367 lines)
[INFO] [2021-06-07 12:46:49] ...measurements (/app/public/data/IUCN-SD/measurement_or_fact.tab)
[CMD] [2021-06-07 12:46:49] /usr/bin/sort /app/public/converted_csv/IUCN-SD_measurements_3996.csv > /app/public/converted_csv/IUCN-SD_measurements_3996.csv_sorted
[INFO] [2021-06-07 12:46:50] Converted: /app/public/converted_csv/IUCN-SD_measurements_3996.csv (921181 lines)
[STOP] [2021-06-07 12:46:50] convert_to_csv
[START] [2021-06-07 12:46:50] calculate_delta
[INFO] [2021-06-07 12:46:50] Looping over 3 formats...
[INFO] [2021-06-07 12:46:50] ...nodes (/app/public/data/IUCN-SD/taxon.tab)
[CMD] [2021-06-07 12:46:50] echo "0a" > /app/public/diff/IUCN-SD_nodes_3996.diff
[CMD] [2021-06-07 12:46:50] tail -n +1 /app/public/converted_csv/IUCN-SD_nodes_3996.csv >> /app/public/diff/IUCN-SD_nodes_3996.diff
[CMD] [2021-06-07 12:46:50] echo "." >> /app/public/diff/IUCN-SD_nodes_3996.diff
[INFO] [2021-06-07 12:46:50] Created diff: /app/public/diff/IUCN-SD_nodes_3996.diff (118718 lines)
[INFO] [2021-06-07 12:46:50] ...occurrences (/app/public/data/IUCN-SD/occurrence.tab)
[CMD] [2021-06-07 12:46:50] echo "0a" > /app/public/diff/IUCN-SD_occurrences_3996.diff
[CMD] [2021-06-07 12:46:50] tail -n +1 /app/public/converted_csv/IUCN-SD_occurrences_3996.csv >> /app/public/diff/IUCN-SD_occurrences_3996.diff
[CMD] [2021-06-07 12:46:51] echo "." >> /app/public/diff/IUCN-SD_occurrences_3996.diff
[INFO] [2021-06-07 12:46:51] Created diff: /app/public/diff/IUCN-SD_occurrences_3996.diff (359369 lines)
[INFO] [2021-06-07 12:46:51] ...measurements (/app/public/data/IUCN-SD/measurement_or_fact.tab)
[CMD] [2021-06-07 12:46:51] echo "0a" > /app/public/diff/IUCN-SD_measurements_3996.diff
[CMD] [2021-06-07 12:46:51] tail -n +1 /app/public/converted_csv/IUCN-SD_measurements_3996.csv >> /app/public/diff/IUCN-SD_measurements_3996.diff
[CMD] [2021-06-07 12:46:51] echo "." >> /app/public/diff/IUCN-SD_measurements_3996.diff
[INFO] [2021-06-07 12:46:52] Created diff: /app/public/diff/IUCN-SD_measurements_3996.diff (921183 lines)
[STOP] [2021-06-07 12:46:52] calculate_delta
[START] [2021-06-07 12:46:52] parse_diff_and_store
[INFO] [2021-06-07 12:46:52] Handling diff: /app/public/diff/IUCN-SD_nodes_3996.diff (118718 lines)
[INFO] [2021-06-07 12:46:52] Loading nodes diff file into memory (118718 /app/public/diff/IUCN-SD_nodes_3996.diff lines)...
[WARN] [2021-06-07 12:46:52] Filtered Scientific Name `Stictophaula coco  Gorochov & Voltshenkova, 2009` to `Stictophaula coco Gorochov & Voltshenkova, 2009`
[WARN] [2021-06-07 12:46:53] Filtered Scientific Name `Lamellidea microstoma (Quadras  and von Möllendorff, 1894)` to `Lamellidea microstoma (Quadras and von Möllendorff, 1894)`
[WARN] [2021-06-07 12:46:53] Filtered Scientific Name `Lamprocystis denticulata (Quadras  and von Möllendorff, 1894)` to `Lamprocystis denticulata (Quadras and von Möllendorff, 1894)`
[WARN] [2021-06-07 12:46:54] Filtered Scientific Name `Diplolophium buchananii (Benth. ex Oliv.)  C.Norman` to `Diplolophium buchananii (Benth. ex Oliv.) C.Norman`
[WARN] [2021-06-07 12:46:54] Filtered Scientific Name `Bothriocline moramballae (Oliv. & Hiern)  O.Hoffm.` to `Bothriocline moramballae (Oliv. & Hiern) O.Hoffm.`
[WARN] [2021-06-07 12:46:56] Filtered Scientific Name `Latopotamon xuanweiense Naruse, Yeo &  Zhou, 2008` to `Latopotamon xuanweiense Naruse, Yeo & Zhou, 2008`
[WARN] [2021-06-07 12:46:56] Filtered Scientific Name `Parathelphusa linduensis  (Roux, 1904)` to `Parathelphusa linduensis (Roux, 1904)`
[WARN] [2021-06-07 12:46:56] Filtered Scientific Name `Snaha aruna  Bahir & Yeo, 2007` to `Snaha aruna Bahir & Yeo, 2007`
[WARN] [2021-06-07 12:46:56] Filtered Scientific Name `Sinopotamon styxum  Dai, 1990` to `Sinopotamon styxum Dai, 1990`
[WARN] [2021-06-07 12:46:56] Filtered Scientific Name `Oncorhynchus nerka TRANSBOUNDARY FJORDS: Petersburg Lk/N Kupreanof Is (Walbaum, 1792)` to `Oncorhynchus nerka TRANSBOUNDARY FJORDS: Petersburg LkN Kupreanof Is (Walbaum, 1792)`
[WARN] [2021-06-07 12:46:56] Filtered Scientific Name `Oncorhynchus nerka COLUMBIA RIVER: Okanogan R/Osoyoos Lk (Walbaum, 1792)` to `Oncorhynchus nerka COLUMBIA RIVER: Okanogan ROsoyoos Lk (Walbaum, 1792)`
[WARN] [2021-06-07 12:46:56] Filtered Scientific Name `Oncorhynchus nerka PUGET SOUND-GEORGIA BASIN: Baker Lk/Puget Sound (Walbaum, 1792)` to `Oncorhynchus nerka PUGET SOUND-GEORGIA BASIN: Baker LkPuget Sound (Walbaum, 1792)`
[WARN] [2021-06-07 12:46:56] Filtered Scientific Name `Oncorhynchus nerka PUGET SOUND-GEORGIA BASIN: Schoen Ck/Davie R (Walbaum, 1792)` to `Oncorhynchus nerka PUGET SOUND-GEORGIA BASIN: Schoen CkDavie R (Walbaum, 1792)`
[WARN] [2021-06-07 12:46:56] Filtered Scientific Name `Oncorhynchus nerka NASS-SKEENA ESTUARY: Hugh Smith Lk/Boca de Quadra (Walbaum, 1792)` to `Oncorhynchus nerka NASS-SKEENA ESTUARY: Hugh Smith LkBoca de Quadra (Walbaum, 1792)`
[WARN] [2021-06-07 12:46:56] Filtered Scientific Name `Oncorhynchus nerka BERING SLOPE/KAMCHATKA CURRENTS (Walbaum, 1792)` to `Oncorhynchus nerka BERING SLOPEKAMCHATKA CURRENTS (Walbaum, 1792)`
[WARN] [2021-06-07 12:46:56] Filtered Scientific Name `Oncorhynchus nerka HECATE STRAIT-Q.C. SOUND: Lowe Lk/Granville Ch (Walbaum, 1792)` to `Oncorhynchus nerka HECATE STRAIT-Q.C. SOUND: Lowe LkGranville Ch (Walbaum, 1792)`
[WARN] [2021-06-07 12:46:56] Filtered Scientific Name `Oncorhynchus nerka COLUMBIA RIVER: Suttle Lk/Deschutes R (Walbaum, 1792)` to `Oncorhynchus nerka COLUMBIA RIVER: Suttle LkDeschutes R (Walbaum, 1792)`
[WARN] [2021-06-07 12:46:56] Filtered Scientific Name `Oncorhynchus nerka PUGET SOUND-GEORGIA BASIN: Glendale Ck/Knight Inl (Walbaum, 1792)` to `Oncorhynchus nerka PUGET SOUND-GEORGIA BASIN: Glendale CkKnight Inl (Walbaum, 1792)`
[WARN] [2021-06-07 12:46:56] Filtered Scientific Name `Oncorhynchus nerka SKEENA R, LOWER: McDonnel Lk/Zymoetz R (Walbaum, 1792)` to `Oncorhynchus nerka SKEENA R, LOWER: McDonnel LkZymoetz R (Walbaum, 1792)`
[WARN] [2021-06-07 12:46:56] Filtered Scientific Name `Oncorhynchus nerka TRANSBOUNDARY FJORDS: Kah Sheets Lk/S Kupreanof Is (Walbaum, 1792)` to `Oncorhynchus nerka TRANSBOUNDARY FJORDS: Kah Sheets LkS Kupreanof Is (Walbaum, 1792)`
[WARN] [2021-06-07 12:46:56] Filtered Scientific Name `Oncorhynchus nerka TRANSBOUNDARY FJORDS: Shipley Lk/N Kosciusko Is (Walbaum, 1792)` to `Oncorhynchus nerka TRANSBOUNDARY FJORDS: Shipley LkN Kosciusko Is (Walbaum, 1792)`
[WARN] [2021-06-07 12:46:56] Filtered Scientific Name `Oncorhynchus nerka TRANSBOUNDARY FJORDS: Kunk Lk/E Etolin Is (Walbaum, 1792)` to `Oncorhynchus nerka TRANSBOUNDARY FJORDS: Kunk LkE Etolin Is (Walbaum, 1792)`
[WARN] [2021-06-07 12:46:56] Filtered Scientific Name `Oncorhynchus nerka COLUMBIA RIVER: Upper, Headwater/Arrow, Whatsan Lk (Walbaum, 1792)` to `Oncorhynchus nerka COLUMBIA RIVER: Upper, HeadwaterArrow, Whatsan Lk (Walbaum, 1792)`
[WARN] [2021-06-07 12:46:56] Filtered Scientific Name `Oncorhynchus nerka SKEENA R, MIDDLE: Nanika Lk/Morice R (Walbaum, 1792)` to `Oncorhynchus nerka SKEENA R, MIDDLE: Nanika LkMorice R (Walbaum, 1792)`
[WARN] [2021-06-07 12:46:56] Filtered Scientific Name `Oncorhynchus nerka PUGET SOUND-GEORGIA BASIN: Quatse R/N Vancouver I (Walbaum, 1792)` to `Oncorhynchus nerka PUGET SOUND-GEORGIA BASIN: Quatse RN Vancouver I (Walbaum, 1792)`
[WARN] [2021-06-07 12:46:57] Filtered Scientific Name `Brachycephalus ferruginus Alves, Ribeiro, Haddad  & dos Reis, 2006` to `Brachycephalus ferruginus Alves, Ribeiro, Haddad & dos Reis, 2006`
[WARN] [2021-06-07 12:46:57] Filtered Scientific Name `Megophrys synoria (Stuart, Sok &  Neang, 2006)` to `Megophrys synoria (Stuart, Sok & Neang, 2006)`
[WARN] [2021-06-07 12:46:57] Filtered Scientific Name `Madhuca glabrescens  H.J.Lam` to `Madhuca glabrescens H.J.Lam`
[WARN] [2021-06-07 12:46:57] Filtered Scientific Name `Colobus guereza ssp. occidentalis  (de Rochebrune, 1887)` to `Colobus guereza ssp. occidentalis (de Rochebrune, 1887)`
[WARN] [2021-06-07 12:47:00] (Reached filtered-name limit; supressing further warnings.)
[INFO] [2021-06-07 12:47:32] Handling diff: /app/public/diff/IUCN-SD_occurrences_3996.diff (359369 lines)
[INFO] [2021-06-07 12:47:32] Loading occurrences diff file into memory (359369 /app/public/diff/IUCN-SD_occurrences_3996.diff lines)...
[INFO] [2021-06-07 12:48:18] Handling diff: /app/public/diff/IUCN-SD_measurements_3996.diff (921183 lines)
[INFO] [2021-06-07 12:48:18] Loading measurements diff file into memory (921183 /app/public/diff/IUCN-SD_measurements_3996.diff lines)...
[INFO] [2021-06-07 12:55:12] Storing 121508 ScientificNames
[INFO] [2021-06-07 12:55:12] Processing group of 121508 in 122 groups of 1000
[INFO] [2021-06-07 12:56:05] Average Time: 0.435
[INFO] [2021-06-07 12:56:05] Total Time: 54s
[INFO] [2021-06-07 12:56:05] last 3 / first 3: 0.9
[INFO] [2021-06-07 12:56:05] Std.Dev: 0.44158804331639234; Max: 2.9
[INFO] [2021-06-07 12:56:05] Storing 121508 Nodes
[INFO] [2021-06-07 12:56:05] Processing group of 121508 in 122 groups of 1000
[INFO] [2021-06-07 12:57:00] Average Time: 0.442
[INFO] [2021-06-07 12:57:00] Total Time: 55s
[INFO] [2021-06-07 12:57:00] last 3 / first 3: 0.84
[INFO] [2021-06-07 12:57:00] Std.Dev: 0.5205766033928149; Max: 3.69
[INFO] [2021-06-07 12:57:00] Storing 359367 Occurrences
[INFO] [2021-06-07 12:57:00] Processing group of 359367 in 360 groups of 1000
[INFO] [2021-06-07 12:58:32] Average Time: 0.251
[INFO] [2021-06-07 12:58:32] Total Time: 1m33s
[INFO] [2021-06-07 12:58:32] last 3 / first 3: 0.57
[INFO] [2021-06-07 12:58:32] Std.Dev: 0.7395944834840239; Max: 10.8
[INFO] [2021-06-07 12:58:32] Storing 921181 Traits
[INFO] [2021-06-07 12:58:32] Processing group of 921181 in 922 groups of 1000
[INFO] [2021-06-07 13:05:20] Average Time: 0.437
[INFO] [2021-06-07 13:05:20] Total Time: 6m48s
[INFO] [2021-06-07 13:05:20] last 3 / first 3: 1.08
[INFO] [2021-06-07 13:05:20] Std.Dev: 0.46475800154489; Max: 4.65
[INFO] [2021-06-07 13:05:20] Storing 66305 MetaTraits
[INFO] [2021-06-07 13:05:20] Processing group of 66305 in 67 groups of 1000
[INFO] [2021-06-07 13:05:37] Average Time: 0.25
[INFO] [2021-06-07 13:05:37] Total Time: 18s
[INFO] [2021-06-07 13:05:37] last 3 / first 3: 20.18
[INFO] [2021-06-07 13:05:37] Std.Dev: 0.4929503017546495; Max: 3.19
[STOP] [2021-06-07 13:05:37] parse_diff_and_store
[START] [2021-06-07 13:05:37] resolve_keys
[INFO] [2021-06-07 13:07:28] Occurrences to nodes (through scientific_names)...
[INFO] [2021-06-07 13:07:45] traits to occurrences...
[INFO] [2021-06-07 13:08:04] traits to nodes (through occurrences)...
[INFO] [2021-06-07 13:08:13] Traits to sex term...
[INFO] [2021-06-07 13:08:20] Traits to lifestage term...
[INFO] [2021-06-07 13:08:26] MetaTraits to traits...
[INFO] [2021-06-07 13:08:28] MetaTraits (simple, measurement row refers to parent) to traits...
[INFO] [2021-06-07 13:08:46] Assocs to occurrences...
[INFO] [2021-06-07 13:08:46] Assocs to nodes...
[INFO] [2021-06-07 13:08:46] Assoc to sex term...
[INFO] [2021-06-07 13:08:46] Assoc to lifestage term...
[INFO] [2021-06-07 13:08:46] MetaAssoc to assocs...
[STOP] [2021-06-07 13:08:46] resolve_keys
[START] [2021-06-07 13:08:47] hold_for_later_1
[STOP] [2021-06-07 13:08:47] hold_for_later_1
[START] [2021-06-07 13:08:47] hold_for_later_2
[STOP] [2021-06-07 13:08:47] hold_for_later_2
[START] [2021-06-07 13:08:47] resolve_missing_parents
[STOP] [2021-06-07 13:08:54] resolve_missing_parents
[START] [2021-06-07 13:08:54] rebuild_nodes
[START] [2021-06-07 13:08:54] Flattener#flatten
[START] [2021-06-07 13:08:54] Flattener#study_resource
[START] [2021-06-07 13:09:01] Flattener#build_ancestry
[STOP] [2021-06-07 13:11:38] Flattener#build_ancestry
[INFO] [2021-06-07 13:11:38] 121508 ancestry keys
[START] [2021-06-07 13:11:38] build_node_ancestors
[INFO] [2021-06-07 13:11:38] old ancestors deleted.
[STOP] [2021-06-07 13:12:55] build_node_ancestors
[START] [2021-06-07 13:12:55] Flattener#propagate_ancestor_ids
[STOP] [2021-06-07 13:13:10] Flattener#propagate_ancestor_ids
[STOP] [2021-06-07 13:13:10] Flattener#flatten
[STOP] [2021-06-07 13:13:10] rebuild_nodes
[START] [2021-06-07 13:13:10] resolve_missing_media_owners
[STOP] [2021-06-07 13:13:10] resolve_missing_media_owners
[START] [2021-06-07 13:13:10] sanitize_media_verbatims
[STOP] [2021-06-07 13:13:10] sanitize_media_verbatims
[START] [2021-06-07 13:13:10] queue_downloads
[STOP] [2021-06-07 13:13:10] queue_downloads
[START] [2021-06-07 13:13:10] parse_names
[WARN] [2021-06-07 13:13:10] I see 121508 names which still need to be parsed.
[WARN] [2021-06-07 13:14:55] I see 4 names which still need to be parsed.
[WARN] [2021-06-07 13:14:56] I see 3 names which still need to be parsed.
[WARN] [2021-06-07 13:14:57] I see 2 names which still need to be parsed.
[WARN] [2021-06-07 13:14:59] I see 1 names which still need to be parsed.
[STOP] [2021-06-07 13:15:00] parse_names
[START] [2021-06-07 13:15:00] denormalize_canonical_names_to_nodes
[STOP] [2021-06-07 13:15:02] denormalize_canonical_names_to_nodes
[START] [2021-06-07 13:15:02] match_nodes
[START] [2021-06-07 13:15:02] map_all_nodes_to_pages
[STOP] [2021-06-07 14:31:10] map_all_nodes_to_pages
[INFO] [2021-06-07 14:31:10] 5130 Unmatched nodes (of 121508)! That's too many to output. Full list in /app/public/data/IUCN-SD/unmatched_nodes.txt ; First 10: Canonical: Leptachatina lepida; Node#95668948; ResourceID: 11635; Canonical: Carelia bicolor; Node#95759281; ResourceID: 3876; Canonical: Carelia cochlea; Node#95759292; ResourceID: 3877; Canonical: Carelia cumingiana; Node#95759303; ResourceID: 3878; Canonical: Carelia dolei; Node#95759314; ResourceID: 3879; Canonical: Carelia evelynae; Node#95759325; ResourceID: 3880; Canonical: Carelia glossema; Node#95759336; ResourceID: 3881; Canonical: Carelia hyattiana; Node#95759347; ResourceID: 3882; Canonical: Carelia kalalauensis; Node#95759358; ResourceID: 3883; Canonical: Carelia necra; Node#95759412; ResourceID: 3888
[START] [2021-06-07 14:31:10] update_nodes
[STOP] [2021-06-07 14:31:18] update_nodes
[STOP] [2021-06-07 14:31:18] match_nodes
[START] [2021-06-07 14:31:18] reindex_search
[STOP] [2021-06-07 14:33:11] reindex_search
[START] [2021-06-07 14:33:11] normalize_units
[STOP] [2021-06-07 14:33:39] normalize_units
[START] [2021-06-07 14:33:39] calculate_statistics
[STOP] [2021-06-07 14:33:45] calculate_statistics
[START] [2021-06-07 14:33:45] complete_harvest_instance
[START] [2021-06-07 14:33:45] overall_tsv_creation
[INFO] [2021-06-07 14:33:45] Processing group of 121508 in 13 batches of 10000
[INFO] [2021-06-07 14:35:13] 27724 Traits (unfiltered)...
[INFO] [2021-06-07 14:38:32] 27724 Traits (filtered)...
[INFO] [2021-06-07 14:38:37] 0 Associations (filtered)...
[INFO] [2021-06-07 14:38:43] 45152 metadata added.
[INFO] [2021-06-07 14:38:43] 0 metadata added.
[INFO] [2021-06-07 14:40:31] 29999 Traits (unfiltered)...
[INFO] [2021-06-07 14:44:01] 29999 Traits (filtered)...
[INFO] [2021-06-07 14:44:04] 0 Associations (filtered)...
[INFO] [2021-06-07 14:44:10] 49760 metadata added.
[INFO] [2021-06-07 14:44:10] 0 metadata added.
[INFO] [2021-06-07 14:45:59] 29747 Traits (unfiltered)...
[INFO] [2021-06-07 14:49:29] 29747 Traits (filtered)...
[INFO] [2021-06-07 14:49:32] 0 Associations (filtered)...
[INFO] [2021-06-07 14:49:41] 42147 metadata added.
[INFO] [2021-06-07 14:49:41] 0 metadata added.
[INFO] [2021-06-07 14:51:30] 29346 Traits (unfiltered)...
[INFO] [2021-06-07 14:55:03] 29346 Traits (filtered)...
[INFO] [2021-06-07 14:55:05] 0 Associations (filtered)...
[INFO] [2021-06-07 14:55:14] 56812 metadata added.
[INFO] [2021-06-07 14:55:14] 0 metadata added.
[INFO] [2021-06-07 14:57:03] 30752 Traits (unfiltered)...
[INFO] [2021-06-07 15:00:44] 30752 Traits (filtered)...
[INFO] [2021-06-07 15:00:47] 0 Associations (filtered)...
[INFO] [2021-06-07 15:00:53] 52417 metadata added.
[INFO] [2021-06-07 15:00:53] 0 metadata added.
[INFO] [2021-06-07 15:02:42] 30449 Traits (unfiltered)...
[INFO] [2021-06-07 15:06:23] 30449 Traits (filtered)...
[INFO] [2021-06-07 15:06:25] 0 Associations (filtered)...
[INFO] [2021-06-07 15:06:32] 61416 metadata added.
[INFO] [2021-06-07 15:06:32] 0 metadata added.
[INFO] [2021-06-07 15:08:27] 30207 Traits (unfiltered)...
[INFO] [2021-06-07 15:12:07] 30207 Traits (filtered)...
[INFO] [2021-06-07 15:12:10] 0 Associations (filtered)...
[INFO] [2021-06-07 15:12:18] 48891 metadata added.
[INFO] [2021-06-07 15:12:18] 0 metadata added.
[INFO] [2021-06-07 15:14:08] 30962 Traits (unfiltered)...
[INFO] [2021-06-07 15:17:44] 30962 Traits (filtered)...
[INFO] [2021-06-07 15:17:47] 0 Associations (filtered)...
[INFO] [2021-06-07 15:17:56] 38249 metadata added.
[INFO] [2021-06-07 15:17:56] 0 metadata added.
[INFO] [2021-06-07 15:19:48] 28032 Traits (unfiltered)...
[INFO] [2021-06-07 15:23:11] 28032 Traits (filtered)...
[INFO] [2021-06-07 15:23:14] 0 Associations (filtered)...
[INFO] [2021-06-07 15:23:18] 31512 metadata added.
[INFO] [2021-06-07 15:23:18] 0 metadata added.
[INFO] [2021-06-07 15:25:07] 25708 Traits (unfiltered)...
[INFO] [2021-06-07 15:28:18] 25708 Traits (filtered)...
[INFO] [2021-06-07 15:28:20] 0 Associations (filtered)...
[INFO] [2021-06-07 15:28:25] 43785 metadata added.
[INFO] [2021-06-07 15:28:25] 0 metadata added.
[INFO] [2021-06-07 15:30:16] 31333 Traits (unfiltered)...
[INFO] [2021-06-07 15:33:59] 31333 Traits (filtered)...
[INFO] [2021-06-07 15:34:02] 0 Associations (filtered)...
[INFO] [2021-06-07 15:34:09] 40498 metadata added.
[INFO] [2021-06-07 15:34:09] 0 metadata added.
[INFO] [2021-06-07 15:35:57] 30699 Traits (unfiltered)...
[INFO] [2021-06-07 15:39:36] 30699 Traits (filtered)...
[INFO] [2021-06-07 15:39:38] 0 Associations (filtered)...
[INFO] [2021-06-07 15:39:46] 45291 metadata added.
[INFO] [2021-06-07 15:39:46] 0 metadata added.
[INFO] [2021-06-07 15:41:05] 4409 Traits (unfiltered)...
[INFO] [2021-06-07 15:42:04] 4409 Traits (filtered)...
[INFO] [2021-06-07 15:42:04] 0 Associations (filtered)...
[INFO] [2021-06-07 15:42:05] 5884 metadata added.
[INFO] [2021-06-07 15:42:05] 0 metadata added.
[INFO] [2021-06-07 15:42:33] Average Time: 284.98
[INFO] [2021-06-07 15:42:33] Total Time: 1h8m48s
[INFO] [2021-06-07 15:42:33] last 3 / first 3: 0.83
[INFO] [2021-06-07 15:42:33] Std.Dev: 54.31509918982014; Max: 312.34
[STOP] [2021-06-07 15:42:33] overall_tsv_creation
[INFO] [2021-06-07 15:42:33] Done. Check your files:
[INFO] [2021-06-07 15:42:33] (121504 lines) /app/public/data/IUCN-SD/publish_nodes.tsv
[INFO] [2021-06-07 15:42:34] (604118 lines) /app/public/data/IUCN-SD/publish_node_ancestors.tsv
[INFO] [2021-06-07 15:42:34] (121508 lines) /app/public/data/IUCN-SD/publish_scientific_names.tsv
[INFO] [2021-06-07 15:42:34] (359368 lines) /app/public/data/IUCN-SD/publish_traits.tsv
[INFO] [2021-06-07 15:42:34] (561815 lines) /app/public/data/IUCN-SD/publish_metadata.tsv
[STOP] [2021-06-07 15:42:35] complete_harvest_instance
[START] [2021-06-07 15:42:35] completed
[STOP] [2021-06-07 15:42:35] completed
[STOP] [2021-06-07 15:42:35] logged process, took 10593.5

Latest Process