Harvest for wikipedia emerging_languages Created 29 May 09:37

Stage: completed
Fetched: 29 May 09:37
Validated: 29 May 09:37
Deltas Created 29 May 09:37
Units Normalized: 29 May 09:54
Ancestry Built: 29 May 09:39
Nodes Matched: 29 May 09:53
Names Parsed: 29 May 09:39
New Models Stored: 29 May 09:37
Indexed: 29 May 09:54
Completed: 29 May 09:55
Time to Harvest: less than a minute

Harvesting Log

(298 lines)
# Logfile created on 2020-05-28 15:04:25 -0400 by logger.rb/v1.4.2
[INFO] [2020-05-28 15:04:25] ## HARVEST: type = -harvest
[START] [2020-05-28 15:04:29] logged process
[START] [2020-05-28 15:04:29] create_harvest_instance
[STOP] [2020-05-28 15:04:30] create_harvest_instance
[START] [2020-05-28 15:04:30] fetch_files
[STOP] [2020-05-28 15:04:30] fetch_files
[START] [2020-05-28 15:04:30] validate_each_file
[STOP] [2020-05-28 15:04:31] validate_each_file
[START] [2020-05-28 15:04:31] convert_to_csv
[CMD] [2020-05-28 15:04:31] /usr/bin/sort /app/public/converted_csv/wiki_combined_l2_nodes_21020.csv > /app/public/converted_csv/wiki_combined_l2_nodes_21020.csv_sorted
[CMD] [2020-05-28 15:04:31] /usr/bin/sort /app/public/converted_csv/wiki_combined_l2_media_21021.csv > /app/public/converted_csv/wiki_combined_l2_media_21021.csv_sorted
[STOP] [2020-05-28 15:04:31] convert_to_csv
[START] [2020-05-28 15:04:31] calculate_delta
[CMD] [2020-05-28 15:04:31] echo "0a" > /app/public/diff/wiki_combined_l2_nodes_21020.diff
[CMD] [2020-05-28 15:04:31] tail -n +1 /app/public/converted_csv/wiki_combined_l2_nodes_21020.csv >> /app/public/diff/wiki_combined_l2_nodes_21020.diff
[CMD] [2020-05-28 15:04:31] echo "." >> /app/public/diff/wiki_combined_l2_nodes_21020.diff
[CMD] [2020-05-28 15:04:31] echo "0a" > /app/public/diff/wiki_combined_l2_media_21021.diff
[CMD] [2020-05-28 15:04:31] tail -n +1 /app/public/converted_csv/wiki_combined_l2_media_21021.csv >> /app/public/diff/wiki_combined_l2_media_21021.diff
[CMD] [2020-05-28 15:04:31] echo "." >> /app/public/diff/wiki_combined_l2_media_21021.diff
[STOP] [2020-05-28 15:04:31] calculate_delta
[START] [2020-05-28 15:04:31] parse_diff_and_store
[INFO] [2020-05-28 15:04:31] Loading nodes diff file into memory (true lines)...
[INFO] [2020-05-28 15:04:33] Loading media diff file into memory (true lines)...
[INFO] [2020-05-28 15:04:53] Storing 5697 ScientificNames
[INFO] [2020-05-28 15:04:53] Processing group of 5697 in 6 groups of 1000
[INFO] [2020-05-28 15:04:54] Average Time: 0.31
[INFO] [2020-05-28 15:04:54] Total Time: 2s
[INFO] [2020-05-28 15:04:54] Storing 5697 Identifiers
[INFO] [2020-05-28 15:04:54] Processing group of 5697 in 6 groups of 1000
[INFO] [2020-05-28 15:04:55] Average Time: 0.107
[INFO] [2020-05-28 15:04:55] Total Time: 1s
[INFO] [2020-05-28 15:04:55] Storing 5697 Nodes
[INFO] [2020-05-28 15:04:55] Processing group of 5697 in 6 groups of 1000
[INFO] [2020-05-28 15:04:57] Average Time: 0.28
[INFO] [2020-05-28 15:04:57] Total Time: 2s
[INFO] [2020-05-28 15:04:57] Storing 6829 ArticlesSections
[INFO] [2020-05-28 15:04:57] Processing group of 6829 in 7 groups of 1000
[INFO] [2020-05-28 15:04:57] Average Time: 0.049
[INFO] [2020-05-28 15:04:57] Total Time: 1s
[INFO] [2020-05-28 15:04:57] last 3 / first 3: 0.93
[INFO] [2020-05-28 15:04:57] Std.Dev: 0.0; Max: 0.05
[INFO] [2020-05-28 15:04:57] Storing 6829 Articles
[INFO] [2020-05-28 15:04:57] Processing group of 6829 in 7 groups of 1000
[INFO] [2020-05-28 15:05:00] Average Time: 0.441
[INFO] [2020-05-28 15:05:00] Total Time: 4s
[INFO] [2020-05-28 15:05:00] last 3 / first 3: 0.87
[INFO] [2020-05-28 15:05:00] Std.Dev: 0.044721359549995794; Max: 0.5
[STOP] [2020-05-28 15:05:00] parse_diff_and_store
[START] [2020-05-28 15:05:00] resolve_keys
[INFO] [2020-05-28 15:05:40] Occurrences to nodes (through scientific_names)...
[INFO] [2020-05-28 15:05:40] traits to occurrences...
[INFO] [2020-05-28 15:05:40] traits to nodes (through occurrences)...
[INFO] [2020-05-28 15:05:40] Traits to sex term...
[INFO] [2020-05-28 15:05:40] Traits to lifestage term...
[INFO] [2020-05-28 15:05:40] MetaTraits to traits...
[INFO] [2020-05-28 15:05:40] MetaTraits (simple, measurement row refers to parent) to traits...
[INFO] [2020-05-28 15:05:40] Assocs to occurrences...
[INFO] [2020-05-28 15:05:40] Assocs to nodes...
[INFO] [2020-05-28 15:05:40] Assoc to sex term...
[INFO] [2020-05-28 15:05:40] Assoc to lifestage term...
[STOP] [2020-05-28 15:05:40] resolve_keys
[START] [2020-05-28 15:05:40] hold_for_later_1
[STOP] [2020-05-28 15:05:40] hold_for_later_1
[START] [2020-05-28 15:05:40] hold_for_later_2
[STOP] [2020-05-28 15:05:40] hold_for_later_2
[START] [2020-05-28 15:05:40] resolve_missing_parents
[STOP] [2020-05-28 15:05:43] resolve_missing_parents
[START] [2020-05-28 15:05:43] rebuild_nodes
[START] [2020-05-28 15:05:43] Flattener#flatten
[START] [2020-05-28 15:05:43] Flattener#study_resource
[START] [2020-05-28 15:05:43] Flattener#build_ancestry
[STOP] [2020-05-28 15:05:43] Flattener#build_ancestry
[INFO] [2020-05-28 15:05:43] 5697 ancestry keys
[START] [2020-05-28 15:05:43] build_node_ancestors
[INFO] [2020-05-28 15:05:43] old ancestors deleted.
[STOP] [2020-05-28 15:05:54] build_node_ancestors
[START] [2020-05-28 15:05:55] Flattener#propagate_ancestor_ids
[STOP] [2020-05-28 15:05:58] Flattener#propagate_ancestor_ids
[STOP] [2020-05-28 15:05:58] Flattener#flatten
[STOP] [2020-05-28 15:05:58] rebuild_nodes
[START] [2020-05-28 15:05:58] resolve_missing_media_owners
[STOP] [2020-05-28 15:05:58] resolve_missing_media_owners
[START] [2020-05-28 15:05:58] sanitize_media_verbatims
[STOP] [2020-05-28 15:05:58] sanitize_media_verbatims
[START] [2020-05-28 15:05:58] queue_downloads
[STOP] [2020-05-28 15:05:58] queue_downloads
[START] [2020-05-28 15:05:58] parse_names
[WARN] [2020-05-28 15:05:58] I see 5697 names which still need to be parsed.
[WARN] [2020-05-28 15:06:02] I see 10 names which still need to be parsed.
[STOP] [2020-05-28 15:06:03] parse_names
[START] [2020-05-28 15:06:03] denormalize_canonical_names_to_nodes
[STOP] [2020-05-28 15:06:04] denormalize_canonical_names_to_nodes
[START] [2020-05-28 15:06:04] match_nodes
[START] [2020-05-28 15:06:04] map_all_nodes_to_pages
[STOP] [2020-05-28 15:25:38] map_all_nodes_to_pages
[INFO] [2020-05-28 15:25:38] 959 Unmatched nodes (of 5697)! That's too many to output. First 10: Biota (#78592447); Prokaryota (#78591779); Bacteria (#78589903); Negibacteria (#78593459); Escherichia coli (#78592609); Posibacteria (#78593499); Actinobacteria (#78590213); Actinobacteria (#78592737); Actinobacteridae (#78589813); Eozoa (#78593199)
[START] [2020-05-28 15:25:38] update_nodes
[STOP] [2020-05-28 15:25:40] update_nodes
[STOP] [2020-05-28 15:25:40] match_nodes
[START] [2020-05-28 15:25:40] reindex_search
[STOP] [2020-05-28 15:26:10] reindex_search
[START] [2020-05-28 15:26:10] normalize_units
[STOP] [2020-05-28 15:26:10] normalize_units
[START] [2020-05-28 15:26:10] calculate_statistics
[STOP] [2020-05-28 15:26:11] calculate_statistics
[START] [2020-05-28 15:26:11] complete_harvest_instance
[START] [2020-05-28 15:26:11] overall_tsv_creation
[INFO] [2020-05-28 15:26:11] Processing group of 5697 in 1 batches of 10000
[2020-05-28 15:26:50] Encountered new language, please assign it to a language group and give it a name: szy
[2020-05-28 15:26:51] Encountered new language, please assign it to a language group and give it a name: ban
[WARN] [2020-05-28 15:26:51] Encountered new license, please find a logo URL and give it a name: lij
[INFO] [2020-05-28 15:27:22] Average Time: 31.28
[INFO] [2020-05-28 15:27:22] Total Time: 1m11s
[STOP] [2020-05-28 15:27:22] overall_tsv_creation
[INFO] [2020-05-28 15:27:22] Done. Check your files:
[INFO] [2020-05-28 15:27:22] (5697 lines) /app/public/data/wiki_combined_l2/publish_nodes.tsv
[INFO] [2020-05-28 15:27:22] (5697 lines) /app/public/data/wiki_combined_l2/publish_identifiers.tsv
[INFO] [2020-05-28 15:27:22] (112210 lines) /app/public/data/wiki_combined_l2/publish_node_ancestors.tsv
[INFO] [2020-05-28 15:27:22] (5697 lines) /app/public/data/wiki_combined_l2/publish_scientific_names.tsv
[INFO] [2020-05-28 15:27:22] (64068 lines) /app/public/data/wiki_combined_l2/publish_articles.tsv
[INFO] [2020-05-28 15:27:22] (6829 lines) /app/public/data/wiki_combined_l2/publish_content_sections.tsv
[STOP] [2020-05-28 15:27:22] complete_harvest_instance
[START] [2020-05-28 15:27:22] completed
[STOP] [2020-05-28 15:27:22] completed
[STOP] [2020-05-28 15:27:22] logged process, took 1373.5
[INFO] [2020-05-29 09:36:59] ## HARVEST: type = re_download_opendata_-harvest
[INFO] [2020-05-29 09:37:00] ## remove_type: ScientificName
[INFO] [2020-05-29 09:37:01] ++ Calling delete_all on 5697 instances...
[INFO] [2020-05-29 09:37:01] [09:37:01.555] Removed 5697 Scientificnames
[INFO] [2020-05-29 09:37:01] ## remove_type: Vernacular
[INFO] [2020-05-29 09:37:01] ++ Calling delete_all on 0 instances...
[INFO] [2020-05-29 09:37:01] [09:37:01.559] Removed 0 Vernaculars
[INFO] [2020-05-29 09:37:01] ## remove_type: Article
[INFO] [2020-05-29 09:37:01] ++ Calling delete_all on 6829 instances...
[INFO] [2020-05-29 09:37:04] [09:37:04.766] Removed 6829 Articles
[INFO] [2020-05-29 09:37:04] ## remove_type: Medium
[INFO] [2020-05-29 09:37:04] ++ Calling delete_all on 0 instances...
[INFO] [2020-05-29 09:37:04] [09:37:04.773] Removed 0 Media
[INFO] [2020-05-29 09:37:04] ## remove_type: Trait
[INFO] [2020-05-29 09:37:04] ++ Calling delete_all on 0 instances...
[INFO] [2020-05-29 09:37:04] [09:37:04.776] Removed 0 Traits
[INFO] [2020-05-29 09:37:04] ## remove_type: MetaTrait
[INFO] [2020-05-29 09:37:04] ++ Calling delete_all on 0 instances...
[INFO] [2020-05-29 09:37:04] [09:37:04.784] Removed 0 Metatraits
[INFO] [2020-05-29 09:37:04] ## remove_type: OccurrenceMetadatum
[INFO] [2020-05-29 09:37:04] ++ Calling delete_all on 0 instances...
[INFO] [2020-05-29 09:37:04] [09:37:04.810] Removed 0 Occurrencemetadata
[INFO] [2020-05-29 09:37:04] ## remove_type: Assoc
[INFO] [2020-05-29 09:37:04] ++ Calling delete_all on 0 instances...
[INFO] [2020-05-29 09:37:04] [09:37:04.812] Removed 0 Assocs
[INFO] [2020-05-29 09:37:04] ## remove_type: MetaAssoc
[INFO] [2020-05-29 09:37:05] ++ Calling delete_all on 0 instances...
[INFO] [2020-05-29 09:37:05] [09:37:05.128] Removed 0 Metaassocs
[INFO] [2020-05-29 09:37:05] ## remove_type: Identifier
[INFO] [2020-05-29 09:37:05] ++ Calling delete_all on 5697 instances...
[INFO] [2020-05-29 09:37:07] [09:37:07.165] Removed 5697 Identifiers
[INFO] [2020-05-29 09:37:07] ## remove_type: Reference
[INFO] [2020-05-29 09:37:07] ++ Calling delete_all on 0 instances...
[INFO] [2020-05-29 09:37:07] [09:37:07.169] Removed 0 References
[INFO] [2020-05-29 09:37:07] Starting batch with ID 78589736...
[INFO] [2020-05-29 09:37:08] Starting batch with ID 78589736...
[INFO] [2020-05-29 09:37:09] Starting batch with ID 78589741...
[INFO] [2020-05-29 09:37:09] Starting batch with ID 78593902...
[INFO] [2020-05-29 09:37:09] Starting batch with ID 78593902...
[INFO] [2020-05-29 09:37:09] Starting batch with ID 78593902...
[INFO] [2020-05-29 09:37:09] Starting batch with ID 78593902...
[INFO] [2020-05-29 09:37:10] Starting batch with ID 78593902...
[INFO] [2020-05-29 09:37:10] ## remove_type: Node
[INFO] [2020-05-29 09:37:10] ++ Calling delete_all on 5697 instances...
[INFO] [2020-05-29 09:37:11] [09:37:11.509] Removed 5697 Nodes
[START] [2020-05-29 09:37:23] logged process
[START] [2020-05-29 09:37:23] Creating resource from OpenData
[START] [2020-05-29 09:37:24] logged process
[START] [2020-05-29 09:37:24] Parse meta.xml file and create formats with fields
[STOP] [2020-05-29 09:37:24] Parse meta.xml file and create formats with fields
[STOP] [2020-05-29 09:37:24] Creating resource from OpenData
[START] [2020-05-29 09:37:24] logged process
[START] [2020-05-29 09:37:24] create_harvest_instance
[STOP] [2020-05-29 09:37:26] create_harvest_instance
[START] [2020-05-29 09:37:26] fetch_files
[STOP] [2020-05-29 09:37:26] fetch_files
[START] [2020-05-29 09:37:26] validate_each_file
[STOP] [2020-05-29 09:37:27] validate_each_file
[START] [2020-05-29 09:37:27] convert_to_csv
[CMD] [2020-05-29 09:37:27] /usr/bin/sort /app/public/converted_csv/wiki_combined_l2_nodes_21028.csv > /app/public/converted_csv/wiki_combined_l2_nodes_21028.csv_sorted
[CMD] [2020-05-29 09:37:27] /usr/bin/sort /app/public/converted_csv/wiki_combined_l2_media_21029.csv > /app/public/converted_csv/wiki_combined_l2_media_21029.csv_sorted
[STOP] [2020-05-29 09:37:27] convert_to_csv
[START] [2020-05-29 09:37:27] calculate_delta
[CMD] [2020-05-29 09:37:27] echo "0a" > /app/public/diff/wiki_combined_l2_nodes_21028.diff
[CMD] [2020-05-29 09:37:27] tail -n +1 /app/public/converted_csv/wiki_combined_l2_nodes_21028.csv >> /app/public/diff/wiki_combined_l2_nodes_21028.diff
[CMD] [2020-05-29 09:37:27] echo "." >> /app/public/diff/wiki_combined_l2_nodes_21028.diff
[CMD] [2020-05-29 09:37:27] echo "0a" > /app/public/diff/wiki_combined_l2_media_21029.diff
[CMD] [2020-05-29 09:37:27] tail -n +1 /app/public/converted_csv/wiki_combined_l2_media_21029.csv >> /app/public/diff/wiki_combined_l2_media_21029.diff
[CMD] [2020-05-29 09:37:27] echo "." >> /app/public/diff/wiki_combined_l2_media_21029.diff
[STOP] [2020-05-29 09:37:27] calculate_delta
[START] [2020-05-29 09:37:27] parse_diff_and_store
[INFO] [2020-05-29 09:37:27] Loading nodes diff file into memory (true lines)...
[INFO] [2020-05-29 09:37:29] Loading media diff file into memory (true lines)...
[INFO] [2020-05-29 09:37:50] Storing 5697 ScientificNames
[INFO] [2020-05-29 09:37:50] Processing group of 5697 in 6 groups of 1000
[INFO] [2020-05-29 09:37:53] Average Time: 0.495
[INFO] [2020-05-29 09:37:53] Total Time: 4s
[INFO] [2020-05-29 09:37:53] Storing 5697 Identifiers
[INFO] [2020-05-29 09:37:53] Processing group of 5697 in 6 groups of 1000
[INFO] [2020-05-29 09:37:54] Average Time: 0.098
[INFO] [2020-05-29 09:37:54] Total Time: 1s
[INFO] [2020-05-29 09:37:54] Storing 5697 Nodes
[INFO] [2020-05-29 09:37:54] Processing group of 5697 in 6 groups of 1000
[INFO] [2020-05-29 09:37:55] Average Time: 0.287
[INFO] [2020-05-29 09:37:55] Total Time: 2s
[INFO] [2020-05-29 09:37:55] Storing 6826 ArticlesSections
[INFO] [2020-05-29 09:37:55] Processing group of 6826 in 7 groups of 1000
[INFO] [2020-05-29 09:37:56] Average Time: 0.051
[INFO] [2020-05-29 09:37:56] Total Time: 1s
[INFO] [2020-05-29 09:37:56] last 3 / first 3: 0.82
[INFO] [2020-05-29 09:37:56] Std.Dev: 0.0; Max: 0.07
[INFO] [2020-05-29 09:37:56] Storing 6826 Articles
[INFO] [2020-05-29 09:37:56] Processing group of 6826 in 7 groups of 1000
[INFO] [2020-05-29 09:37:59] Average Time: 0.493
[INFO] [2020-05-29 09:37:59] Total Time: 4s
[INFO] [2020-05-29 09:37:59] last 3 / first 3: 1.09
[INFO] [2020-05-29 09:37:59] Std.Dev: 0.09486832980505137; Max: 0.7
[STOP] [2020-05-29 09:37:59] parse_diff_and_store
[START] [2020-05-29 09:37:59] resolve_keys
[INFO] [2020-05-29 09:38:55] Occurrences to nodes (through scientific_names)...
[INFO] [2020-05-29 09:38:55] traits to occurrences...
[INFO] [2020-05-29 09:38:55] traits to nodes (through occurrences)...
[INFO] [2020-05-29 09:38:55] Traits to sex term...
[INFO] [2020-05-29 09:38:55] Traits to lifestage term...
[INFO] [2020-05-29 09:38:55] MetaTraits to traits...
[INFO] [2020-05-29 09:38:55] MetaTraits (simple, measurement row refers to parent) to traits...
[INFO] [2020-05-29 09:38:55] Assocs to occurrences...
[INFO] [2020-05-29 09:38:55] Assocs to nodes...
[INFO] [2020-05-29 09:38:55] Assoc to sex term...
[INFO] [2020-05-29 09:38:55] Assoc to lifestage term...
[STOP] [2020-05-29 09:38:55] resolve_keys
[START] [2020-05-29 09:38:55] hold_for_later_1
[STOP] [2020-05-29 09:38:55] hold_for_later_1
[START] [2020-05-29 09:38:55] hold_for_later_2
[STOP] [2020-05-29 09:38:55] hold_for_later_2
[START] [2020-05-29 09:38:55] resolve_missing_parents
[STOP] [2020-05-29 09:38:58] resolve_missing_parents
[START] [2020-05-29 09:38:58] rebuild_nodes
[START] [2020-05-29 09:38:58] Flattener#flatten
[START] [2020-05-29 09:38:58] Flattener#study_resource
[START] [2020-05-29 09:38:58] Flattener#build_ancestry
[STOP] [2020-05-29 09:38:58] Flattener#build_ancestry
[INFO] [2020-05-29 09:38:58] 5697 ancestry keys
[START] [2020-05-29 09:38:58] build_node_ancestors
[INFO] [2020-05-29 09:38:58] old ancestors deleted.
[STOP] [2020-05-29 09:39:09] build_node_ancestors
[START] [2020-05-29 09:39:10] Flattener#propagate_ancestor_ids
[STOP] [2020-05-29 09:39:13] Flattener#propagate_ancestor_ids
[STOP] [2020-05-29 09:39:13] Flattener#flatten
[STOP] [2020-05-29 09:39:13] rebuild_nodes
[START] [2020-05-29 09:39:13] resolve_missing_media_owners
[STOP] [2020-05-29 09:39:13] resolve_missing_media_owners
[START] [2020-05-29 09:39:13] sanitize_media_verbatims
[STOP] [2020-05-29 09:39:13] sanitize_media_verbatims
[START] [2020-05-29 09:39:13] queue_downloads
[STOP] [2020-05-29 09:39:13] queue_downloads
[START] [2020-05-29 09:39:13] parse_names
[WARN] [2020-05-29 09:39:13] I see 5697 names which still need to be parsed.
[WARN] [2020-05-29 09:39:18] I see 10 names which still need to be parsed.
[STOP] [2020-05-29 09:39:19] parse_names
[START] [2020-05-29 09:39:19] denormalize_canonical_names_to_nodes
[STOP] [2020-05-29 09:39:19] denormalize_canonical_names_to_nodes
[START] [2020-05-29 09:39:19] match_nodes
[START] [2020-05-29 09:39:19] map_all_nodes_to_pages
[STOP] [2020-05-29 09:53:34] map_all_nodes_to_pages
[INFO] [2020-05-29 09:53:34] 957 Unmatched nodes (of 5697)! That's too many to output. First 10: Biota (#79551387); Prokaryota (#79550719); Bacteria (#79548843); Negibacteria (#79552399); Escherichia coli (#79551549); Posibacteria (#79552439); Actinobacteria (#79549153); Actinobacteria (#79551677); Actinobacteridae (#79548753); Eozoa (#79552139)
[START] [2020-05-29 09:53:34] update_nodes
[STOP] [2020-05-29 09:53:37] update_nodes
[STOP] [2020-05-29 09:53:37] match_nodes
[START] [2020-05-29 09:53:37] reindex_search
[STOP] [2020-05-29 09:54:04] reindex_search
[START] [2020-05-29 09:54:04] normalize_units
[STOP] [2020-05-29 09:54:04] normalize_units
[START] [2020-05-29 09:54:04] calculate_statistics
[STOP] [2020-05-29 09:54:04] calculate_statistics
[START] [2020-05-29 09:54:04] complete_harvest_instance
[START] [2020-05-29 09:54:04] overall_tsv_creation
[INFO] [2020-05-29 09:54:04] Processing group of 5697 in 1 batches of 10000
[INFO] [2020-05-29 09:55:55] Average Time: 58.9
[INFO] [2020-05-29 09:55:55] Total Time: 1m51s
[STOP] [2020-05-29 09:55:55] overall_tsv_creation
[INFO] [2020-05-29 09:55:55] Done. Check your files:
[INFO] [2020-05-29 09:55:55] (5697 lines) /app/public/data/wiki_combined_l2/publish_nodes.tsv
[INFO] [2020-05-29 09:55:55] (5697 lines) /app/public/data/wiki_combined_l2/publish_identifiers.tsv
[INFO] [2020-05-29 09:55:55] (112210 lines) /app/public/data/wiki_combined_l2/publish_node_ancestors.tsv
[INFO] [2020-05-29 09:55:55] (5697 lines) /app/public/data/wiki_combined_l2/publish_scientific_names.tsv
[INFO] [2020-05-29 09:55:55] (64198 lines) /app/public/data/wiki_combined_l2/publish_articles.tsv
[INFO] [2020-05-29 09:55:55] (6826 lines) /app/public/data/wiki_combined_l2/publish_content_sections.tsv
[STOP] [2020-05-29 09:55:55] complete_harvest_instance
[START] [2020-05-29 09:55:55] completed
[STOP] [2020-05-29 09:55:55] completed
[STOP] [2020-05-29 09:55:55] logged process, took 1110.68

Latest Process