Harvest for Govindarajan et al 2011 Created 03 Aug 12:47

Harvesting Log

[INFO] [2022-08-03 12:47:31] Created harvest instance #4152
[STOP] [2022-08-03 12:47:31] create_harvest_instance
[START] [2022-08-03 12:47:31] fetch_files
[STOP] [2022-08-03 12:47:31] fetch_files
[START] [2022-08-03 12:47:31] validate_each_file
[INFO] [2022-08-03 12:47:31] Looping over 3 formats...
[INFO] [2022-08-03 12:47:31] ...nodes (/app/public/data/govindarajan_et_/taxa.txt)
[INFO] [2022-08-03 12:47:31] Valid: /app/public/data/govindarajan_et_/converted_csv/govindarajan_et__nodes_29422.csv (4 lines)
[INFO] [2022-08-03 12:47:31] ...occurrences (/app/public/data/govindarajan_et_/occurrences.txt)
[INFO] [2022-08-03 12:47:31] Valid: /app/public/data/govindarajan_et_/converted_csv/govindarajan_et__occurrences_29423.csv (8 lines)
[INFO] [2022-08-03 12:47:31] ...measurements (/app/public/data/govindarajan_et_/measurementOrFact.txt)
[INFO] [2022-08-03 12:47:31] Valid: /app/public/data/govindarajan_et_/converted_csv/govindarajan_et__measurements_29424.csv (16 lines)
[STOP] [2022-08-03 12:47:31] validate_each_file
[START] [2022-08-03 12:47:31] convert_to_csv
[INFO] [2022-08-03 12:47:31] Looping over 3 formats...
[INFO] [2022-08-03 12:47:31] ...nodes (/app/public/data/govindarajan_et_/taxa.txt)
[CMD] [2022-08-03 12:47:31] /usr/bin/sort /app/public/data/govindarajan_et_/converted_csv/govindarajan_et__nodes_29422.csv > /app/public/data/govindarajan_et_/converted_csv/govindarajan_et__nodes_29422.csv_sorted
[INFO] [2022-08-03 12:47:31] Converted: /app/public/data/govindarajan_et_/converted_csv/govindarajan_et__nodes_29422.csv (4 lines)
[INFO] [2022-08-03 12:47:31] ...occurrences (/app/public/data/govindarajan_et_/occurrences.txt)
[CMD] [2022-08-03 12:47:31] /usr/bin/sort /app/public/data/govindarajan_et_/converted_csv/govindarajan_et__occurrences_29423.csv > /app/public/data/govindarajan_et_/converted_csv/govindarajan_et__occurrences_29423.csv_sorted
[INFO] [2022-08-03 12:47:31] Converted: /app/public/data/govindarajan_et_/converted_csv/govindarajan_et__occurrences_29423.csv (8 lines)
[INFO] [2022-08-03 12:47:31] ...measurements (/app/public/data/govindarajan_et_/measurementOrFact.txt)
[CMD] [2022-08-03 12:47:31] /usr/bin/sort /app/public/data/govindarajan_et_/converted_csv/govindarajan_et__measurements_29424.csv > /app/public/data/govindarajan_et_/converted_csv/govindarajan_et__measurements_29424.csv_sorted
[INFO] [2022-08-03 12:47:31] Converted: /app/public/data/govindarajan_et_/converted_csv/govindarajan_et__measurements_29424.csv (16 lines)
[STOP] [2022-08-03 12:47:31] convert_to_csv
[START] [2022-08-03 12:47:31] calculate_delta
[INFO] [2022-08-03 12:47:31] Looping over 3 formats...
[INFO] [2022-08-03 12:47:31] ...nodes (/app/public/data/govindarajan_et_/taxa.txt)
[CMD] [2022-08-03 12:47:31] echo "0a" > /app/public/data/govindarajan_et_/diff/govindarajan_et__nodes_29422.diff
[CMD] [2022-08-03 12:47:31] tail -n +1 /app/public/data/govindarajan_et_/converted_csv/govindarajan_et__nodes_29422.csv >> /app/public/data/govindarajan_et_/diff/govindarajan_et__nodes_29422.diff
[CMD] [2022-08-03 12:47:31] echo "." >> /app/public/data/govindarajan_et_/diff/govindarajan_et__nodes_29422.diff
[INFO] [2022-08-03 12:47:31] Created diff: /app/public/data/govindarajan_et_/diff/govindarajan_et__nodes_29422.diff (6 lines)
[INFO] [2022-08-03 12:47:31] ...occurrences (/app/public/data/govindarajan_et_/occurrences.txt)
[CMD] [2022-08-03 12:47:31] echo "0a" > /app/public/data/govindarajan_et_/diff/govindarajan_et__occurrences_29423.diff
[CMD] [2022-08-03 12:47:31] tail -n +1 /app/public/data/govindarajan_et_/converted_csv/govindarajan_et__occurrences_29423.csv >> /app/public/data/govindarajan_et_/diff/govindarajan_et__occurrences_29423.diff
[CMD] [2022-08-03 12:47:31] echo "." >> /app/public/data/govindarajan_et_/diff/govindarajan_et__occurrences_29423.diff
[INFO] [2022-08-03 12:47:31] Created diff: /app/public/data/govindarajan_et_/diff/govindarajan_et__occurrences_29423.diff (10 lines)
[INFO] [2022-08-03 12:47:31] ...measurements (/app/public/data/govindarajan_et_/measurementOrFact.txt)
[CMD] [2022-08-03 12:47:31] echo "0a" > /app/public/data/govindarajan_et_/diff/govindarajan_et__measurements_29424.diff
[CMD] [2022-08-03 12:47:31] tail -n +1 /app/public/data/govindarajan_et_/converted_csv/govindarajan_et__measurements_29424.csv >> /app/public/data/govindarajan_et_/diff/govindarajan_et__measurements_29424.diff
[CMD] [2022-08-03 12:47:31] echo "." >> /app/public/data/govindarajan_et_/diff/govindarajan_et__measurements_29424.diff
[INFO] [2022-08-03 12:47:31] Created diff: /app/public/data/govindarajan_et_/diff/govindarajan_et__measurements_29424.diff (18 lines)
[STOP] [2022-08-03 12:47:31] calculate_delta
[START] [2022-08-03 12:47:31] parse_diff_and_store
[INFO] [2022-08-03 12:47:31] Handling diff: /app/public/data/govindarajan_et_/diff/govindarajan_et__nodes_29422.diff (6 lines)
[INFO] [2022-08-03 12:47:31] Loading nodes diff file into memory (6 lines)...
[INFO] [2022-08-03 12:47:31] Storing 4 ScientificNames (8/4/6)
[INFO] [2022-08-03 12:47:31] Storing 4 Nodes (8/4/6)
[INFO] [2022-08-03 12:47:31] Handling diff: /app/public/data/govindarajan_et_/diff/govindarajan_et__occurrences_29423.diff (10 lines)
[INFO] [2022-08-03 12:47:31] Loading occurrences diff file into memory (10 lines)...
[INFO] [2022-08-03 12:47:33] Storing 8 Occurrences (15/8/10)
[INFO] [2022-08-03 12:47:33] Storing 7 OccurrenceMetadata (15/8/10)
[INFO] [2022-08-03 12:47:33] Handling diff: /app/public/data/govindarajan_et_/diff/govindarajan_et__measurements_29424.diff (18 lines)
[INFO] [2022-08-03 12:47:33] Loading measurements diff file into memory (18 lines)...
[INFO] [2022-08-03 12:47:33] Storing 16 Traits (24/16/18)
[INFO] [2022-08-03 12:47:33] Storing 8 MetaTraits (24/16/18)
[STOP] [2022-08-03 12:47:33] parse_diff_and_store
[START] [2022-08-03 12:47:33] resolve_keys
[2022-08-03 12:47:33] Resolving downloaded urls (this is not actually downloading them yet)
[INFO] [2022-08-03 12:47:40] Occurrences to nodes (through scientific_names)...
[INFO] [2022-08-03 12:47:40] traits to occurrences...
[INFO] [2022-08-03 12:47:40] traits to nodes (through occurrences)...
[INFO] [2022-08-03 12:47:40] Traits to sex term...
[INFO] [2022-08-03 12:47:40] Traits to lifestage term...
[INFO] [2022-08-03 12:47:40] MetaTraits to traits...
[INFO] [2022-08-03 12:47:40] MetaTraits (simple, measurement row refers to parent) to traits...
[INFO] [2022-08-03 12:47:40] Assocs to occurrences...
[INFO] [2022-08-03 12:47:40] Assocs to nodes...
[INFO] [2022-08-03 12:47:40] Assoc to sex term...
[INFO] [2022-08-03 12:47:40] Assoc to lifestage term...
[INFO] [2022-08-03 12:47:40] MetaAssoc to assocs...
[STOP] [2022-08-03 12:47:40] resolve_keys
[START] [2022-08-03 12:47:40] hold_for_later_1
[STOP] [2022-08-03 12:47:40] hold_for_later_1
[START] [2022-08-03 12:47:40] hold_for_later_2
[STOP] [2022-08-03 12:47:40] hold_for_later_2
[START] [2022-08-03 12:47:40] resolve_missing_parents
[STOP] [2022-08-03 12:47:40] resolve_missing_parents
[START] [2022-08-03 12:47:40] rebuild_nodes
[START] [2022-08-03 12:47:40] Flattener#flatten
[START] [2022-08-03 12:47:40] Flattener#study_resource
[START] [2022-08-03 12:47:40] Flattener#build_ancestry
[STOP] [2022-08-03 12:47:40] Flattener#build_ancestry
[INFO] [2022-08-03 12:47:40] 4 ancestry keys
[START] [2022-08-03 12:47:40] build_node_ancestors
[INFO] [2022-08-03 12:47:40] old ancestors deleted.
[STOP] [2022-08-03 12:47:40] build_node_ancestors
[WARN] [2022-08-03 12:47:40] Flattener: nothing to flatten! (Completely flat resource?)
[STOP] [2022-08-03 12:47:40] Flattener#flatten
[STOP] [2022-08-03 12:47:40] rebuild_nodes
[START] [2022-08-03 12:47:40] resolve_missing_media_owners
[STOP] [2022-08-03 12:47:40] resolve_missing_media_owners
[START] [2022-08-03 12:47:40] sanitize_media_verbatims
[STOP] [2022-08-03 12:47:40] sanitize_media_verbatims
[START] [2022-08-03 12:47:40] queue_downloads
[STOP] [2022-08-03 12:47:40] queue_downloads
[START] [2022-08-03 12:47:40] parse_names
[WARN] [2022-08-03 12:47:40] I see 4 names which still need to be parsed.
[WARN] [2022-08-03 12:47:40] Names to parse: 4 formatted: 4 learned: 4 parsed: 4
[STOP] [2022-08-03 12:47:41] parse_names
[START] [2022-08-03 12:47:41] denormalize_canonical_names_to_nodes
[STOP] [2022-08-03 12:47:41] denormalize_canonical_names_to_nodes
[START] [2022-08-03 12:47:41] match_nodes
[START] [2022-08-03 12:47:41] map_all_nodes_to_pages
[STOP] [2022-08-03 12:47:41] map_all_nodes_to_pages
[INFO] [2022-08-03 12:47:41] ZERO unmatched nodes (of 4)! Nicely done.
[START] [2022-08-03 12:47:41] update_nodes
[STOP] [2022-08-03 12:47:41] update_nodes
[STOP] [2022-08-03 12:47:41] match_nodes
[START] [2022-08-03 12:47:41] reindex_search
[STOP] [2022-08-03 12:47:41] reindex_search
[START] [2022-08-03 12:47:41] normalize_units
[STOP] [2022-08-03 12:47:41] normalize_units
[START] [2022-08-03 12:47:41] calculate_statistics
[2022-08-03 12:47:41] ZERO NODE ANCESTORS. Is this actually a completely flat resource?
[INFO] [2022-08-03 12:47:41] Duplicate page_id count: 0
[STOP] [2022-08-03 12:47:41] calculate_statistics
[START] [2022-08-03 12:47:41] complete_harvest_instance
[START] [2022-08-03 12:47:41] overall_tsv_creation
[STOP] [2022-08-03 12:47:41] overall_tsv_creation
[STOP] [2022-08-03 12:47:41] complete_harvest_instance
[ERR] [2022-08-03 12:47:41] ActiveRecord::StatementInvalid
[ERR] [2022-08-03 12:47:41] Mysql2::Error::ConnectionError: Lost connection to MySQL server during query: SELECT id FROM `resources` WHERE repository_id = 1132 LIMIT 1
[ERR] [2022-08-03 12:47:41] ../models/web_db.rb:290:in `exec_query'
[ERR] [2022-08-03 12:47:41] ../models/web_db.rb:267:in `find_by_repo_id'
[ERR] [2022-08-03 12:47:41] ../models/web_db.rb:225:in `resource_id'
[ERR] [2022-08-03 12:47:41] ../models/publisher.rb:101:in `learn_resource_publishing_id'
[ERR] [2022-08-03 12:47:41] ../models/publisher.rb:80:in `block in by_resource'
[ERR] [2022-08-03 12:47:41] ../models/logged_process.rb:43:in `run_step'
[ERR] [2022-08-03 12:47:41] ../models/publisher.rb:79:in `by_resource'
[ERR] [2022-08-03 12:47:41] ../models/publisher.rb:23:in `by_resource'
[ERR] [2022-08-03 12:47:41] ../models/resource_harvester.rb:726:in `complete_harvest_instance'
[ERR] [2022-08-03 12:47:41] ../models/resource_harvester.rb:86:in `block (2 levels) in start'
[ERR] [2022-08-03 12:47:41] ../models/logged_process.rb:43:in `run_step'
[ERR] [2022-08-03 12:47:41] ../models/resource_harvester.rb:86:in `block in start'
[ERR] [2022-08-03 12:47:41] ../models/resource_harvester.rb:75:in `each_key'
[ERR] [2022-08-03 12:47:41] ../models/resource_harvester.rb:75:in `start'
[ERR] [2022-08-03 12:47:41] ../models/resource.rb:300:in `harvest'
[ERR] [2022-08-03 12:47:41] bin/rails:4:in `require'
[ERR] [2022-08-03 12:47:41] bin/rails:4:in `<main>'
[STOP] [2022-08-03 12:47:41] logged process, took 10.61
[INFO] [2022-08-03 12:49:44] ## HARVEST: type = resume_harvest
[START] [2022-08-03 12:49:47] logged process: cc99dec1bd4343b158c54391c8619b4b8fda1396 Break up huge trait CSV wrtites
[INFO] [2022-08-03 12:49:47] Already completed stage create_harvest_instance, skipping...
[INFO] [2022-08-03 12:49:47] Already completed stage fetch_files, skipping...
[INFO] [2022-08-03 12:49:47] Already completed stage validate_each_file, skipping...
[INFO] [2022-08-03 12:49:47] Already completed stage convert_to_csv, skipping...
[INFO] [2022-08-03 12:49:47] Already completed stage calculate_delta, skipping...
[INFO] [2022-08-03 12:49:47] Already completed stage parse_diff_and_store, skipping...
[INFO] [2022-08-03 12:49:47] Already completed stage resolve_keys, skipping...
[INFO] [2022-08-03 12:49:47] Already completed stage hold_for_later_1, skipping...
[INFO] [2022-08-03 12:49:47] Already completed stage hold_for_later_2, skipping...
[INFO] [2022-08-03 12:49:47] Already completed stage resolve_missing_parents, skipping...
[INFO] [2022-08-03 12:49:47] Already completed stage rebuild_nodes, skipping...
[INFO] [2022-08-03 12:49:47] Already completed stage resolve_missing_media_owners, skipping...
[INFO] [2022-08-03 12:49:47] Already completed stage sanitize_media_verbatims, skipping...
[INFO] [2022-08-03 12:49:47] Already completed stage queue_downloads, skipping...
[INFO] [2022-08-03 12:49:47] Already completed stage parse_names, skipping...
[INFO] [2022-08-03 12:49:47] Already completed stage denormalize_canonical_names_to_nodes, skipping...
[INFO] [2022-08-03 12:49:47] Already completed stage match_nodes, skipping...
[INFO] [2022-08-03 12:49:47] Already completed stage reindex_search, skipping...
[INFO] [2022-08-03 12:49:47] Already completed stage normalize_units, skipping...
[INFO] [2022-08-03 12:49:47] Already completed stage calculate_statistics, skipping...
[START] [2022-08-03 12:49:47] complete_harvest_instance
[START] [2022-08-03 12:49:47] overall_tsv_creation
[INFO] [2022-08-03 12:49:47] Exporting 4 nodes as TSV in batches of 10000...
[INFO] [2022-08-03 12:49:47] Processing group of 4 in 1 batches of 10000
[INFO] [2022-08-03 12:50:29] 8 Traits (unfiltered) and 0 associations...
[INFO] [2022-08-03 12:50:29] Building Traits map for 4 nodes (this can take a while)...
[INFO] [2022-08-03 12:51:22] Mapped 8 traits (8 meta) for 4 nodes.
[INFO] [2022-08-03 12:51:22] Building Associations map (this can take a while)...
[INFO] [2022-08-03 12:51:22] Done. 0 assocs mapped (0 meta).
[INFO] [2022-08-03 12:51:22] Adding 8 traits...
[INFO] [2022-08-03 12:51:22] 8 metadata added.
[INFO] [2022-08-03 12:51:22] Adding 0 assocs...
[INFO] [2022-08-03 12:51:22] 0 metadata added.
[INFO] [2022-08-03 12:52:04] 0 Traits (unfiltered) and 0 associations...
[INFO] [2022-08-03 12:52:04] Building Traits map for 0 nodes (this can take a while)...
[INFO] [2022-08-03 12:52:04] Mapped 0 traits (0 meta) for 0 nodes.
[INFO] [2022-08-03 12:52:04] Building Associations map (this can take a while)...
[INFO] [2022-08-03 12:52:04] Done. 0 assocs mapped (0 meta).
[INFO] [2022-08-03 12:52:04] Adding 0 traits...
[INFO] [2022-08-03 12:52:04] 0 metadata added.
[INFO] [2022-08-03 12:52:04] Adding 0 assocs...
[INFO] [2022-08-03 12:52:04] 0 metadata added.
[INFO] [2022-08-03 12:52:46] 0 Traits (unfiltered) and 0 associations...
[INFO] [2022-08-03 12:52:46] Building Traits map for 0 nodes (this can take a while)...
[INFO] [2022-08-03 12:52:46] Mapped 0 traits (0 meta) for 0 nodes.
[INFO] [2022-08-03 12:52:46] Building Associations map (this can take a while)...
[INFO] [2022-08-03 12:52:46] Done. 0 assocs mapped (0 meta).
[INFO] [2022-08-03 12:52:46] Adding 0 traits...
[INFO] [2022-08-03 12:52:46] 0 metadata added.
[INFO] [2022-08-03 12:52:46] Adding 0 assocs...
[INFO] [2022-08-03 12:52:46] 0 metadata added.
[INFO] [2022-08-03 12:53:30] 0 Traits (unfiltered) and 0 associations...
[INFO] [2022-08-03 12:53:30] Building Traits map for 0 nodes (this can take a while)...
[INFO] [2022-08-03 12:53:30] Mapped 0 traits (0 meta) for 0 nodes.
[INFO] [2022-08-03 12:53:30] Building Associations map (this can take a while)...
[INFO] [2022-08-03 12:53:30] Done. 0 assocs mapped (0 meta).
[INFO] [2022-08-03 12:53:30] Adding 0 traits...
[INFO] [2022-08-03 12:53:30] 0 metadata added.
[INFO] [2022-08-03 12:53:30] Adding 0 assocs...
[INFO] [2022-08-03 12:53:30] 0 metadata added.
[INFO] [2022-08-03 12:54:12] 0 Traits (unfiltered) and 0 associations...
[INFO] [2022-08-03 12:54:12] Building Traits map for 0 nodes (this can take a while)...
[INFO] [2022-08-03 12:54:12] Mapped 0 traits (0 meta) for 0 nodes.
[INFO] [2022-08-03 12:54:12] Building Associations map (this can take a while)...
[INFO] [2022-08-03 12:54:12] Done. 0 assocs mapped (0 meta).
[INFO] [2022-08-03 12:54:12] Adding 0 traits...
[INFO] [2022-08-03 12:54:12] 0 metadata added.
[INFO] [2022-08-03 12:54:12] Adding 0 assocs...
[INFO] [2022-08-03 12:54:12] 0 metadata added.
[INFO] [2022-08-03 12:54:55] 0 Traits (unfiltered) and 0 associations...
[INFO] [2022-08-03 12:54:55] Building Traits map for 0 nodes (this can take a while)...
[INFO] [2022-08-03 12:54:55] Mapped 0 traits (0 meta) for 0 nodes.
[INFO] [2022-08-03 12:54:55] Building Associations map (this can take a while)...
[INFO] [2022-08-03 12:54:55] Done. 0 assocs mapped (0 meta).
[INFO] [2022-08-03 12:54:55] Adding 0 traits...
[INFO] [2022-08-03 12:54:55] 0 metadata added.
[INFO] [2022-08-03 12:54:55] Adding 0 assocs...
[INFO] [2022-08-03 12:54:55] 0 metadata added.
[INFO] [2022-08-03 12:55:37] 0 Traits (unfiltered) and 0 associations...
[INFO] [2022-08-03 12:55:37] Building Traits map for 0 nodes (this can take a while)...
[INFO] [2022-08-03 12:55:37] Mapped 0 traits (0 meta) for 0 nodes.
[INFO] [2022-08-03 12:55:37] Building Associations map (this can take a while)...
[INFO] [2022-08-03 12:55:37] Done. 0 assocs mapped (0 meta).
[INFO] [2022-08-03 12:55:37] Adding 0 traits...
[INFO] [2022-08-03 12:55:37] 0 metadata added.
[INFO] [2022-08-03 12:55:37] Adding 0 assocs...
[INFO] [2022-08-03 12:55:37] 0 metadata added.
[INFO] [2022-08-03 12:56:18] 0 Traits (unfiltered) and 0 associations...
[INFO] [2022-08-03 12:56:18] Building Traits map for 0 nodes (this can take a while)...
[INFO] [2022-08-03 12:56:18] Mapped 0 traits (0 meta) for 0 nodes.
[INFO] [2022-08-03 12:56:18] Building Associations map (this can take a while)...
[INFO] [2022-08-03 12:56:18] Done. 0 assocs mapped (0 meta).
[INFO] [2022-08-03 12:56:18] Adding 0 traits...
[INFO] [2022-08-03 12:56:18] 0 metadata added.
[INFO] [2022-08-03 12:56:18] Adding 0 assocs...
[INFO] [2022-08-03 12:56:18] 0 metadata added.
[INFO] [2022-08-03 12:57:02] 0 Traits (unfiltered) and 0 associations...
[INFO] [2022-08-03 12:57:02] Building Traits map for 0 nodes (this can take a while)...
[INFO] [2022-08-03 12:57:02] Mapped 0 traits (0 meta) for 0 nodes.
[INFO] [2022-08-03 12:57:02] Building Associations map (this can take a while)...
[INFO] [2022-08-03 12:57:02] Done. 0 assocs mapped (0 meta).
[INFO] [2022-08-03 12:57:02] Adding 0 traits...
[INFO] [2022-08-03 12:57:02] 0 metadata added.
[INFO] [2022-08-03 12:57:02] Adding 0 assocs...
[INFO] [2022-08-03 12:57:02] 0 metadata added.
[START] [2022-08-03 12:58:05] logged process: cc99dec1bd4343b158c54391c8619b4b8fda1396 Break up huge trait CSV wrtites
[INFO] [2022-08-03 12:58:05] Already completed stage create_harvest_instance, skipping...
[INFO] [2022-08-03 12:58:05] Already completed stage fetch_files, skipping...
[INFO] [2022-08-03 12:58:05] Already completed stage validate_each_file, skipping...
[INFO] [2022-08-03 12:58:05] Already completed stage convert_to_csv, skipping...
[INFO] [2022-08-03 12:58:05] Already completed stage calculate_delta, skipping...
[INFO] [2022-08-03 12:58:05] Already completed stage parse_diff_and_store, skipping...
[INFO] [2022-08-03 12:58:05] Already completed stage resolve_keys, skipping...
[INFO] [2022-08-03 12:58:05] Already completed stage hold_for_later_1, skipping...
[INFO] [2022-08-03 12:58:05] Already completed stage hold_for_later_2, skipping...
[INFO] [2022-08-03 12:58:05] Already completed stage resolve_missing_parents, skipping...
[INFO] [2022-08-03 12:58:05] Already completed stage rebuild_nodes, skipping...
[INFO] [2022-08-03 12:58:05] Already completed stage resolve_missing_media_owners, skipping...
[INFO] [2022-08-03 12:58:05] Already completed stage sanitize_media_verbatims, skipping...
[INFO] [2022-08-03 12:58:05] Already completed stage queue_downloads, skipping...
[INFO] [2022-08-03 12:58:05] Already completed stage parse_names, skipping...
[INFO] [2022-08-03 12:58:05] Already completed stage denormalize_canonical_names_to_nodes, skipping...
[INFO] [2022-08-03 12:58:05] Already completed stage match_nodes, skipping...
[INFO] [2022-08-03 12:58:05] Already completed stage reindex_search, skipping...
[INFO] [2022-08-03 12:58:05] Already completed stage normalize_units, skipping...
[INFO] [2022-08-03 12:58:05] Already completed stage calculate_statistics, skipping...
[START] [2022-08-03 12:58:05] complete_harvest_instance
[START] [2022-08-03 12:58:05] overall_tsv_creation
[INFO] [2022-08-03 12:58:05] It looks like we have already exported up to node 118594001, resuming.
[INFO] [2022-08-03 12:58:05] Exporting another 0 nodes as TSV in batches of 10000...
[INFO] [2022-08-03 12:58:05] Processing group of 0 in 0 batches of 10000
[INFO] [2022-08-03 12:58:05] Average Time: NaN
[INFO] [2022-08-03 12:58:05] Total Time: 1s
[STOP] [2022-08-03 12:58:05] overall_tsv_creation
[INFO] [2022-08-03 12:58:05] Done. Check your files:
[STOP] [2022-08-03 12:58:05] complete_harvest_instance
[START] [2022-08-03 12:58:05] completed
[STOP] [2022-08-03 12:58:05] completed
[STOP] [2022-08-03 12:58:05] logged process, took 0.15

Latest Process

03 Aug 12:58 EXITED currently processing 0