Harvest for Zookeys Created 19 Jan 15:15

Harvesting Log

[INFO] [2022-01-19 15:15:10] Created harvest instance #4093
[STOP] [2022-01-19 15:15:10] create_harvest_instance
[START] [2022-01-19 15:15:10] fetch_files
[STOP] [2022-01-19 15:15:10] fetch_files
[START] [2022-01-19 15:15:10] validate_each_file
[INFO] [2022-01-19 15:15:10] Looping over 7 formats...
[INFO] [2022-01-19 15:15:10] ...agents (/app/public/data/Zookeys/agent.tab)
[INFO] [2022-01-19 15:15:10] Valid: /app/public/converted_csv/Zookeys_agents_4093.csv (2031 lines)
[INFO] [2022-01-19 15:15:10] ...refs (/app/public/data/Zookeys/reference.tab)
[INFO] [2022-01-19 15:15:10] Valid: /app/public/converted_csv/Zookeys_refs_4093.csv (1420 lines)
[INFO] [2022-01-19 15:15:10] ...nodes (/app/public/data/Zookeys/taxon.tab)
[INFO] [2022-01-19 15:15:11] Valid: /app/public/converted_csv/Zookeys_nodes_4093.csv (8847 lines)
[INFO] [2022-01-19 15:15:11] ...media (/app/public/data/Zookeys/media_resource.tab)
[INFO] [2022-01-19 15:15:15] Valid: /app/public/converted_csv/Zookeys_media_4093.csv (28979 lines)
[INFO] [2022-01-19 15:15:15] ...occurrences (/app/public/data/Zookeys/occurrence_specific.tab)
[INFO] [2022-01-19 15:15:15] Valid: /app/public/converted_csv/Zookeys_occurrences_4093.csv (9777 lines)
[INFO] [2022-01-19 15:15:15] ...assocs (/app/public/data/Zookeys/association.tab)
[INFO] [2022-01-19 15:15:15] Valid: /app/public/converted_csv/Zookeys_assocs_4093.csv (21 lines)
[INFO] [2022-01-19 15:15:15] ...measurements (/app/public/data/Zookeys/measurement_or_fact_specific.tab)
[INFO] [2022-01-19 15:15:16] Valid: /app/public/converted_csv/Zookeys_measurements_4093.csv (9745 lines)
[STOP] [2022-01-19 15:15:16] validate_each_file
[START] [2022-01-19 15:15:16] convert_to_csv
[INFO] [2022-01-19 15:15:16] Looping over 7 formats...
[INFO] [2022-01-19 15:15:16] ...agents (/app/public/data/Zookeys/agent.tab)
[CMD] [2022-01-19 15:15:16] /usr/bin/sort /app/public/converted_csv/Zookeys_agents_4093.csv > /app/public/converted_csv/Zookeys_agents_4093.csv_sorted
[INFO] [2022-01-19 15:15:18] Converted: /app/public/converted_csv/Zookeys_agents_4093.csv (2031 lines)
[INFO] [2022-01-19 15:15:18] ...refs (/app/public/data/Zookeys/reference.tab)
[CMD] [2022-01-19 15:15:18] /usr/bin/sort /app/public/converted_csv/Zookeys_refs_4093.csv > /app/public/converted_csv/Zookeys_refs_4093.csv_sorted
[INFO] [2022-01-19 15:15:19] Converted: /app/public/converted_csv/Zookeys_refs_4093.csv (1420 lines)
[INFO] [2022-01-19 15:15:19] ...nodes (/app/public/data/Zookeys/taxon.tab)
[CMD] [2022-01-19 15:15:19] /usr/bin/sort /app/public/converted_csv/Zookeys_nodes_4093.csv > /app/public/converted_csv/Zookeys_nodes_4093.csv_sorted
[INFO] [2022-01-19 15:15:21] Converted: /app/public/converted_csv/Zookeys_nodes_4093.csv (8847 lines)
[INFO] [2022-01-19 15:15:21] ...media (/app/public/data/Zookeys/media_resource.tab)
[CMD] [2022-01-19 15:15:21] /usr/bin/sort /app/public/converted_csv/Zookeys_media_4093.csv > /app/public/converted_csv/Zookeys_media_4093.csv_sorted
[INFO] [2022-01-19 15:15:23] Converted: /app/public/converted_csv/Zookeys_media_4093.csv (28979 lines)
[INFO] [2022-01-19 15:15:23] ...occurrences (/app/public/data/Zookeys/occurrence_specific.tab)
[CMD] [2022-01-19 15:15:23] /usr/bin/sort /app/public/converted_csv/Zookeys_occurrences_4093.csv > /app/public/converted_csv/Zookeys_occurrences_4093.csv_sorted
[INFO] [2022-01-19 15:15:24] Converted: /app/public/converted_csv/Zookeys_occurrences_4093.csv (9777 lines)
[INFO] [2022-01-19 15:15:24] ...assocs (/app/public/data/Zookeys/association.tab)
[CMD] [2022-01-19 15:15:24] /usr/bin/sort /app/public/converted_csv/Zookeys_assocs_4093.csv > /app/public/converted_csv/Zookeys_assocs_4093.csv_sorted
[INFO] [2022-01-19 15:15:26] Converted: /app/public/converted_csv/Zookeys_assocs_4093.csv (21 lines)
[INFO] [2022-01-19 15:15:26] ...measurements (/app/public/data/Zookeys/measurement_or_fact_specific.tab)
[CMD] [2022-01-19 15:15:26] /usr/bin/sort /app/public/converted_csv/Zookeys_measurements_4093.csv > /app/public/converted_csv/Zookeys_measurements_4093.csv_sorted
[INFO] [2022-01-19 15:15:28] Converted: /app/public/converted_csv/Zookeys_measurements_4093.csv (9745 lines)
[STOP] [2022-01-19 15:15:28] convert_to_csv
[START] [2022-01-19 15:15:28] calculate_delta
[INFO] [2022-01-19 15:15:28] Looping over 7 formats...
[INFO] [2022-01-19 15:15:28] ...agents (/app/public/data/Zookeys/agent.tab)
[CMD] [2022-01-19 15:15:28] echo "0a" > /app/public/diff/Zookeys_agents_4093.diff
[CMD] [2022-01-19 15:15:29] tail -n +1 /app/public/converted_csv/Zookeys_agents_4093.csv >> /app/public/diff/Zookeys_agents_4093.diff
[CMD] [2022-01-19 15:15:31] echo "." >> /app/public/diff/Zookeys_agents_4093.diff
[INFO] [2022-01-19 15:15:32] Created diff: /app/public/diff/Zookeys_agents_4093.diff (2033 lines)
[INFO] [2022-01-19 15:15:32] ...refs (/app/public/data/Zookeys/reference.tab)
[CMD] [2022-01-19 15:15:32] echo "0a" > /app/public/diff/Zookeys_refs_4093.diff
[CMD] [2022-01-19 15:15:34] tail -n +1 /app/public/converted_csv/Zookeys_refs_4093.csv >> /app/public/diff/Zookeys_refs_4093.diff
[CMD] [2022-01-19 15:15:35] echo "." >> /app/public/diff/Zookeys_refs_4093.diff
[INFO] [2022-01-19 15:15:37] Created diff: /app/public/diff/Zookeys_refs_4093.diff (1422 lines)
[INFO] [2022-01-19 15:15:37] ...nodes (/app/public/data/Zookeys/taxon.tab)
[CMD] [2022-01-19 15:15:37] echo "0a" > /app/public/diff/Zookeys_nodes_4093.diff
[CMD] [2022-01-19 15:15:39] tail -n +1 /app/public/converted_csv/Zookeys_nodes_4093.csv >> /app/public/diff/Zookeys_nodes_4093.diff
[CMD] [2022-01-19 15:15:40] echo "." >> /app/public/diff/Zookeys_nodes_4093.diff
[INFO] [2022-01-19 15:15:42] Created diff: /app/public/diff/Zookeys_nodes_4093.diff (8849 lines)
[INFO] [2022-01-19 15:15:42] ...media (/app/public/data/Zookeys/media_resource.tab)
[CMD] [2022-01-19 15:15:42] echo "0a" > /app/public/diff/Zookeys_media_4093.diff
[CMD] [2022-01-19 15:15:43] tail -n +1 /app/public/converted_csv/Zookeys_media_4093.csv >> /app/public/diff/Zookeys_media_4093.diff
[CMD] [2022-01-19 15:15:45] echo "." >> /app/public/diff/Zookeys_media_4093.diff
[INFO] [2022-01-19 15:15:47] Created diff: /app/public/diff/Zookeys_media_4093.diff (28981 lines)
[INFO] [2022-01-19 15:15:47] ...occurrences (/app/public/data/Zookeys/occurrence_specific.tab)
[CMD] [2022-01-19 15:15:47] echo "0a" > /app/public/diff/Zookeys_occurrences_4093.diff
[CMD] [2022-01-19 15:15:48] tail -n +1 /app/public/converted_csv/Zookeys_occurrences_4093.csv >> /app/public/diff/Zookeys_occurrences_4093.diff
[CMD] [2022-01-19 15:15:50] echo "." >> /app/public/diff/Zookeys_occurrences_4093.diff
[INFO] [2022-01-19 15:15:51] Created diff: /app/public/diff/Zookeys_occurrences_4093.diff (9779 lines)
[INFO] [2022-01-19 15:15:51] ...assocs (/app/public/data/Zookeys/association.tab)
[CMD] [2022-01-19 15:15:51] echo "0a" > /app/public/diff/Zookeys_assocs_4093.diff
[CMD] [2022-01-19 15:15:53] tail -n +1 /app/public/converted_csv/Zookeys_assocs_4093.csv >> /app/public/diff/Zookeys_assocs_4093.diff
[CMD] [2022-01-19 15:15:55] echo "." >> /app/public/diff/Zookeys_assocs_4093.diff
[INFO] [2022-01-19 15:15:56] Created diff: /app/public/diff/Zookeys_assocs_4093.diff (23 lines)
[INFO] [2022-01-19 15:15:56] ...measurements (/app/public/data/Zookeys/measurement_or_fact_specific.tab)
[CMD] [2022-01-19 15:15:56] echo "0a" > /app/public/diff/Zookeys_measurements_4093.diff
[CMD] [2022-01-19 15:15:58] tail -n +1 /app/public/converted_csv/Zookeys_measurements_4093.csv >> /app/public/diff/Zookeys_measurements_4093.diff
[CMD] [2022-01-19 15:15:59] echo "." >> /app/public/diff/Zookeys_measurements_4093.diff
[INFO] [2022-01-19 15:16:01] Created diff: /app/public/diff/Zookeys_measurements_4093.diff (9747 lines)
[STOP] [2022-01-19 15:16:01] calculate_delta
[START] [2022-01-19 15:16:01] parse_diff_and_store
[INFO] [2022-01-19 15:16:01] Handling diff: /app/public/diff/Zookeys_agents_4093.diff (2033 lines)
[INFO] [2022-01-19 15:16:02] Loading agents diff file into memory (2033 /app/public/diff/Zookeys_agents_4093.diff lines)...
[INFO] [2022-01-19 15:16:04] Handling diff: /app/public/diff/Zookeys_refs_4093.diff (1422 lines)
[INFO] [2022-01-19 15:16:06] Loading refs diff file into memory (1422 /app/public/diff/Zookeys_refs_4093.diff lines)...
[INFO] [2022-01-19 15:16:08] Handling diff: /app/public/diff/Zookeys_nodes_4093.diff (8849 lines)
[INFO] [2022-01-19 15:16:09] Loading nodes diff file into memory (8849 /app/public/diff/Zookeys_nodes_4093.diff lines)...
[WARN] [2022-01-19 15:16:12] Filtered Scientific Name `Lasionycta perplexella\tCrabo et Lafontaine, 2009` to `Lasionycta perplexellatCrabo et Lafontaine, 2009`
[WARN] [2022-01-19 15:16:15] Filtered Scientific Name `Plastus  Plastus  amplus  Wu et Zhou, 2010` to `Plastus Plastus amplus Wu et Zhou, 2010`
[WARN] [2022-01-19 15:16:15] Filtered Scientific Name `Plastus  Plastus  biconcavus Wu et Zhou, 2010` to `Plastus Plastus biconcavus Wu et Zhou, 2010`
[WARN] [2022-01-19 15:16:15] Filtered Scientific Name `Keilbachia subacumina  Wu et Zhang, 2010` to `Keilbachia subacumina Wu et Zhang, 2010`
[INFO] [2022-01-19 15:16:15] Handling diff: /app/public/diff/Zookeys_media_4093.diff (28981 lines)
[INFO] [2022-01-19 15:16:17] Loading media diff file into memory (28981 /app/public/diff/Zookeys_media_4093.diff lines)...
[INFO] [2022-01-19 15:16:51] Handling diff: /app/public/diff/Zookeys_occurrences_4093.diff (9779 lines)
[INFO] [2022-01-19 15:16:52] Loading occurrences diff file into memory (9779 /app/public/diff/Zookeys_occurrences_4093.diff lines)...
[INFO] [2022-01-19 15:16:55] Handling diff: /app/public/diff/Zookeys_assocs_4093.diff (23 lines)
[INFO] [2022-01-19 15:16:56] Loading assocs diff file into memory (23 /app/public/diff/Zookeys_assocs_4093.diff lines)...
[INFO] [2022-01-19 15:16:58] Handling diff: /app/public/diff/Zookeys_measurements_4093.diff (9747 lines)
[INFO] [2022-01-19 15:16:59] Loading measurements diff file into memory (9747 /app/public/diff/Zookeys_measurements_4093.diff lines)...
[STOP] [2022-01-19 15:17:06] parse_diff_and_store
[ERR] [2022-01-19 15:17:06] RuntimeError
[ERR] [2022-01-19 15:17:06] Missing Term for URI `http://purl.obolibrary.org/obo/ENVO_00000420`, must be added!
[ERR] [2022-01-19 15:17:06] ../models/store/model_builder.rb:653:in `fail_on_bad_uri'
[ERR] [2022-01-19 15:17:06] ../models/store/model_builder.rb:607:in `convert_trait_value'
[ERR] [2022-01-19 15:17:06] ../models/store/model_builder.rb:425:in `build_trait'
[ERR] [2022-01-19 15:17:06] ../models/store/model_builder.rb:28:in `build_models'
[ERR] [2022-01-19 15:17:06] ../models/resource_harvester.rb:354:in `block (3 levels) in parse_diff_and_store'
[ERR] [2022-01-19 15:17:06] ../models/csv_parser.rb:111:in `block in diff_as_hashes'
[ERR] [2022-01-19 15:17:06] ../models/csv_parser.rb:28:in `block in line_at_a_time'
[ERR] [2022-01-19 15:17:06] ../models/csv_parser.rb:25:in `line_at_a_time'
[ERR] [2022-01-19 15:17:06] ../models/csv_parser.rb:96:in `diff_as_hashes'
[ERR] [2022-01-19 15:17:06] ../models/resource_harvester.rb:308:in `block (2 levels) in parse_diff_and_store'
[ERR] [2022-01-19 15:17:06] ../models/logged_process.rb:86:in `enter_group'
[ERR] [2022-01-19 15:17:06] ../models/resource_harvester.rb:306:in `block in parse_diff_and_store'
[ERR] [2022-01-19 15:17:06] ../models/resource_harvester.rb:709:in `block in each_diff'
[ERR] [2022-01-19 15:17:06] ../models/resource_harvester.rb:696:in `each_diff'
[ERR] [2022-01-19 15:17:06] ../models/resource_harvester.rb:301:in `parse_diff_and_store'
[ERR] [2022-01-19 15:17:06] ../models/resource_harvester.rb:86:in `block (2 levels) in start'
[ERR] [2022-01-19 15:17:06] ../models/logged_process.rb:43:in `run_step'
[ERR] [2022-01-19 15:17:06] ../models/resource_harvester.rb:86:in `block in start'
[ERR] [2022-01-19 15:17:06] ../models/resource_harvester.rb:75:in `each_key'
[ERR] [2022-01-19 15:17:06] ../models/resource_harvester.rb:75:in `start'
[ERR] [2022-01-19 15:17:06] ../models/resource.rb:280:in `harvest'
[ERR] [2022-01-19 15:17:06] ../models/resource.rb:256:in `re_download_opendata_and_harvest'
[ERR] [2022-01-19 15:17:06] bin/rails:4:in `require'
[ERR] [2022-01-19 15:17:06] bin/rails:4:in `<main>'
[STOP] [2022-01-19 15:17:06] logged process, took 117.6
[INFO] [2022-01-20 16:19:16] ## HARVEST: type = resume_-harvest
[START] [2022-01-20 16:19:19] logged process: e0f71f84fbb52f8ac28c07bb9ad0f6a065812443 Updating nginx-sites to allow remote origins
[INFO] [2022-01-20 16:19:19] Already completed stage create_harvest_instance, skipping...
[INFO] [2022-01-20 16:19:19] Already completed stage fetch_files, skipping...
[INFO] [2022-01-20 16:19:19] Already completed stage validate_each_file, skipping...
[INFO] [2022-01-20 16:19:19] Already completed stage convert_to_csv, skipping...
[INFO] [2022-01-20 16:19:19] Already completed stage calculate_delta, skipping...
[START] [2022-01-20 16:19:19] parse_diff_and_store
[INFO] [2022-01-20 16:19:19] Handling diff: /app/public/diff/Zookeys_agents_4093.diff (2033 lines)
[INFO] [2022-01-20 16:19:21] Loading agents diff file into memory (2033 /app/public/diff/Zookeys_agents_4093.diff lines)...
[INFO] [2022-01-20 16:19:23] Handling diff: /app/public/diff/Zookeys_refs_4093.diff (1422 lines)
[INFO] [2022-01-20 16:19:25] Loading refs diff file into memory (1422 /app/public/diff/Zookeys_refs_4093.diff lines)...
[INFO] [2022-01-20 16:19:26] Handling diff: /app/public/diff/Zookeys_nodes_4093.diff (8849 lines)
[INFO] [2022-01-20 16:19:28] Loading nodes diff file into memory (8849 /app/public/diff/Zookeys_nodes_4093.diff lines)...
[WARN] [2022-01-20 16:19:45] Filtered Scientific Name `Lasionycta perplexella\tCrabo et Lafontaine, 2009` to `Lasionycta perplexellatCrabo et Lafontaine, 2009`
[WARN] [2022-01-20 16:19:49] Filtered Scientific Name `Plastus  Plastus  amplus  Wu et Zhou, 2010` to `Plastus Plastus amplus Wu et Zhou, 2010`
[WARN] [2022-01-20 16:19:49] Filtered Scientific Name `Plastus  Plastus  biconcavus Wu et Zhou, 2010` to `Plastus Plastus biconcavus Wu et Zhou, 2010`
[WARN] [2022-01-20 16:19:49] Filtered Scientific Name `Keilbachia subacumina  Wu et Zhang, 2010` to `Keilbachia subacumina Wu et Zhang, 2010`
[INFO] [2022-01-20 16:19:50] Handling diff: /app/public/diff/Zookeys_media_4093.diff (28981 lines)
[INFO] [2022-01-20 16:19:51] Loading media diff file into memory (28981 /app/public/diff/Zookeys_media_4093.diff lines)...
[INFO] [2022-01-20 16:20:23] Handling diff: /app/public/diff/Zookeys_occurrences_4093.diff (9779 lines)
[INFO] [2022-01-20 16:20:25] Loading occurrences diff file into memory (9779 /app/public/diff/Zookeys_occurrences_4093.diff lines)...
[INFO] [2022-01-20 16:20:27] Handling diff: /app/public/diff/Zookeys_assocs_4093.diff (23 lines)
[INFO] [2022-01-20 16:20:29] Loading assocs diff file into memory (23 /app/public/diff/Zookeys_assocs_4093.diff lines)...
[INFO] [2022-01-20 16:20:31] Handling diff: /app/public/diff/Zookeys_measurements_4093.diff (9747 lines)
[INFO] [2022-01-20 16:20:32] Loading measurements diff file into memory (9747 /app/public/diff/Zookeys_measurements_4093.diff lines)...
[STOP] [2022-01-20 16:20:39] parse_diff_and_store
[ERR] [2022-01-20 16:20:39] RuntimeError
[ERR] [2022-01-20 16:20:39] Missing Term for URI `http://purl.obolibrary.org/obo/ENVO_00000420`, must be added!
[ERR] [2022-01-20 16:20:39] ../models/store/model_builder.rb:653:in `fail_on_bad_uri'
[ERR] [2022-01-20 16:20:39] ../models/store/model_builder.rb:607:in `convert_trait_value'
[ERR] [2022-01-20 16:20:39] ../models/store/model_builder.rb:425:in `build_trait'
[ERR] [2022-01-20 16:20:39] ../models/store/model_builder.rb:28:in `build_models'
[ERR] [2022-01-20 16:20:39] ../models/resource_harvester.rb:354:in `block (3 levels) in parse_diff_and_store'
[ERR] [2022-01-20 16:20:39] ../models/csv_parser.rb:111:in `block in diff_as_hashes'
[ERR] [2022-01-20 16:20:39] ../models/csv_parser.rb:28:in `block in line_at_a_time'
[ERR] [2022-01-20 16:20:39] ../models/csv_parser.rb:25:in `line_at_a_time'
[ERR] [2022-01-20 16:20:39] ../models/csv_parser.rb:96:in `diff_as_hashes'
[ERR] [2022-01-20 16:20:39] ../models/resource_harvester.rb:308:in `block (2 levels) in parse_diff_and_store'
[ERR] [2022-01-20 16:20:39] ../models/logged_process.rb:86:in `enter_group'
[ERR] [2022-01-20 16:20:39] ../models/resource_harvester.rb:306:in `block in parse_diff_and_store'
[ERR] [2022-01-20 16:20:39] ../models/resource_harvester.rb:709:in `block in each_diff'
[ERR] [2022-01-20 16:20:39] ../models/resource_harvester.rb:696:in `each_diff'
[ERR] [2022-01-20 16:20:39] ../models/resource_harvester.rb:301:in `parse_diff_and_store'
[ERR] [2022-01-20 16:20:39] ../models/resource_harvester.rb:86:in `block (2 levels) in start'
[ERR] [2022-01-20 16:20:39] ../models/logged_process.rb:43:in `run_step'
[ERR] [2022-01-20 16:20:39] ../models/resource_harvester.rb:86:in `block in start'
[ERR] [2022-01-20 16:20:39] ../models/resource_harvester.rb:75:in `each_key'
[ERR] [2022-01-20 16:20:39] ../models/resource_harvester.rb:75:in `start'
[ERR] [2022-01-20 16:20:39] ../models/resource.rb:310:in `resume'
[ERR] [2022-01-20 16:20:39] bin/rails:4:in `require'
[ERR] [2022-01-20 16:20:39] bin/rails:4:in `<main>'
[STOP] [2022-01-20 16:20:39] logged process, took 81.78
[INFO] [2022-01-20 18:08:22] ## HARVEST: type = resume_-harvest
[START] [2022-01-20 18:08:26] logged process: e0f71f84fbb52f8ac28c07bb9ad0f6a065812443 Updating nginx-sites to allow remote origins
[INFO] [2022-01-20 18:08:26] Already completed stage create_harvest_instance, skipping...
[INFO] [2022-01-20 18:08:26] Already completed stage fetch_files, skipping...
[INFO] [2022-01-20 18:08:26] Already completed stage validate_each_file, skipping...
[INFO] [2022-01-20 18:08:26] Already completed stage convert_to_csv, skipping...
[INFO] [2022-01-20 18:08:26] Already completed stage calculate_delta, skipping...
[START] [2022-01-20 18:08:26] parse_diff_and_store
[INFO] [2022-01-20 18:08:26] Handling diff: /app/public/diff/Zookeys_agents_4093.diff (2033 lines)
[INFO] [2022-01-20 18:08:26] Loading agents diff file into memory (2033 /app/public/diff/Zookeys_agents_4093.diff lines)...
[INFO] [2022-01-20 18:08:27] Handling diff: /app/public/diff/Zookeys_refs_4093.diff (1422 lines)
[INFO] [2022-01-20 18:08:27] Loading refs diff file into memory (1422 /app/public/diff/Zookeys_refs_4093.diff lines)...
[INFO] [2022-01-20 18:08:27] Handling diff: /app/public/diff/Zookeys_nodes_4093.diff (8849 lines)
[INFO] [2022-01-20 18:08:27] Loading nodes diff file into memory (8849 /app/public/diff/Zookeys_nodes_4093.diff lines)...
[WARN] [2022-01-20 18:08:28] Filtered Scientific Name `Lasionycta perplexella\tCrabo et Lafontaine, 2009` to `Lasionycta perplexellatCrabo et Lafontaine, 2009`
[WARN] [2022-01-20 18:08:30] Filtered Scientific Name `Plastus  Plastus  amplus  Wu et Zhou, 2010` to `Plastus Plastus amplus Wu et Zhou, 2010`
[WARN] [2022-01-20 18:08:30] Filtered Scientific Name `Plastus  Plastus  biconcavus Wu et Zhou, 2010` to `Plastus Plastus biconcavus Wu et Zhou, 2010`
[WARN] [2022-01-20 18:08:30] Filtered Scientific Name `Keilbachia subacumina  Wu et Zhang, 2010` to `Keilbachia subacumina Wu et Zhang, 2010`
[INFO] [2022-01-20 18:08:30] Handling diff: /app/public/diff/Zookeys_media_4093.diff (28981 lines)
[INFO] [2022-01-20 18:08:30] Loading media diff file into memory (28981 /app/public/diff/Zookeys_media_4093.diff lines)...
[INFO] [2022-01-20 18:08:58] Handling diff: /app/public/diff/Zookeys_occurrences_4093.diff (9779 lines)
[INFO] [2022-01-20 18:08:58] Loading occurrences diff file into memory (9779 /app/public/diff/Zookeys_occurrences_4093.diff lines)...
[INFO] [2022-01-20 18:08:59] Handling diff: /app/public/diff/Zookeys_assocs_4093.diff (23 lines)
[INFO] [2022-01-20 18:08:59] Loading assocs diff file into memory (23 /app/public/diff/Zookeys_assocs_4093.diff lines)...
[INFO] [2022-01-20 18:09:01] Handling diff: /app/public/diff/Zookeys_measurements_4093.diff (9747 lines)
[INFO] [2022-01-20 18:09:02] Loading measurements diff file into memory (9747 /app/public/diff/Zookeys_measurements_4093.diff lines)...
[INFO] [2022-01-20 18:09:06] Storing 2031 Attributions
[INFO] [2022-01-20 18:09:06] Processing group of 2031 in 3 groups of 1000
[INFO] [2022-01-20 18:09:07] Average Time: 0.247
[INFO] [2022-01-20 18:09:07] Total Time: 1s
[INFO] [2022-01-20 18:09:07] Storing 1420 References
[INFO] [2022-01-20 18:09:07] Processing group of 1420 in 2 groups of 1000
[INFO] [2022-01-20 18:09:08] Average Time: 0.395
[INFO] [2022-01-20 18:09:08] Total Time: 1s
[INFO] [2022-01-20 18:09:08] Storing 9686 ScientificNames
[INFO] [2022-01-20 18:09:08] Processing group of 9686 in 10 groups of 1000
[INFO] [2022-01-20 18:09:11] Average Time: 0.277
[INFO] [2022-01-20 18:09:11] Total Time: 3s
[INFO] [2022-01-20 18:09:11] last 3 / first 3: 0.83
[INFO] [2022-01-20 18:09:11] Std.Dev: 0.044721359549995794; Max: 0.35
[INFO] [2022-01-20 18:09:11] Storing 9686 Nodes
[INFO] [2022-01-20 18:09:11] Processing group of 9686 in 10 groups of 1000
[INFO] [2022-01-20 18:09:13] Average Time: 0.243
[INFO] [2022-01-20 18:09:13] Total Time: 3s
[INFO] [2022-01-20 18:09:13] last 3 / first 3: 0.79
[INFO] [2022-01-20 18:09:13] Std.Dev: 0.044721359549995794; Max: 0.31
[INFO] [2022-01-20 18:09:13] Storing 8830 NodesReferences
[INFO] [2022-01-20 18:09:13] Processing group of 8830 in 9 groups of 1000
[INFO] [2022-01-20 18:09:14] Average Time: 0.068
[INFO] [2022-01-20 18:09:14] Total Time: 1s
[INFO] [2022-01-20 18:09:14] last 3 / first 3: 0.65
[INFO] [2022-01-20 18:09:14] Std.Dev: 0.0; Max: 0.12
[INFO] [2022-01-20 18:09:14] Storing 28363 BibliographicCitations
[INFO] [2022-01-20 18:09:14] Processing group of 28363 in 29 groups of 1000
[INFO] [2022-01-20 18:09:19] Average Time: 0.182
[INFO] [2022-01-20 18:09:19] Total Time: 6s
[INFO] [2022-01-20 18:09:19] last 3 / first 3: 0.73
[INFO] [2022-01-20 18:09:19] Std.Dev: 0.07745966692414834; Max: 0.36
[INFO] [2022-01-20 18:09:19] Storing 10831 ArticlesSections
[INFO] [2022-01-20 18:09:19] Processing group of 10831 in 11 groups of 1000
[INFO] [2022-01-20 18:09:20] Average Time: 0.057
[INFO] [2022-01-20 18:09:20] Total Time: 1s
[INFO] [2022-01-20 18:09:20] last 3 / first 3: 0.82
[INFO] [2022-01-20 18:09:20] Std.Dev: 0.0; Max: 0.12
[INFO] [2022-01-20 18:09:20] Storing 10831 Articles
[INFO] [2022-01-20 18:09:20] Processing group of 10831 in 11 groups of 1000
[INFO] [2022-01-20 18:09:24] Average Time: 0.348
[INFO] [2022-01-20 18:09:24] Total Time: 4s
[INFO] [2022-01-20 18:09:24] last 3 / first 3: 0.85
[INFO] [2022-01-20 18:09:24] Std.Dev: 0.03162277660168379; Max: 0.39
[INFO] [2022-01-20 18:09:24] Storing 650 ArticlesReferences
[INFO] [2022-01-20 18:09:24] Processing group of 650 in 1 groups of 1000
[INFO] [2022-01-20 18:09:24] Average Time: 0.19
[INFO] [2022-01-20 18:09:24] Total Time: 1s
[INFO] [2022-01-20 18:09:24] Storing 29553 ContentAttributions
[INFO] [2022-01-20 18:09:24] Processing group of 29553 in 30 groups of 1000
[INFO] [2022-01-20 18:09:28] Average Time: 0.122
[INFO] [2022-01-20 18:09:28] Total Time: 4s
[INFO] [2022-01-20 18:09:28] last 3 / first 3: 0.6
[INFO] [2022-01-20 18:09:28] Std.Dev: 0.03162277660168379; Max: 0.23
[INFO] [2022-01-20 18:09:28] Storing 18148 Media
[INFO] [2022-01-20 18:09:28] Processing group of 18148 in 19 groups of 1000
[INFO] [2022-01-20 18:09:35] Average Time: 0.382
[INFO] [2022-01-20 18:09:35] Total Time: 8s
[INFO] [2022-01-20 18:09:35] last 3 / first 3: 0.69
[INFO] [2022-01-20 18:09:35] Std.Dev: 0.1; Max: 0.63
[INFO] [2022-01-20 18:09:35] Storing 9777 Occurrences
[INFO] [2022-01-20 18:09:35] Processing group of 9777 in 10 groups of 1000
[INFO] [2022-01-20 18:09:36] Average Time: 0.13
[INFO] [2022-01-20 18:09:36] Total Time: 2s
[INFO] [2022-01-20 18:09:36] last 3 / first 3: 0.95
[INFO] [2022-01-20 18:09:36] Std.Dev: 0.0; Max: 0.18
[INFO] [2022-01-20 18:09:36] Storing 21 Assocs
[INFO] [2022-01-20 18:09:36] Processing group of 21 in 1 groups of 1000
[INFO] [2022-01-20 18:09:37] Average Time: 0.12
[INFO] [2022-01-20 18:09:37] Total Time: 1s
[INFO] [2022-01-20 18:09:37] Storing 21 MetaAssocs
[INFO] [2022-01-20 18:09:37] Processing group of 21 in 1 groups of 1000
[INFO] [2022-01-20 18:09:37] Average Time: 0.0
[INFO] [2022-01-20 18:09:37] Total Time: 1s
[INFO] [2022-01-20 18:09:37] Storing 9745 Traits
[INFO] [2022-01-20 18:09:37] Processing group of 9745 in 10 groups of 1000
[INFO] [2022-01-20 18:09:40] Average Time: 0.321
[INFO] [2022-01-20 18:09:40] Total Time: 4s
[INFO] [2022-01-20 18:09:40] last 3 / first 3: 0.91
[INFO] [2022-01-20 18:09:40] Std.Dev: 0.044721359549995794; Max: 0.4
[INFO] [2022-01-20 18:09:40] Storing 18441 MetaTraits
[INFO] [2022-01-20 18:09:40] Processing group of 18441 in 19 groups of 1000
[INFO] [2022-01-20 18:09:42] Average Time: 0.126
[INFO] [2022-01-20 18:09:42] Total Time: 3s
[INFO] [2022-01-20 18:09:42] last 3 / first 3: 0.65
[INFO] [2022-01-20 18:09:42] Std.Dev: 0.03162277660168379; Max: 0.18
[STOP] [2022-01-20 18:09:42] parse_diff_and_store
[START] [2022-01-20 18:09:42] resolve_keys
[INFO] [2022-01-20 18:10:26] Occurrences to nodes (through scientific_names)...
[INFO] [2022-01-20 18:10:26] traits to occurrences...
[INFO] [2022-01-20 18:10:26] traits to nodes (through occurrences)...
[INFO] [2022-01-20 18:10:27] Traits to sex term...
[INFO] [2022-01-20 18:10:27] Traits to lifestage term...
[INFO] [2022-01-20 18:10:27] MetaTraits to traits...
[INFO] [2022-01-20 18:10:27] MetaTraits (simple, measurement row refers to parent) to traits...
[INFO] [2022-01-20 18:10:28] Assocs to occurrences...
[INFO] [2022-01-20 18:10:28] Assocs to nodes...
[INFO] [2022-01-20 18:10:28] Assoc to sex term...
[INFO] [2022-01-20 18:10:28] Assoc to lifestage term...
[INFO] [2022-01-20 18:10:28] MetaAssoc to assocs...
[STOP] [2022-01-20 18:10:29] resolve_keys
[START] [2022-01-20 18:10:29] hold_for_later_1
[STOP] [2022-01-20 18:10:29] hold_for_later_1
[START] [2022-01-20 18:10:29] hold_for_later_2
[STOP] [2022-01-20 18:10:29] hold_for_later_2
[START] [2022-01-20 18:10:29] resolve_missing_parents
[STOP] [2022-01-20 18:10:29] resolve_missing_parents
[START] [2022-01-20 18:10:29] rebuild_nodes
[START] [2022-01-20 18:10:29] Flattener#flatten
[START] [2022-01-20 18:10:29] Flattener#study_resource
[START] [2022-01-20 18:10:29] Flattener#build_ancestry
[STOP] [2022-01-20 18:10:31] Flattener#build_ancestry
[INFO] [2022-01-20 18:10:31] 9686 ancestry keys
[START] [2022-01-20 18:10:31] build_node_ancestors
[INFO] [2022-01-20 18:10:31] old ancestors deleted.
[STOP] [2022-01-20 18:10:32] build_node_ancestors
[START] [2022-01-20 18:10:33] Flattener#propagate_ancestor_ids
[STOP] [2022-01-20 18:10:33] Flattener#propagate_ancestor_ids
[STOP] [2022-01-20 18:10:33] Flattener#flatten
[STOP] [2022-01-20 18:10:33] rebuild_nodes
[START] [2022-01-20 18:10:33] resolve_missing_media_owners
[STOP] [2022-01-20 18:10:33] resolve_missing_media_owners
[START] [2022-01-20 18:10:33] sanitize_media_verbatims
[STOP] [2022-01-20 18:10:33] sanitize_media_verbatims
[START] [2022-01-20 18:10:33] queue_downloads
[STOP] [2022-01-20 18:10:33] queue_downloads
[START] [2022-01-20 18:10:33] parse_names
[WARN] [2022-01-20 18:10:33] I see 9686 names which still need to be parsed.
[WARN] [2022-01-20 18:10:35] Names to parse: 9686 formatted: 9686 learned: 9558 parsed: 9686
[STOP] [2022-01-20 18:10:42] parse_names
[START] [2022-01-20 18:10:42] denormalize_canonical_names_to_nodes
[STOP] [2022-01-20 18:10:42] denormalize_canonical_names_to_nodes
[START] [2022-01-20 18:10:42] match_nodes
[START] [2022-01-20 18:10:42] map_all_nodes_to_pages
[ERR] [2022-01-20 18:12:24][hdls] download_and_prep FAILED for Medium.find(13947975): 404 Not Found
[STOP] [2022-01-20 18:21:28] map_all_nodes_to_pages
[INFO] [2022-01-20 18:21:28] 1927 Unmatched nodes (of 9686)! That's too many to output. Full list in /app/public/data/Zookeys/unmatched_nodes.txt ; First 10: Canonical: Trachurus novaezealandiae; Node#102209379; ResourceID: e2806e5b2df93acbcbffcbd998382581; Canonical: Passalus interstitialis; Node#102209372; ResourceID: 9c0ca53066527dc5f60f79cfb478e180; Canonical: Physoderina; Node#102212655; ResourceID: zookeys.284.3893.sp_1; Canonical: Cicindelidae; Node#102216772; ResourceID: Cicindelidae; Canonical: Psammoecus simoni; Node#102216849; ResourceID: zookeys.403.7145.sp_12; Canonical: Psammoecus fasciatus; Node#102216850; ResourceID: zookeys.403.7145.sp_13; Canonical: Psammoecus quadrimaculatus; Node#102216852; ResourceID: zookeys.403.7145.sp_15; Canonical: Psammoecus scitus; Node#102216853; ResourceID: zookeys.403.7145.sp_5; Canonical: Psammoecus bipunctatus; Node#102216854; ResourceID: zookeys.403.7145.sp_6; Canonical: Psammoecus trimaculatus; Node#102216855; ResourceID: zookeys.403.7145.sp_7
[START] [2022-01-20 18:21:28] update_nodes
[STOP] [2022-01-20 18:21:32] update_nodes
[STOP] [2022-01-20 18:21:32] match_nodes
[START] [2022-01-20 18:21:32] reindex_search
[STOP] [2022-01-20 18:21:40] reindex_search
[START] [2022-01-20 18:21:40] normalize_units
[STOP] [2022-01-20 18:21:40] normalize_units
[START] [2022-01-20 18:21:40] calculate_statistics
[2022-01-20 18:21:41] (NEAR) DUPLICATE TRAITS FOUND! There are only 9654 (of 9745 total) unique traits.
[2022-01-20 18:22:54] (Near) duplicate trait pairs (up to 100):
[2022-01-20 18:22:54] (resource_pk: 01083e1af9621dcf38789a8cbd9a9cba_20_ENV, id: 246696663), (resource_pk: 060fb09909ba748e3abea69c0d843cf6_20_ENV, id: 246696852)
[2022-01-20 18:22:54] (resource_pk: 012defcdc003ccaabd86ea1e11f78041_20_ENV, id: 246696671), (resource_pk: 92b33bb8d88db13a97bb6466fe0deaa8_20_ENV, id: 246702240)
[2022-01-20 18:22:54] (resource_pk: 069a3083bd26b7a5659ddee453f3a42e_20_ENV, id: 246696869), (resource_pk: 36012dc40a19fe99e76be516de56d51b_20_ENV, id: 246698578)
[2022-01-20 18:22:54] (resource_pk: 0849a327ea4e8cd09fa3ffcfa5560be0_20_ENV, id: 246696927), (resource_pk: 514d433f2957f0407b8a66510ce46245_20_ENV, id: 246699650)
[2022-01-20 18:22:54] (resource_pk: 088952ea347d7952d22342fa280e7e51_20_ENV, id: 246696937), (resource_pk: 71d987c9c28561b893e87cac32ebd09e_20_ENV, id: 246700941)
[2022-01-20 18:22:54] (resource_pk: 09376858ec1401506c0021e0952ff8b5_20_ENV, id: 246696956), (resource_pk: 68dc5b5087b306614399b0f9b6ab8228_20_ENV, id: 246700573)
[2022-01-20 18:22:54] (resource_pk: 095ce930413c52e63be92bdb9d780c1b_20_ENV, id: 246696963), (resource_pk: 12b301a3aba60ca8658172fd65750b73_20_ENV, id: 246697307)
[2022-01-20 18:22:54] (resource_pk: 0b14df2a450e10b973f87bc4b6059e0f_20_ENV, id: 246697026), (resource_pk: 9e3a1fdbbea6b73bf6c164e229718264_20_ENV, id: 246702682)
[2022-01-20 18:22:54] (resource_pk: 0b66b4c3a138ad79a500b172da2d0a2c_20_ENV, id: 246697036), (resource_pk: 70187d163721da4adcbf2e4b2b0891b4_20_ENV, id: 246700861)
[2022-01-20 18:22:54] (resource_pk: 0c00c63b77058e554e10f057bd1a28a4_20_ENV, id: 246697056), (resource_pk: 9ab2c482b0aa4d06d4639a1311ac2f19_20_ENV, id: 246702557)
[2022-01-20 18:22:54] (resource_pk: 0c765b8dffec1752db4320201b105828_20_ENV, id: 246697075), (resource_pk: a7fc05b60d254ec64b1a72bd139fc990_20_ENV, id: 246703054)
[2022-01-20 18:22:54] (resource_pk: 109a486b8ce573cac06447c002de5c23_20_ENV, id: 246697234), (resource_pk: 2db85460cf2d7fecd4e449c4edd42b63_20_ENV, id: 246698295)
[2022-01-20 18:22:54] (resource_pk: 10e74e89e92b8a58975a94ef626f853c_20_ENV, id: 246697247), (resource_pk: db3919e166c4a86745447e62c93c8bfc_20_ENV, id: 246704985)
[2022-01-20 18:22:54] (resource_pk: 136351ad4b18f160376c3a031b9810c4_20_ENV, id: 246697328), (resource_pk: 150747985868d5005c88331c1bcb01de_20_ENV, id: 246697373)
[2022-01-20 18:22:54] (resource_pk: 1500461b264c5a836f293192ea1fd5fb_20_ENV, id: 246697372), (resource_pk: 2e28d382b2ef7dc83399861a942a3bf9_20_ENV, id: 246698305)
[2022-01-20 18:22:54] (resource_pk: 150d759e3c94e55294c7f40fddb7d944_20_ENV, id: 246697375), (resource_pk: aa569f3a31c2fef91ee4eda4fcf10243_20_ENV, id: 246703138)
[2022-01-20 18:22:54] (resource_pk: 167a2d9dadcd25ab3b6e2d984ecb21e6_20_ENV, id: 246697426), (resource_pk: 27091d5abb5c4085a53305066e4cecd3_20_ENV, id: 246698047)
[2022-01-20 18:22:54] (resource_pk: 173f5eb95d2d2ee2d50bb0968464b02c_20_ENV, id: 246697455), (resource_pk: 77d1bac32eea3eda8da29dc36c5ede1a_20_ENV, id: 246701166)
[2022-01-20 18:22:54] (resource_pk: 186c5df02dbecd86c904026f37d323b5_20_ENV, id: 246697496), (resource_pk: 2e4cf6b4d52c10ca0cb7fcde13da2576_20_ENV, id: 246698313)
[2022-01-20 18:22:54] (resource_pk: 1894a901ab52d296421b053400704ab7_20_ENV, id: 246697503), (resource_pk: 939fccd8cad90629a62444cec0cb128d_20_ENV, id: 246702276)
[2022-01-20 18:22:54] (resource_pk: 18d004c500eaa1f78d98b8f09963f710_20_ENV, id: 246697509), (resource_pk: 4a74fc28c0e7741e6bac47785a9d708d_20_ENV, id: 246699393)
[2022-01-20 18:22:54] (resource_pk: 19a5783672006f625a52537721974a11_20_ENV, id: 246697535), (resource_pk: 92445659f21603783ad8a22df269fef7_20_ENV, id: 246702226)
[2022-01-20 18:22:54] (resource_pk: 1bcceb3b3074e61174be6b9fe2b5ee57_20_ENV, id: 246697620), (resource_pk: ea640e2d017d3fd4ad83a7cfd9acb03b_20_ENV, id: 246705547)
[2022-01-20 18:22:54] (resource_pk: 1d3d1d74861e68d3da5de378d60cbdda_20_ENV, id: 246697676), (resource_pk: 6437a63c330a81d7519ba30e4f7f66be_20_ENV, id: 246700381)
[2022-01-20 18:22:54] (resource_pk: 21b87b12ebb92a1174f050acb5209fb8_20_ENV, id: 246697852), (resource_pk: a4702c253d94c90d919203b21b01666c_20_ENV, id: 246702920)
[2022-01-20 18:22:54] (resource_pk: 273d43b3c5e8e788e96f3a715c47e6c2_20_ENV, id: 246698052), (resource_pk: 4f6b1b4da0451e3ec1b2ad6a2c83d59a_20_ENV, id: 246699574)
[2022-01-20 18:22:54] (resource_pk: 2912c535f5f1ae3a817b1116c7a7e33e_20_ENV, id: 246698120), (resource_pk: eebe0f3ecf4c84b328745a838d2aa4ba_20_ENV, id: 246705703)
[2022-01-20 18:22:54] (resource_pk: 29c6e138808ce4cbf029123f1a2ff102_20_ENV, id: 246698145), (resource_pk: 39cff7c739873dfa380c8762bf0a6cf1_20_ENV, id: 246698736)
[2022-01-20 18:22:54] (resource_pk: 2a45b71b34a7bf8025b4f6a6f682930e_20_ENV, id: 246698167), (resource_pk: c6c92d5329ac148b04fcec024b760295_20_ENV, id: 246704208)
[2022-01-20 18:22:54] (resource_pk: 2b6d31e9e92c6cb21a1dd981ca28df90_20_ENV, id: 246698206), (resource_pk: 39e18de4c5d9b333300d596bfa38de24_20_ENV, id: 246698740)
[2022-01-20 18:22:54] (resource_pk: 2dac46f1d3f6d385ce5e02cff080070d_20_ENV, id: 246698292), (resource_pk: 44f91c457336d96e97e69f1c50f58ee9_20_ENV, id: 246699170)
[2022-01-20 18:22:54] (resource_pk: 2e8347b401526139f42f9d88918b3e96_20_ENV, id: 246698317), (resource_pk: 55536e21b492dc85ffb5147561cebf2f_20_ENV, id: 246699790)
[2022-01-20 18:22:54] (resource_pk: 324e8f05b9a63364ddf401846331c54d_20_ENV, id: 246698450), (resource_pk: 7ebe765f83fa93e4bef8336f34ab1c24_20_ENV, id: 246701452)
[2022-01-20 18:22:54] (resource_pk: 327782df7fefc51fea18a39892ad681c_20_ENV, id: 246698455), (resource_pk: e268508b952624dda440c7dc59046479_20_ENV, id: 246705240)
[2022-01-20 18:22:54] (resource_pk: 34a6a00e1adb9e18f4b7bd1ab4279242_20_ENV, id: 246698528), (resource_pk: b7f2d011c577e3370a156c13f509065e_20_ENV, id: 246703647)
[2022-01-20 18:22:54] (resource_pk: 3740ffc3453565e1bbd5ab570465463d_20_ENV, id: 246698623), (resource_pk: a9183141a763833b11d49a2e2a2cdc95_20_ENV, id: 246703099)
[2022-01-20 18:22:54] (resource_pk: 376dd8b3e6052e7c18a1730ade9f9e58_20_ENV, id: 246698631), (resource_pk: 5a1d962e2cc1f6bcb38035abe3071a05_20_ENV, id: 246699980)
[2022-01-20 18:22:54] (resource_pk: 3831298033acb3cb1ba24229f023d39e_20_ENV, id: 246698669), (resource_pk: e56d766160c39097a87490ed6294ea1a_20_ENV, id: 246705372)
[2022-01-20 18:22:54] (resource_pk: 3ae0399e8333efe294ea4ec43e84d122_20_ENV, id: 246698776), (resource_pk: c7ec15b3fcb61f2703706a9d9a56234b_20_ENV, id: 246704245)
[2022-01-20 18:22:54] (resource_pk: 3b21e6012788840fe28530bec552da26_20_ENV, id: 246698794), (resource_pk: 53b698b371a735e6b147bb27314007ed_20_ENV, id: 246699737)
[2022-01-20 18:22:54] (resource_pk: 3dea2db79eb4a9c2e02837079da94016_20_ENV, id: 246698904), (resource_pk: 85b5eec39951da389de082e7e6ca4a3f_20_ENV, id: 246701739)
[2022-01-20 18:22:54] (resource_pk: 3ec9ff5c53be03e80be76cdb4f4485fd_20_ENV, id: 246698952), (resource_pk: 44591b4a1e974cc0419a13dc36e38631_20_ENV, id: 246699142)
[2022-01-20 18:22:54] (resource_pk: 44065909880f649ac3612776bd5d3d50_20_ENV, id: 246699128), (resource_pk: 458e845594a01a4949f13dc95869cd4b_20_ENV, id: 246699196)
[2022-01-20 18:22:54] (resource_pk: 4b34d25f2e62559abce13a7372ca23fc_20_ENV, id: 246699422), (resource_pk: 587e0d195f71ba14e3789ecfab445296_20_ENV, id: 246699915)
[2022-01-20 18:22:54] (resource_pk: 4dc0d71e62ac346fe3bded36e3180f48_20_ENV, id: 246699513), (resource_pk: c3b900b9b80f7c96cefe187254d5877f_20_ENV, id: 246704086)
[2022-01-20 18:22:54] (resource_pk: 4e0d560f83e5d74baf69f91b78f2382b_20_ENV, id: 246699526), (resource_pk: d8b188af532f286f3efa848d6f81f017_20_ENV, id: 246704887)
[2022-01-20 18:22:54] (resource_pk: 507751eb4c7d156c5f3c2ce5bce6cfed_20_ENV, id: 246699622), (resource_pk: d3c4c2e15c7e4b89bf490dc38842afb1_20_ENV, id: 246704697)
[2022-01-20 18:22:54] (resource_pk: 5095e62829e27d0de2bbaeca3bddf765_20_ENV, id: 246699624), (resource_pk: d9e89fad41732271752cc8f05d2f6da0_20_ENV, id: 246704930)
[2022-01-20 18:22:54] (resource_pk: 52f0e123217b6c0c487af924b457bcf3_20_ENV, id: 246699715), (resource_pk: 6e0f41700f35320dd76bce79a6516a88_20_ENV, id: 246700770)
[2022-01-20 18:22:54] (resource_pk: 5646e923194d434a1381372421b8073e_20_ENV, id: 246699829), (resource_pk: 82730c9370cf9951b3fe14cb60caab77_20_ENV, id: 246701603)
[2022-01-20 18:22:54] (resource_pk: 57fb4acce123c0936d06719724746d17_20_ENV, id: 246699894), (resource_pk: e866298ab9136a9c9c65d8244287bb97_20_ENV, id: 246705484)
[2022-01-20 18:22:54] (resource_pk: 5b9d0961e7b9e0c022638efeaffff29c_20_ENV, id: 246700033), (resource_pk: fc233aebf4835bceed0b03d6e91e6aa8_20_ENV, id: 246706227)
[2022-01-20 18:22:54] (resource_pk: 5c3a26af99a469b484fc48f12ab308ad_20_ENV, id: 246700056), (resource_pk: dbef2e1fd8092c835304d0f638997d5f_20_ENV, id: 246705014)
[2022-01-20 18:22:54] (resource_pk: 5cc27c218a6aca583889931035730f56_20_ENV, id: 246700073), (resource_pk: 85af45362b5b34ad010993013754c832_20_ENV, id: 246701737)
[2022-01-20 18:22:54] (resource_pk: 5cf98ecb80b2bd80fd1fe127bf95d5e5_20_ENV, id: 246700081), (resource_pk: 7b125512710ad96b73cf0cb3ce596a45_20_ENV, id: 246701299)
[2022-01-20 18:22:54] (resource_pk: 5f9f8febcded4a86791413a0c059b113_20_ENV, id: 246700191), (resource_pk: d28531927e898b83f808b902a5860492_20_ENV, id: 246704655)
[2022-01-20 18:22:54] (resource_pk: 5fbfa613ce68673c84428c8780186623_20_ENV, id: 246700198), (resource_pk: 7fc1c33fd02fc597d1656b0470a10cb2_20_ENV, id: 246701499)
[2022-01-20 18:22:54] (resource_pk: 67350f778245c85bf9be341385086451_20_ENV, id: 246700507), (resource_pk: de0c23da840125e4aedaf6931f565a4a_20_ENV, id: 246705080)
[2022-01-20 18:22:54] (resource_pk: 6e043650ee2599cd74b380d3d137e105_20_ENV, id: 246700769), (resource_pk: 70968be4cdb2e85ccfb7f84350c89dc3_20_ENV, id: 246700887)
[2022-01-20 18:22:54] (resource_pk: 70953727a9e322c0fcd886d213c13637_20_ENV, id: 246700885), (resource_pk: c36dc1a5124f82d9a76f24787e2b3c6f_20_ENV, id: 246704072)
[2022-01-20 18:22:54] (resource_pk: 739342d6848bc3ebc53d3e29257b84bf_20_ENV, id: 246701009), (resource_pk: 745f4897804f0583896d4f49eb7dd6c8_20_ENV, id: 246701042)
[2022-01-20 18:22:54] (resource_pk: 77519bc2d6c3e53a367901cd11ff535a_20_ENV, id: 246701147), (resource_pk: 8cdd05986a633f16552ce6737cf87e61_20_ENV, id: 246702043)
[2022-01-20 18:22:54] (resource_pk: 7961b3aca5e396b7379f87d16b8ab294_20_ENV, id: 246701234), (resource_pk: 907f55fa52ae859c3ad00ef81574ed54_20_ENV, id: 246702171)
[2022-01-20 18:22:54] (resource_pk: 7b936a8e98b30922d3b3b24be43ce93a_20_ENV, id: 246701324), (resource_pk: a544e7cb7ddcaf5de5f57d20b024d39b_20_ENV, id: 246702947)
[2022-01-20 18:22:54] (resource_pk: 7ff9a755698dfbe5f92bdf116e55bf31_20_ENV, id: 246701511), (resource_pk: e074ce399788d1c17b69e0662fc3589a_20_ENV, id: 246705160)
[2022-01-20 18:22:54] (resource_pk: 81f92d9d9b1d7e4f825ab9e209eb8736_20_ENV, id: 246701580), (resource_pk: eedc221a79a11e1b4fed1dac4b796c3d_20_ENV, id: 246705710)
[2022-01-20 18:22:54] (resource_pk: 839ef1f241baedc64c37ba93a2f1e800_20_ENV, id: 246701651), (resource_pk: dd01f5acfcd71d16b25541cee3e403a5_20_ENV, id: 246705049)
[2022-01-20 18:22:54] (resource_pk: 8534cbed911bd00046b5f894c0520e0e_20_ENV, id: 246701719), (resource_pk: cfdb7633c83afdbffc7585f03e0ef680_20_ENV, id: 246704537)
[2022-01-20 18:22:54] (resource_pk: 868795be3ef50d1c74c5d509f6c26fed_20_ENV, id: 246701779), (resource_pk: ab9e967c645054076f1095e4f25ee84f_20_ENV, id: 246703185)
[2022-01-20 18:22:54] (resource_pk: 87a52bea8fc17d279c8665f64d07095b_20_ENV, id: 246701835), (resource_pk: af101c23629cb5e6fba43ea1ea0dcd3c_20_ENV, id: 246703326)
[2022-01-20 18:22:54] (resource_pk: 87dcf2b72f6d67023d059eec96472c38_20_ENV, id: 246701846), (resource_pk: 98b20637b3b143428b8ba92de2210abd_20_ENV, id: 246702468)
[2022-01-20 18:22:54] (resource_pk: 8d8ddfb555a5c624f7142a33b3ac9057_20_ENV, id: 246702066), (resource_pk: fb836372d4d2b8781e6044f694d0a994_20_ENV, id: 246706206)
[2022-01-20 18:22:54] (resource_pk: 8fdfb6a8bde89712cfd1219e151c4a3f_20_ENV, id: 246702149), (resource_pk: c01a3e2b7df457d087ac3c96f1b596df_20_ENV, id: 246703961)
[2022-01-20 18:22:54] (resource_pk: 9204fee7f2ffdc68c0c65b414eb097db_20_ENV, id: 246702212), (resource_pk: b002188c45452f1a53fa71e108b75918_20_ENV, id: 246703355)
[2022-01-20 18:22:54] (resource_pk: 937b756474f855ff0188858ace2b4dc2_20_ENV, id: 246702268), (resource_pk: ba30277ae6ddab29d788e176a317d436_20_ENV, id: 246703753)
[2022-01-20 18:22:54] (resource_pk: 93da783fe85e510bad3d014f15c6447b_20_ENV, id: 246702287), (resource_pk: b7cbd1869c929996a8e0053cbd19f5b8_20_ENV, id: 246703641)
[2022-01-20 18:22:54] (resource_pk: 9476815e0a7c5c4c329a00bd2b386b83_20_ENV, id: 246702313), (resource_pk: 9d17b6a18cbc6d0bec962b28a5be3204_20_ENV, id: 246702652)
[2022-01-20 18:22:54] (resource_pk: 9820b67d651251e293a53c6be5967ba6_20_ENV, id: 246702445), (resource_pk: e82af27ad5c5f6ec1031929b422e6edf_20_ENV, id: 246705472)
[2022-01-20 18:22:54] (resource_pk: 9c4e07a198412961c7da8084cf451e36_20_ENV, id: 246702623), (resource_pk: acd29dc46edc0064b185b9989221c19e_20_ENV, id: 246703234)
[2022-01-20 18:22:54] (resource_pk: 9cc6f7c16faea2da967f76fde86acdb6_20_ENV, id: 246702640), (resource_pk: e61400081d19c7090d5af6b01042ca28_20_ENV, id: 246705393)
[2022-01-20 18:22:54] (resource_pk: a073cac24a0859fb3561a6f861f12ea0_20_ENV, id: 246702762), (resource_pk: ad0b35fbab2511fc4880724ce3531cbe_20_ENV, id: 246703246)
[2022-01-20 18:22:54] (resource_pk: a0a385c4bd693f43d32d9efbbb5d25f0_20_ENV, id: 246702773), (resource_pk: cdd12a043d5ce024390c09475df38475_20_ENV, id: 246704461)
[2022-01-20 18:22:54] (resource_pk: a6874a4fe0d9d80ccc26cb4bed1325ed_20_ENV, id: 246703001), (resource_pk: e7f95c06969e33298d89289b8a3dc2c9_20_ENV, id: 246705467)
[2022-01-20 18:22:54] (resource_pk: b28da34099697fba7a38801e658a7b24_20_ENV, id: 246703454), (resource_pk: bba36696756ba484cf11b3b09aa8ff1d_20_ENV, id: 246703790)
[2022-01-20 18:22:54] (resource_pk: c4522f8359e65d9745c42c77a8a2fd78_20_ENV, id: 246704104), (resource_pk: f40d542d6196cac10fe26c46cebf48b5_20_ENV, id: 246705928)
[2022-01-20 18:22:54] (resource_pk: cb7c25c82c4f67682c02df76c810d993_20_ENV, id: 246704382), (resource_pk: ffb0e4271d4c583ad5586907b124dd3d_20_ENV, id: 246706357)
[2022-01-20 18:22:54] (resource_pk: d2228734356c9dd43e1c5f2e92555fd1_20_ENV, id: 246704635), (resource_pk: f5edf0813fb550f37ad7bf983d785a4a_20_ENV, id: 246706004)
[2022-01-20 18:22:54] (resource_pk: e499d964211ec396e10891a97972c634_20_ENV, id: 246705337), (resource_pk: e65bb78b72f05cb216d4b6b70de6bae1_20_ENV, id: 246705410)
[2022-01-20 18:22:54] (resource_pk: e598d7e63a5f57850a28ec15097f44e5_20_ENV, id: 246705377), (resource_pk: ed910b9891ed6ab55f9ce7b6f0a8d6a6_20_ENV, id: 246705666)
[2022-01-20 18:22:54] (resource_pk: e9b67fbc05d2abffb4e9848508ad8a3e_20_ENV, id: 246705529), (resource_pk: e9bdbfddd4a822519b0f7a2011a7e790_20_ENV, id: 246705530)
[2022-01-20 18:22:54] (resource_pk: f336f6eab6767855bcb3fab7e3603ed6_20_ENV, id: 246705884), (resource_pk: f3cc70cf27f59c2c4a87d3fc0e778869_20_ENV, id: 246705916)
[STOP] [2022-01-20 18:22:54] calculate_statistics
[START] [2022-01-20 18:22:54] complete_harvest_instance
[START] [2022-01-20 18:22:54] overall_tsv_creation
[INFO] [2022-01-20 18:22:54] Processing group of 9686 in 1 batches of 10000
[INFO] [2022-01-20 18:25:14] 9745 Traits (unfiltered)...
[INFO] [2022-01-20 18:27:20] 9745 Traits (filtered)...
[INFO] [2022-01-20 18:27:33] 21 Associations (filtered)...
[INFO] [2022-01-20 18:27:36] 0 metadata added.
[INFO] [2022-01-20 18:27:36] 0 metadata added.
[INFO] [2022-01-20 18:28:13] Average Time: 241.67
[INFO] [2022-01-20 18:28:13] Total Time: 5m20s
[STOP] [2022-01-20 18:28:13] overall_tsv_creation
[INFO] [2022-01-20 18:28:13] Done. Check your files:
[INFO] [2022-01-20 18:28:13] (28363 lines) /app/public/data/Zookeys/publish_bibliographic_citations.tsv
[INFO] [2022-01-20 18:28:13] (9601 lines) /app/public/data/Zookeys/publish_nodes.tsv
[INFO] [2022-01-20 18:28:13] (19955 lines) /app/public/data/Zookeys/publish_node_ancestors.tsv
[INFO] [2022-01-20 18:28:13] (9686 lines) /app/public/data/Zookeys/publish_scientific_names.tsv
[INFO] [2022-01-20 18:28:13] (18148 lines) /app/public/data/Zookeys/publish_media.tsv
[INFO] [2022-01-20 18:28:13] (10831 lines) /app/public/data/Zookeys/publish_articles.tsv
[INFO] [2022-01-20 18:28:13] (818 lines) /app/public/data/Zookeys/publish_image_info.tsv
[INFO] [2022-01-20 18:28:13] (1420 lines) /app/public/data/Zookeys/publish_references.tsv
[INFO] [2022-01-20 18:28:13] (29553 lines) /app/public/data/Zookeys/publish_attributions.tsv
[INFO] [2022-01-20 18:28:13] (10831 lines) /app/public/data/Zookeys/publish_content_sections.tsv
[INFO] [2022-01-20 18:28:13] (1420 lines) /app/public/data/Zookeys/publish_referents.tsv
[INFO] [2022-01-20 18:28:13] (9767 lines) /app/public/data/Zookeys/publish_traits.tsv
[INFO] [2022-01-20 18:28:13] (1 lines) /app/public/data/Zookeys/publish_metadata.tsv
[STOP] [2022-01-20 18:28:14] complete_harvest_instance
[START] [2022-01-20 18:28:14] completed
[STOP] [2022-01-20 18:28:14] completed
[STOP] [2022-01-20 18:28:14] logged process, took 1187.31
[ERR] [2022-01-20 18:39:00][hdls] download_and_prep FAILED for Medium.find(13949546): 404 Not Found
[ERR] [2022-01-20 18:39:00][hdls] download_and_prep FAILED for Medium.find(13949547): 404 Not Found
[ERR] [2022-01-20 18:39:01][hdls] download_and_prep FAILED for Medium.find(13949548): 404 Not Found
[ERR] [2022-01-20 18:47:27][hdls] download_and_prep FAILED for Medium.find(13950172): 404 Not Found
[ERR] [2022-01-20 18:47:28][hdls] download_and_prep FAILED for Medium.find(13950173): 404 Not Found
[ERR] [2022-01-20 18:47:29][hdls] download_and_prep FAILED for Medium.find(13950174): 404 Not Found
[ERR] [2022-01-20 18:47:30][hdls] download_and_prep FAILED for Medium.find(13950175): 404 Not Found
[ERR] [2022-01-20 18:47:59][hdls] download_and_prep FAILED for Medium.find(13950214): 403 Forbidden
[ERR] [2022-01-20 18:49:50][hdls] download_and_prep FAILED for Medium.find(13950303): 403 Forbidden
[ERR] [2022-01-20 18:52:00][hdls] download_and_prep FAILED for Medium.find(13950429): 403 Forbidden
[ERR] [2022-01-20 18:54:52][hdls] download_and_prep FAILED for Medium.find(13950596): 404 Not Found
[ERR] [2022-01-20 18:54:53][hdls] download_and_prep FAILED for Medium.find(13950597): 404 Not Found
[ERR] [2022-01-20 18:59:02][hdls] download_and_prep FAILED for Medium.find(13950845): 403 Forbidden
[ERR] [2022-01-20 18:59:05][hdls] download_and_prep FAILED for Medium.find(13950848): 403 Forbidden
[ERR] [2022-01-20 19:02:19][hdls] download_and_prep FAILED for Medium.find(13951030): 404 Not Found
[ERR] [2022-01-20 19:02:20][hdls] download_and_prep FAILED for Medium.find(13951031): 404 Not Found
[ERR] [2022-01-20 19:02:20][hdls] download_and_prep FAILED for Medium.find(13951032): 404 Not Found
[ERR] [2022-01-20 19:02:20][hdls] download_and_prep FAILED for Medium.find(13951033): 404 Not Found
[ERR] [2022-01-20 19:02:21][hdls] download_and_prep FAILED for Medium.find(13951034): 404 Not Found
[ERR] [2022-01-20 19:02:21][hdls] download_and_prep FAILED for Medium.find(13951035): 404 Not Found
[ERR] [2022-01-20 19:02:21][hdls] download_and_prep FAILED for Medium.find(13951036): 404 Not Found
[ERR] [2022-01-20 19:02:22][hdls] download_and_prep FAILED for Medium.find(13951037): 404 Not Found
[ERR] [2022-01-20 19:02:22][hdls] download_and_prep FAILED for Medium.find(13951038): 404 Not Found
[ERR] [2022-01-20 19:02:22][hdls] download_and_prep FAILED for Medium.find(13951039): 404 Not Found
[ERR] [2022-01-20 19:17:19][hdls] download_and_prep FAILED for Medium.find(13951828): 403 Forbidden
[ERR] [2022-01-20 19:17:21][hdls] download_and_prep FAILED for Medium.find(13951831): 403 Forbidden
[ERR] [2022-01-20 19:17:26][hdls] download_and_prep FAILED for Medium.find(13951836): 403 Forbidden
[ERR] [2022-01-20 19:17:28][hdls] download_and_prep FAILED for Medium.find(13951839): 403 Forbidden
[ERR] [2022-01-20 19:17:30][hdls] download_and_prep FAILED for Medium.find(13951842): 403 Forbidden
[ERR] [2022-01-20 19:31:38][hdls] download_and_prep FAILED for Medium.find(13952918): 403 Forbidden
[ERR] [2022-01-20 19:34:52][hdls] download_and_prep FAILED for Medium.find(13953092): 404 Not Found
[ERR] [2022-01-20 19:34:53][hdls] download_and_prep FAILED for Medium.find(13953093): 404 Not Found
[ERR] [2022-01-20 19:38:28][hdls] download_and_prep FAILED for Medium.find(13953293): 404 Not Found
[ERR] [2022-01-20 19:38:28][hdls] download_and_prep FAILED for Medium.find(13953294): 404 Not Found
[ERR] [2022-01-20 19:38:29][hdls] download_and_prep FAILED for Medium.find(13953295): 404 Not Found
[ERR] [2022-01-20 19:38:29][hdls] download_and_prep FAILED for Medium.find(13953296): 404 Not Found
[ERR] [2022-01-20 19:38:29][hdls] download_and_prep FAILED for Medium.find(13953297): 404 Not Found
[ERR] [2022-01-20 19:38:29][hdls] download_and_prep FAILED for Medium.find(13953298): 404 Not Found
[ERR] [2022-01-20 19:38:29][hdls] download_and_prep FAILED for Medium.find(13953299): 404 Not Found
[ERR] [2022-01-20 19:38:30][hdls] download_and_prep FAILED for Medium.find(13953300): 404 Not Found
[ERR] [2022-01-20 19:38:30][hdls] download_and_prep FAILED for Medium.find(13953301): 404 Not Found
[ERR] [2022-01-20 19:38:30][hdls] download_and_prep FAILED for Medium.find(13953302): 404 Not Found
[ERR] [2022-01-20 19:38:30][hdls] download_and_prep FAILED for Medium.find(13953303): 404 Not Found
[ERR] [2022-01-20 19:38:30][hdls] download_and_prep FAILED for Medium.find(13953304): 404 Not Found
[ERR] [2022-01-20 19:38:31][hdls] download_and_prep FAILED for Medium.find(13953305): 404 Not Found
[ERR] [2022-01-20 19:38:31][hdls] download_and_prep FAILED for Medium.find(13953306): 404 Not Found
[ERR] [2022-01-20 19:38:31][hdls] download_and_prep FAILED for Medium.find(13953307): 404 Not Found
[ERR] [2022-01-20 19:38:31][hdls] download_and_prep FAILED for Medium.find(13953308): 404 Not Found
[ERR] [2022-01-20 19:38:31][hdls] download_and_prep FAILED for Medium.find(13953309): 404 Not Found
[ERR] [2022-01-20 19:38:31][hdls] download_and_prep FAILED for Medium.find(13953310): 404 Not Found
[ERR] [2022-01-20 19:38:31][hdls] download_and_prep FAILED for Medium.find(13953311): 404 Not Found
[ERR] [2022-01-20 19:38:31][hdls] download_and_prep FAILED for Medium.find(13953312): 404 Not Found
[ERR] [2022-01-20 19:38:32][hdls] download_and_prep FAILED for Medium.find(13953313): 404 Not Found
[ERR] [2022-01-20 19:38:32][hdls] download_and_prep FAILED for Medium.find(13953314): 404 Not Found
[ERR] [2022-01-20 19:38:32][hdls] download_and_prep FAILED for Medium.find(13953315): 404 Not Found
[ERR] [2022-01-20 19:38:32][hdls] download_and_prep FAILED for Medium.find(13953316): 404 Not Found
[ERR] [2022-01-20 19:38:32][hdls] download_and_prep FAILED for Medium.find(13953317): 404 Not Found
[ERR] [2022-01-20 19:38:32][hdls] download_and_prep FAILED for Medium.find(13953318): 404 Not Found
[ERR] [2022-01-20 19:38:33][hdls] download_and_prep FAILED for Medium.find(13953319): 404 Not Found
[ERR] [2022-01-20 19:38:33][hdls] download_and_prep FAILED for Medium.find(13953320): 404 Not Found
[ERR] [2022-01-20 19:38:33][hdls] download_and_prep FAILED for Medium.find(13953321): 404 Not Found
[ERR] [2022-01-20 19:38:33][hdls] download_and_prep FAILED for Medium.find(13953322): 404 Not Found
[ERR] [2022-01-20 19:38:33][hdls] download_and_prep FAILED for Medium.find(13953323): 404 Not Found
[ERR] [2022-01-20 19:38:33][hdls] download_and_prep FAILED for Medium.find(13953324): 404 Not Found
[ERR] [2022-01-20 19:38:33][hdls] download_and_prep FAILED for Medium.find(13953325): 404 Not Found
[ERR] [2022-01-20 19:38:33][hdls] download_and_prep FAILED for Medium.find(13953326): 404 Not Found
[ERR] [2022-01-20 19:38:34][hdls] download_and_prep FAILED for Medium.find(13953327): 404 Not Found
[ERR] [2022-01-20 19:38:34][hdls] download_and_prep FAILED for Medium.find(13953329): 404 Not Found
[ERR] [2022-01-20 19:38:34][hdls] download_and_prep FAILED for Medium.find(13953330): 404 Not Found
[ERR] [2022-01-20 19:38:34][hdls] download_and_prep FAILED for Medium.find(13953331): 404 Not Found
[ERR] [2022-01-20 19:38:34][hdls] download_and_prep FAILED for Medium.find(13953332): 404 Not Found
[ERR] [2022-01-20 19:38:35][hdls] download_and_prep FAILED for Medium.find(13953333): 404 Not Found
[ERR] [2022-01-20 19:38:35][hdls] download_and_prep FAILED for Medium.find(13953334): 404 Not Found
[ERR] [2022-01-20 19:38:35][hdls] download_and_prep FAILED for Medium.find(13953335): 404 Not Found
[ERR] [2022-01-20 19:38:35][hdls] download_and_prep FAILED for Medium.find(13953336): 404 Not Found
[ERR] [2022-01-20 19:38:35][hdls] download_and_prep FAILED for Medium.find(13953328): 404 Not Found
[ERR] [2022-01-20 19:38:35][hdls] download_and_prep FAILED for Medium.find(13953337): 404 Not Found
[ERR] [2022-01-20 19:38:36][hdls] download_and_prep FAILED for Medium.find(13953338): 404 Not Found
[ERR] [2022-01-20 19:38:36][hdls] download_and_prep FAILED for Medium.find(13953339): 404 Not Found
[ERR] [2022-01-20 19:38:36][hdls] download_and_prep FAILED for Medium.find(13953340): 404 Not Found
[ERR] [2022-01-20 19:38:36][hdls] download_and_prep FAILED for Medium.find(13953341): 404 Not Found
[ERR] [2022-01-20 19:38:36][hdls] download_and_prep FAILED for Medium.find(13953342): 404 Not Found
[ERR] [2022-01-20 19:38:36][hdls] download_and_prep FAILED for Medium.find(13953343): 404 Not Found
[ERR] [2022-01-20 19:38:37][hdls] download_and_prep FAILED for Medium.find(13953359): 404 Not Found
[ERR] [2022-01-20 19:38:37][hdls] download_and_prep FAILED for Medium.find(13953360): 404 Not Found
[ERR] [2022-01-20 19:38:37][hdls] download_and_prep FAILED for Medium.find(13953361): 404 Not Found
[ERR] [2022-01-20 19:38:37][hdls] download_and_prep FAILED for Medium.find(13953362): 404 Not Found
[ERR] [2022-01-20 19:38:37][hdls] download_and_prep FAILED for Medium.find(13953363): 404 Not Found
[ERR] [2022-01-20 19:38:37][hdls] download_and_prep FAILED for Medium.find(13953364): 404 Not Found
[ERR] [2022-01-20 19:38:38][hdls] download_and_prep FAILED for Medium.find(13953365): 404 Not Found
[ERR] [2022-01-20 19:38:38][hdls] download_and_prep FAILED for Medium.find(13953366): 404 Not Found
[ERR] [2022-01-20 19:38:38][hdls] download_and_prep FAILED for Medium.find(13953367): 404 Not Found
[ERR] [2022-01-20 19:38:38][hdls] download_and_prep FAILED for Medium.find(13953368): 404 Not Found
[ERR] [2022-01-20 19:38:38][hdls] download_and_prep FAILED for Medium.find(13953344): 404 Not Found
[ERR] [2022-01-20 19:38:38][hdls] download_and_prep FAILED for Medium.find(13953345): 404 Not Found
[ERR] [2022-01-20 19:38:38][hdls] download_and_prep FAILED for Medium.find(13953346): 404 Not Found
[ERR] [2022-01-20 19:38:39][hdls] download_and_prep FAILED for Medium.find(13953347): 404 Not Found
[ERR] [2022-01-20 19:38:39][hdls] download_and_prep FAILED for Medium.find(13953348): 404 Not Found
[ERR] [2022-01-20 19:38:39][hdls] download_and_prep FAILED for Medium.find(13953349): 404 Not Found
[ERR] [2022-01-20 19:38:39][hdls] download_and_prep FAILED for Medium.find(13953350): 404 Not Found
[ERR] [2022-01-20 19:38:39][hdls] download_and_prep FAILED for Medium.find(13953351): 404 Not Found
[ERR] [2022-01-20 19:38:39][hdls] download_and_prep FAILED for Medium.find(13953352): 404 Not Found
[ERR] [2022-01-20 19:38:40][hdls] download_and_prep FAILED for Medium.find(13953353): 404 Not Found
[ERR] [2022-01-20 19:38:40][hdls] download_and_prep FAILED for Medium.find(13953354): 404 Not Found
[ERR] [2022-01-20 19:38:40][hdls] download_and_prep FAILED for Medium.find(13953355): 404 Not Found
[ERR] [2022-01-20 19:38:40][hdls] download_and_prep FAILED for Medium.find(13953356): 404 Not Found
[ERR] [2022-01-20 19:38:40][hdls] download_and_prep FAILED for Medium.find(13953357): 404 Not Found
[ERR] [2022-01-20 19:38:40][hdls] download_and_prep FAILED for Medium.find(13953358): 404 Not Found
[ERR] [2022-01-20 19:38:40][hdls] download_and_prep FAILED for Medium.find(13953369): 404 Not Found
[ERR] [2022-01-20 19:38:41][hdls] download_and_prep FAILED for Medium.find(13953370): 404 Not Found
[ERR] [2022-01-20 19:38:41][hdls] download_and_prep FAILED for Medium.find(13953371): 404 Not Found
[ERR] [2022-01-20 19:38:41][hdls] download_and_prep FAILED for Medium.find(13953372): 404 Not Found
[ERR] [2022-01-20 19:38:41][hdls] download_and_prep FAILED for Medium.find(13953373): 404 Not Found
[ERR] [2022-01-20 19:38:41][hdls] download_and_prep FAILED for Medium.find(13953374): 404 Not Found
[ERR] [2022-01-20 19:38:41][hdls] download_and_prep FAILED for Medium.find(13953375): 404 Not Found
[ERR] [2022-01-20 19:38:42][hdls] download_and_prep FAILED for Medium.find(13953376): 404 Not Found
[ERR] [2022-01-20 19:38:42][hdls] download_and_prep FAILED for Medium.find(13953377): 404 Not Found
[ERR] [2022-01-20 19:38:42][hdls] download_and_prep FAILED for Medium.find(13953378): 404 Not Found
[ERR] [2022-01-20 19:38:42][hdls] download_and_prep FAILED for Medium.find(13953379): 404 Not Found
[ERR] [2022-01-20 19:38:42][hdls] download_and_prep FAILED for Medium.find(13953380): 404 Not Found
[ERR] [2022-01-20 19:38:42][hdls] download_and_prep FAILED for Medium.find(13953381): 404 Not Found
[ERR] [2022-01-20 19:38:42][hdls] download_and_prep FAILED for Medium.find(13953382): 404 Not Found
[ERR] [2022-01-20 19:38:42][hdls] download_and_prep FAILED for Medium.find(13953383): 404 Not Found
[ERR] [2022-01-20 19:38:43][hdls] download_and_prep FAILED for Medium.find(13953384): 404 Not Found
[ERR] [2022-01-20 19:38:43][hdls] download_and_prep FAILED for Medium.find(13953385): 404 Not Found
[ERR] [2022-01-20 19:38:43][hdls] download_and_prep FAILED for Medium.find(13953386): 404 Not Found
[ERR] [2022-01-20 19:38:43][hdls] download_and_prep FAILED for Medium.find(13953387): 404 Not Found
[ERR] [2022-01-20 19:38:43][hdls] download_and_prep FAILED for Medium.find(13953388): 404 Not Found
[ERR] [2022-01-20 19:38:43][hdls] download_and_prep FAILED for Medium.find(13953389): 404 Not Found
[ERR] [2022-01-20 19:38:43][hdls] download_and_prep FAILED for Medium.find(13953390): 404 Not Found
[ERR] [2022-01-20 19:38:43][hdls] download_and_prep FAILED for Medium.find(13953391): 404 Not Found
[ERR] [2022-01-20 19:38:44][hdls] download_and_prep FAILED for Medium.find(13953392): 404 Not Found
[ERR] [2022-01-20 19:38:44][hdls] download_and_prep FAILED for Medium.find(13953393): 404 Not Found
[ERR] [2022-01-20 19:38:44][hdls] download_and_prep FAILED for Medium.find(13953394): 404 Not Found
[ERR] [2022-01-20 19:38:44][hdls] download_and_prep FAILED for Medium.find(13953395): 404 Not Found
[ERR] [2022-01-20 19:38:44][hdls] download_and_prep FAILED for Medium.find(13953396): 404 Not Found
[ERR] [2022-01-20 19:38:45][hdls] download_and_prep FAILED for Medium.find(13953397): 404 Not Found
[ERR] [2022-01-20 19:38:45][hdls] download_and_prep FAILED for Medium.find(13953398): 404 Not Found
[ERR] [2022-01-20 19:38:45][hdls] download_and_prep FAILED for Medium.find(13953399): 404 Not Found
[ERR] [2022-01-20 19:38:45][hdls] download_and_prep FAILED for Medium.find(13953400): 404 Not Found
[ERR] [2022-01-20 19:38:45][hdls] download_and_prep FAILED for Medium.find(13953401): 404 Not Found
[ERR] [2022-01-20 19:38:46][hdls] download_and_prep FAILED for Medium.find(13953402): 404 Not Found
[ERR] [2022-01-20 19:38:46][hdls] download_and_prep FAILED for Medium.find(13953403): 404 Not Found
[ERR] [2022-01-20 19:38:46][hdls] download_and_prep FAILED for Medium.find(13953404): 404 Not Found
[ERR] [2022-01-20 19:38:46][hdls] download_and_prep FAILED for Medium.find(13953405): 404 Not Found
[ERR] [2022-01-20 19:38:46][hdls] download_and_prep FAILED for Medium.find(13953406): 404 Not Found
[ERR] [2022-01-20 19:38:47][hdls] download_and_prep FAILED for Medium.find(13953407): 404 Not Found
[ERR] [2022-01-20 19:38:47][hdls] download_and_prep FAILED for Medium.find(13953408): 404 Not Found
[ERR] [2022-01-20 19:38:47][hdls] download_and_prep FAILED for Medium.find(13953409): 404 Not Found
[ERR] [2022-01-20 19:38:47][hdls] download_and_prep FAILED for Medium.find(13953410): 404 Not Found
[ERR] [2022-01-20 19:38:47][hdls] download_and_prep FAILED for Medium.find(13953411): 404 Not Found
[ERR] [2022-01-20 19:38:48][hdls] download_and_prep FAILED for Medium.find(13953412): 404 Not Found
[ERR] [2022-01-20 19:38:48][hdls] download_and_prep FAILED for Medium.find(13953413): 404 Not Found
[ERR] [2022-01-20 19:38:48][hdls] download_and_prep FAILED for Medium.find(13953414): 404 Not Found
[ERR] [2022-01-20 19:38:48][hdls] download_and_prep FAILED for Medium.find(13953415): 404 Not Found
[ERR] [2022-01-20 19:53:13][hdls] download_and_prep FAILED for Medium.find(13954204): 404 Not Found
[ERR] [2022-01-20 19:53:14][hdls] download_and_prep FAILED for Medium.find(13954205): 404 Not Found
[ERR] [2022-01-20 19:53:14][hdls] download_and_prep FAILED for Medium.find(13954206): 404 Not Found
[ERR] [2022-01-20 19:53:15][hdls] download_and_prep FAILED for Medium.find(13954207): 404 Not Found
[ERR] [2022-01-20 20:50:04][hdls] download_and_prep FAILED for Medium.find(13957434): 404 Not Found
[ERR] [2022-01-20 20:50:04][hdls] download_and_prep FAILED for Medium.find(13957435): 404 Not Found
[ERR] [2022-01-20 20:50:05][hdls] download_and_prep FAILED for Medium.find(13957436): 404 Not Found
[ERR] [2022-01-20 20:50:05][hdls] download_and_prep FAILED for Medium.find(13957437): 404 Not Found
[ERR] [2022-01-20 20:50:05][hdls] download_and_prep FAILED for Medium.find(13957438): 404 Not Found
[ERR] [2022-01-20 20:50:05][hdls] download_and_prep FAILED for Medium.find(13957439): 404 Not Found
[ERR] [2022-01-20 20:50:06][hdls] download_and_prep FAILED for Medium.find(13957440): 404 Not Found
[ERR] [2022-01-20 20:50:06][hdls] download_and_prep FAILED for Medium.find(13957441): 404 Not Found
[ERR] [2022-01-20 20:50:06][hdls] download_and_prep FAILED for Medium.find(13957442): 404 Not Found
[ERR] [2022-01-20 20:50:07][hdls] download_and_prep FAILED for Medium.find(13957443): 404 Not Found
[ERR] [2022-01-20 20:50:07][hdls] download_and_prep FAILED for Medium.find(13957444): 404 Not Found
[ERR] [2022-01-20 20:50:07][hdls] download_and_prep FAILED for Medium.find(13957445): 404 Not Found
[ERR] [2022-01-20 20:50:07][hdls] download_and_prep FAILED for Medium.find(13957446): 404 Not Found
[ERR] [2022-01-20 20:50:07][hdls] download_and_prep FAILED for Medium.find(13957447): 404 Not Found
[ERR] [2022-01-20 20:50:07][hdls] download_and_prep FAILED for Medium.find(13957448): 404 Not Found
[ERR] [2022-01-20 20:50:08][hdls] download_and_prep FAILED for Medium.find(13957449): 404 Not Found
[ERR] [2022-01-20 20:50:08][hdls] download_and_prep FAILED for Medium.find(13957450): 404 Not Found
[ERR] [2022-01-20 20:53:44][hdls] download_and_prep FAILED for Medium.find(13957661): 403 Forbidden
[ERR] [2022-01-20 20:57:20][hdls] download_and_prep FAILED for Medium.find(13957860): 403 Forbidden
[ERR] [2022-01-20 21:19:45][hdls] download_and_prep FAILED for Medium.find(13959099): 404 Not Found
[ERR] [2022-01-20 21:19:46][hdls] download_and_prep FAILED for Medium.find(13959100): 404 Not Found
[ERR] [2022-01-20 21:19:46][hdls] download_and_prep FAILED for Medium.find(13959101): 404 Not Found
[ERR] [2022-01-20 21:19:47][hdls] download_and_prep FAILED for Medium.find(13959102): 404 Not Found
[ERR] [2022-01-20 21:19:47][hdls] download_and_prep FAILED for Medium.find(13959103): 404 Not Found
[ERR] [2022-01-20 21:19:47][hdls] download_and_prep FAILED for Medium.find(13959104): 404 Not Found
[ERR] [2022-01-20 21:19:48][hdls] download_and_prep FAILED for Medium.find(13959105): 404 Not Found
[ERR] [2022-01-20 21:43:21][hdls] download_and_prep FAILED for Medium.find(13960323): 404 Not Found
[ERR] [2022-01-20 21:43:22][hdls] download_and_prep FAILED for Medium.find(13960324): 404 Not Found
[ERR] [2022-01-20 21:43:22][hdls] download_and_prep FAILED for Medium.find(13960325): 404 Not Found
[ERR] [2022-01-20 21:43:22][hdls] download_and_prep FAILED for Medium.find(13960326): 404 Not Found
[ERR] [2022-01-20 21:43:22][hdls] download_and_prep FAILED for Medium.find(13960327): 404 Not Found
[ERR] [2022-01-20 21:43:23][hdls] download_and_prep FAILED for Medium.find(13960328): 404 Not Found
[ERR] [2022-01-20 21:43:23][hdls] download_and_prep FAILED for Medium.find(13960329): 404 Not Found
[ERR] [2022-01-20 21:43:23][hdls] download_and_prep FAILED for Medium.find(13960330): 404 Not Found
[ERR] [2022-01-20 21:43:23][hdls] download_and_prep FAILED for Medium.find(13960331): 404 Not Found
[ERR] [2022-01-20 21:43:24][hdls] download_and_prep FAILED for Medium.find(13960332): 404 Not Found
[ERR] [2022-01-20 21:43:24][hdls] download_and_prep FAILED for Medium.find(13960333): 404 Not Found
[ERR] [2022-01-20 21:43:24][hdls] download_and_prep FAILED for Medium.find(13960334): 404 Not Found
[ERR] [2022-01-20 21:43:24][hdls] download_and_prep FAILED for Medium.find(13960335): 404 Not Found
[ERR] [2022-01-20 21:43:24][hdls] download_and_prep FAILED for Medium.find(13960336): 404 Not Found
[ERR] [2022-01-20 21:43:25][hdls] download_and_prep FAILED for Medium.find(13960337): 404 Not Found
[ERR] [2022-01-20 21:43:25][hdls] download_and_prep FAILED for Medium.find(13960338): 404 Not Found
[ERR] [2022-01-20 21:43:25][hdls] download_and_prep FAILED for Medium.find(13960339): 404 Not Found
[ERR] [2022-01-20 21:43:25][hdls] download_and_prep FAILED for Medium.find(13960340): 404 Not Found
[ERR] [2022-01-20 21:43:25][hdls] download_and_prep FAILED for Medium.find(13960341): 404 Not Found
[ERR] [2022-01-20 21:43:26][hdls] download_and_prep FAILED for Medium.find(13960342): 404 Not Found
[ERR] [2022-01-20 21:43:26][hdls] download_and_prep FAILED for Medium.find(13960343): 404 Not Found
[ERR] [2022-01-20 21:43:26][hdls] download_and_prep FAILED for Medium.find(13960344): 404 Not Found
[ERR] [2022-01-20 21:43:26][hdls] download_and_prep FAILED for Medium.find(13960345): 404 Not Found
[ERR] [2022-01-20 21:43:26][hdls] download_and_prep FAILED for Medium.find(13960346): 404 Not Found
[ERR] [2022-01-20 21:43:26][hdls] download_and_prep FAILED for Medium.find(13960347): 404 Not Found
[ERR] [2022-01-20 21:43:27][hdls] download_and_prep FAILED for Medium.find(13960348): 404 Not Found
[ERR] [2022-01-20 21:43:27][hdls] download_and_prep FAILED for Medium.find(13960349): 404 Not Found
[ERR] [2022-01-20 21:43:27][hdls] download_and_prep FAILED for Medium.find(13960350): 404 Not Found
[ERR] [2022-01-20 21:43:27][hdls] download_and_prep FAILED for Medium.find(13960352): 404 Not Found
[ERR] [2022-01-20 21:43:27][hdls] download_and_prep FAILED for Medium.find(13960353): 404 Not Found
[ERR] [2022-01-20 21:43:27][hdls] download_and_prep FAILED for Medium.find(13960351): 404 Not Found
[ERR] [2022-01-20 21:43:27][hdls] download_and_prep FAILED for Medium.find(13960354): 404 Not Found
[ERR] [2022-01-20 21:43:28][hdls] download_and_prep FAILED for Medium.find(13960355): 404 Not Found
[ERR] [2022-01-20 21:43:28][hdls] download_and_prep FAILED for Medium.find(13960356): 404 Not Found
[ERR] [2022-01-20 21:43:28][hdls] download_and_prep FAILED for Medium.find(13960360): 404 Not Found
[ERR] [2022-01-20 22:20:16][hdls] download_and_prep FAILED for Medium.find(13962642): 403 Forbidden
[ERR] [2022-01-20 22:54:05][hdls] download_and_prep FAILED for Medium.find(13964579): 404 Not Found
[ERR] [2022-01-20 22:54:06][hdls] download_and_prep FAILED for Medium.find(13964580): 404 Not Found
[ERR] [2022-01-20 22:54:07][hdls] download_and_prep FAILED for Medium.find(13964581): 404 Not Found
[ERR] [2022-01-20 22:54:07][hdls] download_and_prep FAILED for Medium.find(13964582): 404 Not Found
[ERR] [2022-01-20 22:54:07][hdls] download_and_prep FAILED for Medium.find(13964583): 404 Not Found
[ERR] [2022-01-20 22:54:08][hdls] download_and_prep FAILED for Medium.find(13964584): 404 Not Found
[ERR] [2022-01-20 22:54:08][hdls] download_and_prep FAILED for Medium.find(13964585): 404 Not Found
[ERR] [2022-01-20 22:54:08][hdls] download_and_prep FAILED for Medium.find(13964586): 404 Not Found
[ERR] [2022-01-20 22:54:09][hdls] download_and_prep FAILED for Medium.find(13964587): 404 Not Found
[ERR] [2022-01-20 22:54:09][hdls] download_and_prep FAILED for Medium.find(13964588): 404 Not Found
[ERR] [2022-01-20 22:54:09][hdls] download_and_prep FAILED for Medium.find(13964589): 404 Not Found
[ERR] [2022-01-20 22:54:09][hdls] download_and_prep FAILED for Medium.find(13964590): 404 Not Found
[ERR] [2022-01-20 22:54:10][hdls] download_and_prep FAILED for Medium.find(13964591): 404 Not Found
[ERR] [2022-01-20 22:54:10][hdls] download_and_prep FAILED for Medium.find(13964592): 404 Not Found
[ERR] [2022-01-20 22:54:10][hdls] download_and_prep FAILED for Medium.find(13964593): 404 Not Found
[ERR] [2022-01-20 22:54:10][hdls] download_and_prep FAILED for Medium.find(13964594): 404 Not Found
[ERR] [2022-01-20 22:54:10][hdls] download_and_prep FAILED for Medium.find(13964595): 404 Not Found
[ERR] [2022-01-20 22:54:10][hdls] download_and_prep FAILED for Medium.find(13964596): 404 Not Found
[ERR] [2022-01-20 22:54:10][hdls] download_and_prep FAILED for Medium.find(13964597): 404 Not Found
[ERR] [2022-01-20 23:09:15][hdls] download_and_prep FAILED for Medium.find(13965426): 403 Forbidden
[ERR] [2022-01-20 23:10:26][hdls] download_and_prep FAILED for Medium.find(13965537): 404 Not Found
[ERR] [2022-01-20 23:10:26][hdls] download_and_prep FAILED for Medium.find(13965538): 404 Not Found
[ERR] [2022-01-20 23:10:26][hdls] download_and_prep FAILED for Medium.find(13965539): 404 Not Found
[ERR] [2022-01-20 23:11:05][hdls] download_and_prep FAILED for Medium.find(13965582): 404 Not Found
[ERR] [2022-01-20 23:11:05][hdls] download_and_prep FAILED for Medium.find(13965583): 404 Not Found
[ERR] [2022-01-20 23:11:06][hdls] download_and_prep FAILED for Medium.find(13965586): 404 Not Found
[ERR] [2022-01-20 23:11:06][hdls] download_and_prep FAILED for Medium.find(13965587): 404 Not Found
[ERR] [2022-01-20 23:11:06][hdls] download_and_prep FAILED for Medium.find(13965588): 404 Not Found
[ERR] [2022-01-20 23:11:07][hdls] download_and_prep FAILED for Medium.find(13965589): 404 Not Found
[ERR] [2022-01-20 23:11:07][hdls] download_and_prep FAILED for Medium.find(13965588): 404 Not Found
[ERR] [2022-01-20 23:11:11][hdls] download_and_prep FAILED for Medium.find(13965595): 404 Not Found
[ERR] [2022-01-20 23:11:12][hdls] download_and_prep FAILED for Medium.find(13965596): 404 Not Found
[ERR] [2022-01-20 23:11:12][hdls] download_and_prep FAILED for Medium.find(13965597): 404 Not Found
[ERR] [2022-01-20 23:11:31][hdls] download_and_prep FAILED for Medium.find(13965625): 404 Not Found
[ERR] [2022-01-20 23:11:32][hdls] download_and_prep FAILED for Medium.find(13965626): 404 Not Found
[ERR] [2022-01-20 23:11:32][hdls] download_and_prep FAILED for Medium.find(13965627): 404 Not Found
[ERR] [2022-01-20 23:11:33][hdls] download_and_prep FAILED for Medium.find(13965628): 404 Not Found
[ERR] [2022-01-20 23:11:33][hdls] download_and_prep FAILED for Medium.find(13965629): 404 Not Found
[ERR] [2022-01-20 23:11:34][hdls] download_and_prep FAILED for Medium.find(13965630): 404 Not Found
[ERR] [2022-01-20 23:11:35][hdls] download_and_prep FAILED for Medium.find(13965631): 404 Not Found
[ERR] [2022-01-20 23:12:44][hdls] download_and_prep FAILED for Medium.find(13965729): 404 Not Found
[ERR] [2022-01-20 23:12:44][hdls] download_and_prep FAILED for Medium.find(13965730): 404 Not Found
[ERR] [2022-01-20 23:12:45][hdls] download_and_prep FAILED for Medium.find(13965731): 404 Not Found
[ERR] [2022-01-20 23:12:45][hdls] download_and_prep FAILED for Medium.find(13965732): 404 Not Found
[ERR] [2022-01-20 23:12:46][hdls] download_and_prep FAILED for Medium.find(13965733): 404 Not Found
[ERR] [2022-01-20 23:12:46][hdls] download_and_prep FAILED for Medium.find(13965734): 404 Not Found
[ERR] [2022-01-20 23:12:46][hdls] download_and_prep FAILED for Medium.find(13965735): 404 Not Found
[ERR] [2022-01-20 23:12:46][hdls] download_and_prep FAILED for Medium.find(13965736): 404 Not Found
[ERR] [2022-01-20 23:12:47][hdls] download_and_prep FAILED for Medium.find(13965737): 404 Not Found
[ERR] [2022-01-20 23:12:47][hdls] download_and_prep FAILED for Medium.find(13965738): 404 Not Found
[ERR] [2022-01-20 23:13:34][hdls] download_and_prep FAILED for Medium.find(13965822): 404 Not Found
[ERR] [2022-01-20 23:13:34][hdls] download_and_prep FAILED for Medium.find(13965823): 404 Not Found

Latest Process

20 Jan 18:08 EXITED currently processing 0