Harvest for TreatmentBank Created 24 Nov 10:29

Stage: complete_harvest_instance
Fetched: 24 Nov 10:29
Validated: 24 Nov 10:32
Deltas Created 24 Nov 10:32
Units Normalized: 24 Nov 19:39
Ancestry Built: 24 Nov 12:07
Nodes Matched: 24 Nov 19:28
Names Parsed: 24 Nov 12:15
New Models Stored: 24 Nov 11:40
Indexed: 24 Nov 19:38

Harvesting Log

(923 lines)
[INFO] [2022-11-24 10:29:58] Created harvest instance #4231
[STOP] [2022-11-24 10:29:58] create_harvest_instance
[START] [2022-11-24 10:29:58] fetch_files
[STOP] [2022-11-24 10:29:58] fetch_files
[START] [2022-11-24 10:29:58] validate_each_file
[INFO] [2022-11-24 10:29:58] Looping over 3 formats...
[INFO] [2022-11-24 10:29:58] ...nodes (/app/public/data/trek_nat_dw_trek/taxon.tab)
[START] [2022-11-24 10:30:01] logged process: 8a4ee2952f2a2ead9dbcbd7dbda333ac2885d8af Attempt to change the WebDb reconnect code to parallel ActiveRecord
[START] [2022-11-24 10:30:01] Parse meta.xml file and create formats with fields
[WARN] [2022-11-24 10:30:04] (common) IGNORED  (nodes) field header: originalNameUsageID term: http://rs.tdwg.org/dwc/terms/originalNameUsageID
[WARN] [2022-11-24 10:30:04] (common) IGNORED  (nodes) field header: scientificNameAuthorship term: http://rs.tdwg.org/dwc/terms/scientificNameAuthorship
[WARN] [2022-11-24 10:30:04] (common) IGNORED  (nodes) field header: nomenclaturalStatus term: http://rs.tdwg.org/dwc/terms/nomenclaturalStatus
[WARN] [2022-11-24 10:30:04] (common) IGNORED  (nodes) field header: references term: http://purl.org/dc/terms/references
[WARN] [2022-11-24 10:30:04] (common) IGNORED  (nodes) field header: canonicalName term: http://rs.gbif.org/terms/1.0/canonicalName
[STOP] [2022-11-24 10:30:04] Parse meta.xml file and create formats with fields
[INFO] [2022-11-24 10:30:32] Valid: /app/public/data/trek_nat_dw_trek/converted_csv/trek_nat_dw_trek_nodes_29875.csv (470607 lines)
[INFO] [2022-11-24 10:30:32] ...occurrences (/app/public/data/trek_nat_dw_trek/occurrence_specific.tab)
[INFO] [2022-11-24 10:30:52] Valid: /app/public/data/trek_nat_dw_trek/converted_csv/trek_nat_dw_trek_occurrences_29873.csv (1673761 lines)
[INFO] [2022-11-24 10:30:52] ...measurements (/app/public/data/trek_nat_dw_trek/measurement_or_fact_specific.tab)
[INFO] [2022-11-24 10:32:04] Valid: /app/public/data/trek_nat_dw_trek/converted_csv/trek_nat_dw_trek_measurements_29874.csv (1673761 lines)
[STOP] [2022-11-24 10:32:04] validate_each_file
[START] [2022-11-24 10:32:04] convert_to_csv
[INFO] [2022-11-24 10:32:04] Looping over 3 formats...
[INFO] [2022-11-24 10:32:04] ...nodes (/app/public/data/trek_nat_dw_trek/taxon.tab)
[CMD] [2022-11-24 10:32:04] /usr/bin/sort /app/public/data/trek_nat_dw_trek/converted_csv/trek_nat_dw_trek_nodes_29875.csv > /app/public/data/trek_nat_dw_trek/converted_csv/trek_nat_dw_trek_nodes_29875.csv_sorted
[INFO] [2022-11-24 10:32:07] Converted: /app/public/data/trek_nat_dw_trek/converted_csv/trek_nat_dw_trek_nodes_29875.csv (470607 lines)
[INFO] [2022-11-24 10:32:07] ...occurrences (/app/public/data/trek_nat_dw_trek/occurrence_specific.tab)
[CMD] [2022-11-24 10:32:07] /usr/bin/sort /app/public/data/trek_nat_dw_trek/converted_csv/trek_nat_dw_trek_occurrences_29873.csv > /app/public/data/trek_nat_dw_trek/converted_csv/trek_nat_dw_trek_occurrences_29873.csv_sorted
[INFO] [2022-11-24 10:32:10] Converted: /app/public/data/trek_nat_dw_trek/converted_csv/trek_nat_dw_trek_occurrences_29873.csv (1673761 lines)
[INFO] [2022-11-24 10:32:10] ...measurements (/app/public/data/trek_nat_dw_trek/measurement_or_fact_specific.tab)
[CMD] [2022-11-24 10:32:10] /usr/bin/sort /app/public/data/trek_nat_dw_trek/converted_csv/trek_nat_dw_trek_measurements_29874.csv > /app/public/data/trek_nat_dw_trek/converted_csv/trek_nat_dw_trek_measurements_29874.csv_sorted
[INFO] [2022-11-24 10:32:27] Converted: /app/public/data/trek_nat_dw_trek/converted_csv/trek_nat_dw_trek_measurements_29874.csv (1673761 lines)
[STOP] [2022-11-24 10:32:27] convert_to_csv
[START] [2022-11-24 10:32:27] calculate_delta
[INFO] [2022-11-24 10:32:27] Created diff dir: /app/public/diff
[INFO] [2022-11-24 10:32:27] Looping over 3 formats...
[INFO] [2022-11-24 10:32:27] ...nodes (/app/public/data/trek_nat_dw_trek/taxon.tab)
[CMD] [2022-11-24 10:32:27] echo "0a" > /app/public/data/trek_nat_dw_trek/diff/trek_nat_dw_trek_nodes_29875.diff
[CMD] [2022-11-24 10:32:27] tail -n +1 /app/public/data/trek_nat_dw_trek/converted_csv/trek_nat_dw_trek_nodes_29875.csv >> /app/public/data/trek_nat_dw_trek/diff/trek_nat_dw_trek_nodes_29875.diff
[CMD] [2022-11-24 10:32:29] echo "." >> /app/public/data/trek_nat_dw_trek/diff/trek_nat_dw_trek_nodes_29875.diff
[INFO] [2022-11-24 10:32:29] Created diff: /app/public/data/trek_nat_dw_trek/diff/trek_nat_dw_trek_nodes_29875.diff (470609 lines)
[INFO] [2022-11-24 10:32:29] ...occurrences (/app/public/data/trek_nat_dw_trek/occurrence_specific.tab)
[CMD] [2022-11-24 10:32:29] echo "0a" > /app/public/data/trek_nat_dw_trek/diff/trek_nat_dw_trek_occurrences_29873.diff
[CMD] [2022-11-24 10:32:29] tail -n +1 /app/public/data/trek_nat_dw_trek/converted_csv/trek_nat_dw_trek_occurrences_29873.csv >> /app/public/data/trek_nat_dw_trek/diff/trek_nat_dw_trek_occurrences_29873.diff
[CMD] [2022-11-24 10:32:31] echo "." >> /app/public/data/trek_nat_dw_trek/diff/trek_nat_dw_trek_occurrences_29873.diff
[INFO] [2022-11-24 10:32:32] Created diff: /app/public/data/trek_nat_dw_trek/diff/trek_nat_dw_trek_occurrences_29873.diff (1673763 lines)
[INFO] [2022-11-24 10:32:32] ...measurements (/app/public/data/trek_nat_dw_trek/measurement_or_fact_specific.tab)
[CMD] [2022-11-24 10:32:32] echo "0a" > /app/public/data/trek_nat_dw_trek/diff/trek_nat_dw_trek_measurements_29874.diff
[CMD] [2022-11-24 10:32:32] tail -n +1 /app/public/data/trek_nat_dw_trek/converted_csv/trek_nat_dw_trek_measurements_29874.csv >> /app/public/data/trek_nat_dw_trek/diff/trek_nat_dw_trek_measurements_29874.diff
[CMD] [2022-11-24 10:32:40] echo "." >> /app/public/data/trek_nat_dw_trek/diff/trek_nat_dw_trek_measurements_29874.diff
[INFO] [2022-11-24 10:32:42] Created diff: /app/public/data/trek_nat_dw_trek/diff/trek_nat_dw_trek_measurements_29874.diff (1673763 lines)
[STOP] [2022-11-24 10:32:42] calculate_delta
[START] [2022-11-24 10:32:42] parse_diff_and_store
[INFO] [2022-11-24 10:32:43] Handling diff: /app/public/data/trek_nat_dw_trek/diff/trek_nat_dw_trek_nodes_29875.diff (470609 lines)
[INFO] [2022-11-24 10:32:43] Loading nodes diff file into memory (470609 lines)...
[WARN] [2022-11-24 10:32:43] Filtered Scientific Name `Spiroptera mugientis " von Linstow 1898` to `Spiroptera mugientis von Linstow 1898`
[WARN] [2022-11-24 10:32:43] Filtered Scientific Name `Ficobolus jaliscoi  2014` to `Ficobolus jaliscoi 2014`
[WARN] [2022-11-24 10:32:43] Filtered Scientific Name `Visiana (Xanthorhoe) robinsoni (Prout 1939)  1939` to `Visiana (Xanthorhoe) robinsoni (Prout 1939) 1939`
[WARN] [2022-11-24 10:32:44] Filtered Scientific Name `Calvatomina sp. " nov. 3 "` to `Calvatomina sp. nov. 3 `
[WARN] [2022-11-24 10:32:45] Filtered Scientific Name `Meioneta affinis (Kulczyn \ ' ski 1898)` to `Meioneta affinis (Kulczyn ' ski 1898)`
[INFO] [2022-11-24 10:32:48] Storing 15659 ScientificNames (31318/10000/470609)
[INFO] [2022-11-24 10:32:53] Storing 15659 Nodes (31318/10000/470609)
[WARN] [2022-11-24 10:33:04] SKIPPED 1000 Scientific names (60940/20000/470609) with resource_pks already be in the database!
[WARN] [2022-11-24 10:33:04] SKIPPED 1000 Nodes (60940/20000/470609) with resource_pks already be in the database!
[INFO] [2022-11-24 10:33:04] Storing 13811 ScientificNames (60940/20000/470609)
[INFO] [2022-11-24 10:33:09] Storing 13811 Nodes (60940/20000/470609)
[WARN] [2022-11-24 10:33:17] SKIPPED 1331 Scientific names (90202/30000/470609) with resource_pks already be in the database!
[WARN] [2022-11-24 10:33:17] SKIPPED 1331 Nodes (90202/30000/470609) with resource_pks already be in the database!
[INFO] [2022-11-24 10:33:18] Storing 13300 ScientificNames (90202/30000/470609)
[INFO] [2022-11-24 10:33:21] Storing 13300 Nodes (90202/30000/470609)
[WARN] [2022-11-24 10:33:25] Filtered Scientific Name `Andrena (Callandrena) placata  Mitchell 1960` to `Andrena (Callandrena) placata Mitchell 1960`
[WARN] [2022-11-24 10:33:29] Filtered Scientific Name `Thraulodes schlingeri ": Traver & Edmunds 1967` to `Thraulodes schlingeri : Traver & Edmunds 1967`
[WARN] [2022-11-24 10:33:30] SKIPPED 1535 Scientific names (119078/40000/470609) with resource_pks already be in the database!
[WARN] [2022-11-24 10:33:30] SKIPPED 1535 Nodes (119078/40000/470609) with resource_pks already be in the database!
[INFO] [2022-11-24 10:33:30] Storing 12903 ScientificNames (119078/40000/470609)
[INFO] [2022-11-24 10:33:34] Storing 12903 Nodes (119078/40000/470609)
[WARN] [2022-11-24 10:33:38] Filtered Scientific Name `Dzhungarodorcadion aethiops subsp. aethiops  Scopoli 1763` to `Dzhungarodorcadion aethiops subsp. aethiops Scopoli 1763`
[WARN] [2022-11-24 10:33:41] Filtered Scientific Name `Lilium lancifolium Thunb.  1794` to `Lilium lancifolium Thunb. 1794`
[WARN] [2022-11-24 10:33:42] SKIPPED 1573 Scientific names (147972/50000/470609) with resource_pks already be in the database!
[WARN] [2022-11-24 10:33:42] SKIPPED 1573 Nodes (147972/50000/470609) with resource_pks already be in the database!
[INFO] [2022-11-24 10:33:42] Storing 12874 ScientificNames (147972/50000/470609)
[INFO] [2022-11-24 10:33:46] Storing 12874 Nodes (147972/50000/470609)
[WARN] [2022-11-24 10:33:52] Filtered Scientific Name `Apallates viridiniger (Enderlein)  1911` to `Apallates viridiniger (Enderlein) 1911`
[WARN] [2022-11-24 10:33:52] Filtered Scientific Name `Apallates tener (Coquillett)  1900` to `Apallates tener (Coquillett) 1900`
[WARN] [2022-11-24 10:33:52] Filtered Scientific Name `Apallates subtomentosus (Enderlein)  1911` to `Apallates subtomentosus (Enderlein) 1911`
[WARN] [2022-11-24 10:33:52] Filtered Scientific Name `Apallates magnicornis (Duda)  1930` to `Apallates magnicornis (Duda) 1930`
[WARN] [2022-11-24 10:33:52] Filtered Scientific Name `Apallates fur (Williston)  1896` to `Apallates fur (Williston) 1896`
[WARN] [2022-11-24 10:33:52] Filtered Scientific Name `Apallates convexus (Loew)  1866` to `Apallates convexus (Loew) 1866`
[WARN] [2022-11-24 10:33:52] Filtered Scientific Name `columbiana (Becker)  1912` to `columbiana (Becker) 1912`
[WARN] [2022-11-24 10:33:52] Filtered Scientific Name `Thaumatomyia sulfurifrons (Duda)  1930` to `Thaumatomyia sulfurifrons (Duda) 1930`
[WARN] [2022-11-24 10:33:52] Filtered Scientific Name `Elachiptera dubiosa (Becker)  1916` to `Elachiptera dubiosa (Becker) 1916`
[WARN] [2022-11-24 10:33:52] Filtered Scientific Name `Biorbitella rubicunda (Becker)  1912` to `Biorbitella rubicunda (Becker) 1912`
[WARN] [2022-11-24 10:33:52] Filtered Scientific Name `Liohippelates peruanus (Becker)  1912` to `Liohippelates peruanus (Becker) 1912`
[WARN] [2022-11-24 10:33:52] Filtered Scientific Name `Liohippelates flavipes (Loew)  1866` to `Liohippelates flavipes (Loew) 1866`
[WARN] [2022-11-24 10:33:52] Filtered Scientific Name `Liohippelates femoralis (Duda)  1929` to `Liohippelates femoralis (Duda) 1929`
[WARN] [2022-11-24 10:33:52] Filtered Scientific Name `Liohippelates currani (Aldrich)  1931` to `Liohippelates currani (Aldrich) 1931`
[WARN] [2022-11-24 10:33:52] Filtered Scientific Name `Cadrema subequalis (Malloch)  1913` to `Cadrema subequalis (Malloch) 1913`
[WARN] [2022-11-24 10:33:54] SKIPPED 1946 Scientific names (177400/60000/470609) with resource_pks already be in the database!
[WARN] [2022-11-24 10:33:54] SKIPPED 1946 Nodes (177400/60000/470609) with resource_pks already be in the database!
[INFO] [2022-11-24 10:33:54] Storing 12768 ScientificNames (177400/60000/470609)
[INFO] [2022-11-24 10:33:58] Storing 12768 Nodes (177400/60000/470609)
[WARN] [2022-11-24 10:34:06] SKIPPED 1983 Scientific names (205982/70000/470609) with resource_pks already be in the database!
[WARN] [2022-11-24 10:34:07] SKIPPED 1983 Nodes (205982/70000/470609) with resource_pks already be in the database!
[INFO] [2022-11-24 10:34:07] Storing 12308 ScientificNames (205982/70000/470609)
[INFO] [2022-11-24 10:34:10] Storing 12308 Nodes (205982/70000/470609)
[WARN] [2022-11-24 10:34:17] Filtered Scientific Name `Nymphula  fluctuosalis` to `Nymphula fluctuosalis`
[WARN] [2022-11-24 10:34:18] SKIPPED 2172 Scientific names (234874/80000/470609) with resource_pks already be in the database!
[WARN] [2022-11-24 10:34:19] SKIPPED 2172 Nodes (234874/80000/470609) with resource_pks already be in the database!
[INFO] [2022-11-24 10:34:19] Storing 12274 ScientificNames (234874/80000/470609)
[INFO] [2022-11-24 10:34:22] Storing 12274 Nodes (234874/80000/470609)
[WARN] [2022-11-24 10:34:30] SKIPPED 2390 Scientific names (264582/90000/470609) with resource_pks already be in the database!
[WARN] [2022-11-24 10:34:31] SKIPPED 2390 Nodes (264582/90000/470609) with resource_pks already be in the database!
[INFO] [2022-11-24 10:34:31] Storing 12464 ScientificNames (264582/90000/470609)
[INFO] [2022-11-24 10:34:34] Storing 12464 Nodes (264582/90000/470609)
[WARN] [2022-11-24 10:34:43] SKIPPED 2408 Scientific names (293338/100000/470609) with resource_pks already be in the database!
[WARN] [2022-11-24 10:34:43] SKIPPED 2408 Nodes (293338/100000/470609) with resource_pks already be in the database!
[INFO] [2022-11-24 10:34:43] Storing 11970 ScientificNames (293338/100000/470609)
[INFO] [2022-11-24 10:34:47] Storing 11970 Nodes (293338/100000/470609)
[WARN] [2022-11-24 10:34:55] SKIPPED 2221 Scientific names (322284/110000/470609) with resource_pks already be in the database!
[WARN] [2022-11-24 10:34:55] SKIPPED 2221 Nodes (322284/110000/470609) with resource_pks already be in the database!
[INFO] [2022-11-24 10:34:55] Storing 12252 ScientificNames (322284/110000/470609)
[INFO] [2022-11-24 10:34:59] Storing 12252 Nodes (322284/110000/470609)
[WARN] [2022-11-24 10:35:04] Filtered Scientific Name `Eupetaurus cinereus  THOMAS 1888` to `Eupetaurus cinereus THOMAS 1888`
[WARN] [2022-11-24 10:35:04] Filtered Scientific Name `Palaeoscincus  costatus` to `Palaeoscincus costatus`
[WARN] [2022-11-24 10:35:05] Filtered Scientific Name `Halipeurus diversus (Kellogg 1896) " Thompson 1939` to `Halipeurus diversus (Kellogg 1896) Thompson 1939`
[WARN] [2022-11-24 10:35:05] Filtered Scientific Name `Saemundssonia (Saemundssonia) lari (O. Fabricius 1780) " Clay` to `Saemundssonia (Saemundssonia) lari (O. Fabricius 1780) Clay`
[WARN] [2022-11-24 10:35:05] (Reached filtered-name limit; supressing further warnings.)
[WARN] [2022-11-24 10:35:07] SKIPPED 2472 Scientific names (350980/120000/470609) with resource_pks already be in the database!
[WARN] [2022-11-24 10:35:08] SKIPPED 2472 Nodes (350980/120000/470609) with resource_pks already be in the database!
[INFO] [2022-11-24 10:35:08] Storing 11876 ScientificNames (350980/120000/470609)
[INFO] [2022-11-24 10:35:11] Storing 11876 Nodes (350980/120000/470609)
[WARN] [2022-11-24 10:35:19] SKIPPED 2472 Scientific names (379480/130000/470609) with resource_pks already be in the database!
[WARN] [2022-11-24 10:35:20] SKIPPED 2472 Nodes (379480/130000/470609) with resource_pks already be in the database!
[INFO] [2022-11-24 10:35:20] Storing 11778 ScientificNames (379480/130000/470609)
[INFO] [2022-11-24 10:35:23] Storing 11778 Nodes (379480/130000/470609)
[WARN] [2022-11-24 10:35:32] SKIPPED 2772 Scientific names (409060/140000/470609) with resource_pks already be in the database!
[WARN] [2022-11-24 10:35:33] SKIPPED 2772 Nodes (409060/140000/470609) with resource_pks already be in the database!
[INFO] [2022-11-24 10:35:33] Storing 12018 ScientificNames (409060/140000/470609)
[INFO] [2022-11-24 10:35:36] Storing 12018 Nodes (409060/140000/470609)
[WARN] [2022-11-24 10:35:44] SKIPPED 2326 Scientific names (437068/150000/470609) with resource_pks already be in the database!
[WARN] [2022-11-24 10:35:45] SKIPPED 2326 Nodes (437068/150000/470609) with resource_pks already be in the database!
[INFO] [2022-11-24 10:35:45] Storing 11678 ScientificNames (437068/150000/470609)
[INFO] [2022-11-24 10:35:48] Storing 11678 Nodes (437068/150000/470609)
[WARN] [2022-11-24 10:35:57] SKIPPED 2735 Scientific names (466342/160000/470609) with resource_pks already be in the database!
[WARN] [2022-11-24 10:35:58] SKIPPED 2735 Nodes (466342/160000/470609) with resource_pks already be in the database!
[INFO] [2022-11-24 10:35:58] Storing 11902 ScientificNames (466342/160000/470609)
[INFO] [2022-11-24 10:36:01] Storing 11902 Nodes (466342/160000/470609)
[WARN] [2022-11-24 10:36:09] SKIPPED 2320 Scientific names (493816/170000/470609) with resource_pks already be in the database!
[WARN] [2022-11-24 10:36:10] SKIPPED 2320 Nodes (493816/170000/470609) with resource_pks already be in the database!
[INFO] [2022-11-24 10:36:10] Storing 11417 ScientificNames (493816/170000/470609)
[INFO] [2022-11-24 10:36:13] Storing 11417 Nodes (493816/170000/470609)
[WARN] [2022-11-24 10:36:22] SKIPPED 3117 Scientific names (523724/180000/470609) with resource_pks already be in the database!
[WARN] [2022-11-24 10:36:22] SKIPPED 3117 Nodes (523724/180000/470609) with resource_pks already be in the database!
[INFO] [2022-11-24 10:36:23] Storing 11837 ScientificNames (523724/180000/470609)
[INFO] [2022-11-24 10:36:26] Storing 11837 Nodes (523724/180000/470609)
[WARN] [2022-11-24 10:36:34] SKIPPED 3410 Scientific names (554822/190000/470609) with resource_pks already be in the database!
[WARN] [2022-11-24 10:36:35] SKIPPED 3410 Nodes (554822/190000/470609) with resource_pks already be in the database!
[INFO] [2022-11-24 10:36:35] Storing 12139 ScientificNames (554822/190000/470609)
[INFO] [2022-11-24 10:36:39] Storing 12139 Nodes (554822/190000/470609)
[WARN] [2022-11-24 10:36:48] SKIPPED 4192 Scientific names (588590/200000/470609) with resource_pks already be in the database!
[WARN] [2022-11-24 10:36:49] SKIPPED 4192 Nodes (588590/200000/470609) with resource_pks already be in the database!
[INFO] [2022-11-24 10:36:49] Storing 12692 ScientificNames (588590/200000/470609)
[INFO] [2022-11-24 10:36:53] Storing 12692 Nodes (588590/200000/470609)
[WARN] [2022-11-24 10:37:03] SKIPPED 4406 Scientific names (622004/210000/470609) with resource_pks already be in the database!
[WARN] [2022-11-24 10:37:04] SKIPPED 4406 Nodes (622004/210000/470609) with resource_pks already be in the database!
[INFO] [2022-11-24 10:37:04] Storing 12301 ScientificNames (622004/210000/470609)
[INFO] [2022-11-24 10:37:09] Storing 12301 Nodes (622004/210000/470609)
[WARN] [2022-11-24 10:37:19] SKIPPED 4642 Scientific names (655346/220000/470609) with resource_pks already be in the database!
[WARN] [2022-11-24 10:37:20] SKIPPED 4642 Nodes (655346/220000/470609) with resource_pks already be in the database!
[INFO] [2022-11-24 10:37:20] Storing 12029 ScientificNames (655346/220000/470609)
[INFO] [2022-11-24 10:37:25] Storing 12029 Nodes (655346/220000/470609)
[WARN] [2022-11-24 10:37:35] SKIPPED 4587 Scientific names (688326/230000/470609) with resource_pks already be in the database!
[WARN] [2022-11-24 10:37:36] SKIPPED 4587 Nodes (688326/230000/470609) with resource_pks already be in the database!
[INFO] [2022-11-24 10:37:36] Storing 11903 ScientificNames (688326/230000/470609)
[INFO] [2022-11-24 10:37:41] Storing 11903 Nodes (688326/230000/470609)
[WARN] [2022-11-24 10:37:52] SKIPPED 4988 Scientific names (721998/240000/470609) with resource_pks already be in the database!
[WARN] [2022-11-24 10:37:53] SKIPPED 4988 Nodes (721998/240000/470609) with resource_pks already be in the database!
[INFO] [2022-11-24 10:37:53] Storing 11848 ScientificNames (721998/240000/470609)
[INFO] [2022-11-24 10:37:57] Storing 11848 Nodes (721998/240000/470609)
[WARN] [2022-11-24 10:38:07] SKIPPED 4735 Scientific names (754650/250000/470609) with resource_pks already be in the database!
[WARN] [2022-11-24 10:38:08] SKIPPED 4735 Nodes (754650/250000/470609) with resource_pks already be in the database!
[INFO] [2022-11-24 10:38:08] Storing 11591 ScientificNames (754650/250000/470609)
[INFO] [2022-11-24 10:38:13] Storing 11591 Nodes (754650/250000/470609)
[WARN] [2022-11-24 10:38:23] SKIPPED 5307 Scientific names (788576/260000/470609) with resource_pks already be in the database!
[WARN] [2022-11-24 10:38:25] SKIPPED 5307 Nodes (788576/260000/470609) with resource_pks already be in the database!
[INFO] [2022-11-24 10:38:25] Storing 11656 ScientificNames (788576/260000/470609)
[INFO] [2022-11-24 10:38:29] Storing 11656 Nodes (788576/260000/470609)
[WARN] [2022-11-24 10:38:38] SKIPPED 5097 Scientific names (821980/270000/470609) with resource_pks already be in the database!
[WARN] [2022-11-24 10:38:39] SKIPPED 5097 Nodes (821980/270000/470609) with resource_pks already be in the database!
[INFO] [2022-11-24 10:38:39] Storing 11605 ScientificNames (821980/270000/470609)
[INFO] [2022-11-24 10:38:44] Storing 11605 Nodes (821980/270000/470609)
[WARN] [2022-11-24 10:38:55] SKIPPED 4952 Scientific names (854918/280000/470609) with resource_pks already be in the database!
[WARN] [2022-11-24 10:38:56] SKIPPED 4952 Nodes (854918/280000/470609) with resource_pks already be in the database!
[INFO] [2022-11-24 10:38:56] Storing 11517 ScientificNames (854918/280000/470609)
[INFO] [2022-11-24 10:39:00] Storing 11517 Nodes (854918/280000/470609)
[WARN] [2022-11-24 10:39:10] SKIPPED 5414 Scientific names (888488/290000/470609) with resource_pks already be in the database!
[WARN] [2022-11-24 10:39:12] SKIPPED 5414 Nodes (888488/290000/470609) with resource_pks already be in the database!
[INFO] [2022-11-24 10:39:12] Storing 11371 ScientificNames (888488/290000/470609)
[INFO] [2022-11-24 10:39:16] Storing 11371 Nodes (888488/290000/470609)
[WARN] [2022-11-24 10:39:26] SKIPPED 5558 Scientific names (922160/300000/470609) with resource_pks already be in the database!
[WARN] [2022-11-24 10:39:28] SKIPPED 5558 Nodes (922160/300000/470609) with resource_pks already be in the database!
[INFO] [2022-11-24 10:39:28] Storing 11278 ScientificNames (922160/300000/470609)
[INFO] [2022-11-24 10:39:32] Storing 11278 Nodes (922160/300000/470609)
[WARN] [2022-11-24 10:39:42] SKIPPED 5146 Scientific names (955632/310000/470609) with resource_pks already be in the database!
[WARN] [2022-11-24 10:39:44] SKIPPED 5146 Nodes (955632/310000/470609) with resource_pks already be in the database!
[INFO] [2022-11-24 10:39:44] Storing 11590 ScientificNames (955632/310000/470609)
[INFO] [2022-11-24 10:39:48] Storing 11590 Nodes (955632/310000/470609)
[WARN] [2022-11-24 10:39:58] SKIPPED 5266 Scientific names (988808/320000/470609) with resource_pks already be in the database!
[WARN] [2022-11-24 10:39:59] SKIPPED 5266 Nodes (988808/320000/470609) with resource_pks already be in the database!
[INFO] [2022-11-24 10:39:59] Storing 11322 ScientificNames (988808/320000/470609)
[INFO] [2022-11-24 10:40:04] Storing 11322 Nodes (988808/320000/470609)
[WARN] [2022-11-24 10:40:14] SKIPPED 5726 Scientific names (1023162/330000/470609) with resource_pks already be in the database!
[WARN] [2022-11-24 10:40:15] SKIPPED 5726 Nodes (1023162/330000/470609) with resource_pks already be in the database!
[INFO] [2022-11-24 10:40:16] Storing 11451 ScientificNames (1023162/330000/470609)
[INFO] [2022-11-24 10:40:20] Storing 11451 Nodes (1023162/330000/470609)
[WARN] [2022-11-24 10:40:30] SKIPPED 5512 Scientific names (1056638/340000/470609) with resource_pks already be in the database!
[WARN] [2022-11-24 10:40:31] SKIPPED 5512 Nodes (1056638/340000/470609) with resource_pks already be in the database!
[INFO] [2022-11-24 10:40:31] Storing 11226 ScientificNames (1056638/340000/470609)
[INFO] [2022-11-24 10:40:36] Storing 11226 Nodes (1056638/340000/470609)
[WARN] [2022-11-24 10:40:46] SKIPPED 5529 Scientific names (1090056/350000/470609) with resource_pks already be in the database!
[WARN] [2022-11-24 10:40:48] SKIPPED 5529 Nodes (1090056/350000/470609) with resource_pks already be in the database!
[INFO] [2022-11-24 10:40:48] Storing 11180 ScientificNames (1090056/350000/470609)
[INFO] [2022-11-24 10:40:51] Storing 11180 Nodes (1090056/350000/470609)
[WARN] [2022-11-24 10:41:02] SKIPPED 5449 Scientific names (1123420/360000/470609) with resource_pks already be in the database!
[WARN] [2022-11-24 10:41:03] SKIPPED 5449 Nodes (1123420/360000/470609) with resource_pks already be in the database!
[INFO] [2022-11-24 10:41:03] Storing 11233 ScientificNames (1123420/360000/470609)
[INFO] [2022-11-24 10:41:08] Storing 11233 Nodes (1123420/360000/470609)
[WARN] [2022-11-24 10:41:19] SKIPPED 6026 Scientific names (1157924/370000/470609) with resource_pks already be in the database!
[WARN] [2022-11-24 10:41:21] SKIPPED 6026 Nodes (1157924/370000/470609) with resource_pks already be in the database!
[INFO] [2022-11-24 10:41:21] Storing 11226 ScientificNames (1157924/370000/470609)
[INFO] [2022-11-24 10:41:25] Storing 11226 Nodes (1157924/370000/470609)
[WARN] [2022-11-24 10:41:35] SKIPPED 5611 Scientific names (1191414/380000/470609) with resource_pks already be in the database!
[WARN] [2022-11-24 10:41:38] SKIPPED 5611 Nodes (1191414/380000/470609) with resource_pks already be in the database!
[INFO] [2022-11-24 10:41:38] Storing 11134 ScientificNames (1191414/380000/470609)
[INFO] [2022-11-24 10:41:41] Storing 11134 Nodes (1191414/380000/470609)
[WARN] [2022-11-24 10:41:52] SKIPPED 5530 Scientific names (1224396/390000/470609) with resource_pks already be in the database!
[WARN] [2022-11-24 10:41:54] SKIPPED 5530 Nodes (1224396/390000/470609) with resource_pks already be in the database!
[INFO] [2022-11-24 10:41:54] Storing 10961 ScientificNames (1224396/390000/470609)
[INFO] [2022-11-24 10:41:57] Storing 10961 Nodes (1224396/390000/470609)
[WARN] [2022-11-24 10:42:08] SKIPPED 5674 Scientific names (1257594/400000/470609) with resource_pks already be in the database!
[WARN] [2022-11-24 10:42:10] SKIPPED 5674 Nodes (1257594/400000/470609) with resource_pks already be in the database!
[INFO] [2022-11-24 10:42:10] Storing 10925 ScientificNames (1257594/400000/470609)
[INFO] [2022-11-24 10:42:13] Storing 10925 Nodes (1257594/400000/470609)
[WARN] [2022-11-24 10:42:24] SKIPPED 5701 Scientific names (1290972/410000/470609) with resource_pks already be in the database!
[WARN] [2022-11-24 10:42:26] SKIPPED 5701 Nodes (1290972/410000/470609) with resource_pks already be in the database!
[INFO] [2022-11-24 10:42:26] Storing 10988 ScientificNames (1290972/410000/470609)
[INFO] [2022-11-24 10:42:30] Storing 10988 Nodes (1290972/410000/470609)
[WARN] [2022-11-24 10:42:40] SKIPPED 5913 Scientific names (1324692/420000/470609) with resource_pks already be in the database!
[WARN] [2022-11-24 10:42:43] SKIPPED 5913 Nodes (1324692/420000/470609) with resource_pks already be in the database!
[INFO] [2022-11-24 10:42:43] Storing 10947 ScientificNames (1324692/420000/470609)
[INFO] [2022-11-24 10:42:46] Storing 10947 Nodes (1324692/420000/470609)
[WARN] [2022-11-24 10:42:57] SKIPPED 5657 Scientific names (1358064/430000/470609) with resource_pks already be in the database!
[WARN] [2022-11-24 10:42:59] SKIPPED 5657 Nodes (1358064/430000/470609) with resource_pks already be in the database!
[INFO] [2022-11-24 10:42:59] Storing 11029 ScientificNames (1358064/430000/470609)
[INFO] [2022-11-24 10:43:02] Storing 11029 Nodes (1358064/430000/470609)
[WARN] [2022-11-24 10:43:12] SKIPPED 5986 Scientific names (1392090/440000/470609) with resource_pks already be in the database!
[WARN] [2022-11-24 10:43:14] SKIPPED 5986 Nodes (1392090/440000/470609) with resource_pks already be in the database!
[INFO] [2022-11-24 10:43:14] Storing 11027 ScientificNames (1392090/440000/470609)
[INFO] [2022-11-24 10:43:18] Storing 11027 Nodes (1392090/440000/470609)
[WARN] [2022-11-24 10:43:28] SKIPPED 5909 Scientific names (1425828/450000/470609) with resource_pks already be in the database!
[WARN] [2022-11-24 10:43:31] SKIPPED 5909 Nodes (1425828/450000/470609) with resource_pks already be in the database!
[INFO] [2022-11-24 10:43:31] Storing 10960 ScientificNames (1425828/450000/470609)
[INFO] [2022-11-24 10:43:34] Storing 10960 Nodes (1425828/450000/470609)
[WARN] [2022-11-24 10:43:45] SKIPPED 5966 Scientific names (1459724/460000/470609) with resource_pks already be in the database!
[WARN] [2022-11-24 10:43:48] SKIPPED 5966 Nodes (1459724/460000/470609) with resource_pks already be in the database!
[INFO] [2022-11-24 10:43:48] Storing 10982 ScientificNames (1459724/460000/470609)
[INFO] [2022-11-24 10:43:51] Storing 10982 Nodes (1459724/460000/470609)
[WARN] [2022-11-24 10:44:02] SKIPPED 5895 Scientific names (1493210/470000/470609) with resource_pks already be in the database!
[WARN] [2022-11-24 10:44:05] SKIPPED 5895 Nodes (1493210/470000/470609) with resource_pks already be in the database!
[INFO] [2022-11-24 10:44:05] Storing 10848 ScientificNames (1493210/470000/470609)
[INFO] [2022-11-24 10:44:08] Storing 10848 Nodes (1493210/470000/470609)
[WARN] [2022-11-24 10:44:15] SKIPPED 805 Scientific names (1496146/470607/470609) with resource_pks already be in the database!
[WARN] [2022-11-24 10:44:17] SKIPPED 805 Nodes (1496146/470607/470609) with resource_pks already be in the database!
[INFO] [2022-11-24 10:44:17] Storing 663 ScientificNames (1496146/470607/470609)
[INFO] [2022-11-24 10:44:17] Storing 663 Nodes (1496146/470607/470609)
[INFO] [2022-11-24 10:44:18] Handling diff: /app/public/data/trek_nat_dw_trek/diff/trek_nat_dw_trek_occurrences_29873.diff (1673763 lines)
[INFO] [2022-11-24 10:44:18] Loading occurrences diff file into memory (1673763 lines)...
[INFO] [2022-11-24 10:44:19] Storing 9999 Occurrences (9999/10000/1673763)
[INFO] [2022-11-24 10:44:21] Storing 10000 Occurrences (19999/20000/1673763)
[INFO] [2022-11-24 10:44:25] Storing 10000 Occurrences (29999/30000/1673763)
[INFO] [2022-11-24 10:44:27] Storing 10000 Occurrences (39999/40000/1673763)
[INFO] [2022-11-24 10:44:30] Storing 10000 Occurrences (49999/50000/1673763)
[INFO] [2022-11-24 10:44:32] Storing 10000 Occurrences (59999/60000/1673763)
[INFO] [2022-11-24 10:44:35] Storing 10000 Occurrences (69999/70000/1673763)
[INFO] [2022-11-24 10:44:38] Storing 10000 Occurrences (79999/80000/1673763)
[INFO] [2022-11-24 10:44:41] Storing 10000 Occurrences (89999/90000/1673763)
[INFO] [2022-11-24 10:44:43] Storing 10000 Occurrences (99999/100000/1673763)
[INFO] [2022-11-24 10:44:47] Storing 10000 Occurrences (109999/110000/1673763)
[INFO] [2022-11-24 10:44:50] Storing 10000 Occurrences (119999/120000/1673763)
[INFO] [2022-11-24 10:44:53] Storing 10000 Occurrences (129999/130000/1673763)
[INFO] [2022-11-24 10:44:56] Storing 10000 Occurrences (139999/140000/1673763)
[INFO] [2022-11-24 10:44:59] Storing 10000 Occurrences (149999/150000/1673763)
[INFO] [2022-11-24 10:45:02] Storing 10000 Occurrences (159999/160000/1673763)
[INFO] [2022-11-24 10:45:05] Storing 10000 Occurrences (169999/170000/1673763)
[INFO] [2022-11-24 10:45:08] Storing 10000 Occurrences (179999/180000/1673763)
[INFO] [2022-11-24 10:45:11] Storing 10000 Occurrences (189999/190000/1673763)
[INFO] [2022-11-24 10:45:14] Storing 10000 Occurrences (199999/200000/1673763)
[INFO] [2022-11-24 10:45:17] Storing 10000 Occurrences (209999/210000/1673763)
[INFO] [2022-11-24 10:45:20] Storing 10000 Occurrences (219999/220000/1673763)
[INFO] [2022-11-24 10:45:24] Storing 10000 Occurrences (229999/230000/1673763)
[INFO] [2022-11-24 10:45:27] Storing 10000 Occurrences (239999/240000/1673763)
[INFO] [2022-11-24 10:45:31] Storing 10000 Occurrences (249999/250000/1673763)
[INFO] [2022-11-24 10:45:34] Storing 10000 Occurrences (259999/260000/1673763)
[INFO] [2022-11-24 10:45:38] Storing 10000 Occurrences (269999/270000/1673763)
[INFO] [2022-11-24 10:45:41] Storing 10000 Occurrences (279999/280000/1673763)
[INFO] [2022-11-24 10:45:45] Storing 10000 Occurrences (289999/290000/1673763)
[INFO] [2022-11-24 10:45:49] Storing 10000 Occurrences (299999/300000/1673763)
[INFO] [2022-11-24 10:45:53] Storing 10000 Occurrences (309999/310000/1673763)
[INFO] [2022-11-24 10:45:56] Storing 10000 Occurrences (319999/320000/1673763)
[INFO] [2022-11-24 10:46:00] Storing 10000 Occurrences (329999/330000/1673763)
[INFO] [2022-11-24 10:46:04] Storing 10000 Occurrences (339999/340000/1673763)
[INFO] [2022-11-24 10:46:07] Storing 10000 Occurrences (349999/350000/1673763)
[INFO] [2022-11-24 10:46:11] Storing 10000 Occurrences (359999/360000/1673763)
[INFO] [2022-11-24 10:46:15] Storing 10000 Occurrences (369999/370000/1673763)
[INFO] [2022-11-24 10:46:19] Storing 10000 Occurrences (379999/380000/1673763)
[INFO] [2022-11-24 10:46:23] Storing 10000 Occurrences (389999/390000/1673763)
[INFO] [2022-11-24 10:46:27] Storing 10000 Occurrences (399999/400000/1673763)
[INFO] [2022-11-24 10:46:31] Storing 10000 Occurrences (409999/410000/1673763)
[INFO] [2022-11-24 10:46:35] Storing 10000 Occurrences (419999/420000/1673763)
[INFO] [2022-11-24 10:46:39] Storing 10000 Occurrences (429999/430000/1673763)
[INFO] [2022-11-24 10:46:44] Storing 10000 Occurrences (439999/440000/1673763)
[INFO] [2022-11-24 10:46:48] Storing 10000 Occurrences (449999/450000/1673763)
[INFO] [2022-11-24 10:46:52] Storing 10000 Occurrences (459999/460000/1673763)
[INFO] [2022-11-24 10:46:56] Storing 10000 Occurrences (469999/470000/1673763)
[INFO] [2022-11-24 10:47:01] Storing 10000 Occurrences (479999/480000/1673763)
[INFO] [2022-11-24 10:47:05] Storing 10000 Occurrences (489999/490000/1673763)
[INFO] [2022-11-24 10:47:10] Storing 10000 Occurrences (499999/500000/1673763)
[INFO] [2022-11-24 10:47:14] Storing 10000 Occurrences (509999/510000/1673763)
[INFO] [2022-11-24 10:47:19] Storing 10000 Occurrences (519999/520000/1673763)
[INFO] [2022-11-24 10:47:24] Storing 10000 Occurrences (529999/530000/1673763)
[INFO] [2022-11-24 10:47:28] Storing 10000 Occurrences (539999/540000/1673763)
[INFO] [2022-11-24 10:47:33] Storing 10000 Occurrences (549999/550000/1673763)
[INFO] [2022-11-24 10:47:38] Storing 10000 Occurrences (559999/560000/1673763)
[INFO] [2022-11-24 10:47:44] Storing 10000 Occurrences (569999/570000/1673763)
[INFO] [2022-11-24 10:47:49] Storing 10000 Occurrences (579999/580000/1673763)
[INFO] [2022-11-24 10:47:54] Storing 10000 Occurrences (589999/590000/1673763)
[INFO] [2022-11-24 10:47:59] Storing 10000 Occurrences (599999/600000/1673763)
[INFO] [2022-11-24 10:48:04] Storing 10000 Occurrences (609999/610000/1673763)
[INFO] [2022-11-24 10:48:09] Storing 10000 Occurrences (619999/620000/1673763)
[INFO] [2022-11-24 10:48:14] Storing 10000 Occurrences (629999/630000/1673763)
[INFO] [2022-11-24 10:48:19] Storing 10000 Occurrences (639999/640000/1673763)
[INFO] [2022-11-24 10:48:24] Storing 10000 Occurrences (649999/650000/1673763)
[INFO] [2022-11-24 10:48:29] Storing 10000 Occurrences (659999/660000/1673763)
[INFO] [2022-11-24 10:48:34] Storing 10000 Occurrences (669999/670000/1673763)
[INFO] [2022-11-24 10:48:39] Storing 10000 Occurrences (679999/680000/1673763)
[INFO] [2022-11-24 10:48:45] Storing 10000 Occurrences (689999/690000/1673763)
[INFO] [2022-11-24 10:48:50] Storing 10000 Occurrences (699999/700000/1673763)
[INFO] [2022-11-24 10:48:55] Storing 10000 Occurrences (709999/710000/1673763)
[INFO] [2022-11-24 10:49:01] Storing 10000 Occurrences (719999/720000/1673763)
[INFO] [2022-11-24 10:49:06] Storing 10000 Occurrences (729999/730000/1673763)
[INFO] [2022-11-24 10:49:12] Storing 10000 Occurrences (739999/740000/1673763)
[INFO] [2022-11-24 10:49:17] Storing 10000 Occurrences (749999/750000/1673763)
[INFO] [2022-11-24 10:49:23] Storing 10000 Occurrences (759999/760000/1673763)
[INFO] [2022-11-24 10:49:29] Storing 10000 Occurrences (769999/770000/1673763)
[INFO] [2022-11-24 10:49:34] Storing 10000 Occurrences (779999/780000/1673763)
[INFO] [2022-11-24 10:49:40] Storing 10000 Occurrences (789999/790000/1673763)
[INFO] [2022-11-24 10:49:45] Storing 10000 Occurrences (799999/800000/1673763)
[INFO] [2022-11-24 10:49:51] Storing 10000 Occurrences (809999/810000/1673763)
[INFO] [2022-11-24 10:49:57] Storing 10000 Occurrences (819999/820000/1673763)
[INFO] [2022-11-24 10:50:03] Storing 10000 Occurrences (829999/830000/1673763)
[INFO] [2022-11-24 10:50:09] Storing 10000 Occurrences (839999/840000/1673763)
[INFO] [2022-11-24 10:50:15] Storing 10000 Occurrences (849999/850000/1673763)
[INFO] [2022-11-24 10:50:21] Storing 10000 Occurrences (859999/860000/1673763)
[INFO] [2022-11-24 10:50:27] Storing 10000 Occurrences (869999/870000/1673763)
[INFO] [2022-11-24 10:50:33] Storing 10000 Occurrences (879999/880000/1673763)
[INFO] [2022-11-24 10:50:39] Storing 10000 Occurrences (889999/890000/1673763)
[INFO] [2022-11-24 10:50:46] Storing 10000 Occurrences (899999/900000/1673763)
[INFO] [2022-11-24 10:50:52] Storing 10000 Occurrences (909999/910000/1673763)
[INFO] [2022-11-24 10:50:59] Storing 10000 Occurrences (919999/920000/1673763)
[INFO] [2022-11-24 10:51:05] Storing 10000 Occurrences (929999/930000/1673763)
[INFO] [2022-11-24 10:51:12] Storing 10000 Occurrences (939999/940000/1673763)
[INFO] [2022-11-24 10:51:18] Storing 10000 Occurrences (949999/950000/1673763)
[INFO] [2022-11-24 10:51:25] Storing 10000 Occurrences (959999/960000/1673763)
[INFO] [2022-11-24 10:51:32] Storing 10000 Occurrences (969999/970000/1673763)
[INFO] [2022-11-24 10:51:39] Storing 10000 Occurrences (979999/980000/1673763)
[INFO] [2022-11-24 10:51:46] Storing 10000 Occurrences (989999/990000/1673763)
[INFO] [2022-11-24 10:51:53] Storing 10000 Occurrences (999999/1000000/1673763)
[INFO] [2022-11-24 10:52:00] Storing 10000 Occurrences (1009999/1010000/1673763)
[INFO] [2022-11-24 10:52:07] Storing 10000 Occurrences (1019999/1020000/1673763)
[INFO] [2022-11-24 10:52:14] Storing 10000 Occurrences (1029999/1030000/1673763)
[INFO] [2022-11-24 10:52:21] Storing 10000 Occurrences (1039999/1040000/1673763)
[INFO] [2022-11-24 10:52:28] Storing 10000 Occurrences (1049999/1050000/1673763)
[INFO] [2022-11-24 10:52:36] Storing 10000 Occurrences (1059999/1060000/1673763)
[INFO] [2022-11-24 10:52:43] Storing 10000 Occurrences (1069999/1070000/1673763)
[INFO] [2022-11-24 10:52:51] Storing 10000 Occurrences (1079999/1080000/1673763)
[INFO] [2022-11-24 10:52:59] Storing 10000 Occurrences (1089999/1090000/1673763)
[INFO] [2022-11-24 10:53:06] Storing 10000 Occurrences (1099999/1100000/1673763)
[INFO] [2022-11-24 10:53:14] Storing 10000 Occurrences (1109999/1110000/1673763)
[INFO] [2022-11-24 10:53:22] Storing 10000 Occurrences (1119999/1120000/1673763)
[INFO] [2022-11-24 10:53:29] Storing 10000 Occurrences (1129999/1130000/1673763)
[INFO] [2022-11-24 10:53:37] Storing 10000 Occurrences (1139999/1140000/1673763)
[INFO] [2022-11-24 10:53:44] Storing 10000 Occurrences (1149999/1150000/1673763)
[INFO] [2022-11-24 10:53:52] Storing 10000 Occurrences (1159999/1160000/1673763)
[INFO] [2022-11-24 10:53:59] Storing 10000 Occurrences (1169999/1170000/1673763)
[INFO] [2022-11-24 10:54:06] Storing 10000 Occurrences (1179999/1180000/1673763)
[INFO] [2022-11-24 10:54:14] Storing 10000 Occurrences (1189999/1190000/1673763)
[INFO] [2022-11-24 10:54:21] Storing 10000 Occurrences (1199999/1200000/1673763)
[INFO] [2022-11-24 10:54:29] Storing 10000 Occurrences (1209999/1210000/1673763)
[INFO] [2022-11-24 10:54:37] Storing 10000 Occurrences (1219999/1220000/1673763)
[INFO] [2022-11-24 10:54:45] Storing 10000 Occurrences (1229999/1230000/1673763)
[INFO] [2022-11-24 10:54:54] Storing 10000 Occurrences (1239999/1240000/1673763)
[INFO] [2022-11-24 10:55:02] Storing 10000 Occurrences (1249999/1250000/1673763)
[INFO] [2022-11-24 10:55:10] Storing 10000 Occurrences (1259999/1260000/1673763)
[INFO] [2022-11-24 10:55:18] Storing 10000 Occurrences (1269999/1270000/1673763)
[INFO] [2022-11-24 10:55:26] Storing 10000 Occurrences (1279999/1280000/1673763)
[INFO] [2022-11-24 10:55:35] Storing 10000 Occurrences (1289999/1290000/1673763)
[INFO] [2022-11-24 10:55:43] Storing 10000 Occurrences (1299999/1300000/1673763)
[INFO] [2022-11-24 10:55:52] Storing 10000 Occurrences (1309999/1310000/1673763)
[INFO] [2022-11-24 10:56:00] Storing 10000 Occurrences (1319999/1320000/1673763)
[INFO] [2022-11-24 10:56:09] Storing 10000 Occurrences (1329999/1330000/1673763)
[INFO] [2022-11-24 10:56:18] Storing 10000 Occurrences (1339999/1340000/1673763)
[INFO] [2022-11-24 10:56:26] Storing 10000 Occurrences (1349999/1350000/1673763)
[INFO] [2022-11-24 10:56:35] Storing 10000 Occurrences (1359999/1360000/1673763)
[INFO] [2022-11-24 10:56:44] Storing 10000 Occurrences (1369999/1370000/1673763)
[INFO] [2022-11-24 10:56:53] Storing 10000 Occurrences (1379999/1380000/1673763)
[INFO] [2022-11-24 10:57:02] Storing 10000 Occurrences (1389999/1390000/1673763)
[INFO] [2022-11-24 10:57:10] Storing 10000 Occurrences (1399999/1400000/1673763)
[INFO] [2022-11-24 10:57:19] Storing 10000 Occurrences (1409999/1410000/1673763)
[INFO] [2022-11-24 10:57:28] Storing 10000 Occurrences (1419999/1420000/1673763)
[INFO] [2022-11-24 10:57:37] Storing 10000 Occurrences (1429999/1430000/1673763)
[INFO] [2022-11-24 10:57:46] Storing 10000 Occurrences (1439999/1440000/1673763)
[INFO] [2022-11-24 10:57:55] Storing 10000 Occurrences (1449999/1450000/1673763)
[INFO] [2022-11-24 10:58:04] Storing 10000 Occurrences (1459999/1460000/1673763)
[INFO] [2022-11-24 10:58:12] Storing 10000 Occurrences (1469999/1470000/1673763)
[INFO] [2022-11-24 10:58:21] Storing 10000 Occurrences (1479999/1480000/1673763)
[INFO] [2022-11-24 10:58:30] Storing 10000 Occurrences (1489999/1490000/1673763)
[INFO] [2022-11-24 10:58:39] Storing 10000 Occurrences (1499999/1500000/1673763)
[INFO] [2022-11-24 10:58:48] Storing 10000 Occurrences (1509999/1510000/1673763)
[INFO] [2022-11-24 10:58:58] Storing 10000 Occurrences (1519999/1520000/1673763)
[INFO] [2022-11-24 10:59:07] Storing 10000 Occurrences (1529999/1530000/1673763)
[INFO] [2022-11-24 10:59:16] Storing 10000 Occurrences (1539999/1540000/1673763)
[INFO] [2022-11-24 10:59:25] Storing 10000 Occurrences (1549999/1550000/1673763)
[INFO] [2022-11-24 10:59:34] Storing 10000 Occurrences (1559999/1560000/1673763)
[INFO] [2022-11-24 10:59:43] Storing 10000 Occurrences (1569999/1570000/1673763)
[INFO] [2022-11-24 10:59:53] Storing 10000 Occurrences (1579999/1580000/1673763)
[INFO] [2022-11-24 11:00:02] Storing 10000 Occurrences (1589999/1590000/1673763)
[INFO] [2022-11-24 11:00:12] Storing 10000 Occurrences (1599999/1600000/1673763)
[INFO] [2022-11-24 11:00:21] Storing 10000 Occurrences (1609999/1610000/1673763)
[INFO] [2022-11-24 11:00:31] Storing 10000 Occurrences (1619999/1620000/1673763)
[INFO] [2022-11-24 11:00:40] Storing 10000 Occurrences (1629999/1630000/1673763)
[INFO] [2022-11-24 11:00:50] Storing 10000 Occurrences (1639999/1640000/1673763)
[INFO] [2022-11-24 11:01:00] Storing 10000 Occurrences (1649999/1650000/1673763)
[INFO] [2022-11-24 11:01:10] Storing 10000 Occurrences (1659999/1660000/1673763)
[INFO] [2022-11-24 11:01:20] Storing 10000 Occurrences (1669999/1670000/1673763)
[INFO] [2022-11-24 11:01:30] Storing 3762 Occurrences (1673761/1673761/1673763)
[INFO] [2022-11-24 11:01:33] Handling diff: /app/public/data/trek_nat_dw_trek/diff/trek_nat_dw_trek_measurements_29874.diff (1673763 lines)
[INFO] [2022-11-24 11:01:33] Loading measurements diff file into memory (1673763 lines)...
[INFO] [2022-11-24 11:01:40] Storing 9999 Traits (28721/10000/1673763)
[INFO] [2022-11-24 11:01:44] Storing 18722 MetaTraits (28721/10000/1673763)
[INFO] [2022-11-24 11:01:51] Storing 10000 Traits (57386/20000/1673763)
[INFO] [2022-11-24 11:01:55] Storing 18665 MetaTraits (57386/20000/1673763)
[INFO] [2022-11-24 11:02:02] Storing 10000 Traits (86104/30000/1673763)
[INFO] [2022-11-24 11:02:05] Storing 18718 MetaTraits (86104/30000/1673763)
[INFO] [2022-11-24 11:02:13] Storing 10000 Traits (114883/40000/1673763)
[INFO] [2022-11-24 11:02:16] Storing 18779 MetaTraits (114883/40000/1673763)
[INFO] [2022-11-24 11:02:23] Storing 10000 Traits (143538/50000/1673763)
[INFO] [2022-11-24 11:02:27] Storing 18655 MetaTraits (143538/50000/1673763)
[INFO] [2022-11-24 11:02:34] Storing 10000 Traits (172248/60000/1673763)
[INFO] [2022-11-24 11:02:37] Storing 18710 MetaTraits (172248/60000/1673763)
[INFO] [2022-11-24 11:02:45] Storing 10000 Traits (200947/70000/1673763)
[INFO] [2022-11-24 11:02:48] Storing 18699 MetaTraits (200947/70000/1673763)
[INFO] [2022-11-24 11:02:56] Storing 10000 Traits (229649/80000/1673763)
[INFO] [2022-11-24 11:02:59] Storing 18702 MetaTraits (229649/80000/1673763)
[INFO] [2022-11-24 11:03:06] Storing 10000 Traits (258415/90000/1673763)
[INFO] [2022-11-24 11:03:09] Storing 18766 MetaTraits (258415/90000/1673763)
[INFO] [2022-11-24 11:03:17] Storing 10000 Traits (287138/100000/1673763)
[INFO] [2022-11-24 11:03:20] Storing 18723 MetaTraits (287138/100000/1673763)
[INFO] [2022-11-24 11:03:27] Storing 10000 Traits (315904/110000/1673763)
[INFO] [2022-11-24 11:03:31] Storing 18766 MetaTraits (315904/110000/1673763)
[INFO] [2022-11-24 11:03:38] Storing 10000 Traits (344598/120000/1673763)
[INFO] [2022-11-24 11:03:41] Storing 18694 MetaTraits (344598/120000/1673763)
[INFO] [2022-11-24 11:03:49] Storing 10000 Traits (373379/130000/1673763)
[INFO] [2022-11-24 11:03:52] Storing 18781 MetaTraits (373379/130000/1673763)
[INFO] [2022-11-24 11:04:00] Storing 10000 Traits (402116/140000/1673763)
[INFO] [2022-11-24 11:04:02] Storing 18737 MetaTraits (402116/140000/1673763)
[INFO] [2022-11-24 11:04:10] Storing 10000 Traits (430838/150000/1673763)
[INFO] [2022-11-24 11:04:13] Storing 18722 MetaTraits (430838/150000/1673763)
[INFO] [2022-11-24 11:04:21] Storing 10000 Traits (459582/160000/1673763)
[INFO] [2022-11-24 11:04:24] Storing 18744 MetaTraits (459582/160000/1673763)
[INFO] [2022-11-24 11:04:32] Storing 10000 Traits (488280/170000/1673763)
[INFO] [2022-11-24 11:04:35] Storing 18698 MetaTraits (488280/170000/1673763)
[INFO] [2022-11-24 11:04:42] Storing 10000 Traits (517006/180000/1673763)
[INFO] [2022-11-24 11:04:45] Storing 18726 MetaTraits (517006/180000/1673763)
[INFO] [2022-11-24 11:04:53] Storing 10000 Traits (545778/190000/1673763)
[INFO] [2022-11-24 11:04:56] Storing 18772 MetaTraits (545778/190000/1673763)
[INFO] [2022-11-24 11:05:04] Storing 10000 Traits (574531/200000/1673763)
[INFO] [2022-11-24 11:05:07] Storing 18753 MetaTraits (574531/200000/1673763)
[INFO] [2022-11-24 11:05:15] Storing 10000 Traits (603193/210000/1673763)
[INFO] [2022-11-24 11:05:18] Storing 18662 MetaTraits (603193/210000/1673763)
[INFO] [2022-11-24 11:05:26] Storing 10000 Traits (631936/220000/1673763)
[INFO] [2022-11-24 11:05:29] Storing 18743 MetaTraits (631936/220000/1673763)
[INFO] [2022-11-24 11:05:37] Storing 10000 Traits (660648/230000/1673763)
[INFO] [2022-11-24 11:05:40] Storing 18712 MetaTraits (660648/230000/1673763)
[INFO] [2022-11-24 11:05:48] Storing 10000 Traits (689351/240000/1673763)
[INFO] [2022-11-24 11:05:51] Storing 18703 MetaTraits (689351/240000/1673763)
[INFO] [2022-11-24 11:05:59] Storing 10000 Traits (718127/250000/1673763)
[INFO] [2022-11-24 11:06:02] Storing 18776 MetaTraits (718127/250000/1673763)
[INFO] [2022-11-24 11:06:11] Storing 10000 Traits (746837/260000/1673763)
[INFO] [2022-11-24 11:06:14] Storing 18710 MetaTraits (746837/260000/1673763)
[INFO] [2022-11-24 11:06:22] Storing 10000 Traits (775488/270000/1673763)
[INFO] [2022-11-24 11:06:25] Storing 18651 MetaTraits (775488/270000/1673763)
[INFO] [2022-11-24 11:06:33] Storing 10000 Traits (804249/280000/1673763)
[INFO] [2022-11-24 11:06:36] Storing 18761 MetaTraits (804249/280000/1673763)
[INFO] [2022-11-24 11:06:44] Storing 10000 Traits (832973/290000/1673763)
[INFO] [2022-11-24 11:06:47] Storing 18724 MetaTraits (832973/290000/1673763)
[INFO] [2022-11-24 11:06:56] Storing 10000 Traits (861711/300000/1673763)
[INFO] [2022-11-24 11:06:59] Storing 18738 MetaTraits (861711/300000/1673763)
[INFO] [2022-11-24 11:07:07] Storing 10000 Traits (890429/310000/1673763)
[INFO] [2022-11-24 11:07:10] Storing 18718 MetaTraits (890429/310000/1673763)
[INFO] [2022-11-24 11:07:19] Storing 10000 Traits (919124/320000/1673763)
[INFO] [2022-11-24 11:07:22] Storing 18695 MetaTraits (919124/320000/1673763)
[INFO] [2022-11-24 11:07:30] Storing 10000 Traits (947866/330000/1673763)
[INFO] [2022-11-24 11:07:33] Storing 18742 MetaTraits (947866/330000/1673763)
[INFO] [2022-11-24 11:07:42] Storing 10000 Traits (976615/340000/1673763)
[INFO] [2022-11-24 11:07:45] Storing 18749 MetaTraits (976615/340000/1673763)
[INFO] [2022-11-24 11:07:53] Storing 10000 Traits (1005344/350000/1673763)
[INFO] [2022-11-24 11:07:57] Storing 18729 MetaTraits (1005344/350000/1673763)
[INFO] [2022-11-24 11:08:05] Storing 10000 Traits (1034113/360000/1673763)
[INFO] [2022-11-24 11:08:08] Storing 18769 MetaTraits (1034113/360000/1673763)
[INFO] [2022-11-24 11:08:16] Storing 10000 Traits (1062819/370000/1673763)
[INFO] [2022-11-24 11:08:20] Storing 18706 MetaTraits (1062819/370000/1673763)
[INFO] [2022-11-24 11:08:28] Storing 10000 Traits (1091510/380000/1673763)
[INFO] [2022-11-24 11:08:31] Storing 18691 MetaTraits (1091510/380000/1673763)
[INFO] [2022-11-24 11:08:40] Storing 10000 Traits (1120244/390000/1673763)
[INFO] [2022-11-24 11:08:43] Storing 18734 MetaTraits (1120244/390000/1673763)
[INFO] [2022-11-24 11:08:52] Storing 10000 Traits (1148935/400000/1673763)
[INFO] [2022-11-24 11:08:55] Storing 18691 MetaTraits (1148935/400000/1673763)
[INFO] [2022-11-24 11:09:03] Storing 10000 Traits (1177643/410000/1673763)
[INFO] [2022-11-24 11:09:06] Storing 18708 MetaTraits (1177643/410000/1673763)
[INFO] [2022-11-24 11:09:15] Storing 10000 Traits (1206385/420000/1673763)
[INFO] [2022-11-24 11:09:18] Storing 18742 MetaTraits (1206385/420000/1673763)
[INFO] [2022-11-24 11:09:27] Storing 10000 Traits (1235095/430000/1673763)
[INFO] [2022-11-24 11:09:30] Storing 18710 MetaTraits (1235095/430000/1673763)
[INFO] [2022-11-24 11:09:39] Storing 10000 Traits (1263818/440000/1673763)
[INFO] [2022-11-24 11:09:42] Storing 18723 MetaTraits (1263818/440000/1673763)
[INFO] [2022-11-24 11:09:51] Storing 10000 Traits (1292567/450000/1673763)
[INFO] [2022-11-24 11:09:54] Storing 18749 MetaTraits (1292567/450000/1673763)
[INFO] [2022-11-24 11:10:03] Storing 10000 Traits (1321288/460000/1673763)
[INFO] [2022-11-24 11:10:06] Storing 18721 MetaTraits (1321288/460000/1673763)
[INFO] [2022-11-24 11:10:15] Storing 10000 Traits (1349945/470000/1673763)
[INFO] [2022-11-24 11:10:18] Storing 18657 MetaTraits (1349945/470000/1673763)
[INFO] [2022-11-24 11:10:27] Storing 10000 Traits (1378639/480000/1673763)
[INFO] [2022-11-24 11:10:30] Storing 18694 MetaTraits (1378639/480000/1673763)
[INFO] [2022-11-24 11:10:39] Storing 10000 Traits (1407421/490000/1673763)
[INFO] [2022-11-24 11:10:42] Storing 18782 MetaTraits (1407421/490000/1673763)
[INFO] [2022-11-24 11:10:51] Storing 10000 Traits (1436144/500000/1673763)
[INFO] [2022-11-24 11:10:54] Storing 18723 MetaTraits (1436144/500000/1673763)
[INFO] [2022-11-24 11:11:03] Storing 10000 Traits (1464823/510000/1673763)
[INFO] [2022-11-24 11:11:06] Storing 18679 MetaTraits (1464823/510000/1673763)
[INFO] [2022-11-24 11:11:16] Storing 10000 Traits (1493514/520000/1673763)
[INFO] [2022-11-24 11:11:19] Storing 18691 MetaTraits (1493514/520000/1673763)
[INFO] [2022-11-24 11:11:28] Storing 10000 Traits (1522254/530000/1673763)
[INFO] [2022-11-24 11:11:31] Storing 18740 MetaTraits (1522254/530000/1673763)
[INFO] [2022-11-24 11:11:40] Storing 10000 Traits (1550964/540000/1673763)
[INFO] [2022-11-24 11:11:44] Storing 18710 MetaTraits (1550964/540000/1673763)
[INFO] [2022-11-24 11:11:53] Storing 10000 Traits (1579659/550000/1673763)
[INFO] [2022-11-24 11:11:56] Storing 18695 MetaTraits (1579659/550000/1673763)
[INFO] [2022-11-24 11:12:05] Storing 10000 Traits (1608398/560000/1673763)
[INFO] [2022-11-24 11:12:08] Storing 18739 MetaTraits (1608398/560000/1673763)
[INFO] [2022-11-24 11:12:17] Storing 10000 Traits (1637074/570000/1673763)
[INFO] [2022-11-24 11:12:20] Storing 18676 MetaTraits (1637074/570000/1673763)
[INFO] [2022-11-24 11:12:30] Storing 10000 Traits (1665801/580000/1673763)
[INFO] [2022-11-24 11:12:33] Storing 18727 MetaTraits (1665801/580000/1673763)
[INFO] [2022-11-24 11:12:42] Storing 10000 Traits (1694534/590000/1673763)
[INFO] [2022-11-24 11:12:45] Storing 18733 MetaTraits (1694534/590000/1673763)
[INFO] [2022-11-24 11:12:54] Storing 10000 Traits (1723244/600000/1673763)
[INFO] [2022-11-24 11:12:58] Storing 18710 MetaTraits (1723244/600000/1673763)
[INFO] [2022-11-24 11:13:08] Storing 10000 Traits (1751953/610000/1673763)
[INFO] [2022-11-24 11:13:11] Storing 18709 MetaTraits (1751953/610000/1673763)
[INFO] [2022-11-24 11:13:21] Storing 10000 Traits (1780677/620000/1673763)
[INFO] [2022-11-24 11:13:24] Storing 18724 MetaTraits (1780677/620000/1673763)
[INFO] [2022-11-24 11:13:34] Storing 10000 Traits (1809379/630000/1673763)
[INFO] [2022-11-24 11:13:37] Storing 18702 MetaTraits (1809379/630000/1673763)
[INFO] [2022-11-24 11:13:47] Storing 10000 Traits (1838036/640000/1673763)
[INFO] [2022-11-24 11:13:50] Storing 18657 MetaTraits (1838036/640000/1673763)
[INFO] [2022-11-24 11:14:00] Storing 10000 Traits (1866676/650000/1673763)
[INFO] [2022-11-24 11:14:03] Storing 18640 MetaTraits (1866676/650000/1673763)
[INFO] [2022-11-24 11:14:13] Storing 10000 Traits (1895340/660000/1673763)
[INFO] [2022-11-24 11:14:16] Storing 18664 MetaTraits (1895340/660000/1673763)
[INFO] [2022-11-24 11:14:25] Storing 10000 Traits (1924048/670000/1673763)
[INFO] [2022-11-24 11:14:28] Storing 18708 MetaTraits (1924048/670000/1673763)
[INFO] [2022-11-24 11:14:39] Storing 10000 Traits (1952713/680000/1673763)
[INFO] [2022-11-24 11:14:41] Storing 18665 MetaTraits (1952713/680000/1673763)
[INFO] [2022-11-24 11:14:51] Storing 10000 Traits (1981448/690000/1673763)
[INFO] [2022-11-24 11:14:54] Storing 18735 MetaTraits (1981448/690000/1673763)
[INFO] [2022-11-24 11:15:05] Storing 10000 Traits (2010166/700000/1673763)
[INFO] [2022-11-24 11:15:08] Storing 18718 MetaTraits (2010166/700000/1673763)
[INFO] [2022-11-24 11:15:17] Storing 10000 Traits (2038903/710000/1673763)
[INFO] [2022-11-24 11:15:20] Storing 18737 MetaTraits (2038903/710000/1673763)
[INFO] [2022-11-24 11:15:30] Storing 10000 Traits (2067610/720000/1673763)
[INFO] [2022-11-24 11:15:33] Storing 18707 MetaTraits (2067610/720000/1673763)
[INFO] [2022-11-24 11:15:44] Storing 10000 Traits (2096328/730000/1673763)
[INFO] [2022-11-24 11:15:47] Storing 18718 MetaTraits (2096328/730000/1673763)
[INFO] [2022-11-24 11:15:58] Storing 10000 Traits (2125013/740000/1673763)
[INFO] [2022-11-24 11:16:01] Storing 18685 MetaTraits (2125013/740000/1673763)
[INFO] [2022-11-24 11:16:11] Storing 10000 Traits (2153713/750000/1673763)
[INFO] [2022-11-24 11:16:14] Storing 18700 MetaTraits (2153713/750000/1673763)
[INFO] [2022-11-24 11:16:25] Storing 10000 Traits (2182440/760000/1673763)
[INFO] [2022-11-24 11:16:28] Storing 18727 MetaTraits (2182440/760000/1673763)
[INFO] [2022-11-24 11:16:38] Storing 10000 Traits (2211150/770000/1673763)
[INFO] [2022-11-24 11:16:41] Storing 18710 MetaTraits (2211150/770000/1673763)
[INFO] [2022-11-24 11:16:51] Storing 10000 Traits (2239853/780000/1673763)
[INFO] [2022-11-24 11:16:54] Storing 18703 MetaTraits (2239853/780000/1673763)
[INFO] [2022-11-24 11:17:06] Storing 10000 Traits (2268574/790000/1673763)
[INFO] [2022-11-24 11:17:08] Storing 18721 MetaTraits (2268574/790000/1673763)
[INFO] [2022-11-24 11:17:19] Storing 10000 Traits (2297262/800000/1673763)
[INFO] [2022-11-24 11:17:22] Storing 18688 MetaTraits (2297262/800000/1673763)
[INFO] [2022-11-24 11:17:33] Storing 10000 Traits (2325908/810000/1673763)
[INFO] [2022-11-24 11:17:36] Storing 18646 MetaTraits (2325908/810000/1673763)
[INFO] [2022-11-24 11:17:47] Storing 10000 Traits (2354685/820000/1673763)
[INFO] [2022-11-24 11:17:50] Storing 18777 MetaTraits (2354685/820000/1673763)
[INFO] [2022-11-24 11:18:01] Storing 10000 Traits (2383385/830000/1673763)
[INFO] [2022-11-24 11:18:04] Storing 18700 MetaTraits (2383385/830000/1673763)
[INFO] [2022-11-24 11:18:15] Storing 10000 Traits (2412123/840000/1673763)
[INFO] [2022-11-24 11:18:18] Storing 18738 MetaTraits (2412123/840000/1673763)
[INFO] [2022-11-24 11:18:30] Storing 10000 Traits (2440779/850000/1673763)
[INFO] [2022-11-24 11:18:33] Storing 18656 MetaTraits (2440779/850000/1673763)
[INFO] [2022-11-24 11:18:44] Storing 10000 Traits (2469467/860000/1673763)
[INFO] [2022-11-24 11:18:47] Storing 18688 MetaTraits (2469467/860000/1673763)
[INFO] [2022-11-24 11:18:58] Storing 10000 Traits (2498144/870000/1673763)
[INFO] [2022-11-24 11:19:01] Storing 18677 MetaTraits (2498144/870000/1673763)
[INFO] [2022-11-24 11:19:12] Storing 10000 Traits (2526814/880000/1673763)
[INFO] [2022-11-24 11:19:15] Storing 18670 MetaTraits (2526814/880000/1673763)
[INFO] [2022-11-24 11:19:26] Storing 10000 Traits (2555565/890000/1673763)
[INFO] [2022-11-24 11:19:29] Storing 18751 MetaTraits (2555565/890000/1673763)
[INFO] [2022-11-24 11:19:41] Storing 10000 Traits (2584267/900000/1673763)
[INFO] [2022-11-24 11:19:44] Storing 18702 MetaTraits (2584267/900000/1673763)
[INFO] [2022-11-24 11:19:55] Storing 10000 Traits (2612995/910000/1673763)
[INFO] [2022-11-24 11:19:58] Storing 18728 MetaTraits (2612995/910000/1673763)
[INFO] [2022-11-24 11:20:09] Storing 10000 Traits (2641695/920000/1673763)
[INFO] [2022-11-24 11:20:12] Storing 18700 MetaTraits (2641695/920000/1673763)
[INFO] [2022-11-24 11:20:23] Storing 10000 Traits (2670388/930000/1673763)
[INFO] [2022-11-24 11:20:26] Storing 18693 MetaTraits (2670388/930000/1673763)
[INFO] [2022-11-24 11:20:37] Storing 10000 Traits (2699152/940000/1673763)
[INFO] [2022-11-24 11:20:40] Storing 18764 MetaTraits (2699152/940000/1673763)
[INFO] [2022-11-24 11:20:51] Storing 10000 Traits (2727870/950000/1673763)
[INFO] [2022-11-24 11:20:54] Storing 18718 MetaTraits (2727870/950000/1673763)
[INFO] [2022-11-24 11:21:06] Storing 10000 Traits (2756558/960000/1673763)
[INFO] [2022-11-24 11:21:09] Storing 18688 MetaTraits (2756558/960000/1673763)
[INFO] [2022-11-24 11:21:21] Storing 10000 Traits (2785244/970000/1673763)
[INFO] [2022-11-24 11:21:24] Storing 18686 MetaTraits (2785244/970000/1673763)
[INFO] [2022-11-24 11:21:36] Storing 10000 Traits (2813986/980000/1673763)
[INFO] [2022-11-24 11:21:39] Storing 18742 MetaTraits (2813986/980000/1673763)
[INFO] [2022-11-24 11:21:51] Storing 10000 Traits (2842737/990000/1673763)
[INFO] [2022-11-24 11:21:54] Storing 18751 MetaTraits (2842737/990000/1673763)
[INFO] [2022-11-24 11:22:05] Storing 10000 Traits (2871395/1000000/1673763)
[INFO] [2022-11-24 11:22:08] Storing 18658 MetaTraits (2871395/1000000/1673763)
[INFO] [2022-11-24 11:22:19] Storing 10000 Traits (2900124/1010000/1673763)
[INFO] [2022-11-24 11:22:22] Storing 18729 MetaTraits (2900124/1010000/1673763)
[INFO] [2022-11-24 11:22:34] Storing 10000 Traits (2928836/1020000/1673763)
[INFO] [2022-11-24 11:22:37] Storing 18712 MetaTraits (2928836/1020000/1673763)
[INFO] [2022-11-24 11:22:48] Storing 10000 Traits (2957592/1030000/1673763)
[INFO] [2022-11-24 11:22:51] Storing 18756 MetaTraits (2957592/1030000/1673763)
[INFO] [2022-11-24 11:23:03] Storing 10000 Traits (2986345/1040000/1673763)
[INFO] [2022-11-24 11:23:06] Storing 18753 MetaTraits (2986345/1040000/1673763)
[INFO] [2022-11-24 11:23:18] Storing 10000 Traits (3015066/1050000/1673763)
[INFO] [2022-11-24 11:23:21] Storing 18721 MetaTraits (3015066/1050000/1673763)
[INFO] [2022-11-24 11:23:33] Storing 10000 Traits (3043812/1060000/1673763)
[INFO] [2022-11-24 11:23:36] Storing 18746 MetaTraits (3043812/1060000/1673763)
[INFO] [2022-11-24 11:23:48] Storing 10000 Traits (3072503/1070000/1673763)
[INFO] [2022-11-24 11:23:51] Storing 18691 MetaTraits (3072503/1070000/1673763)
[INFO] [2022-11-24 11:24:03] Storing 10000 Traits (3101177/1080000/1673763)
[INFO] [2022-11-24 11:24:06] Storing 18674 MetaTraits (3101177/1080000/1673763)
[INFO] [2022-11-24 11:24:18] Storing 10000 Traits (3129925/1090000/1673763)
[INFO] [2022-11-24 11:24:21] Storing 18748 MetaTraits (3129925/1090000/1673763)
[INFO] [2022-11-24 11:24:33] Storing 10000 Traits (3158674/1100000/1673763)
[INFO] [2022-11-24 11:24:36] Storing 18749 MetaTraits (3158674/1100000/1673763)
[INFO] [2022-11-24 11:24:49] Storing 10000 Traits (3187433/1110000/1673763)
[INFO] [2022-11-24 11:24:51] Storing 18759 MetaTraits (3187433/1110000/1673763)
[INFO] [2022-11-24 11:25:04] Storing 10000 Traits (3216091/1120000/1673763)
[INFO] [2022-11-24 11:25:07] Storing 18658 MetaTraits (3216091/1120000/1673763)
[INFO] [2022-11-24 11:25:18] Storing 10000 Traits (3244692/1130000/1673763)
[INFO] [2022-11-24 11:25:21] Storing 18601 MetaTraits (3244692/1130000/1673763)
[INFO] [2022-11-24 11:25:33] Storing 10000 Traits (3273371/1140000/1673763)
[INFO] [2022-11-24 11:25:36] Storing 18679 MetaTraits (3273371/1140000/1673763)
[INFO] [2022-11-24 11:25:49] Storing 10000 Traits (3302118/1150000/1673763)
[INFO] [2022-11-24 11:25:52] Storing 18747 MetaTraits (3302118/1150000/1673763)
[INFO] [2022-11-24 11:26:04] Storing 10000 Traits (3330838/1160000/1673763)
[INFO] [2022-11-24 11:26:07] Storing 18720 MetaTraits (3330838/1160000/1673763)
[INFO] [2022-11-24 11:26:20] Storing 10000 Traits (3359578/1170000/1673763)
[INFO] [2022-11-24 11:26:23] Storing 18740 MetaTraits (3359578/1170000/1673763)
[INFO] [2022-11-24 11:26:36] Storing 10000 Traits (3388277/1180000/1673763)
[INFO] [2022-11-24 11:26:39] Storing 18699 MetaTraits (3388277/1180000/1673763)
[INFO] [2022-11-24 11:26:51] Storing 10000 Traits (3417019/1190000/1673763)
[INFO] [2022-11-24 11:26:54] Storing 18742 MetaTraits (3417019/1190000/1673763)
[INFO] [2022-11-24 11:27:07] Storing 10000 Traits (3445733/1200000/1673763)
[INFO] [2022-11-24 11:27:09] Storing 18714 MetaTraits (3445733/1200000/1673763)
[INFO] [2022-11-24 11:27:22] Storing 10000 Traits (3474416/1210000/1673763)
[INFO] [2022-11-24 11:27:25] Storing 18683 MetaTraits (3474416/1210000/1673763)
[INFO] [2022-11-24 11:27:37] Storing 10000 Traits (3503148/1220000/1673763)
[INFO] [2022-11-24 11:27:40] Storing 18732 MetaTraits (3503148/1220000/1673763)
[INFO] [2022-11-24 11:27:52] Storing 10000 Traits (3531844/1230000/1673763)
[INFO] [2022-11-24 11:27:55] Storing 18696 MetaTraits (3531844/1230000/1673763)
[INFO] [2022-11-24 11:28:08] Storing 10000 Traits (3560531/1240000/1673763)
[INFO] [2022-11-24 11:28:11] Storing 18687 MetaTraits (3560531/1240000/1673763)
[INFO] [2022-11-24 11:28:24] Storing 10000 Traits (3589218/1250000/1673763)
[INFO] [2022-11-24 11:28:27] Storing 18687 MetaTraits (3589218/1250000/1673763)
[INFO] [2022-11-24 11:28:39] Storing 10000 Traits (3617963/1260000/1673763)
[INFO] [2022-11-24 11:28:42] Storing 18745 MetaTraits (3617963/1260000/1673763)
[INFO] [2022-11-24 11:28:55] Storing 10000 Traits (3646584/1270000/1673763)
[INFO] [2022-11-24 11:28:58] Storing 18621 MetaTraits (3646584/1270000/1673763)
[INFO] [2022-11-24 11:29:10] Storing 10000 Traits (3675283/1280000/1673763)
[INFO] [2022-11-24 11:29:13] Storing 18699 MetaTraits (3675283/1280000/1673763)
[INFO] [2022-11-24 11:29:26] Storing 10000 Traits (3704047/1290000/1673763)
[INFO] [2022-11-24 11:29:29] Storing 18764 MetaTraits (3704047/1290000/1673763)
[INFO] [2022-11-24 11:29:42] Storing 10000 Traits (3732737/1300000/1673763)
[INFO] [2022-11-24 11:29:45] Storing 18690 MetaTraits (3732737/1300000/1673763)
[INFO] [2022-11-24 11:29:58] Storing 10000 Traits (3761446/1310000/1673763)
[INFO] [2022-11-24 11:30:01] Storing 18709 MetaTraits (3761446/1310000/1673763)
[INFO] [2022-11-24 11:30:14] Storing 10000 Traits (3790127/1320000/1673763)
[INFO] [2022-11-24 11:30:17] Storing 18681 MetaTraits (3790127/1320000/1673763)
[INFO] [2022-11-24 11:30:30] Storing 10000 Traits (3818850/1330000/1673763)
[INFO] [2022-11-24 11:30:33] Storing 18723 MetaTraits (3818850/1330000/1673763)
[INFO] [2022-11-24 11:30:46] Storing 10000 Traits (3847542/1340000/1673763)
[INFO] [2022-11-24 11:30:49] Storing 18692 MetaTraits (3847542/1340000/1673763)
[INFO] [2022-11-24 11:31:02] Storing 10000 Traits (3876223/1350000/1673763)
[INFO] [2022-11-24 11:31:05] Storing 18681 MetaTraits (3876223/1350000/1673763)
[INFO] [2022-11-24 11:31:18] Storing 10000 Traits (3904883/1360000/1673763)
[INFO] [2022-11-24 11:31:21] Storing 18660 MetaTraits (3904883/1360000/1673763)
[INFO] [2022-11-24 11:31:34] Storing 10000 Traits (3933580/1370000/1673763)
[INFO] [2022-11-24 11:31:37] Storing 18697 MetaTraits (3933580/1370000/1673763)
[INFO] [2022-11-24 11:31:50] Storing 10000 Traits (3962282/1380000/1673763)
[INFO] [2022-11-24 11:31:53] Storing 18702 MetaTraits (3962282/1380000/1673763)
[INFO] [2022-11-24 11:32:06] Storing 10000 Traits (3990982/1390000/1673763)
[INFO] [2022-11-24 11:32:09] Storing 18700 MetaTraits (3990982/1390000/1673763)
[INFO] [2022-11-24 11:32:23] Storing 10000 Traits (4019717/1400000/1673763)
[INFO] [2022-11-24 11:32:26] Storing 18735 MetaTraits (4019717/1400000/1673763)
[INFO] [2022-11-24 11:32:40] Storing 10000 Traits (4048463/1410000/1673763)
[INFO] [2022-11-24 11:32:43] Storing 18746 MetaTraits (4048463/1410000/1673763)
[INFO] [2022-11-24 11:32:56] Storing 10000 Traits (4077207/1420000/1673763)
[INFO] [2022-11-24 11:32:59] Storing 18744 MetaTraits (4077207/1420000/1673763)
[INFO] [2022-11-24 11:33:13] Storing 10000 Traits (4105960/1430000/1673763)
[INFO] [2022-11-24 11:33:15] Storing 18753 MetaTraits (4105960/1430000/1673763)
[INFO] [2022-11-24 11:33:28] Storing 10000 Traits (4134674/1440000/1673763)
[INFO] [2022-11-24 11:33:31] Storing 18714 MetaTraits (4134674/1440000/1673763)
[INFO] [2022-11-24 11:33:45] Storing 10000 Traits (4163428/1450000/1673763)
[INFO] [2022-11-24 11:33:48] Storing 18754 MetaTraits (4163428/1450000/1673763)
[INFO] [2022-11-24 11:34:01] Storing 10000 Traits (4192116/1460000/1673763)
[INFO] [2022-11-24 11:34:04] Storing 18688 MetaTraits (4192116/1460000/1673763)
[INFO] [2022-11-24 11:34:17] Storing 10000 Traits (4220838/1470000/1673763)
[INFO] [2022-11-24 11:34:20] Storing 18722 MetaTraits (4220838/1470000/1673763)
[INFO] [2022-11-24 11:34:34] Storing 10000 Traits (4249512/1480000/1673763)
[INFO] [2022-11-24 11:34:37] Storing 18674 MetaTraits (4249512/1480000/1673763)
[INFO] [2022-11-24 11:34:51] Storing 10000 Traits (4278182/1490000/1673763)
[INFO] [2022-11-24 11:34:54] Storing 18670 MetaTraits (4278182/1490000/1673763)
[INFO] [2022-11-24 11:35:07] Storing 10000 Traits (4306930/1500000/1673763)
[INFO] [2022-11-24 11:35:10] Storing 18748 MetaTraits (4306930/1500000/1673763)
[INFO] [2022-11-24 11:35:24] Storing 10000 Traits (4335689/1510000/1673763)
[INFO] [2022-11-24 11:35:27] Storing 18759 MetaTraits (4335689/1510000/1673763)
[INFO] [2022-11-24 11:35:41] Storing 10000 Traits (4364418/1520000/1673763)
[INFO] [2022-11-24 11:35:44] Storing 18729 MetaTraits (4364418/1520000/1673763)
[INFO] [2022-11-24 11:35:57] Storing 10000 Traits (4393145/1530000/1673763)
[INFO] [2022-11-24 11:36:00] Storing 18727 MetaTraits (4393145/1530000/1673763)
[INFO] [2022-11-24 11:36:14] Storing 10000 Traits (4421838/1540000/1673763)
[INFO] [2022-11-24 11:36:16] Storing 18693 MetaTraits (4421838/1540000/1673763)
[INFO] [2022-11-24 11:36:30] Storing 10000 Traits (4450614/1550000/1673763)
[INFO] [2022-11-24 11:36:33] Storing 18776 MetaTraits (4450614/1550000/1673763)
[INFO] [2022-11-24 11:36:47] Storing 10000 Traits (4479341/1560000/1673763)
[INFO] [2022-11-24 11:36:49] Storing 18727 MetaTraits (4479341/1560000/1673763)
[INFO] [2022-11-24 11:37:03] Storing 10000 Traits (4508053/1570000/1673763)
[INFO] [2022-11-24 11:37:06] Storing 18712 MetaTraits (4508053/1570000/1673763)
[INFO] [2022-11-24 11:37:20] Storing 10000 Traits (4536790/1580000/1673763)
[INFO] [2022-11-24 11:37:23] Storing 18737 MetaTraits (4536790/1580000/1673763)
[INFO] [2022-11-24 11:37:37] Storing 10000 Traits (4565488/1590000/1673763)
[INFO] [2022-11-24 11:37:40] Storing 18698 MetaTraits (4565488/1590000/1673763)
[INFO] [2022-11-24 11:37:54] Storing 10000 Traits (4594192/1600000/1673763)
[INFO] [2022-11-24 11:37:57] Storing 18704 MetaTraits (4594192/1600000/1673763)
[INFO] [2022-11-24 11:38:11] Storing 10000 Traits (4622890/1610000/1673763)
[INFO] [2022-11-24 11:38:14] Storing 18698 MetaTraits (4622890/1610000/1673763)
[INFO] [2022-11-24 11:38:27] Storing 10000 Traits (4651638/1620000/1673763)
[INFO] [2022-11-24 11:38:30] Storing 18748 MetaTraits (4651638/1620000/1673763)
[INFO] [2022-11-24 11:38:44] Storing 10000 Traits (4680368/1630000/1673763)
[INFO] [2022-11-24 11:38:46] Storing 18730 MetaTraits (4680368/1630000/1673763)
[INFO] [2022-11-24 11:39:00] Storing 10000 Traits (4709179/1640000/1673763)
[INFO] [2022-11-24 11:39:03] Storing 18811 MetaTraits (4709179/1640000/1673763)
[INFO] [2022-11-24 11:39:16] Storing 10000 Traits (4737866/1650000/1673763)
[INFO] [2022-11-24 11:39:19] Storing 18687 MetaTraits (4737866/1650000/1673763)
[INFO] [2022-11-24 11:39:33] Storing 10000 Traits (4766577/1660000/1673763)
[INFO] [2022-11-24 11:39:36] Storing 18711 MetaTraits (4766577/1660000/1673763)
[INFO] [2022-11-24 11:39:50] Storing 10000 Traits (4795278/1670000/1673763)
[INFO] [2022-11-24 11:39:53] Storing 18701 MetaTraits (4795278/1670000/1673763)
[INFO] [2022-11-24 11:40:04] Storing 3762 Traits (4806085/1673761/1673763)
[INFO] [2022-11-24 11:40:05] Storing 7045 MetaTraits (4806085/1673761/1673763)
[STOP] [2022-11-24 11:40:05] parse_diff_and_store
[START] [2022-11-24 11:40:05] resolve_keys
[2022-11-24 11:42:01] Resolving downloaded urls (this is not actually downloading them yet)
[INFO] [2022-11-24 11:42:12] Occurrences to nodes (through scientific_names)...
[INFO] [2022-11-24 11:42:59] traits to occurrences...
[INFO] [2022-11-24 11:44:09] traits to nodes (through occurrences)...
[INFO] [2022-11-24 11:45:07] Traits to sex term...
[INFO] [2022-11-24 11:45:39] Traits to lifestage term...
[INFO] [2022-11-24 11:46:03] MetaTraits to traits...
[INFO] [2022-11-24 11:47:22] MetaTraits (simple, measurement row refers to parent) to traits...
[INFO] [2022-11-24 11:47:24] Assocs to occurrences...
[INFO] [2022-11-24 11:47:24] Assocs to nodes...
[INFO] [2022-11-24 11:47:24] Assoc to sex term...
[INFO] [2022-11-24 11:47:24] Assoc to lifestage term...
[INFO] [2022-11-24 11:47:24] MetaAssoc to assocs...
[STOP] [2022-11-24 11:47:24] resolve_keys
[START] [2022-11-24 11:47:24] hold_for_later_1
[STOP] [2022-11-24 11:47:24] hold_for_later_1
[START] [2022-11-24 11:47:24] hold_for_later_2
[STOP] [2022-11-24 11:47:24] hold_for_later_2
[START] [2022-11-24 11:47:24] resolve_missing_parents
[STOP] [2022-11-24 11:47:33] resolve_missing_parents
[START] [2022-11-24 11:47:33] rebuild_nodes
[START] [2022-11-24 11:47:33] Flattener#flatten
[START] [2022-11-24 11:47:33] Flattener#study_resource
[START] [2022-11-24 11:48:53] Flattener#build_ancestry
[STOP] [2022-11-24 12:00:56] Flattener#build_ancestry
[INFO] [2022-11-24 12:00:57] 556711 ancestry keys
[START] [2022-11-24 12:00:57] build_node_ancestors
[INFO] [2022-11-24 12:00:57] old ancestors deleted.
[STOP] [2022-11-24 12:06:09] build_node_ancestors
[START] [2022-11-24 12:06:13] Flattener#propagate_ancestor_ids
[STOP] [2022-11-24 12:07:43] Flattener#propagate_ancestor_ids
[STOP] [2022-11-24 12:07:43] Flattener#flatten
[STOP] [2022-11-24 12:07:43] rebuild_nodes
[START] [2022-11-24 12:07:43] resolve_missing_media_owners
[STOP] [2022-11-24 12:07:43] resolve_missing_media_owners
[START] [2022-11-24 12:07:43] sanitize_media_verbatims
[STOP] [2022-11-24 12:07:43] sanitize_media_verbatims
[START] [2022-11-24 12:07:43] queue_downloads
[STOP] [2022-11-24 12:07:43] queue_downloads
[START] [2022-11-24 12:07:43] parse_names
[WARN] [2022-11-24 12:07:44] I see 556711 names which still need to be parsed.
[WARN] [2022-11-24 12:07:45] Names to parse: 10000 formatted: 10000 learned: 9369 parsed: 10000
[WARN] [2022-11-24 12:07:56] Names to parse: 10000 formatted: 10000 learned: 9648 parsed: 10000
[WARN] [2022-11-24 12:08:05] Names to parse: 10000 formatted: 10000 learned: 9459 parsed: 10000
[WARN] [2022-11-24 12:08:14] Names to parse: 10000 formatted: 10000 learned: 9556 parsed: 10000
[WARN] [2022-11-24 12:08:23] Names to parse: 10000 formatted: 10000 learned: 9675 parsed: 10000
[WARN] [2022-11-24 12:08:32] Names to parse: 10000 formatted: 10000 learned: 9592 parsed: 10000
[WARN] [2022-11-24 12:08:41] Names to parse: 10000 formatted: 10000 learned: 9705 parsed: 10000
[WARN] [2022-11-24 12:08:49] Names to parse: 10000 formatted: 10000 learned: 9546 parsed: 10000
[WARN] [2022-11-24 12:08:58] Names to parse: 10000 formatted: 10000 learned: 9626 parsed: 10000
[WARN] [2022-11-24 12:09:07] Names to parse: 10000 formatted: 10000 learned: 9665 parsed: 10000
[WARN] [2022-11-24 12:09:15] Names to parse: 10000 formatted: 10000 learned: 9585 parsed: 10000
[WARN] [2022-11-24 12:09:23] Names to parse: 10000 formatted: 10000 learned: 9596 parsed: 10000
[WARN] [2022-11-24 12:09:32] Names to parse: 10000 formatted: 10000 learned: 9610 parsed: 10000
[WARN] [2022-11-24 12:09:41] Names to parse: 10000 formatted: 10000 learned: 9642 parsed: 10000
[WARN] [2022-11-24 12:09:50] Names to parse: 10000 formatted: 10000 learned: 9680 parsed: 10000
[WARN] [2022-11-24 12:09:58] Names to parse: 10000 formatted: 10000 learned: 9677 parsed: 10000
[WARN] [2022-11-24 12:10:06] Names to parse: 10000 formatted: 10000 learned: 9714 parsed: 10000
[WARN] [2022-11-24 12:10:14] Names to parse: 10000 formatted: 10000 learned: 9667 parsed: 10000
[WARN] [2022-11-24 12:10:23] Names to parse: 10000 formatted: 10000 learned: 9684 parsed: 10000
[WARN] [2022-11-24 12:10:31] Names to parse: 10000 formatted: 10000 learned: 9484 parsed: 10000
[WARN] [2022-11-24 12:10:39] Names to parse: 10000 formatted: 10000 learned: 9686 parsed: 10000
[WARN] [2022-11-24 12:10:47] Names to parse: 10000 formatted: 10000 learned: 9685 parsed: 10000
[WARN] [2022-11-24 12:10:55] Names to parse: 10000 formatted: 10000 learned: 9593 parsed: 10000
[WARN] [2022-11-24 12:11:03] Names to parse: 10000 formatted: 10000 learned: 9735 parsed: 10000
[WARN] [2022-11-24 12:11:11] Names to parse: 10000 formatted: 10000 learned: 9698 parsed: 10000
[WARN] [2022-11-24 12:11:19] Names to parse: 10000 formatted: 10000 learned: 9705 parsed: 10000
[WARN] [2022-11-24 12:11:27] Names to parse: 10000 formatted: 10000 learned: 9677 parsed: 10000
[WARN] [2022-11-24 12:11:35] Names to parse: 10000 formatted: 10000 learned: 9732 parsed: 10000
[WARN] [2022-11-24 12:11:43] Names to parse: 10000 formatted: 10000 learned: 9787 parsed: 10000
[WARN] [2022-11-24 12:11:51] Names to parse: 10000 formatted: 10000 learned: 9695 parsed: 10000
[WARN] [2022-11-24 12:11:58] Names to parse: 10000 formatted: 10000 learned: 9723 parsed: 10000
[WARN] [2022-11-24 12:12:06] Names to parse: 10000 formatted: 10000 learned: 9718 parsed: 10000
[WARN] [2022-11-24 12:12:15] Names to parse: 10000 formatted: 10000 learned: 9682 parsed: 10000
[WARN] [2022-11-24 12:12:22] Names to parse: 10000 formatted: 10000 learned: 9705 parsed: 10000
[WARN] [2022-11-24 12:12:30] Names to parse: 10000 formatted: 10000 learned: 9730 parsed: 10000
[WARN] [2022-11-24 12:12:38] Names to parse: 10000 formatted: 10000 learned: 9691 parsed: 10000
[WARN] [2022-11-24 12:12:46] Names to parse: 10000 formatted: 10000 learned: 9755 parsed: 10000
[WARN] [2022-11-24 12:12:54] Names to parse: 10000 formatted: 10000 learned: 9660 parsed: 10000
[WARN] [2022-11-24 12:13:02] Names to parse: 10000 formatted: 10000 learned: 9639 parsed: 10000
[WARN] [2022-11-24 12:13:10] Names to parse: 10000 formatted: 10000 learned: 9720 parsed: 10000
[WARN] [2022-11-24 12:13:17] Names to parse: 10000 formatted: 10000 learned: 9613 parsed: 10000
[WARN] [2022-11-24 12:13:25] Names to parse: 10000 formatted: 10000 learned: 9779 parsed: 10000
[WARN] [2022-11-24 12:13:33] Names to parse: 10000 formatted: 10000 learned: 9632 parsed: 10000
[WARN] [2022-11-24 12:13:41] Names to parse: 10000 formatted: 10000 learned: 9678 parsed: 10000
[WARN] [2022-11-24 12:13:49] Names to parse: 10000 formatted: 10000 learned: 9646 parsed: 10000
[WARN] [2022-11-24 12:13:57] Names to parse: 10000 formatted: 10000 learned: 9687 parsed: 10000
[WARN] [2022-11-24 12:14:05] Names to parse: 10000 formatted: 10000 learned: 9690 parsed: 10000
[WARN] [2022-11-24 12:14:13] Names to parse: 10000 formatted: 10000 learned: 9645 parsed: 10000
[WARN] [2022-11-24 12:14:22] Names to parse: 10000 formatted: 10000 learned: 9715 parsed: 10000
[WARN] [2022-11-24 12:14:29] Names to parse: 10000 formatted: 10000 learned: 9655 parsed: 10000
[WARN] [2022-11-24 12:14:37] Names to parse: 10000 formatted: 10000 learned: 9665 parsed: 10000
[WARN] [2022-11-24 12:14:45] Names to parse: 10000 formatted: 10000 learned: 9756 parsed: 10000
[WARN] [2022-11-24 12:14:53] Names to parse: 10000 formatted: 10000 learned: 9738 parsed: 10000
[WARN] [2022-11-24 12:15:01] Names to parse: 10000 formatted: 10000 learned: 9739 parsed: 10000
[WARN] [2022-11-24 12:15:09] Names to parse: 10000 formatted: 10000 learned: 9724 parsed: 10000
[WARN] [2022-11-24 12:15:18] Names to parse: 6711 formatted: 6711 learned: 6576 parsed: 6711
[STOP] [2022-11-24 12:15:24] parse_names
[START] [2022-11-24 12:15:24] denormalize_canonical_names_to_nodes
[STOP] [2022-11-24 12:15:48] denormalize_canonical_names_to_nodes
[START] [2022-11-24 12:15:48] match_nodes
[START] [2022-11-24 12:15:49] map_all_nodes_to_pages
[STOP] [2022-11-24 19:27:51] map_all_nodes_to_pages
[INFO] [2022-11-24 19:27:51] 234889 Unmatched nodes (of 556711)! That's too many to output. Full list in /app/public/data/trek_nat_dw_trek/unmatched_nodes.txt ; First 10: Canonical: Saigona baiseensis; Node#119219345; ResourceID: 000040332F2853C295734E7BD4190F05.taxon; Canonical: Saigona; Node#119449368; ResourceID: 03FE879EC9161676FE88FC3DFD79B7D9.taxon; Canonical: Saigona maculata; Node#119527142; ResourceID: 398D4D016DD5529B8802FFC173CCEF33.taxon; Canonical: Saigona; Node#119585636; ResourceID: 661BAEAEE26EF2B4837E9F46DE3BE9FA.taxon; Canonical: Saigona; Node#119626527; ResourceID: 85BA0CB718A95181B9FC7D31D2BCF911.taxon; Canonical: Fernandea; Node#119246951; ResourceID: 03899314243871265BA5FD56EBA9DAAF.taxon; Canonical: Fernandea; Node#119246952; ResourceID: 03899314243D71215BA5FF35EDFEDC05.taxon; Canonical: Tenguna; Node#119259038; ResourceID: 039087E2FF86E924FDBAFD0AFC4D745B.taxon; Canonical: Tenguna medogensis; Node#119706619; ResourceID: C62CBD5B0060645CFF28FC7BFD02E4C6.taxon; Canonical: Tenguna; Node#119716867; ResourceID: CE929642500A2E37BD502B72A30FE2A5.taxon
[START] [2022-11-24 19:27:51] update_nodes
[STOP] [2022-11-24 19:28:27] update_nodes
[STOP] [2022-11-24 19:28:27] match_nodes
[START] [2022-11-24 19:28:27] reindex_search
[STOP] [2022-11-24 19:38:00] reindex_search
[START] [2022-11-24 19:38:00] normalize_units
[STOP] [2022-11-24 19:39:16] normalize_units
[START] [2022-11-24 19:39:16] calculate_statistics
[INFO] [2022-11-24 19:39:31] Duplicate page_id count: 0
[STOP] [2022-11-24 19:39:34] calculate_statistics
[START] [2022-11-24 19:39:34] complete_harvest_instance
[START] [2022-11-24 19:39:34] overall_tsv_creation
[INFO] [2022-11-24 19:39:34] Exporting 556711 nodes as TSV in batches of 10000...
[INFO] [2022-11-24 19:39:34] Processing group of 556711 in 56 batches of 10000
[WARN] [2022-11-24 19:39:40] Encountered new rank, please ensure there are handlers for it: undefspecies
[INFO] [2022-11-24 19:39:53] 21547 Traits (unfiltered) and 0 associations...
[INFO] [2022-11-24 19:39:53] Building Traits map for 10000 nodes (this can take a while)...
[INFO] [2022-11-24 19:44:01] Mapped 21547 traits (40383 meta) for 10000 nodes.
[INFO] [2022-11-24 19:44:01] Building Associations map (this can take a while)...
[INFO] [2022-11-24 19:44:19] Done. 0 assocs mapped (0 meta).
[INFO] [2022-11-24 19:44:19] Adding 21547 traits...
[INFO] [2022-11-24 19:44:54] 0 metadata added.
[INFO] [2022-11-24 19:44:54] Adding 0 assocs...
[INFO] [2022-11-24 19:44:54] 0 metadata added.
[INFO] [2022-11-24 19:45:58] Processed 10000/556711 nodes
[INFO] [2022-11-24 19:46:20] 32201 Traits (unfiltered) and 0 associations...
[INFO] [2022-11-24 19:46:20] Building Traits map for 10000 nodes (this can take a while)...
[INFO] [2022-11-24 19:52:43] Mapped 32201 traits (61879 meta) for 10000 nodes.
[INFO] [2022-11-24 19:52:43] Building Associations map (this can take a while)...
[INFO] [2022-11-24 19:52:54] Done. 0 assocs mapped (0 meta).
[INFO] [2022-11-24 19:52:54] Adding 32201 traits...
[STOP] [2022-11-24 19:53:40] overall_tsv_creation
[STOP] [2022-11-24 19:53:40] complete_harvest_instance
[STOP] [2022-11-24 19:53:40] logged process, took 33822.19

Latest Process