Stage:
completed
Fetched:
27 May 15:19
Validated:
27 May 15:19
Deltas Created
27 May 15:19
Units Normalized:
27 May 15:20
Ancestry Built:
27 May 15:20
Nodes Matched:
27 May 15:20
Names Parsed:
27 May 15:20
New Models Stored:
27 May 15:20
Indexed:
27 May 15:20
Completed:
27 May 15:22
Time to Harvest:
less than a minute
Harvesting Log
(255 lines)
[INFO] [2021-05-27 15:19:37] Created harvest instance #3892
[STOP] [2021-05-27 15:19:37] create_harvest_instance
[START] [2021-05-27 15:19:37] fetch_files
[STOP] [2021-05-27 15:19:37] fetch_files
[START] [2021-05-27 15:19:37] validate_each_file
[INFO] [2021-05-27 15:19:37] Looping over 3 formats...
[INFO] [2021-05-27 15:19:37] ...nodes (/app/public/data/washington_bird_/taxon.tab)
[INFO] [2021-05-27 15:19:37] Valid: /app/public/converted_csv/washington_bird__nodes_3892.csv (138 lines)
[INFO] [2021-05-27 15:19:37] ...occurrences (/app/public/data/washington_bird_/occurrence.txt)
[INFO] [2021-05-27 15:19:37] Valid: /app/public/converted_csv/washington_bird__occurrences_3892.csv (1429 lines)
[INFO] [2021-05-27 15:19:37] ...measurements (/app/public/data/washington_bird_/measurement_or_fact.txt)
[INFO] [2021-05-27 15:19:37] Valid: /app/public/converted_csv/washington_bird__measurements_3892.csv (2858 lines)
[STOP] [2021-05-27 15:19:37] validate_each_file
[START] [2021-05-27 15:19:37] convert_to_csv
[INFO] [2021-05-27 15:19:37] Looping over 3 formats...
[INFO] [2021-05-27 15:19:37] ...nodes (/app/public/data/washington_bird_/taxon.tab)
[CMD] [2021-05-27 15:19:37] /usr/bin/sort /app/public/converted_csv/washington_bird__nodes_3892.csv > /app/public/converted_csv/washington_bird__nodes_3892.csv_sorted
[INFO] [2021-05-27 15:19:38] Converted: /app/public/converted_csv/washington_bird__nodes_3892.csv (138 lines)
[INFO] [2021-05-27 15:19:38] ...occurrences (/app/public/data/washington_bird_/occurrence.txt)
[CMD] [2021-05-27 15:19:38] /usr/bin/sort /app/public/converted_csv/washington_bird__occurrences_3892.csv > /app/public/converted_csv/washington_bird__occurrences_3892.csv_sorted
[INFO] [2021-05-27 15:19:40] Converted: /app/public/converted_csv/washington_bird__occurrences_3892.csv (1429 lines)
[INFO] [2021-05-27 15:19:40] ...measurements (/app/public/data/washington_bird_/measurement_or_fact.txt)
[CMD] [2021-05-27 15:19:40] /usr/bin/sort /app/public/converted_csv/washington_bird__measurements_3892.csv > /app/public/converted_csv/washington_bird__measurements_3892.csv_sorted
[INFO] [2021-05-27 15:19:41] Converted: /app/public/converted_csv/washington_bird__measurements_3892.csv (2858 lines)
[STOP] [2021-05-27 15:19:41] convert_to_csv
[START] [2021-05-27 15:19:41] calculate_delta
[INFO] [2021-05-27 15:19:41] Looping over 3 formats...
[INFO] [2021-05-27 15:19:41] ...nodes (/app/public/data/washington_bird_/taxon.tab)
[CMD] [2021-05-27 15:19:41] echo "0a" > /app/public/diff/washington_bird__nodes_3892.diff
[CMD] [2021-05-27 15:19:43] tail -n +1 /app/public/converted_csv/washington_bird__nodes_3892.csv >> /app/public/diff/washington_bird__nodes_3892.diff
[CMD] [2021-05-27 15:19:44] echo "." >> /app/public/diff/washington_bird__nodes_3892.diff
[INFO] [2021-05-27 15:19:45] Created diff: /app/public/diff/washington_bird__nodes_3892.diff (140 lines)
[INFO] [2021-05-27 15:19:45] ...occurrences (/app/public/data/washington_bird_/occurrence.txt)
[CMD] [2021-05-27 15:19:45] echo "0a" > /app/public/diff/washington_bird__occurrences_3892.diff
[CMD] [2021-05-27 15:19:46] tail -n +1 /app/public/converted_csv/washington_bird__occurrences_3892.csv >> /app/public/diff/washington_bird__occurrences_3892.diff
[CMD] [2021-05-27 15:19:48] echo "." >> /app/public/diff/washington_bird__occurrences_3892.diff
[INFO] [2021-05-27 15:19:49] Created diff: /app/public/diff/washington_bird__occurrences_3892.diff (1431 lines)
[INFO] [2021-05-27 15:19:49] ...measurements (/app/public/data/washington_bird_/measurement_or_fact.txt)
[CMD] [2021-05-27 15:19:49] echo "0a" > /app/public/diff/washington_bird__measurements_3892.diff
[CMD] [2021-05-27 15:19:50] tail -n +1 /app/public/converted_csv/washington_bird__measurements_3892.csv >> /app/public/diff/washington_bird__measurements_3892.diff
[CMD] [2021-05-27 15:19:52] echo "." >> /app/public/diff/washington_bird__measurements_3892.diff
[INFO] [2021-05-27 15:19:53] Created diff: /app/public/diff/washington_bird__measurements_3892.diff (2860 lines)
[STOP] [2021-05-27 15:19:53] calculate_delta
[START] [2021-05-27 15:19:53] parse_diff_and_store
[INFO] [2021-05-27 15:19:53] Handling diff: /app/public/diff/washington_bird__nodes_3892.diff (140 lines)
[INFO] [2021-05-27 15:19:54] Loading nodes diff file into memory (140 /app/public/diff/washington_bird__nodes_3892.diff lines)...
[INFO] [2021-05-27 15:19:56] Handling diff: /app/public/diff/washington_bird__occurrences_3892.diff (1431 lines)
[INFO] [2021-05-27 15:19:57] Loading occurrences diff file into memory (1431 /app/public/diff/washington_bird__occurrences_3892.diff lines)...
[INFO] [2021-05-27 15:19:59] Handling diff: /app/public/diff/washington_bird__measurements_3892.diff (2860 lines)
[INFO] [2021-05-27 15:20:00] Loading measurements diff file into memory (2860 /app/public/diff/washington_bird__measurements_3892.diff lines)...
[INFO] [2021-05-27 15:20:02] Storing 249 ScientificNames
[INFO] [2021-05-27 15:20:02] Processing group of 249 in 1 groups of 1000
[INFO] [2021-05-27 15:20:02] Average Time: 0.08
[INFO] [2021-05-27 15:20:02] Total Time: 1s
[INFO] [2021-05-27 15:20:02] Storing 249 Nodes
[INFO] [2021-05-27 15:20:02] Processing group of 249 in 1 groups of 1000
[INFO] [2021-05-27 15:20:02] Average Time: 0.06
[INFO] [2021-05-27 15:20:02] Total Time: 1s
[INFO] [2021-05-27 15:20:02] Storing 1429 Occurrences
[INFO] [2021-05-27 15:20:02] Processing group of 1429 in 2 groups of 1000
[INFO] [2021-05-27 15:20:03] Average Time: 0.14
[INFO] [2021-05-27 15:20:03] Total Time: 1s
[INFO] [2021-05-27 15:20:03] Storing 2858 OccurrenceMetadata
[INFO] [2021-05-27 15:20:03] Processing group of 2858 in 3 groups of 1000
[INFO] [2021-05-27 15:20:03] Average Time: 0.177
[INFO] [2021-05-27 15:20:03] Total Time: 1s
[INFO] [2021-05-27 15:20:03] Storing 1429 Traits
[INFO] [2021-05-27 15:20:03] Processing group of 1429 in 2 groups of 1000
[INFO] [2021-05-27 15:20:04] Average Time: 0.255
[INFO] [2021-05-27 15:20:04] Total Time: 1s
[INFO] [2021-05-27 15:20:04] Storing 1121 MetaTraits
[INFO] [2021-05-27 15:20:04] Processing group of 1121 in 2 groups of 1000
[INFO] [2021-05-27 15:20:04] Average Time: 0.06
[INFO] [2021-05-27 15:20:04] Total Time: 1s
[STOP] [2021-05-27 15:20:04] parse_diff_and_store
[START] [2021-05-27 15:20:04] resolve_keys
[INFO] [2021-05-27 15:20:11] Occurrences to nodes (through scientific_names)...
[INFO] [2021-05-27 15:20:11] traits to occurrences...
[INFO] [2021-05-27 15:20:11] traits to nodes (through occurrences)...
[INFO] [2021-05-27 15:20:11] Traits to sex term...
[INFO] [2021-05-27 15:20:12] Traits to lifestage term...
[INFO] [2021-05-27 15:20:12] MetaTraits to traits...
[INFO] [2021-05-27 15:20:12] MetaTraits (simple, measurement row refers to parent) to traits...
[INFO] [2021-05-27 15:20:12] Assocs to occurrences...
[INFO] [2021-05-27 15:20:12] Assocs to nodes...
[INFO] [2021-05-27 15:20:12] Assoc to sex term...
[INFO] [2021-05-27 15:20:12] Assoc to lifestage term...
[INFO] [2021-05-27 15:20:12] MetaAssoc to assocs...
[STOP] [2021-05-27 15:20:12] resolve_keys
[START] [2021-05-27 15:20:12] hold_for_later_1
[STOP] [2021-05-27 15:20:12] hold_for_later_1
[START] [2021-05-27 15:20:12] hold_for_later_2
[STOP] [2021-05-27 15:20:12] hold_for_later_2
[START] [2021-05-27 15:20:12] resolve_missing_parents
[STOP] [2021-05-27 15:20:12] resolve_missing_parents
[START] [2021-05-27 15:20:12] rebuild_nodes
[START] [2021-05-27 15:20:12] Flattener#flatten
[START] [2021-05-27 15:20:12] Flattener#study_resource
[START] [2021-05-27 15:20:12] Flattener#build_ancestry
[STOP] [2021-05-27 15:20:12] Flattener#build_ancestry
[INFO] [2021-05-27 15:20:12] 249 ancestry keys
[START] [2021-05-27 15:20:12] build_node_ancestors
[INFO] [2021-05-27 15:20:12] old ancestors deleted.
[STOP] [2021-05-27 15:20:12] build_node_ancestors
[START] [2021-05-27 15:20:12] Flattener#propagate_ancestor_ids
[STOP] [2021-05-27 15:20:12] Flattener#propagate_ancestor_ids
[STOP] [2021-05-27 15:20:12] Flattener#flatten
[STOP] [2021-05-27 15:20:12] rebuild_nodes
[START] [2021-05-27 15:20:12] resolve_missing_media_owners
[STOP] [2021-05-27 15:20:12] resolve_missing_media_owners
[START] [2021-05-27 15:20:12] sanitize_media_verbatims
[STOP] [2021-05-27 15:20:12] sanitize_media_verbatims
[START] [2021-05-27 15:20:12] queue_downloads
[STOP] [2021-05-27 15:20:12] queue_downloads
[START] [2021-05-27 15:20:12] parse_names
[WARN] [2021-05-27 15:20:12] I see 249 names which still need to be parsed.
[STOP] [2021-05-27 15:20:13] parse_names
[START] [2021-05-27 15:20:13] denormalize_canonical_names_to_nodes
[STOP] [2021-05-27 15:20:13] denormalize_canonical_names_to_nodes
[START] [2021-05-27 15:20:13] match_nodes
[START] [2021-05-27 15:20:13] map_all_nodes_to_pages
[STOP] [2021-05-27 15:20:25] map_all_nodes_to_pages
[INFO] [2021-05-27 15:20:25] 19 Unmatched nodes (of 249)! That's too many to output. Full list in /app/public/data/washington_bird_/unmatched_nodes.txt ; First 10: Canonical: Actitis macularia; Node#94708802; ResourceID: Actitis_macularia; Canonical: Amphispiza belli; Node#94708812; ResourceID: Amphispiza_belli; Canonical: Anas strepera; Node#94708815; ResourceID: Anas_strepera; Canonical: Carduelis pinus; Node#94708841; ResourceID: Carduelis_pinus; Canonical: Carduelis tristis; Node#94708842; ResourceID: Carduelis_tristis; Canonical: Carpodacus mexicanus; Node#94708844; ResourceID: Carpodacus_mexicanus; Canonical: Carpodacus purpureus; Node#94708845; ResourceID: Carpodacus_purpureus; Canonical: Cerorhinica; Node#94708853; ResourceID: Cerorhinica; Canonical: Cerorhinica monocerata; Node#94708854; ResourceID: Cerorhinica_monocerata; Canonical: Dendroica; Node#94708884; ResourceID: Dendroica
[START] [2021-05-27 15:20:25] update_nodes
[STOP] [2021-05-27 15:20:25] update_nodes
[STOP] [2021-05-27 15:20:25] match_nodes
[START] [2021-05-27 15:20:25] reindex_search
[STOP] [2021-05-27 15:20:25] reindex_search
[START] [2021-05-27 15:20:25] normalize_units
[STOP] [2021-05-27 15:20:25] normalize_units
[START] [2021-05-27 15:20:25] calculate_statistics
[2021-05-27 15:20:25] (NEAR) DUPLICATE TRAITS FOUND! There are only 549 (of 1429 total) unique traits.
[2021-05-27 15:20:26] (Near) duplicate trait pairs (up to 100):
[2021-05-27 15:20:26] (resource_pk: M_1000, id: 211872372), (resource_pk: M_1161, id: 211872549)
[2021-05-27 15:20:26] (resource_pk: M_1000, id: 211872372), (resource_pk: M_1195, id: 211872586)
[2021-05-27 15:20:26] (resource_pk: M_1000, id: 211872372), (resource_pk: M_1301, id: 211872703)
[2021-05-27 15:20:26] (resource_pk: M_1000, id: 211872372), (resource_pk: M_1488, id: 211872895)
[2021-05-27 15:20:26] (resource_pk: M_1000, id: 211872372), (resource_pk: M_1541, id: 211872948)
[2021-05-27 15:20:26] (resource_pk: M_1000, id: 211872372), (resource_pk: M_662, id: 211873363)
[2021-05-27 15:20:26] (resource_pk: M_1000, id: 211872372), (resource_pk: M_665, id: 211873366)
[2021-05-27 15:20:26] (resource_pk: M_1000, id: 211872372), (resource_pk: M_696, id: 211873397)
[2021-05-27 15:20:26] (resource_pk: M_1000, id: 211872372), (resource_pk: M_936, id: 211873637)
[2021-05-27 15:20:26] (resource_pk: M_1001, id: 211872373), (resource_pk: M_1115, id: 211872498)
[2021-05-27 15:20:26] (resource_pk: M_1001, id: 211872373), (resource_pk: M_1192, id: 211872583)
[2021-05-27 15:20:26] (resource_pk: M_1001, id: 211872373), (resource_pk: M_1350, id: 211872757)
[2021-05-27 15:20:26] (resource_pk: M_1001, id: 211872373), (resource_pk: M_1404, id: 211872811)
[2021-05-27 15:20:26] (resource_pk: M_1001, id: 211872373), (resource_pk: M_1496, id: 211872903)
[2021-05-27 15:20:26] (resource_pk: M_1001, id: 211872373), (resource_pk: M_641, id: 211873342)
[2021-05-27 15:20:26] (resource_pk: M_1001, id: 211872373), (resource_pk: M_744, id: 211873445)
[2021-05-27 15:20:26] (resource_pk: M_1001, id: 211872373), (resource_pk: M_773, id: 211873474)
[2021-05-27 15:20:26] (resource_pk: M_1001, id: 211872373), (resource_pk: M_960, id: 211873661)
[2021-05-27 15:20:26] (resource_pk: M_1002, id: 211872374), (resource_pk: M_1096, id: 211872477)
[2021-05-27 15:20:26] (resource_pk: M_1002, id: 211872374), (resource_pk: M_1164, id: 211872552)
[2021-05-27 15:20:26] (resource_pk: M_1002, id: 211872374), (resource_pk: M_1248, id: 211872644)
[2021-05-27 15:20:26] (resource_pk: M_1002, id: 211872374), (resource_pk: M_1357, id: 211872764)
[2021-05-27 15:20:26] (resource_pk: M_1002, id: 211872374), (resource_pk: M_1366, id: 211872773)
[2021-05-27 15:20:26] (resource_pk: M_1002, id: 211872374), (resource_pk: M_761, id: 211873462)
[2021-05-27 15:20:26] (resource_pk: M_1002, id: 211872374), (resource_pk: M_835, id: 211873536)
[2021-05-27 15:20:26] (resource_pk: M_1002, id: 211872374), (resource_pk: M_887, id: 211873588)
[2021-05-27 15:20:26] (resource_pk: M_1002, id: 211872374), (resource_pk: M_937, id: 211873638)
[2021-05-27 15:20:26] (resource_pk: M_1003, id: 211872375), (resource_pk: M_1075, id: 211872454)
[2021-05-27 15:20:26] (resource_pk: M_1003, id: 211872375), (resource_pk: M_1101, id: 211872483)
[2021-05-27 15:20:26] (resource_pk: M_1003, id: 211872375), (resource_pk: M_1335, id: 211872740)
[2021-05-27 15:20:26] (resource_pk: M_1003, id: 211872375), (resource_pk: M_1476, id: 211872883)
[2021-05-27 15:20:26] (resource_pk: M_1003, id: 211872375), (resource_pk: M_601, id: 211873302)
[2021-05-27 15:20:26] (resource_pk: M_1003, id: 211872375), (resource_pk: M_637, id: 211873338)
[2021-05-27 15:20:26] (resource_pk: M_1003, id: 211872375), (resource_pk: M_740, id: 211873441)
[2021-05-27 15:20:26] (resource_pk: M_1003, id: 211872375), (resource_pk: M_756, id: 211873457)
[2021-05-27 15:20:26] (resource_pk: M_1003, id: 211872375), (resource_pk: M_926, id: 211873627)
[2021-05-27 15:20:26] (resource_pk: M_1004, id: 211872376), (resource_pk: M_1116, id: 211872499)
[2021-05-27 15:20:26] (resource_pk: M_1004, id: 211872376), (resource_pk: M_1229, id: 211872623)
[2021-05-27 15:20:26] (resource_pk: M_1004, id: 211872376), (resource_pk: M_1313, id: 211872716)
[2021-05-27 15:20:26] (resource_pk: M_1004, id: 211872376), (resource_pk: M_1421, id: 211872828)
[2021-05-27 15:20:26] (resource_pk: M_1004, id: 211872376), (resource_pk: M_608, id: 211873309)
[2021-05-27 15:20:26] (resource_pk: M_1004, id: 211872376), (resource_pk: M_657, id: 211873358)
[2021-05-27 15:20:26] (resource_pk: M_1004, id: 211872376), (resource_pk: M_723, id: 211873424)
[2021-05-27 15:20:26] (resource_pk: M_1004, id: 211872376), (resource_pk: M_819, id: 211873520)
[2021-05-27 15:20:26] (resource_pk: M_1004, id: 211872376), (resource_pk: M_962, id: 211873663)
[2021-05-27 15:20:26] (resource_pk: M_1005, id: 211872377), (resource_pk: M_1052, id: 211872429)
[2021-05-27 15:20:26] (resource_pk: M_1005, id: 211872377), (resource_pk: M_1067, id: 211872445)
[2021-05-27 15:20:26] (resource_pk: M_1005, id: 211872377), (resource_pk: M_1104, id: 211872486)
[2021-05-27 15:20:26] (resource_pk: M_1005, id: 211872377), (resource_pk: M_1125, id: 211872509)
[2021-05-27 15:20:26] (resource_pk: M_1005, id: 211872377), (resource_pk: M_1343, id: 211872749)
[2021-05-27 15:20:26] (resource_pk: M_1005, id: 211872377), (resource_pk: M_1562, id: 211872969)
[2021-05-27 15:20:26] (resource_pk: M_1005, id: 211872377), (resource_pk: M_751, id: 211873452)
[2021-05-27 15:20:26] (resource_pk: M_1005, id: 211872377), (resource_pk: M_847, id: 211873548)
[2021-05-27 15:20:26] (resource_pk: M_1005, id: 211872377), (resource_pk: M_866, id: 211873567)
[2021-05-27 15:20:26] (resource_pk: M_1005, id: 211872377), (resource_pk: M_916, id: 211873617)
[2021-05-27 15:20:26] (resource_pk: M_1005, id: 211872377), (resource_pk: M_990, id: 211873691)
[2021-05-27 15:20:26] (resource_pk: M_1006, id: 211872378), (resource_pk: M_1053, id: 211872430)
[2021-05-27 15:20:26] (resource_pk: M_1006, id: 211872378), (resource_pk: M_1068, id: 211872446)
[2021-05-27 15:20:26] (resource_pk: M_1006, id: 211872378), (resource_pk: M_1184, id: 211872574)
[2021-05-27 15:20:26] (resource_pk: M_1006, id: 211872378), (resource_pk: M_1511, id: 211872918)
[2021-05-27 15:20:26] (resource_pk: M_1006, id: 211872378), (resource_pk: M_554, id: 211873255)
[2021-05-27 15:20:26] (resource_pk: M_1006, id: 211872378), (resource_pk: M_598, id: 211873299)
[2021-05-27 15:20:26] (resource_pk: M_1006, id: 211872378), (resource_pk: M_710, id: 211873411)
[2021-05-27 15:20:26] (resource_pk: M_1006, id: 211872378), (resource_pk: M_784, id: 211873485)
[2021-05-27 15:20:26] (resource_pk: M_1006, id: 211872378), (resource_pk: M_841, id: 211873542)
[2021-05-27 15:20:26] (resource_pk: M_1006, id: 211872378), (resource_pk: M_950, id: 211873651)
[2021-05-27 15:20:26] (resource_pk: M_1007, id: 211872379), (resource_pk: M_1107, id: 211872489)
[2021-05-27 15:20:26] (resource_pk: M_1007, id: 211872379), (resource_pk: M_1216, id: 211872609)
[2021-05-27 15:20:26] (resource_pk: M_1007, id: 211872379), (resource_pk: M_1312, id: 211872715)
[2021-05-27 15:20:26] (resource_pk: M_1007, id: 211872379), (resource_pk: M_1454, id: 211872861)
[2021-05-27 15:20:26] (resource_pk: M_1007, id: 211872379), (resource_pk: M_1533, id: 211872940)
[2021-05-27 15:20:26] (resource_pk: M_1008, id: 211872380), (resource_pk: M_1167, id: 211872555)
[2021-05-27 15:20:26] (resource_pk: M_1008, id: 211872380), (resource_pk: M_1559, id: 211872966)
[2021-05-27 15:20:26] (resource_pk: M_1009, id: 211872381), (resource_pk: M_1305, id: 211872707)
[2021-05-27 15:20:26] (resource_pk: M_1009, id: 211872381), (resource_pk: M_1485, id: 211872892)
[2021-05-27 15:20:26] (resource_pk: M_1009, id: 211872381), (resource_pk: M_1531, id: 211872938)
[2021-05-27 15:20:26] (resource_pk: M_1010, id: 211872383), (resource_pk: M_1144, id: 211872530)
[2021-05-27 15:20:26] (resource_pk: M_1010, id: 211872383), (resource_pk: M_1317, id: 211872720)
[2021-05-27 15:20:26] (resource_pk: M_1010, id: 211872383), (resource_pk: M_1367, id: 211872774)
[2021-05-27 15:20:26] (resource_pk: M_1010, id: 211872383), (resource_pk: M_1512, id: 211872919)
[2021-05-27 15:20:26] (resource_pk: M_1010, id: 211872383), (resource_pk: M_649, id: 211873350)
[2021-05-27 15:20:26] (resource_pk: M_1011, id: 211872384), (resource_pk: M_1079, id: 211872458)
[2021-05-27 15:20:26] (resource_pk: M_1011, id: 211872384), (resource_pk: M_1158, id: 211872545)
[2021-05-27 15:20:26] (resource_pk: M_1011, id: 211872384), (resource_pk: M_1287, id: 211872687)
[2021-05-27 15:20:26] (resource_pk: M_1011, id: 211872384), (resource_pk: M_1453, id: 211872860)
[2021-05-27 15:20:26] (resource_pk: M_1011, id: 211872384), (resource_pk: M_1565, id: 211872972)
[2021-05-27 15:20:26] (resource_pk: M_1011, id: 211872384), (resource_pk: M_559, id: 211873260)
[2021-05-27 15:20:26] (resource_pk: M_1011, id: 211872384), (resource_pk: M_674, id: 211873375)
[2021-05-27 15:20:26] (resource_pk: M_1011, id: 211872384), (resource_pk: M_755, id: 211873456)
[2021-05-27 15:20:26] (resource_pk: M_1011, id: 211872384), (resource_pk: M_790, id: 211873491)
[2021-05-27 15:20:26] (resource_pk: M_1011, id: 211872384), (resource_pk: M_842, id: 211873543)
[2021-05-27 15:20:26] (resource_pk: M_1011, id: 211872384), (resource_pk: M_880, id: 211873581)
[2021-05-27 15:20:26] (resource_pk: M_1011, id: 211872384), (resource_pk: M_973, id: 211873674)
[2021-05-27 15:20:26] (resource_pk: M_1011, id: 211872384), (resource_pk: M_993, id: 211873694)
[2021-05-27 15:20:26] (resource_pk: M_1012, id: 211872385), (resource_pk: M_1108, id: 211872490)
[2021-05-27 15:20:26] (resource_pk: M_1012, id: 211872385), (resource_pk: M_1360, id: 211872767)
[2021-05-27 15:20:26] (resource_pk: M_1012, id: 211872385), (resource_pk: M_1551, id: 211872958)
[2021-05-27 15:20:26] (resource_pk: M_1012, id: 211872385), (resource_pk: M_752, id: 211873453)
[2021-05-27 15:20:26] (resource_pk: M_1013, id: 211872386), (resource_pk: M_1560, id: 211872967)
[2021-05-27 15:20:26] (resource_pk: M_1013, id: 211872386), (resource_pk: M_603, id: 211873304)
[STOP] [2021-05-27 15:20:26] calculate_statistics
[START] [2021-05-27 15:20:26] complete_harvest_instance
[START] [2021-05-27 15:20:26] overall_tsv_creation
[INFO] [2021-05-27 15:20:26] Processing group of 249 in 1 batches of 10000
[INFO] [2021-05-27 15:21:17] 1429 Traits (unfiltered)...
[INFO] [2021-05-27 15:21:58] 1429 Traits (filtered)...
[INFO] [2021-05-27 15:21:58] 0 Associations (filtered)...
[INFO] [2021-05-27 15:21:58] 1429 metadata added.
[INFO] [2021-05-27 15:21:58] 0 metadata added.
[INFO] [2021-05-27 15:22:27] Average Time: 81.7
[INFO] [2021-05-27 15:22:27] Total Time: 2m2s
[STOP] [2021-05-27 15:22:27] overall_tsv_creation
[INFO] [2021-05-27 15:22:27] Done. Check your files:
[INFO] [2021-05-27 15:22:28] (249 lines) /app/public/data/washington_bird_/publish_nodes.tsv
[INFO] [2021-05-27 15:22:30] (386 lines) /app/public/data/washington_bird_/publish_node_ancestors.tsv
[INFO] [2021-05-27 15:22:31] (249 lines) /app/public/data/washington_bird_/publish_scientific_names.tsv
[INFO] [2021-05-27 15:22:32] (1430 lines) /app/public/data/washington_bird_/publish_traits.tsv
[INFO] [2021-05-27 15:22:34] (1430 lines) /app/public/data/washington_bird_/publish_metadata.tsv
[STOP] [2021-05-27 15:22:34] complete_harvest_instance
[START] [2021-05-27 15:22:34] completed
[STOP] [2021-05-27 15:22:34] completed
[STOP] [2021-05-27 15:22:34] logged process, took 178.17
Latest Process