Harvest for Freshwater and Marine Image Bank U Washington Created 28 Jan 11:22

Harvesting Log

# Logfile created on 2021-01-28 11:22:47 -0500 by logger.rb/v1.4.2
[INFO] [2021-01-28 11:22:47] ## HARVEST: type = re_download_opendata_-harvest
[INFO] [2021-01-28 11:22:48] ## remove_type: ScientificName
[INFO] [2021-01-28 11:22:48] ++ Calling delete_all on 4563 instances...
[INFO] [2021-01-28 11:22:48] [11:22:48.840] Removed 4563 Scientificnames
[INFO] [2021-01-28 11:22:48] ## remove_type: Vernacular
[INFO] [2021-01-28 11:22:48] ++ Calling delete_all on 0 instances...
[INFO] [2021-01-28 11:22:48] [11:22:48.843] Removed 0 Vernaculars
[INFO] [2021-01-28 11:22:48] ## remove_type: Article
[INFO] [2021-01-28 11:22:48] ++ Calling delete_all on 0 instances...
[INFO] [2021-01-28 11:22:48] [11:22:48.846] Removed 0 Articles
[INFO] [2021-01-28 11:22:48] ## remove_type: Medium
[INFO] [2021-01-28 11:22:48] ++ Calling delete_all on 7872 instances...
[INFO] [2021-01-28 11:22:50] [11:22:50.017] Removed 7872 Media
[INFO] [2021-01-28 11:22:50] ## remove_type: Trait
[INFO] [2021-01-28 11:22:50] ++ Calling delete_all on 0 instances...
[INFO] [2021-01-28 11:22:50] [11:22:50.020] Removed 0 Traits
[INFO] [2021-01-28 11:22:50] ## remove_type: MetaTrait
[INFO] [2021-01-28 11:22:50] ++ Calling delete_all on 0 instances...
[INFO] [2021-01-28 11:22:50] [11:22:50.023] Removed 0 Metatraits
[INFO] [2021-01-28 11:22:50] ## remove_type: OccurrenceMetadatum
[INFO] [2021-01-28 11:22:50] ++ Calling delete_all on 0 instances...
[INFO] [2021-01-28 11:22:50] [11:22:50.026] Removed 0 Occurrencemetadata
[INFO] [2021-01-28 11:22:50] ## remove_type: Assoc
[INFO] [2021-01-28 11:22:50] ++ Calling delete_all on 0 instances...
[INFO] [2021-01-28 11:22:50] [11:22:50.029] Removed 0 Assocs
[INFO] [2021-01-28 11:22:50] ## remove_type: MetaAssoc
[INFO] [2021-01-28 11:22:50] ++ Calling delete_all on 0 instances...
[INFO] [2021-01-28 11:22:50] [11:22:50.036] Removed 0 Metaassocs
[INFO] [2021-01-28 11:22:50] ## remove_type: Identifier
[INFO] [2021-01-28 11:22:50] ++ Calling delete_all on 0 instances...
[INFO] [2021-01-28 11:22:50] [11:22:50.038] Removed 0 Identifiers
[INFO] [2021-01-28 11:22:50] ## remove_type: Reference
[INFO] [2021-01-28 11:22:50] ++ Calling delete_all on 0 instances...
[INFO] [2021-01-28 11:22:50] [11:22:50.041] Removed 0 References
[INFO] [2021-01-28 11:22:50] Starting batch with ID 25434164...
[INFO] [2021-01-28 11:22:51] Starting batch with ID 25434164...
[INFO] [2021-01-28 11:22:52] ## remove_type: Node
[INFO] [2021-01-28 11:22:52] ++ Calling delete_all on 4563 instances...
[INFO] [2021-01-28 11:22:52] [11:22:52.549] Removed 4563 Nodes
[START] [2021-01-28 11:22:54] logged process: e38687fde360d9ce2f48dd55c3bf56ebb9d8efa6

[START] [2021-01-28 11:22:54] Creating resource from OpenData
[START] [2021-01-28 11:22:54] logged process: e38687fde360d9ce2f48dd55c3bf56ebb9d8efa6

[START] [2021-01-28 11:22:54] Parse meta.xml file and create formats with fields
[WARN] [2021-01-28 11:22:54] (common) IGNORED  (media) field header: Rating term: http://ns.adobe.com/xap/1.0/Rating
[WARN] [2021-01-28 11:22:54] (common) IGNORED  (media) field header: rights term: http://purl.org/dc/terms/rights
[STOP] [2021-01-28 11:22:54] Parse meta.xml file and create formats with fields
[STOP] [2021-01-28 11:22:54] Creating resource from OpenData
[START] [2021-01-28 11:22:54] logged process: e38687fde360d9ce2f48dd55c3bf56ebb9d8efa6

[START] [2021-01-28 11:22:54] create_harvest_instance
[STOP] [2021-01-28 11:22:56] create_harvest_instance
[START] [2021-01-28 11:22:56] fetch_files
[STOP] [2021-01-28 11:22:56] fetch_files
[START] [2021-01-28 11:22:56] validate_each_file
[STOP] [2021-01-28 11:22:57] validate_each_file
[START] [2021-01-28 11:22:57] convert_to_csv
[CMD] [2021-01-28 11:22:57] /usr/bin/sort /app/public/converted_csv/fmibfw_agents_26275.csv > /app/public/converted_csv/fmibfw_agents_26275.csv_sorted
[CMD] [2021-01-28 11:22:57] /usr/bin/sort /app/public/converted_csv/fmibfw_nodes_26276.csv > /app/public/converted_csv/fmibfw_nodes_26276.csv_sorted
[CMD] [2021-01-28 11:22:57] /usr/bin/sort /app/public/converted_csv/fmibfw_media_26277.csv > /app/public/converted_csv/fmibfw_media_26277.csv_sorted
[STOP] [2021-01-28 11:22:57] convert_to_csv
[START] [2021-01-28 11:22:57] calculate_delta
[CMD] [2021-01-28 11:22:57] echo "0a" > /app/public/diff/fmibfw_agents_26275.diff
[CMD] [2021-01-28 11:22:57] tail -n +1 /app/public/converted_csv/fmibfw_agents_26275.csv >> /app/public/diff/fmibfw_agents_26275.diff
[CMD] [2021-01-28 11:22:57] echo "." >> /app/public/diff/fmibfw_agents_26275.diff
[CMD] [2021-01-28 11:22:57] echo "0a" > /app/public/diff/fmibfw_nodes_26276.diff
[CMD] [2021-01-28 11:22:57] tail -n +1 /app/public/converted_csv/fmibfw_nodes_26276.csv >> /app/public/diff/fmibfw_nodes_26276.diff
[CMD] [2021-01-28 11:22:57] echo "." >> /app/public/diff/fmibfw_nodes_26276.diff
[CMD] [2021-01-28 11:22:57] echo "0a" > /app/public/diff/fmibfw_media_26277.diff
[CMD] [2021-01-28 11:22:57] tail -n +1 /app/public/converted_csv/fmibfw_media_26277.csv >> /app/public/diff/fmibfw_media_26277.diff
[CMD] [2021-01-28 11:22:57] echo "." >> /app/public/diff/fmibfw_media_26277.diff
[STOP] [2021-01-28 11:22:57] calculate_delta
[START] [2021-01-28 11:22:57] parse_diff_and_store
[INFO] [2021-01-28 11:22:57] Loading agents diff file into memory (true lines)...
[INFO] [2021-01-28 11:22:57] Loading nodes diff file into memory (true lines)...
[INFO] [2021-01-28 11:22:58] Loading media diff file into memory (true lines)...
[WARN] [2021-01-28 11:23:06] title is too long for medium 20624545; truncating to 254 chars: Dictyota: Thalle encroute le plus souvent par le calcaire, qui lui donne une couleur gres vert, rampant ou dresse, foliace ou lineaire, dichotome ou dechire irregulierement, touffes de poils repandus a la surface du thalle, contenant les spores st dispose...
[WARN] [2021-01-28 11:23:06] title is too long for medium 20624546; truncating to 254 chars: Sperm Whale (Physeter macrocephalus); California Gray Whale (Rhachianectes glaucus); Pacific Humpback Whale (Megaptera versabilis); Sulphur-Bottom Whale (Sibbaldius sulfureus); Pacific Right Whale (Balaenia japonica). 1888/1889. Whales; Sperm whale; Calif...
[WARN] [2021-01-28 11:23:06] title is too long for medium 20624547; truncating to 254 chars: Sample of concrete pile-jacket containing four borers (Pholadidea penita) in a space of 3 inches square. Two of the borers are visible, presence of the others being indicated by openings at lower left. 1923. Marine borers; Piling (Civil engineering); Weat...
[WARN] [2021-01-28 11:23:06] title is too long for medium 20624548; truncating to 254 chars: Coelophrys micropus. From station 5115. Dorsal view (1); Coelophrys brevipes. From the type. Dorsal view (2); Coelophrys oblonga. From the type. Dorsal view (3); Coelophrys arca. From the type. Dorsal view <4); Coelophrys mollis. From the type. Dorsal vie...
[WARN] [2021-01-28 11:23:06] title is too long for medium 20624549; truncating to 254 chars: Coelophrys micropus. From station 5115. Ventral view (1); Coelophrys brevipes. From the type. Ventral view (2); Coelophrys oblonga. From the type. Ventral view (3); Coelophrys arca. From the type. Ventral view <4); Coelophrys mollis. From the type. Ventra...
[WARN] [2021-01-28 11:23:06] title is too long for medium 20624550; truncating to 254 chars: Conger Eel : Embryo Freed from its membrane, showing continued constriction of anterior end of yolk and general diminuition of the enlarged anterior portion of yolk with the corresponding increase of caudal portion of yolk. August 2, 7:30 a.m. 1902. Eels-...
[WARN] [2021-01-28 11:23:06] title is too long for medium 20624551; truncating to 254 chars: Cyprinodon variegatus : Egg with blastoderm showing germ ring, GR, fully differentiated and an early stage in differentiation of embryonic shield, ES; PP, posterior pole of blastoderm. 1916. Sheepshead minnow--Embryology; Cyprinodon variegatus--Embryology...
[WARN] [2021-01-28 11:23:06] title is too long for medium 20624552; truncating to 254 chars: Black Rock Cod (Epinephelus damelli). Almost black, with creamy spots, this fish relies upon its colouration to camouflage it when beneath the shelter of a boulder on the reef, but is obtrusively conspicuous when the shelter is removed. 1924. Groupers; Ep...
[WARN] [2021-01-28 11:23:06] title is too long for medium 20624553; truncating to 254 chars: Etheostoma rex, Jordan & Evermann (fig.9); Etheostoma roanoka, Jordan & Jenkins (Fig.10); Etheostoma pudostemone, Jordan & Jenkins (Fig.11); Etheostoma Vercundum, Jordan & Evermann (Fig.12); Teheostoma swannanoa, Jordan & Evermann (Fig.13). 1888. Etheosto...
[WARN] [2021-01-28 11:23:06] title is too long for medium 20624554; truncating to 254 chars: Helicocranchia sp., ventral view of specimen from the vicinity of Kauai, partially restored. In this figure the mantle is scarcely represented as sufficiently elongate and the arms are probably shown as much too short and stocky. 1914. Cephalopoda; Helico...
[WARN] [2021-01-28 11:23:06] title is too long for medium 20624555; truncating to 254 chars: When rolled over or otherwise disturbed, the Cotton-fish, or Beche de Mer (Holothurea fusco-cinerea) ejects sticky white threats, which apparently serve as anchor lines, and enable it to recover its position. 1924. Photography of fishes; Trepang; Holothur...
[WARN] [2021-01-28 11:23:06] title is too long for medium 20624556; truncating to 254 chars: Moxostoma rupiscartes, Jordan & Jenkins (Fig.3): Notropis macdonaldi, Jordan & Jenkins (Fig.4): Notropis kanawha, Jordan & Jenkins (Fig.5); Hybopsis vatauga, Jordan & Evermann (Fig.6); Fundulus rathbuni, Jordan & Meek (Fig.7); Chologaster avitus, Jordan &...
[WARN] [2021-01-28 11:23:06] title is too long for medium 20624557; truncating to 254 chars: King Salmon: Variotions in the form of the myomeres are shown in this figure of the left side on Oncorhynchus tschawytscha. The superficial markings of the myomeres and of the myocommata are indicated. There is some little variation, but of no great signi...
[WARN] [2021-01-28 11:23:06] title is too long for medium 20624558; truncating to 254 chars: Paralichthys. Group of Paralichthys on a white background containing considerable debris scattered over it. All of the specimens are albiguttus except the large one above and to the left, which is dentalus. Note that this specimen has five dark areas, two...
[WARN] [2021-01-28 11:23:06] title is too long for medium 20624559; truncating to 254 chars: Paralichthys. Group of Paralichthys on a white background containing considerable debris scattered over it. All of the specimens are albiguttus except the large one above and to the left, which is dentalus. Note that this specimen has five dark areas, two...
[WARN] [2021-01-28 11:23:06] title is too long for medium 20624560; truncating to 254 chars: 44-Paralichthys abliguttus, (G), 22 cm long, head continuously on white and tail on back. This specimen was taken from a black aquarium and was fully adapted to black in the beginning of the experiment. 45- Individual (G), one eye on white the other on bl...
[WARN] [2021-01-28 11:23:06] title is too long for medium 20624561; truncating to 254 chars: 21- Paralichthys albiguttus, 16 cm long, in shallow bluish-gray mottled granite pan. Excellend simulation of the background on the entire surface except the three ocelli, which are nearly black. 22- Same specimen photographed in the granite pan.very short...
[WARN] [2021-01-28 11:23:06] title is too long for medium 20624562; truncating to 254 chars: 48- Paralichthys albiguttus, 12 cm long, fully adapted to a very light gray background. This specimen continuously appeared somewhat darker than the background. Note that the three ocelli have almost entirely disappeared. 49- Individual (B)., on black and...
[WARN] [2021-01-28 11:23:06] title is too long for medium 20624563; truncating to 254 chars: 5-Paralichthys albiguttus, on very fine gray sand, almost entirely covered with sand, from August 19 to 21. Note the two small depressions in the sand at the base of the caudal fin. The lower one is much more prominent than the other. This individual brea...
[WARN] [2021-01-28 11:23:06] title is too long for medium 20624564; truncating to 254 chars: 13-Paralichthys albiguttus, Individual (B) on a smooth white background continuously from July 23, 2 p.m., to July 25, 10 a.m. It was alternately on white and on black about equal time during the preceding seven days. The skin actually appeared much white...
[WARN] [2021-01-28 11:23:06] title is too long for medium 20624565; truncating to 254 chars: 1-Paralichthys albiguttus, 20 com. long, on fine variegated shells, yellow predominating partly buried as usually found in nature. 2-Paralichthys albiguttus, same individual two minutes later with the shells removed. 3- Paralichthys albiguttus, w1 cm long...
[WARN] [2021-01-28 11:23:06] title is too long for medium 20624566; truncating to 254 chars: 9- Paralichthys albiguttus, 14 cm. long, individual (B), on black and white background (2 mm. squares) from July 29, 11 a.m. to July 30, 3 p.m., after having been adapted to the background shown in figure 10. This indiviidual was extensively used in the s...
[WARN] [2021-01-28 11:23:06] title is too long for medium 20624567; truncating to 254 chars: 23- Paralichthys albiguttus, Individual (B) on black and white background (5 by 10 mm. rectangular), long axis of the fish parallel with short axis of rectangles. 24- Individual (B) on same background, long axis of fish continuously parallel with long axi...
[WARN] [2021-01-28 11:23:06] title is too long for medium 20624568; truncating to 254 chars: 17- Paralichthys albiguttus, Individual (B) on black background (1 sq. cm. circles) from August 1, 4:30 p.m. to August 2, 11 a.m. Probably not fully adapted; 18- P. albiguttus (E) 10 cm long, on black and white background (1 sq. cm. circles. On this backg...
[WARN] [2021-01-28 11:23:06] title is too long for medium 20624569; truncating to 254 chars: 27- Paralichthys albiguttus, individual (B) on black and white background (1 sq. cm. circles, area of black equal to that of white). 28- Individual (B) on black and white background (stripes 1 cm. wide). 29- Individual (B) on black and white background (s...
[WARN] [2021-01-28 11:23:06] title is too long for medium 20624570; truncating to 254 chars: Paralichthys albiguttus, 19 cm. long., on dark blue. This specimen became bluish exceptionally rapidly. It remained on dark blue four days longer and became but little more blue than it was when autochromed. 1916. Gulf flounder--Adaptation; Gulf flounder-...
[WARN] [2021-01-28 11:23:06] title is too long for medium 20624571; truncating to 254 chars: 41- Paralichthys albiguttus, Individual (B).on black and white background (2 mm. squares). 42- Individual (B) on black and white background (circles 1 sq. cm.) .43- Individual (B), one eye continuously on a coarse and the other on a fine-grained backgroun...
[WARN] [2021-01-28 11:23:06] title is too long for medium 20624572; truncating to 254 chars: Paralichthys albiguttus; Photographs taken with orthomon plates of specimens adapted to colored backgrounds. 68-Brown; 69-Dark blue; 70-Maroon; 71-Green; 72-Vermilion; 73-Light blue; 74-Dark blue; 75-Green; 76-Chrome yellow. Note the remarkable simulation...
[WARN] [2021-01-28 11:23:06] title is too long for medium 20624573; truncating to 254 chars: 31- Paralichthys albiguttus (F), 14 cm long, in large, shallow granite pan (variegated, dark blue and white). Note the small white spots shown in irregular rows across the fish. 32- Individual (F) on black and white background (dots 2 mm. in diameter). Th...
[WARN] [2021-01-28 11:23:06] title is too long for medium 20624574; truncating to 254 chars: Paralichthys albiguttus; Photographs taken with orthomon plates of specimens adapted to colored backgrounds. 68-Brown; 69-Dark blue; 70-Maroon; 71-Green; 72-Vermilion; 73-Light blue; 74-Dark blue; 75-Green; 76-Chrome yellow. Note the remarkable simulation...
[WARN] [2021-01-28 11:23:06] title is too long for medium 20624575; truncating to 254 chars: Paralichthys albiguttus, individual (B) on black and white background (dots 3 mm. in diameter). 53- Individual (B), on black and white background (dots 3 mm. in diameter).  -54 Individual (B), on black and white background (dots 2 mm. in diameter).after h...
[WARN] [2021-01-28 11:23:06] title is too long for medium 20624576; truncating to 254 chars: Pleuronectes flesus, Young Flounder taken in Mevagissey Harbour, Aporil 2, 1889. pw, pelvid fin (1); Pleuronectes limanda, Larva of dab.new hatc hed, from artificially fertilised egg, March 11, 1889. pt, pectoral fin; yk, yolk (2); Pleuronectes microc. 18...
[WARN] [2021-01-28 11:23:06] title is too long for medium 20624577; truncating to 254 chars: Pleuronectes flesus, Young Flounder taken in Mevagissey Harbour, Aporil 2, 1889. pw, pelvid fin (1); Pleuronectes limanda, Larva of dab.new hatc hed, from artificially fertilised egg, March 11, 1889. pt, pectoral fin; yk, yolk (2); Pleuronectes microcepha...
[WARN] [2021-01-28 11:23:06] title is too long for medium 20624578; truncating to 254 chars: Butterfly Cod (Pterols volitans). A fish of evil reputation but extraordinary beauty. Having numerous sp8ines endowed tih venom-glands, it is accorded proper respect by its neighbours, before whom it flaunts its greatly enlarged and gorgeously coloured fi...
[WARN] [2021-01-28 11:23:06] title is too long for medium 20624580; truncating to 254 chars: Photographed upon bleached corals, this Red Rock Cod (Scorpaena cooki) is unable to conceal itself, but when lying quiescent among weed-covered stones, its variegated colours render it almost invisible. 1924. Scorpionfishes; Scorpaena cooki; Photography o...
[WARN] [2021-01-28 11:23:06] title is too long for medium 20624581; truncating to 254 chars: Photograph of the nest of a horned dace (Semotilus atromaculatus), taken with a reflecting camera and by the aid of a cloth screen. The reflected image of part of the screen is seen over the right and left parts of the nest. In the upper part of the pi. 1...
[WARN] [2021-01-28 11:23:06] title is too long for medium 20624582; truncating to 254 chars: Male and two females of the horned dace (Semotilus atromaculatus). ONe female is above at the left, the other behind the male. The head of the male bears four organs. Photographed with a reflecting camera, the fish in an aquarium out of doors. 1910. Semot...
[WARN] [2021-01-28 11:23:06] title is too long for medium 20624583; truncating to 254 chars: Solea vulgaris : Body cavity of the female Common Sole after all the viscera have been removed except the ovary and kidneys, which are lift in situ. The wooden rod passes through the anus, the blue probe pass through the external aperture of the common ov...
[WARN] [2021-01-28 11:23:06] title is too long for medium 20624584; truncating to 254 chars: Solea vulgaris : Body cavity of the male Common Sole after all the viscera have been removed except the testes and kidneys, which are left in situ. The wooden rod passes through the anus, the black bristle passes into the urinary bladder, which lies benea...
[WARN] [2021-01-28 11:23:06] title is too long for medium 20624585; truncating to 254 chars: Solea vulgaris : Skeleton of the Common Sole; the branchial arches, jaws, and bones of the paired fins have been removed, all the other bones are in their natural position in relation to one another (1); One of the dorsal fin-rays; a, from the side; b, fr...
[WARN] [2021-01-28 11:23:06] title is too long for medium 20624586; truncating to 254 chars: Solea vulgaris : General view of the musculature of the common sole seen from the right side, after removal of the skin. The superficial abductors of the ventral fin have been removed, to expose the elevators and depressors of the ventral fin-rays which l...
[WARN] [2021-01-28 11:23:06] title is too long for medium 20624587; truncating to 254 chars: Elm Borers and Elm Bark Louse : Elm Borer (Sapreda tridentata Oliv.). 1. Larva or grub within its burrow just under the bark; 1a, Larva or grum extended; 2. Pupa within its cell just under the bark; 3. Burrows of the grub as exposed after removal of the b...
[WARN] [2021-01-28 11:23:06] title is too long for medium 20624588; truncating to 254 chars: Sepedon and Tetaoncera : Sepedon fuscipennis Loew.: 1. Larva, dorsal view; 2. Larva, lateral view; 3. Puparium, dorsal view; 4. Puparium, lateral view; 5. Open puparium; 6. Seed floating which the puparium simulates; 7. Imago, dorsal view; 8. Imago, later...
[WARN] [2021-01-28 11:23:06] title is too long for medium 20624589; truncating to 254 chars: Sepedon and Tetaoncera : Sepedon fuscipennis Loew.: 1. Larva, dorsal view; 2. Larva, lateral view; 3. Puparium, dorsal view; 4. Puparium, lateral view; 5. Open puparium; 6. Seed floating which the puparium simulates; 7. Imago, dorsal view; 8. Imago, later...
[WARN] [2021-01-28 11:23:06] title is too long for medium 20624592; truncating to 254 chars: Cucumaria frondosa side view (65), dorsal view (66); Thyone briareus dorsal view (67); Thyone unisemita side view (68), ventral view (69); Cucumaria pulcherrima side view (70); thyone scabra side view of a young specimen (71); trochostoma ovliticum side v...
[WARN] [2021-01-28 11:23:06] title is too long for medium 20624594; truncating to 254 chars: 1. Lophelia Prolifera, 2. Peachia Triphylla, 3. Sphenditrochus Wrightii, 4. 5. S. Mac Andrewanus, 5. Zoanthus Couchii, 6. Paracyathus Taxilianus, 7. P. Pteropus, 8. P. Thulensis, 9. Phyllangia Americana, 10. 11. Balanophyllia Regia, 12. 13. Cyathina Smith...
[WARN] [2021-01-28 11:23:06] title is too long for medium 20624595; truncating to 254 chars: Mulinia lateralis, gray (1); Star-fish about 2 days old, much enlarged, devouring a clam. Outlines of stomach of star-fish can be seen through transparent shell of clam (2): Larva of star-fish, nearly ready to set, in side view; dark bands show position o...
[WARN] [2021-01-28 11:23:06] title is too long for medium 20624596; truncating to 254 chars: Ophioglypha robusta. Broken young one from crab ledge, aboral view (31), oral view (32); Amphipholis squamata (adult), aboral view (33), oral view (34); Gorgonocephalus agassizii, aboral view (35), oral view (36). 1904. Ophiuroidea; Ophioglypha; Amphiphol...
[WARN] [2021-01-28 11:23:06] title is too long for medium 20624597; truncating to 254 chars: Stronglyocentrotus drobachiensis, arboral view of test with spines (53); oral view of test with spines (54); side view of test without spines (55); aboral view of test without spines (56); oral view of test without spines (57). 1904. Green sea urchin; Str...
[WARN] [2021-01-28 11:23:06] title is too long for medium 20624598; truncating to 254 chars: Dentalium, as seen in longitudinal section (except the foot): S, shell, Mt, mantle; Sa, shell muscle; Mh, mantle-cavity; F, foot, Mk, cephalic prominence or oral cone; T, capfacula; R, radula; D, intestine; l, liver, Af, anus; G, cerebral ganglion; N, kid...
[WARN] [2021-01-28 11:23:06] title is too long for medium 20624599; truncating to 254 chars: Helicina brenchleyi Baird (1,2); Helicina fulgurata Baird (3,4); Helicina multifasciata Baird (5,6); Helicina julii Baird (7,8); Helicina strigata Baird (9,10); Tellina novae caledoniae Baird (11,12); Tellina bifaria Baird (13). 1873. Shells; Helicinidae;...
[WARN] [2021-01-28 11:23:06] title is too long for medium 20624600; truncating to 254 chars: Figures illustrating the tubes in which Lingula anatifera lives. The upper figure is a view of the trilobed opening of the tube. The lower figure shows the tube in the sand laid open and the animal exposed. The dotted line indicates the position of the bo...
[WARN] [2021-01-28 11:23:06] title is too long for medium 20624602; truncating to 254 chars: Male of Ocythoe tuberculata Raf. (=Philonexis catenulatus, Fer.), Mediterranean, showing three stages, A, B, and C., in the development of the hectocotylus arm; h.cy, hectocotylus still in the cyst; c'y', spoon-shaped cyst at the end of the arm when freed...
[WARN] [2021-01-28 11:23:06] title is too long for medium 20624603; truncating to 254 chars: Oliva textilina showing how the front part of the food (f) is developed into a sort of fender, the propordium (pr); e, e, eyes un.ap, front appendage of mantle; m, ap, hinder appendage of mantle folded into the suture when the animal is at rest; si, sipho...
[WARN] [2021-01-28 11:23:06] title is too long for medium 20624604; truncating to 254 chars: Diagram of the sutures of Ammonites: A, an elaborate suture (Phylloceras); B, a simple suture (Ceralites); s,s, siphonal; s,v., ventral; s.l., first lateral; s,l', second lateral saddles; t.v. ventral; l, first lateral; l', second lateral loce; La,la, aux...
[WARN] [2021-01-28 11:23:06] title is too long for medium 20624605; truncating to 254 chars: Sigarelus bevigatus, showing extensive development of the propodium (pr.) and metapodium (met.) in a mollusk living in sand (the shell, which covers only the liver and adjacent parts, has been removed): l, liver; s. ap., aperture of brotoscis, here deflec...
[WARN] [2021-01-28 11:23:06] title is too long for medium 20624606; truncating to 254 chars: Local distribution of the gastropod mollusk Tritia trivittata. This species was recorded from 353 stations out of the total of 417 comprised within the limits of the map. It has thus the most general distribution of any species of animal dredged within th...
[WARN] [2021-01-28 11:23:06] title is too long for medium 20624607; truncating to 254 chars: Local distribution of the bivalve mollusk Venericardia borealis. Here it is almost wholly restricted to the colder waters at the outer ends of Vineyard Sound and Buzzards Bay. Its range along our coast extends from the Arctic Ocean to off Cape Hatteras. 1...
[WARN] [2021-01-28 11:23:06] title is too long for medium 20624608; truncating to 254 chars: Copulatory organs of male crab. Black paper has been placed behind the ducts leading from the reproductive organs. A, vas-deferens duct leading from the testis out through the inner joint (coxopodite) of the leg to the intromittent organs; B, intromittent...
[WARN] [2021-01-28 11:23:06] title is too long for medium 20624609; truncating to 254 chars: Shrimps and Prawns: Above on Right (Crangon vulgaris); Above on Left (Crangon horcas); In the Center (Pandalus annulicosnis); To the right and middle below (Hippolyte sp); To the left below (Hippolyte pusiola); to the left of center (Mysis stenolepis). 19...
[WARN] [2021-01-28 11:23:06] title is too long for medium 20624610; truncating to 254 chars: Cymopolia dentata, after A. Milne Edwards and Bouvier. a, Dorsal view of female hologype; b, Frontal border of the same; c, Carapace of a male Dorsal view; d, Right outer maxilliped; e, Abdomen of male; f, Left oculo-antennal region of same male; g, Merus...
[WARN] [2021-01-28 11:23:06] title is too long for medium 20624611; truncating to 254 chars: Cymopolia gracilipes, after A. Milne Edwards and Bouvier. a, Dorsal view of female holotype; b, Endognath of the right outer maxilliped; c, Merus and carpus of second left leg, upper side; d, Left oculo-antennal region, lower view; e, Abdomen of male. 191...
[WARN] [2021-01-28 11:23:06] title is too long for medium 20624612; truncating to 254 chars: Cymopolia obesa, Immature female holotype, after A. Milne Edwards and Bouvier. a, Dorsal view; b, Endognath of right outer maxilliped; c, First left leg upper side; d, last left leg; e, left frontal and orbital border, from above; f, Left oculo-antennal r...
[WARN] [2021-01-28 11:23:06] title is too long for medium 20624613; truncating to 254 chars: Cymopolia sica, after A. Milne Edwards and Bouvier. a, Male, dorsal view; b, Carapace of same, dorsal view; c, Right oculo-antennal region of same, lower view; d, Merus and carpus of first right leg of same, upper side; e, left outer maxilliped; f, Sternu...
[WARN] [2021-01-28 11:23:06] title is too long for medium 20624614; truncating to 254 chars: Encephaloides armstrongi, Armstrong's Spider-crab, showing the swollen cavernous gill-chambers. The four pairs of crawling legs are too long to be shown. This crab is one of the characteristic inhabitants of the 100-fathom line in Indian Seas. 1902. Crabs...
[WARN] [2021-01-28 11:23:06] title is too long for medium 20624615; truncating to 254 chars: Transverse section of body of female lobster in plane of gastric mill. ad. m. abductor mandibuli muscle; art, branchio-cardiac vessel; arth. br., arthrobranch; br. cav., branchal cavity; brs, branchiostegite; d. g. g. duct of gastric gland; fl. g. ch. bas...
[WARN] [2021-01-28 11:23:06] title is too long for medium 20624616; truncating to 254 chars: Lape Pepin mucket, Lampsilis luteola (Lamarck), male, upper left; Lake Pepin mucket, Lampsilis luteola (Lamarck), female, upper right; Butterfly, Plagiola securis (Lea), lower left); Pocketbook, Lampsilis ventricosa (Barnes), lower right. 1921. Lampsilis;...
[WARN] [2021-01-28 11:23:06] title is too long for medium 20624617; truncating to 254 chars: Mya arenaria. Ten camera outlines of shells varying in length from 0.4 mm to 7.5 mm. They are intended to illustrate the change from a rounded outline in smaller individuals to the elongated condition of older forms. There is at first a more rapid posteri...
[WARN] [2021-01-28 11:23:06] title is too long for medium 20624618; truncating to 254 chars: Nassa obsoleta (the little black winkle of the tide flats) devouring a scallop. These little scavengers swarm over the scallop. Occasionally one is active enough to get between the valves, forming a wedge which permits the entrance of others, which quickl...
[WARN] [2021-01-28 11:23:06] title is too long for medium 20624619; truncating to 254 chars: Pecten caurinus Gould, exterior of right valve, a little less than half natural size #1; Pecten hindsii navarchus Dall, exterior of right and left valves, respectively #2/3; Axinopsis sericatus Carpenter, Typical Specimen #4. 1924. Mollusks--Washington (S...
[WARN] [2021-01-28 11:23:06] title is too long for medium 20624620; truncating to 254 chars: Bullhead, Pleurobema aesopus (Green) from Wabash River, top; Dromedary mussel, Dromus dromas (Lea), from Cumberland River, middle pair; Fan-shell, Cyprogenia irrorala (Lea), from Cumberland River, lower pair. 1921. Pleurobema; Dromus; Cyprogenia; Freshwat...
[WARN] [2021-01-28 11:23:06] title is too long for medium 20624621; truncating to 254 chars: Pimple-back, Quadrula pustulata (Lea) a; Purple pimple-back, Quadrula granifera (Lea), from Mississippi River, b & c; Three-horned warty-back, Obliquaria reflexa (Rafinesque), d; pimple-back, Quadrula cooperiana (Lea) from Cumberland River, e; Purple pimp...
[WARN] [2021-01-28 11:23:06] title is too long for medium 20624622; truncating to 254 chars: Seed scallops, with a small amount of white worm tube (Serpula) attached to the shell. These scallkops have not yet spawned, and, for the future welfare of the scallop fishery, should be protected until they have passed the spawning period, which occurs w...
[WARN] [2021-01-28 11:23:06] title is too long for medium 20624623; truncating to 254 chars: Oyster drill (Urosalpinx cinerea) boring the shell of a scallop. Five drills were found on the specimen, but one rolled off when the photograph was taken. The drill bores a fine hole through the shell by means of a ribbon-like tongue lined with saw-like t...
[WARN] [2021-01-28 11:23:06] title is too long for medium 20624624; truncating to 254 chars: Oyster drill (Urosalpinx cinerea) boring the shell of a scallop. Five drills were found on the specimen, but one rolled off when the photograph was taken. The drill bores a fine hole through the shell by means of a ribbon-like tongue lined with saw-like t...
[WARN] [2021-01-28 11:23:06] title is too long for medium 20624625; truncating to 254 chars: Spectacled Eider, male Arctonetta fischeri; Pacific Eider, male Somateria y-negra; Willow Ptarmigan, male in summer Lagopus lagopus; American Scoter, male Oidemia americana; Surf Scoter, male. 1887. Eider; Ptarmigans; Willow ptarmigan; American scoter; Su...
[WARN] [2021-01-28 11:23:06] title is too long for medium 20624626; truncating to 254 chars: Adult worm (Polydora) (1) ; Great hooks of the fifth segment of the bosy (2) ; Spear-tipped bristles accompanying the former (3); Hooks of the posterior region of the body (4); Front and side view of the of the bristles of the same species (5) ; Caudal se...
[INFO] [2021-01-28 11:23:06] Storing 91 Attributions
[INFO] [2021-01-28 11:23:06] Processing group of 91 in 1 groups of 1000
[INFO] [2021-01-28 11:23:06] Average Time: 0.02
[INFO] [2021-01-28 11:23:06] Total Time: 1s
[INFO] [2021-01-28 11:23:06] Storing 4563 ScientificNames
[INFO] [2021-01-28 11:23:06] Processing group of 4563 in 5 groups of 1000
[INFO] [2021-01-28 11:23:08] Average Time: 0.36
[INFO] [2021-01-28 11:23:08] Total Time: 2s
[INFO] [2021-01-28 11:23:08] Storing 4563 Nodes
[INFO] [2021-01-28 11:23:08] Processing group of 4563 in 5 groups of 1000
[INFO] [2021-01-28 11:23:09] Average Time: 0.234
[INFO] [2021-01-28 11:23:09] Total Time: 2s
[INFO] [2021-01-28 11:23:09] Storing 16528 ContentAttributions
[INFO] [2021-01-28 11:23:09] Processing group of 16528 in 17 groups of 1000
[INFO] [2021-01-28 11:23:10] Average Time: 0.078
[INFO] [2021-01-28 11:23:10] Total Time: 2s
[INFO] [2021-01-28 11:23:10] last 3 / first 3: 0.83
[INFO] [2021-01-28 11:23:10] Std.Dev: 0.0; Max: 0.09
[INFO] [2021-01-28 11:23:10] Storing 7872 Media
[INFO] [2021-01-28 11:23:10] Processing group of 7872 in 8 groups of 1000
[INFO] [2021-01-28 11:23:14] Average Time: 0.478
[INFO] [2021-01-28 11:23:14] Total Time: 5s
[INFO] [2021-01-28 11:23:14] last 3 / first 3: 0.84
[INFO] [2021-01-28 11:23:14] Std.Dev: 0.21908902300206645; Max: 0.99
[STOP] [2021-01-28 11:23:14] parse_diff_and_store
[START] [2021-01-28 11:23:14] resolve_keys
[INFO] [2021-01-28 11:23:22] Occurrences to nodes (through scientific_names)...
[INFO] [2021-01-28 11:23:22] traits to occurrences...
[INFO] [2021-01-28 11:23:22] traits to nodes (through occurrences)...
[INFO] [2021-01-28 11:23:22] Traits to sex term...
[INFO] [2021-01-28 11:23:22] Traits to lifestage term...
[INFO] [2021-01-28 11:23:22] MetaTraits to traits...
[INFO] [2021-01-28 11:23:22] MetaTraits (simple, measurement row refers to parent) to traits...
[INFO] [2021-01-28 11:23:22] Assocs to occurrences...
[INFO] [2021-01-28 11:23:22] Assocs to nodes...
[INFO] [2021-01-28 11:23:22] Assoc to sex term...
[INFO] [2021-01-28 11:23:22] Assoc to lifestage term...
[INFO] [2021-01-28 11:23:22] MetaAssoc to assocs...
[STOP] [2021-01-28 11:23:22] resolve_keys
[START] [2021-01-28 11:23:22] hold_for_later_1
[STOP] [2021-01-28 11:23:22] hold_for_later_1
[START] [2021-01-28 11:23:22] hold_for_later_2
[STOP] [2021-01-28 11:23:22] hold_for_later_2
[START] [2021-01-28 11:23:22] resolve_missing_parents
[STOP] [2021-01-28 11:23:22] resolve_missing_parents
[START] [2021-01-28 11:23:22] rebuild_nodes
[START] [2021-01-28 11:23:22] Flattener#flatten
[START] [2021-01-28 11:23:22] Flattener#study_resource
[START] [2021-01-28 11:23:22] Flattener#build_ancestry
[STOP] [2021-01-28 11:23:23] Flattener#build_ancestry
[INFO] [2021-01-28 11:23:23] 4563 ancestry keys
[START] [2021-01-28 11:23:23] build_node_ancestors
[INFO] [2021-01-28 11:23:23] old ancestors deleted.
[STOP] [2021-01-28 11:23:23] build_node_ancestors
[WARN] [2021-01-28 11:23:23] Flattener: nothing to flatten! (Completely flat resource?)
[STOP] [2021-01-28 11:23:23] Flattener#flatten
[STOP] [2021-01-28 11:23:23] rebuild_nodes
[START] [2021-01-28 11:23:23] resolve_missing_media_owners
[STOP] [2021-01-28 11:23:23] resolve_missing_media_owners
[START] [2021-01-28 11:23:23] sanitize_media_verbatims
[STOP] [2021-01-28 11:23:23] sanitize_media_verbatims
[START] [2021-01-28 11:23:23] queue_downloads
[STOP] [2021-01-28 11:23:23] queue_downloads
[START] [2021-01-28 11:23:23] parse_names
[WARN] [2021-01-28 11:23:23] I see 4563 names which still need to be parsed.
[STOP] [2021-01-28 11:23:28] parse_names
[START] [2021-01-28 11:23:28] denormalize_canonical_names_to_nodes
[STOP] [2021-01-28 11:23:28] denormalize_canonical_names_to_nodes
[START] [2021-01-28 11:23:28] match_nodes
[START] [2021-01-28 11:23:28] map_all_nodes_to_pages
[STOP] [2021-01-28 11:32:17] map_all_nodes_to_pages
[INFO] [2021-01-28 11:32:17] 941 Unmatched nodes (of 4563)! That's too many to output. Full list in /app/public/data/fmibfw/unmatched_nodes.txt ; First 10: Ascoidia (#87652078); Scalpellum perlongum (#87652093); Erismatopterus (#87652094); Croppo (#87652096); Red-spotted (#87652098); Aphiocharax (#87652101); Euchielota (#87652102); Phyllachus (#87652105); Scopelus (#87652109); Plagusia depressa tuberculata (#87652111)
[START] [2021-01-28 11:32:17] update_nodes
[STOP] [2021-01-28 11:32:18] update_nodes
[STOP] [2021-01-28 11:32:18] match_nodes
[START] [2021-01-28 11:32:18] reindex_search
[STOP] [2021-01-28 11:32:25] reindex_search
[START] [2021-01-28 11:32:25] normalize_units
[STOP] [2021-01-28 11:32:25] normalize_units
[START] [2021-01-28 11:32:25] calculate_statistics
[2021-01-28 11:32:25] ZERO NODE ANCESTORS. Is this actually a completely flat resource?
[STOP] [2021-01-28 11:32:25] calculate_statistics
[START] [2021-01-28 11:32:25] complete_harvest_instance
[START] [2021-01-28 11:32:25] overall_tsv_creation
[INFO] [2021-01-28 11:32:25] Processing group of 4563 in 1 batches of 10000
[INFO] [2021-01-28 11:33:20] Average Time: 23.93
[INFO] [2021-01-28 11:33:20] Total Time: 55s
[STOP] [2021-01-28 11:33:20] overall_tsv_creation
[INFO] [2021-01-28 11:33:20] Done. Check your files:
[INFO] [2021-01-28 11:33:20] (4563 lines) /app/public/data/fmibfw/publish_nodes.tsv
[INFO] [2021-01-28 11:33:20] (4563 lines) /app/public/data/fmibfw/publish_scientific_names.tsv
[INFO] [2021-01-28 11:33:20] (7872 lines) /app/public/data/fmibfw/publish_media.tsv
[INFO] [2021-01-28 11:33:20] (7872 lines) /app/public/data/fmibfw/publish_image_info.tsv
[INFO] [2021-01-28 11:33:20] (16528 lines) /app/public/data/fmibfw/publish_attributions.tsv
[STOP] [2021-01-28 11:33:20] complete_harvest_instance
[START] [2021-01-28 11:33:20] completed
[STOP] [2021-01-28 11:33:20] completed
[STOP] [2021-01-28 11:33:20] logged process, took 625.65

Latest Process

28 Jan 11:22 EXITED currently processing 0