EOL Resource Harvester

Abbreviation: world_reg_mar_sp

OpenData URL: a74bcc92-d2a2-4a7b-b18f-b5fd2e3a5b5c

Minimum Days Between Harvests: 0

Harvesting Status: harvested

Nodes: 460161

URLs for node IDs will direct the client to: "(The ID itself: this assumes the IDs are valid URIs)"

"This resource will NOT be harvested after harvesting. It must be harvested manually."

Trusted: Yes.

Classification Resource: Yes.

May Contain Duplicate Taxa: No.

Can perform trait diffs: No.

Created: 19 Apr 11:25

Last Updated: 16 Nov 15:34

Expected File Format Definitions

agents: agent.tab (12 fields) (2125 lines)

refs: reference.tab (18 fields) (791150 lines)

nodes: taxon.tab (16 fields) (405674 lines)

media: media_resource.tab (30 fields) (109192 lines)

vernaculars: vernacular_name.tab (5 fields) (79914 lines)

occurrences: occurrence.tab (3 fields) (445023 lines)

measurements: measurement_or_fact_specific.tab (15 fields) (1183849 lines)

Harvests

16 Nov 06:48: Completed: 16 Nov 15:34 (took 526 minutes)

Processes

29 Nov 12:57 logged process: 9943a13b84233efd28c28c8ae67b831749b775ec merge currently processing 0

29 Nov 10:57 logged process: 7192f67da6a55cfbf452e6f280fd5ef64eb51173 Adding dbg arg to fail_on_bad_uri currently processing 0

16 Nov 06:47 EXITED currently processing 0

03 Nov 05:25 EXITED currently processing 140000 (9.6%) of 1449637 (last five times: 8.4s, 8.0s, 8.3s, 7.8s, 8.1s) (average of all times: 0.67s)

02 Nov 08:49 EXITED currently processing 100000 (6.9%) of 1445621 (last five times: 4.8s, 4.9s, 4.9s, 4.9s, 4.8s) (average of all times: 0.41s)

02 Nov 07:54 EXITED currently processing 100000 (6.9%) of 1445621 (last five times: 8.9s, 9.0s, 9.0s, 8.5s, 8.5s) (average of all times: 0.74s)

30 Oct 08:13 EXITED

26 Oct 08:32 EXITED

24 Oct 06:03 EXITED

23 Oct 22:41 EXITED

23 Oct 12:12 EXITED

12 Oct 21:22 EXITED currently processing 0

11 Oct 13:00 EXITED currently processing 0

30 Jan 08:39 EXITED currently processing 0

23 Dec 15:52 logged process: b2d936622fcfc708ed5519cedbe841bb3639fd3a Blast! The command wasn't in the dockerfile... → Flattener#study_resource → complete_harvest_instance → overall_tsv_creation currently processing 3 (6.6%) of 45

23 Dec 13:34 EXITED currently processing 110000 (7.1%) of 1532256 (last five times: 8.2s, 8.0s, 8.8s, 9.0s, 8.4s) (average of all times: 0.7s)

21 Dec 12:23 EXITED currently processing 1 (0.0%) of 1532256

09 Dec 16:03 EXITED currently processing 180000 (8.2%) of 2188267 (last five times: 8.4s, 8.5s, 8.6s, 8.6s, 8.9s) (average of all times: 0.71s)

19 Jul 16:20 EXITED currently processing 0

19 Jul 13:38 EXITED currently processing 260000 (11.5%) of 2260841 (last five times: 9.1s, 9.0s, 8.9s, 9.5s, 9.1s) (average of all times: 0.79s)

19 Jul 12:23

08 Jun 09:54 EXITED currently processing 0

06 Jun 15:18 EXITED currently processing 1240000 (55.5%) of 2231609 (last five times: 13.7s, 13.1s, 13.2s, 13.1s, 13.2s) (average of all times: 0.83s)

27 May 12:32 EXITED currently processing 1240000 (55.5%) of 2231609 (last five times: 13.2s, 13.2s, 13.1s, 13.2s, 13.2s) (average of all times: 0.83s)

27 May 09:10 EXITED currently processing 350000 (15.6%) of 2231609 (last five times: 9.4s, 9.3s, 9.3s, 9.4s, 9.4s) (average of all times: 0.57s)

25 May 02:38 EXITED currently processing 260000 (11.6%) of 2231609 (last five times: 8.8s, 8.8s, 9.7s, 8.9s, 9.2s) (average of all times: 0.73s)

21 Jan 11:27 EXITED currently processing 0

21 Jan 09:45 EXITED currently processing 340000 (13.2%) of 2561366 (last five times: 29.4s, 4.5s, 4.6s, 29.7s, 4.5s) (average of all times: 1.25s)

19 Jan 17:56 EXITED currently processing 1 (0.0%) of 2561366

26 Oct 16:49 EXITED currently processing 0

25 Oct 15:26 logged process: e71cf55dfadaa6ea8714633b7156ede569e21c03 Resource.parse_names is more intelligent when you don't pass in names. → logged process: e71cf55dfadaa6ea8714633b7156ede569e21c03 Resource.parse_names is more intelligent when you don't pass in names. → Flattener#study_resource → complete_harvest_instance → overall_tsv_creation currently processing 36 (83.7%) of 43 (last five times: 389.1s, 412.1s, 316.5s, 345.1s, 343.2s) (average of all times: 62.81s)

18 Oct 09:36 EXITED currently processing 0

15 Oct 17:41 EXITED currently processing 1520000 (60.1%) of 2526292 (last five times: 44.6s, 5.5s, 5.5s, 44.1s, 5.5s) (average of all times: 1.39s)

15 Oct 08:41 EXITED currently processing 140000 (5.5%) of 2526292 (last five times: 26.7s, 4.4s, 4.2s, 27.0s, 4.4s) (average of all times: 1.13s)

22 Jun 12:04 EXITED currently processing 0

22 Jun 07:50 EXITED currently processing 20000 (0.8%) of 2458818

21 Jun 15:57 EXITED currently processing 1 (0.0%) of 2458818

21 Jun 13:13 EXITED currently processing 1 (0.0%) of 2458818

18 Jun 12:06 EXITED currently processing 1 (0.0%) of 2458818

18 Jun 11:06 EXITED currently processing 10000 (0.4%) of 2091230

11 Jun 14:51 EXITED currently processing 1 (0.0%) of 2458818

09 Jun 13:28 EXITED currently processing 1 (0.0%) of 2458818

02 Jun 12:59 EXITED currently processing 1 (0.0%) of 2458705

02 Jun 01:56 EXITED

27 May 08:03 EXITED currently processing 10000 (0.4%) of 2091217

18 May 13:10 EXITED currently processing 0

17 May 10:48 EXITED currently processing 10000 (0.4%) of 2091217

13 May 07:36 EXITED currently processing 10000 (0.4%) of 2091217

05 Apr 09:00 EXITED currently processing 0

24 Mar 09:34 EXITED currently processing 0

24 Mar 09:27 EXITED currently processing 0

24 Mar 08:57 EXITED currently processing 0

11 Feb 11:40 EXITED currently processing 0

09 Feb 15:30 EXITED currently processing 0

09 Feb 11:39 EXITED currently processing 720000 (28.2%) of 2548513 (last five times: 32.6s, 4.4s, 61.3s, 4.7s, 6.1s) (average of all times: 1.77s)

03 Feb 13:23 logged process: 16b22834be7ac1492cba86047bb0f5dbfa370977

03 Feb 12:56 EXITED currently processing 1 (0.0%) of 2170850

03 Feb 12:32 logged process: 16b22834be7ac1492cba86047bb0f5dbfa370977

30 Dec 16:48 logged process: ca5be136aef877c71c74100a42de34a9e7a07645

24 Dec 08:06 logged process: ca5be136aef877c71c74100a42de34a9e7a07645

17 Dec 18:02 EXITED currently processing 2680000 (80.6%) of 3325055 (last five times: 4.2s, 99.2s, 4.6s, 5.0s, 98.3s) (average of all times: 2.2s)

22 Nov 08:35 EXITED currently processing 0

20 Nov 09:38 EXITED currently processing 0

20 Nov 08:25 logged process: 58bbc42b01abb4c1b2698de049792ffb4b63b979

19 Nov 16:29 EXITED currently processing 70000 (last five times: 138.8s, 181.0s, 223.1s, 264.7s, 306.9s) (average of all times: 12.08s)

19 Nov 16:29 logged process: 58bbc42b01abb4c1b2698de049792ffb4b63b979

19 Nov 16:28 logged process: 58bbc42b01abb4c1b2698de049792ffb4b63b979

16 Apr 21:47 EXITED currently processing 0

16 Apr 21:46 EXITED

16 Apr 21:09 EXITED

10 Feb 10:15 EXITED currently processing 0

07 Feb 14:46 EXITED currently processing 0

17 Dec 14:35 EXITED currently processing 0

23 Oct 01:39 EXITED currently processing 0

21 Oct 13:56 EXITED currently processing 0

21 Oct 03:48 EXITED currently processing 0

19 Oct 02:16 EXITED currently processing 0

17 Oct 13:43 EXITED currently processing 0

16 Oct 13:19 logged process → overall_tsv_creation currently processing 10 (28.5%) of 35 (last five times: 337.4s, 317.5s, 372.2s, 370.6s, 338.8s) (average of all times: 50.97s)

16 Oct 10:13 logged process → Flattener#study_resource currently processing 0

16 Oct 10:12

11 Oct 17:17 EXITED currently processing 0

03 Oct 22:28 EXITED currently processing 0

08 Aug 12:54 logged process currently processing 0

Last Harvest Content

460161

nodes

78961

articles

405673

identifiers

25981

media

791149

references

460161

scientific_names

1183848

traits

associations

79913

vernaculars

25981

downloaded

failed

100% downloaded

Nodes

Root Nodes (18):

World Register of Marine Species