Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

strange symptoms in resource 223 #304

Open
jhammock opened this issue May 27, 2016 · 4 comments
Open

strange symptoms in resource 223 #304

jhammock opened this issue May 27, 2016 · 4 comments
Labels
Milestone

Comments

@jhammock
Copy link
Collaborator

In this resource http://eol.org/resources/223

two odd things are happening:

the first 10% of the images tab of the resource collection (sorted by recently added) is paginated into short pages, beginning with only a few images per page, and growing longer until the normal number appears about 10% of the way through.

This by itself is a very minor issue, mentioning it here in case it is related to the other issue.

A large number of the maps (possibly half) show no points, where point are visible on the source maps. Several examples here

This is a connector, which has Been Through Some Stuff, having supplied the detail tab and then been moved to the maps tab. @eliagbayani , if you can access it, could you run the connector and see what the resource looks like now? Maybe a reharvest will fix this...

@jhammock jhammock added the bug label May 27, 2016
@jhammock jhammock modified the milestones: 2016.05.17, 2016.05.31 May 27, 2016
@jhammock jhammock modified the milestones: 2016.05.31, 2016.06.14 Jun 14, 2016
@eliagbayani
Copy link

eliagbayani commented Jun 29, 2016

I was able to run the connector from the server and generate the latest XML resource.
The numbers in the current collection seems incorrect.
http://eol.org/collections/320

Below are the numbers I got from the latest generated XML resource and one from July 2014.

Taxa ---------- Maps
541,787 ---------- 589,225 24-Jul-14
597,942 ---------- 597,942 29-Jun-16

Resource is now set to force-harvest. We should just re-harvest it and see how it goes.

@eliagbayani
Copy link

I’ve set this up to force-harvest a couple of days ago. Now, resource says ‘Harvest Failed’.
This is copy of the resource file. I copied this from our server, generated by the connector.
Resource validates OK using our validator.
I used my local validator since file is too big to run remotely.

I’m inclined to say that maybe harvesting may still not be ready to handle such big resource.

@JRice
Copy link
Member

JRice commented Jul 7, 2016

Harvesting at this point is NOT automated, and any "Force Harvest" that is
set will end up "Harvest Failed" the following day unless I add it to a
whitelist in the PHP code.

We're really being very careful about what goes through since the port of
the publishing code.

It's nothing personal! ;)

Jen can take your ID and add it to the (manually-maintained) queue...

On Thu, Jul 7, 2016 at 1:29 AM, eliagbayani notifications@github.com
wrote:

I’ve set this up to force-harvest a couple of days ago. Now, resource
http://eol.org/content_partners/311/resources/223 says ‘Harvest Failed’.
This is copy of the resource file
https://dl.dropboxusercontent.com/u/5763406/resources/223.xml.gz. I
copied this from our server, generated by the connector.
Resource validates OK using our validator
http://services.eol.org/validator/.
I used my local validator since file is too big to run remotely.

I’m inclined to say that maybe harvesting may still not be ready to handle
such big resource.


You are receiving this because you are subscribed to this thread.
Reply to this email directly, view it on GitHub
#304 (comment), or mute
the thread
https://github.com/notifications/unsubscribe/AABebtz49hlbEfOuikV7xdoD58rlwCYrks5qTI6lgaJpZM4IoinD
.

@jhammock
Copy link
Collaborator Author

jhammock commented Jul 7, 2016

Ohhh... Upload succeeded, then? Now I think I understand the upload segment of things. This resource is in the queue, not very high since I'm not sure when we'll feel ready for 600k taxa :) Here's hoping the symptoms disappear upon reharvest..

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Projects
None yet
Development

No branches or pull requests

3 participants