Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Unable to find documents based on DOI #46

Closed
riddhis5 opened this issue Jun 8, 2023 · 3 comments
Closed

Unable to find documents based on DOI #46

riddhis5 opened this issue Jun 8, 2023 · 3 comments
Assignees
Labels
bug Something isn't working

Comments

@riddhis5
Copy link

riddhis5 commented Jun 8, 2023

Hello,
When attempting to load an csv file, I am getting the, 'no document found for DOI,' for all DOIs within the csv file. Below is an example of the error.
90%|█████████ | 451/499 [00:51<00:06, 7.57it/s]WARNING:root:no document found for DOI 10.5194/acp-22-395-2022:

My code is as follows:
import os
import sys

path = os.path.abspath(os.path.join('..'))
if path not in sys.path:
sys.path.append(path)

import litstudy
docs1 = litstudy.load_csv(data_path + 'data2.csv')
docs_scopus, docs_notfound = litstudy.refine_scopus(docs1)
print(len(docs_scopus), 'papers found on Scopus')
print(len(docs_notfound), 'papers were not found and were discarded')

I am unsure as to why it is not able to find the documents based on their DOIs, as they are in the correct format. Any help on this would be greatly appreciated.

@stijnh stijnh self-assigned this Jun 8, 2023
@stijnh stijnh added the bug Something isn't working label Jun 8, 2023
@stijnh
Copy link
Member

stijnh commented Jun 8, 2023

Thanks for you using litstudy and thanks for reporting this issue!

I was not able to reproduce your bug :-(. Could you try two things for me:

  1. Can you provide the full error message? I could be something like no document found for DOI {doi}: ...
  2. Could you test what the code litstudy.fetch_scopus("10.5194/acp-22-395-2022") returns?

@riddhis5
Copy link
Author

riddhis5 commented Jun 8, 2023

Thank you for your swift response, upon further inspection I believe the issue is connected to the use of the Elsevier API, as I am getting the following errors:
35%|███▌ | 35/100 [00:05<00:10, 6.32it/s]WARNING:root:no document found for DOI 10.1109/PACT.2015.46: The requestor is not authorized to access the requested view or fields of the resource

Scopus401Error: The requestor is not authorized to access the requested view or fields of the resource

I am using the Elsevier API on my Universities internet connection, therefore, I am unsure as to why it is not letting me access the documents.

@stijnh
Copy link
Member

stijnh commented Jun 8, 2023

Indeed, this seems to be an issue with connecting to Scopus, not with litstudy.

Litstudy uses pybliometrics internally to communicate with Scopus. You can try to see if the following code gives an error

import pybliometrics
pybliometrics.scopus.AbstractRetrieval("10.1109/PACT.2015.46")

If this gives the same error, you can ask on the pybliometrics repository: https://github.com/pybliometrics-dev/pybliometrics

@riddhis5 riddhis5 closed this as completed Jun 9, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Something isn't working
Projects
None yet
Development

No branches or pull requests

2 participants