This is a tiny package to:
- Automactically save ALL searching results of
Web of Science (WOS) - Export DOIs from reference files
- Download the articles from Sci-Hub based on DOIs.
python setpy.py install| Key | Type | Example | Description |
|---|---|---|---|
executable_path |
Str | "/usr/local/bin" | Path of browser driver |
wos_path |
Str | "./wos" | Path for saving downloaded reference files from WOS |
url |
Str | Page of searching results in WOS | |
username |
Int or Str | - | Username for login |
password |
Int or Str | - | Password for login |
institute |
Str | "Fake University" | Name of institute |
format |
Str | "ris" | Format of downloaded reference files |
sortby |
Str | "Date: newest first" | Default: Relevance |
scihub_path |
Str | "./scihub" | Path for saving downloaded pdf files from Sci-Hub |
ppclt wos params.jsonppclt doi params.jsonOptional argument:
--save [SavePath]: save path for DOIs.txt. If not provided, save files in the wos_path.
--external [RefFiles]: reference file(s). Wildcard is supported (e.g., ./test/ref-*.xls).
ppclt pdf params.json --external DOIs.txtOptional argument:
--external [RefFiles]: reference file(s). Wildcard is supported (e.g., ./test/ref-*.xls).
The main idea of this package is to use selenium to finish some actions (e.g., click and send keys) on the browser.
This means that, if the proceduce (for example, for login) is different for you, you might need to make some modifications on the codes.
Besides, you might also want to create your own workflow for other websites/assignments.
If so, you should be interested in the following part.
In this package, the workflow to download reference files from WOS starts with login via institute.
If you want to set a different login pathway, for example, by changing your institue, you need to rewrite the WOS._login method in papercollector.main.
Specifically, you need to change the XPATH or CSS_SELECTOR of the elements your should click/send keys.
You can find some tutorials in Google for how to find them (e.g., Find XPATH in Chrome).
You might want to download reference from the websites other than WOS.
Then you can add a new class analogous to WOS in papercollector.main.
To Do List:
- set background or not in json file