Repository navigation
Folders and files
| Name | Name | Last commit date | ||
|---|---|---|---|---|
Repository files navigation
For articles_download.py you need the following packages (install with conda or pip): bs4 and requests. timeit, datetime, os, re, sys and csv are already parts of Python’s standard library. Configure your search query with config function. Change directories in main function to your local directories where you want all pdfs to be saved. Running this code will produce summary_table.csv file that will have links to pdfs, links to pages, authors, names, description, file size, publication date and other metadata. Additionally, a log file will have information on total amount of documents found that responded to your search, amount of new documents (those that were not found in the directory already) and time it took to run the script.