For researchers, students, and academics, the process of conducting a thorough literature review is fundamental. However, the manual collection of article data from search results can be a time-consuming and repetitive task.
To address this inefficiency, we are pleased to introduce the Scholar DOI Scraper, a new Chrome extension developed to streamline and automate this process.
Core Functionality
The Scholar DOI Scraper integrates directly with your browser to automate data collection. Upon providing a search query, the tool programmatically navigates Google Scholar search pages, identifies each article, and retrieves its official Digital Object Identifier (DOI) via the CrossRef API.
All collected DOIs are stored locally in your browser, available for easy export to your preferred reference manager or database.
Operational Guide
- Installation: Add the extension from the Chrome Web Store.
- Configuration: Open the extension's popup to define your search parameters, including query, year range, and the number of pages to process.
- Execution: Initiate the process with the "Start Scraping" button. The extension will operate in the active tab.
- Data Retrieval: The collected DOIs will populate in the text field for you to copy and utilize in your work.
Technical Limitations and Considerations
To ensure stable and respectful operation, please be aware of the following limitations:
- Request Delays: The extension incorporates mandatory delays between page loads and API calls. This is a critical feature to ensure compliance with the terms of service of Google Scholar and CrossRef and to prevent IP blocking.
- Google Scholar Result Cap: Although a search may yield millions of results, Google Scholar's interface limits access to the first 1000 entries (100 pages). Consequently, the extension can only process up to this limit.
- Current Scope (DOI Only): This version of the tool is focused exclusively on retrieving DOIs. Support for other identifiers, such as arXiv IDs, ISBNs, or ISSNs, is under consideration for future releases.
Feedback and Support
This tool is actively maintained. We welcome constructive feedback and feature suggestions to improve its utility for the research community.
➡️ Download the Scholar DOI Scraper from the Chrome Web Store
➡️ Report an Issue or Suggest a Feature on GitHub
Spend less time collecting data and more time making discoveries. Happy researching!
