CORE Back-office tools

In the last weeks we have invested a significant effort in the development of CORE administration tools. These tools will allow an easier maintainance and analysis of the metadata and full-text content flow from Open Access repositories to CORE. It will also enable the inclusion of more Open Access repositories in the future. The approach we are taking is that after the end of the project we want all the regular maintenance tasks to be performed directly from the user interface without requiring the administrator to have any knowledge of the source code. We believe that this is an important step towards sustainability of CORE.

The current features of the administration interface are:
– Adding/removing repositories
– Starting and monitoring content download and processing tasks including Metadata download through OAI-PMH, PDF download over HTTP, Extraction of text from PDFs and generation of image thumbnails, indexing of the processed content.
– Monitoring the content statistics, i.e. measuring the amount of harvested metadata and full-text content on a per repository basis. Viewing the history of repository updates.
– Scheduling the frequency of harvesting tasks on a per repository basis.

The tools is also already integrated with the engine that discovers similar research articles. This system will be described in a separate blog post. The following two screenshots are taken from the administration interface. The first one shows the repository management section and the second one is displays two currently running harvesting tasks.