arXiv reader

About

The arXiv reader is a corpus of the items of mathematics papers on arXiv: the definitions, the theorems and the other statements, the proofs, the remarks, the examples, the conjectures and the problems. Each item has a permanent tag, the number that the paper prints, its name, its text, and the links to the items that it uses.

How it is made

  1. A pipeline on a server takes the e-prints of papers in scope, one batch each hour, and keeps them with the licence of each version.
  2. The TeX front end of arxiv-reader reads the source of the paper. It expands the macros of the paper and finds each theorem environment, each proof and each head.
  3. A census counts the items of the paper in a second, independent way and checks that the two counts agree. A paper with a gap stops with a reason.
  4. The resolver finds the proof of each statement and the items that each item uses.
  5. This site is built from the records in github.com/tamnd/arxiv and deployed again each time the corpus changes.

No step uses a language model. All text is the text of the paper.

Numbers

Papers on this site824
Papers whose text the site shows824
Items33,769
Papers in scope141,723
Papers stopped with a reason19

Related

math2 is the wiki of mathematics that takes its research layer from this corpus.