Skip to main content

Annotation and Metadata

This is the data path behind annotated links. It connects the Build Pipeline, where metadata is read and generated, to the Popup System, where annotation fragments are shown to readers.

Reading Path

StepPageWhy it matters
1LinkMetadata.hsCentral metadata lookup, annotation creation, and fragment generation
2Annotation.hsDispatcher that routes URLs to source-specific metadata extractors
3GTX.hsParser and writer for the line-based metadata database format
4LinkMetadataTypes.hsShared metadata types used across the backend
5annotations.jsBrowser-side annotation data loading and caching

Scrapers and Cleanup

AreaStart here
arXivannotation-arxiv.hs
BioRxiv and MedRxivannotation-biorxiv.hs
Local gwern.net pagesannotation-gwernnet.hs
OpenReviewannotation-openreview.hs
PDFsannotation-pdf.hs
Author cleanupMetadata.Author.hs
Title cleanupMetadata.Title.hs
Abstract formattingMetadata.Format.hs

Where It Surfaces