one page, copied by an archive over a yeartoday3 March9 June2 September14 October1 Octoberthe latest copy on or before that daythe next copy after it
The run in 5 steps
Read each page as of its trade date
In a batch, each address has its own day. One call reads 20 pages as of 20 trade dates.Request body of fetch_contents_batch, cut to 2 of 20 items
SOURCE_URL and SECOND_SOURCE_URL with the addresses of the pages.
Each record is the latest copy that an archive made on or before the end of that day, in UTC.
Store the time of each copy
The record says when its copy was made. That time, and not the day you asked for, is what your dataset stores. This part of a record is cut to the 2 times, andarchive also has the name of the archive and the address of the copy.
Part of one record
Tell a claimed date from an observed one
A page prints its own date, andpublished_date reports it with where it was read. That date is a claim of the page. A page that was edited last week can still print the date of its first version. Only the time of a copy is an observation, so a rule against look-ahead should use that time.
Refuse a page that cannot be dated
If no archive has a copy on or before the day, the record’s outcome isfailed with the reason no_history, and it names the archives that were asked. Mark the row as excluded. The live page is not a substitute, because nothing shows that it said the same then.
Find when a sentence appeared
To date one sentence, step through the copies. Each record names the time of the next copy. Send the sentence to each copy as a highlight withdeterministic_only set to true. The last copy without the sentence and the first copy with it give an interval, and the sentence appeared inside it. The dataset stores both ends.