UK Web Archive

From Wikipedia, the free encyclopedia
Jump to navigation Jump to search
UK Web Archive
File:Ukwa-2018-onwhite-close.svg
Lua error in Module:Infobox_mapframe at line 197: attempt to index field 'wikibase' (a nil value).
Established2005
Reference to legal mandateYes, provided in law by:
Collection
Other information
class=notpageimage|
Libraries providing access to the archive.

The UK Web Archive is a consortium of the six UK legal deposit libraries which aims to collect all UK websites at least once each year.[2] As of December 2025, its website is unavailable because of a cyberattack on the British Library in October 2023.

History

[edit | edit source]

In 2005, the British Library, The National Archives, Wellcome Trust, National Library of Scotland, National Library of Wales and JISC formed the UK Web Archiving Consortium, a project to archive websites.[3]

UKWAC archived selected websites by license or permission, using PANDAS software developed by the National Library of Australia. During the project its members collected sites relevant to their interest; the Wellcome Library collected medical sites, the national libraries sites that reflect life in contemporary Wales or Scotland. The British Library worked with a broad policy of collecting sites of cultural, historical and political importance to the UK.[4]

The Consortium wound up in 2010. The Archiving and Preservation Working Group took over UKWAC's co-ordinating role web archiving in the UK. The Digital Preservation Coalition hosts the working group.[5]

Web archiving

[edit | edit source]

The archive undertakes an annual crawl of .uk and other UK geographic Top Level Domains such as .scot, .cymru or .london.

A graph showing a small part of a UK Web Archive website crawl. Every circle is a different website, and every line represents a link that was followed between websites. The size of the circle represents how many pages were visited from that site, and the width of the line represents the number of links followed.
A graph showing a small part of a crawl. Every circle is a different website, and every line represents a link that was followed between websites. The size of the circle represents how many pages were visited from that site, and the width of the line represents the number of links followed. UKWA Crawls: one hour in one minute

The crawl is archived in a shared infrastructure called the Digital Library System. Members of the public can nominate sites for preservation there through the UKWA website. The whole web archive is available to registered readers on library premises; and where permission has been given, or license conditions can be met, copies are also accessible through the website.[6]

The archive gathers sites in response to events, building collections - these have preserved writing and imagery recording natural disasters, election campaigns since 2005 and the UK's blogosphere for research, among more than a hundred more.[7]

SHINE

[edit | edit source]
A graph showing the percentage of the dataset which the phrases "millenium bug" or "y2k issue" occur in, between the years of 1996 and 2013. Both trends rise to a maximum in 1999, followed by a decline, following much the same shape.
SHINE graph showing how often different phrases for "year 2000 problem" appear between the years of 1996 and 2013 on archived .uk webpages.

The UK Web Archive holds a collection of all the .uk websites that were archived by the Internet Archive until the end of March in 2013.[8] SHINE is a web interface which can be used to create repeatable lists of results of historical .uk pages. Trends, or occurrences of keywords in the data set on .uk pages over that time, use concordance to show keywords in context.[9]

Mementos

[edit | edit source]

Memento is a name for prior versions of web pages coined by the Memento Project. The UK Web Archive Memento interface allows Mementos to be found across web archives.[10] The interface can be used to find a Memento by its date in a snapshot table, or see how often a site appears across public web archives.

Researching the archive

[edit | edit source]

Research into the web as a reflection of society has helped develop access to the archive.[11] Libraries have developed guides to research skills needed to use web archives. These include using big data to see patterns or trends,[12] or writing citations for archived copies of websites.[13]

GLAM Workbench

[edit | edit source]

GLAM Workbench is a project which looks at how researchers can use data preserved by galleries, libraries, archives and museums.[14] It includes a collection of Jupyter notebooks which draw on Mementos and index data.[15] The notebooks mix description and editable code to help researchers find evidence in web archives.

Where the whole archive can be accessed, by Library
<maplink text="Bodleian Libraries" latitude="51.7550536" longitude="-1.2551059831608038" zoom="14"> {"type": "FeatureCollection", "features": [{ "type": "Feature", "geometry": { "type": "Point", "coordinates": [-1.2551059831608038,51.7550536] }, "properties": { "title": "Weston Library", "marker-color": "041E42", "marker-symbol": "library", "marker-size":"large", "description": "File:Weston Library Exterior by John Cairns 20.3.15-27.jpg" } }, { "type": "Feature", "geometry": { "type": "Point", "coordinates": [-1.2546965225090927,51.75406145] }, "properties": { "title": "Bodleian Library", "marker-color": "041E42", "marker-symbol": "library", "marker-size":"medium", "description": "File:Bodleian from Radcliffe Square.jpg" } }, { "type": "Feature", "geometry": { "type": "Point", "coordinates": [-1.2616295790591385,51.75731055] }, "properties": { "title": "Continuing Education Library", "marker-color": "041E42", "marker-symbol": "library", "marker-size":"medium" } }, { "type": "Feature", "geometry": { "type": "Point", "coordinates": [-1.2559173226869782,51.763648849999996] }, "properties": { "title": "Education Library", "marker-color": "041E42", "marker-symbol": "library", "marker-size":"medium" } }, { "type": "Feature", "geometry": { "type": "Point", "coordinates": [-1.2183140941380586,51.7641349] }, "properties": { "title": "Cairns Library", "marker-color": "041E42", "marker-symbol": "library", "marker-size":"medium" } }, { "type": "Feature", "geometry": { "type": "Point", "coordinates": [-1.2093240767866458,51.75449155] }, "properties": { "title": "Girdlestone Memorial Library", "marker-color": "041E42", "marker-symbol": "library", "marker-size":"medium" } }, { "type": "Feature", "geometry": { "type": "Point", "coordinates": [-1.3376543,52.0541943] }, "properties": { "title": "Horton Library", "marker-color": "041E42", "marker-symbol": "library", "marker-size":"medium", "description": "Health Care Library" } }, { "type": "Feature", "geometry": { "type": "Point", "coordinates": [-1.2140959995972105,51.7519229] }, "properties": { "title": "Knowledge Centre Library", "marker-color": "041E42", "marker-symbol": "library", "marker-size":"medium" } }, { "type": "Feature", "geometry": { "type": "Point", "coordinates": [-1.2540099704885508,51.7534538] }, "properties": { "title": "History Faculty Library", "marker-color": "041E42", "marker-symbol": "library", "marker-size":"medium" } }, { "type": "Feature", "geometry": { "type": "Point", "coordinates": [-1.2610170214609857,51.76325695] }, "properties": { "title": "History of Medicine Library", "marker-color": "041E42", "marker-symbol": "library", "marker-size":"medium" } }, { "type": "Feature", "geometry": { "type": "Point", "coordinates": [-1.262378623681888,51.76338935] }, "properties": { "title": "Japanese Library", "marker-color": "041E42", "marker-symbol": "library", "marker-size":"medium" } }, { "type": "Feature", "geometry": { "type": "Point", "coordinates": [-1.262828236270458,51.7659236] }, "properties": { "title": "K B Chen China Centre Library", "marker-color": "041E42", "marker-symbol": "library", "marker-size":"medium" } }, { "type": "Feature", "geometry": { "type": "Point", "coordinates": [-1.2634651606729377,51.76442445] }, "properties": { "title": "Latin American Centre Library", "marker-color": "041E42", "marker-symbol": "library", "marker-size":"medium" } }, { "type": "Feature", "geometry": { "type": "Point", "coordinates": [-1.2476458,51.7571869] }, "properties": { "title": "Bodleian Law Library", "marker-color": "041E42", "marker-symbol": "library", "marker-size":"medium" } }, { "type": "Feature", "geometry": { "type": "Point", "coordinates": [-1.2630389054334765,51.7566391] }, "properties": { "title": "Leopold Muller Memorial Library for Hebrew and Jewish Studies", "marker-color": "041E42", "marker-symbol": "library", "marker-size":"medium" } }, { "type": "Feature", "geometry": { "type": "Point", "coordinates": [-1.25551940494565,51.75797105] }, "properties": { "title": "Radcliffe Science Library", "marker-color": "041E42", "marker-symbol": "library", "marker-size":"medium", "description": "File:Radcliffe Science Library (Parks College).jpg" } }, { "type": "Feature", "geometry": { "type": "Point", "coordinates": [-1.25589,51.7487557] }, "properties": { "title": "Music Faculty Library", "marker-color": "041E42", "marker-symbol": "library", "marker-size":"medium" } }, { "type": "Feature", "geometry": { "type": "Point", "coordinates": [-1.260888416025609,51.75581305] }, "properties": { "title": "Oriental Institute Library", "marker-color": "041E42", "marker-symbol": "library", "marker-size":"medium" } }, { "type": "Feature", "geometry": { "type": "Point", "coordinates": [-1.2623886962259863,51.76009765] }, "properties": { "title": "Philosophy & Theology Faculties Library", "marker-color": "041E42", "marker-symbol": "library", "marker-size":"medium" } }, { "type": "Feature", "geometry": { "type": "Point", "coordinates": [-1.2540099704885508,51.7534538] }, "properties": { "title": "Radcliffe Camera", "marker-color": "041E42", "marker-symbol": "library", "marker-size":"medium", "description":"File:Radcliffe Camera, Oxford (6263271240).jpg" } }, { "type": "Feature", "geometry": { "type": "Point", "coordinates": [-1.25551940494565,51.75797105] }, "properties": { "title": "Radcliffe Science Library", "marker-color": "041E42", "marker-symbol": "library", "marker-size":"medium" } }, { "type": "Feature", "geometry": { "type": "Point", "coordinates": [-1.2610706393859648,51.755473300000006] }, "properties": { "title": "Sackler Library", "marker-color": "041E42", "marker-symbol": "library", "marker-size":"medium" } }, { "type": "Feature", "geometry": { "type": "Point", "coordinates": [-1.2685249821021294,51.7537148] }, "properties": { "title": "Sainsbury Library", "marker-color": "041E42", "marker-symbol": "library", "marker-size":"medium", "description":"File:Said Business School.jpg" } }, { "type": "Feature", "geometry": { "type": "Point", "coordinates": [-1.246903500718275,51.75746915] }, "properties": { "title": "Social Science Library", "marker-color": "041E42", "marker-symbol": "library", "marker-size":"medium" } }, { "type": "Feature", "geometry": { "type": "Point", "coordinates": [-1.2597069747585337,51.75555825] }, "properties": { "title": "Taylor Institution Library", "marker-color": "041E42", "marker-symbol": "library", "marker-size":"medium" } }, { "type": "Feature", "geometry": { "type": "Point", "coordinates": [-1.2610777426169635,51.763650999999996] }, "properties": { "title": "Tylor Library of Social and Cultural Anthropology", "marker-color": "041E42", "marker-symbol": "library", "marker-size":"medium" } }, { "type": "Feature", "geometry": { "type": "Point", "coordinates": [-1.2538780419731719,51.75764265] }, "properties": { "title": "Vere Harmsworth Library", "marker-color": "041E42", "marker-symbol": "library", "marker-size":"medium" } }, { "type": "Feature", "geometry": { "type": "Point", "coordinates": [-1.2524298,51.7590373] }, "properties": { "title": "Sherardian Library of Plant Taxonomy", "marker-color": "041E42", "marker-symbol": "library", "marker-size":"medium" } }]}</maplink> <maplink text="British Library" latitude="51.529444" longitude="-0.126944" zoom="6"> {"type": "FeatureCollection", "features": [{ "type": "Feature", "geometry": { "type": "Point", "coordinates": [-0.126944, 51.529444] }, "properties": { "title": "British Library, St Pancras", "marker-color": "CC0000", "marker-symbol": "library", "marker-size":"large", "description": "File:British-Library-outside.jpg" } }, { "type": "Feature", "geometry": { "type": "Point", "coordinates": [-1.3225686551231777, 53.920135951614334] }, "properties": { "title": "British Library, Boston Spa", "marker-color": "CC0000", "marker-symbol": "library", "marker-size":"medium", "description": "File:Entrance to the British Library, Street 5, Thorp Arch Trading Estate (10th July 2020).jpg" } }, ]}</maplink> <maplink text="Cambridge University Libraries" latitude="52.205167" longitude="0.108056" zoom="15">

{ 

 "type": "Feature",
 "properties": {
   "marker-symbol": "library",
   "marker-color": "91B9A4",
   "marker-size": "medium",
   "title": "Cambridge University Library",
   "description": "File:CAMBRIDGE 005.JPG"
 },
 "geometry": {
   "type": "Point",
   "coordinates": [
     0.108056,
     52.205167
   ]
 }

} </maplink>

<maplink text="National Library of Scotland" latitude="55.94856253599343" longitude="-3.191948533112736" zoom="9"> {"type": "FeatureCollection", "features": [{ "type": "Feature", "geometry": { "type": "Point", "coordinates": [-3.191948533112736, 55.94856253599343] }, "properties": { "title": "National Library of Scotland, George IV Bridge", "marker-color": "017BC1", "marker-symbol": "library", "marker-size":"large", "description": "File:National Library of Scotland, Edinburgh.JPG" } }, { "type": "Feature", "geometry": { "type": "Point", "coordinates": [-3.180057406534616, 55.936929823182794] }, "properties": { "title": "Map Library, Causewayside", "marker-color": "017BC1", "marker-symbol": "library", "marker-size":"small", "description": "File:National Library of Scotland, Causewayside - geograph.org.uk - 1316111.jpg" } }, { "type": "Feature", "geometry": { "type": "Point", "coordinates": [-4.293979704434606, 55.869254917408696] }, "properties": { "title": "Moving Image Archive, Kelvin Hall", "marker-color": "017BC1", "marker-symbol": "library", "marker-size":"medium", "description": "File:New Entrance to the Kelvin Hall, Bunhouse Road (geograph 5087700).jpg" } },]}</maplink> <maplink text="National Library of Wales" latitude="52.4141407" longitude="-4.068665" zoom="7"> {"type": "FeatureCollection", "features": [{ "type": "Feature", "geometry": { "type": "Point", "coordinates": [-4.068665, 52.4141407] }, "properties": { "title": "National Library of Wales", "marker-color": "E41B13", "marker-symbol": "library", "marker-size":"large", "description": "File:National Library of Wales, Aberystwyth.jpg" } }, { "type": "Feature", "geometry": { "type": "Point", "coordinates": [-3.1825751, 51.4902715] }, "properties": { "title": "NLW Reading Room, Arts and Social Studies Library, University of Cardiff", "marker-color": "E41B13", "marker-symbol": "library", "marker-size":"small", "description": "File:CardiffLawLib.JPG" } }, ]}</maplink> <maplink text="Trinity College Dublin" latitude="53.3444162" longitude="-6.2589561" zoom="14"> {"type": "FeatureCollection", "features": [{ "type": "Feature", "geometry": { "type": "Point", "coordinates": [-6.2577, 53.3444] }, "properties": { "title": "Trinity College Dublin", "marker-color": "005EB8", "marker-symbol": "library", "marker-size":"large", "description": "File:Long Room Interior, Trinity College Dublin, Ireland - Diliff.jpg" } }, { "type": "Feature", "geometry": { "type": "Point", "coordinates": [-6.25602, 53.34291] }, "properties": { "title": "James Ussher Library", "marker-color": "005EB8", "marker-symbol": "library", "marker-size":"medium", "description": "File:The modern Ussher and Berkeley Libraries - geograph.org.uk - 1739121.jpg" } }, { "type": "Feature", "geometry": { "type": "Point", "coordinates": [-6.25682, 53.34331] }, "properties": { "title": "Lecky Library", "marker-color": "005EB8", "marker-symbol": "library", "marker-size":"medium" } }, { "type": "Feature", "geometry": { "type": "Point", "coordinates": [-6.25588, 53.34346] }, "properties": { "title": "Berkeley Library", "marker-color": "005EB8", "marker-symbol": "library", "marker-size":"medium", "description": "File:The modern Ussher and Berkeley Libraries - geograph.org.uk - 1739121.jpg" } }, { "type": "Feature", "geometry": { "type": "Point", "coordinates": [-6.29436, 53.34163] }, "properties": { "title": "John Stearne Medical Library", "marker-color": "005EB8", "marker-symbol": "library", "marker-size":"medium" } }, { "type": "Feature", "geometry": { "type": "Point", "coordinates": [-6.25063, 53.34327] }, "properties": { "title": "Hamilton Library", "marker-color": "005EB8", "marker-symbol": "library", "marker-size":"medium" } }]}</maplink>

See also

[edit | edit source]

References

[edit | edit source]
  1. ^ Lua error in Module:Citation/CS1/Configuration at line 2172: attempt to index field '?' (a nil value).
  2. ^ Lua error in Module:Citation/CS1/Configuration at line 2172: attempt to index field '?' (a nil value).
  3. ^ Lua error in Module:Citation/CS1/Configuration at line 2172: attempt to index field '?' (a nil value).
  4. ^ Lua error in Module:Citation/CS1/Configuration at line 2172: attempt to index field '?' (a nil value).
  5. ^ Lua error in Module:Citation/CS1/Configuration at line 2172: attempt to index field '?' (a nil value).
  6. ^ Lua error in Module:Citation/CS1/Configuration at line 2172: attempt to index field '?' (a nil value).
  7. ^ Lua error in Module:Citation/CS1/Configuration at line 2172: attempt to index field '?' (a nil value).
  8. ^ Lua error in Module:Citation/CS1/Configuration at line 2172: attempt to index field '?' (a nil value).
  9. ^ Lua error in Module:Citation/CS1/Configuration at line 2172: attempt to index field '?' (a nil value).
  10. ^ Lua error in Module:Citation/CS1/Configuration at line 2172: attempt to index field '?' (a nil value).
  11. ^ Lua error in Module:Citation/CS1/Configuration at line 2172: attempt to index field '?' (a nil value).
  12. ^ Lua error in Module:Citation/CS1/Configuration at line 2172: attempt to index field '?' (a nil value).
  13. ^ Lua error in Module:Citation/CS1/Configuration at line 2172: attempt to index field '?' (a nil value).
  14. ^ Lua error in Module:Citation/CS1/Configuration at line 2172: attempt to index field '?' (a nil value).
  15. ^ Lua error in Module:Citation/CS1/Configuration at line 2172: attempt to index field '?' (a nil value).
  16. ^ Lua error in Module:Citation/CS1/Configuration at line 2172: attempt to index field '?' (a nil value).
  17. ^ Lua error in Module:Citation/CS1/Configuration at line 2172: attempt to index field '?' (a nil value).
  18. ^ Lua error in Module:Citation/CS1/Configuration at line 2172: attempt to index field '?' (a nil value).
[edit | edit source]

Lua error in Module:Authority_control at line 153: attempt to index field 'wikibase' (a nil value).

Retrieved from "http://70.231.62.181/index.php?title=UK_Web_Archive&oldid=5998180"