Anubis (software)
| Anubis | |
|---|---|
| Screenshot reading "Making sure you're not a bot!". Below the text is a drawing of the Anubis mascot holding a magnifying glass, and a progress bar. The page shown by Anubis during its challenge. | |
| Original author | Xe Iaso |
| Developer | Techaro[1] |
| Initial release | January 19, 2025[1][2] |
| Repository | github |
| Written in | Go, JavaScript[1] |
| Engine | |
| License | MIT License |
| Website | anubis |
Anubis is a software program that adds a proof of work challenge to websites before users can access them, in order to deter web scraping. It has been adopted mainly by Git forges and free and open-source software projects.[3][4]
Anubis was created by Xe Iaso in response to Amazon's web crawler overloading their Git server, as the crawler did not respect the robots.txt exclusion protocol and would work around restrictions.[3][5]
Adoption
[edit | edit source]It has been used by a number of projects, including:[6]
- The GNOME Project's GitLab instance[3]
- The Linux kernel mailing list archives[1] and Git server[7]
- sourceware.org[6]
- FFmpeg[1][5]
- Wine[8]
- UNESCO[5]
- The Science Olympiad Student Center[8]
- Enlightenment[8]
- FreeCAD[9]
- ScummVM[10]
Criticism
[edit | edit source]Tavis Ormandy noted that the cost of scraping websites protected by Anubis is likely negligible: "I don’t think we reach a single cent per month in compute costs until several million sites have deployed Anubis."[11]
References
[edit | edit source]- ^ a b c d e Lua error in Module:Citation/CS1/Configuration at line 2172: attempt to index field '?' (a nil value).
- ^ Lua error in Module:Citation/CS1/Configuration at line 2172: attempt to index field '?' (a nil value).
- ^ a b c Lua error in Module:Citation/CS1/Configuration at line 2172: attempt to index field '?' (a nil value).
- ^ Lua error in Module:Citation/CS1/Configuration at line 2172: attempt to index field '?' (a nil value).
- ^ a b c Lua error in Module:Citation/CS1/Configuration at line 2172: attempt to index field '?' (a nil value).
- ^ a b Lua error in Module:Citation/CS1/Configuration at line 2172: attempt to index field '?' (a nil value).
- ^ Lua error in Module:Citation/CS1/Configuration at line 2172: attempt to index field '?' (a nil value).
- ^ a b c Lua error in Module:Citation/CS1/Configuration at line 2172: attempt to index field '?' (a nil value).
- ^ Lua error in Module:Citation/CS1/Configuration at line 2172: attempt to index field '?' (a nil value).
- ^ Lua error in Module:Citation/CS1/Configuration at line 2172: attempt to index field '?' (a nil value).
- ^ Lua error in Module:Citation/CS1/Configuration at line 2172: attempt to index field '?' (a nil value).
External links
[edit | edit source]Lua error in mw.title.lua at line 392: bad argument #2 to 'title.new' (unrecognized namespace name 'Portal').