Commit graph

92 commits

Author SHA1 Message Date
Edward Betts 117459bb8f Ignore requests.exceptions.TooManyRedirects for catalog page 2020-06-30 14:00:59 +01:00
Edward Betts dc4455bec5 Catch and ignore UnicodeDecodeError in wd_catalog 2020-06-30 13:09:03 +01:00
Edward Betts 52db7ac00f rijksmuseum URL can point to English catalog page 2020-06-30 11:27:46 +01:00
Edward Betts efa06c9e33 Avoid crash on empty catalog page 2020-06-30 11:23:15 +01:00
Edward Betts 298bef5c6b Follow redirects
Closes: #27
2020-06-30 11:06:46 +01:00
Edward Betts 52a7f94fd0 Bug fix 2020-06-30 09:07:13 +01:00
Edward Betts 3191ae51b0 Bug fix saam parser 2020-06-30 09:05:22 +01:00
Edward Betts dc9989157c Refactor 2020-06-30 09:01:57 +01:00
Edward Betts 97e4501427 Proper display of save errors. 2020-04-22 17:13:03 +01:00
Edward Betts 6194874380 Allow edit via proxy to avoid global IP block 2020-04-22 16:44:04 +01:00
Edward Betts e903c4092f Add the ability to mail admin. 2020-04-22 16:43:51 +01:00
Edward Betts 95d69ef302 Add block list report to show active blocks 2020-04-22 15:03:22 +01:00
Edward Betts 0aac0e46be Increase timeout for error mails. 2020-03-03 15:17:21 +00:00
Edward Betts 97ca0aaa34 Remove some unused code. 2020-01-16 14:01:43 +00:00
Edward Betts 6ba4fc7e35 Correct URL for commons API. 2020-01-08 15:38:35 +00:00
Edward Betts 8eecad0f9e Add more detail to error mails. 2020-01-07 21:29:31 +00:00
Edward Betts 50dc706b32 identifier can be 'no value', example: Q26754456 2020-01-07 17:39:39 +00:00
Edward Betts d0ddcc96eb A human item replaced with a redirect causes confusion. 2020-01-07 15:10:59 +00:00
Edward Betts c201535d21 Drop unused import. 2020-01-01 14:23:30 +00:00
Edward Betts 63f8d0f580 Add missing changes for catching non-artwork. 2019-12-31 09:01:20 +00:00
Edward Betts f1264c8333 Remove unused fields for depicts. 2019-12-30 09:20:53 +00:00
Edward Betts cacafb1d52 Add 'get history' mediawiki API call 2019-12-29 11:22:46 +00:00
Edward Betts 3e445a3133 Add a foreign key to the triple table. 2019-12-22 10:22:46 +00:00
Edward Betts c8d6e0e9d6 Avoid crash when imageinfo is missing. 2019-12-18 19:07:32 +00:00
Edward Betts a1f72f4620 Not using nltk 2019-12-18 18:52:26 +00:00
Edward Betts b952213b23 Switch to using database for browse pages. 2019-12-18 15:06:24 +00:00
Edward Betts 7313df54f7 Rename ArtworkItem to Item and add more fields 2019-12-17 16:10:45 +00:00
Edward Betts d2cbcc4c04 Better error handling. 2019-12-17 11:45:30 +00:00
Edward Betts b5f87657ba Add missing exceptions. 2019-12-12 15:37:39 +00:00
Edward Betts b894188f1a Record page title and endpoint with query 2019-11-27 10:00:00 +00:00
Edward Betts 48fbe6c8f5 Record query row count 2019-11-26 20:11:27 +00:00
Edward Betts 1badd35362 Reformat report. 2019-11-26 19:23:48 +00:00
Edward Betts d12c85cfde Handle incomplete query 2019-11-26 18:41:35 +00:00
Edward Betts d94d1bb170 Save query template name 2019-11-26 17:21:58 +00:00
Edward Betts c649179caf Record WQDS details and show report. 2019-11-26 14:01:14 +00:00
Edward Betts cc62265a0d Handle entity without labels. 2019-11-25 15:53:31 +00:00
Edward Betts 2cbc88a947 Show existing depicts on browse page 2019-11-25 15:46:05 +00:00
Edward Betts 036a4be5ed Expand focus from paintings to more artworks
Replace all references to 'painting' with 'artwork'
2019-11-25 11:49:34 +00:00
Edward Betts 7de29233e0 Bug fix 2019-11-08 21:21:43 +00:00
Edward Betts 92040bcc9f Store Wikidata entity JSON with depicts item 2019-11-07 10:16:44 +00:00
Edward Betts 09b4b47b8d Add user table 2019-11-07 10:12:56 +00:00
Edward Betts db0eda0abf Catch and ignore more catalog exceptions 2019-10-22 22:21:25 +01:00
Edward Betts a89a947be5 Add debugging method. 2019-10-15 16:32:13 +01:00
Edward Betts 8a90bf5e3f bug fix 2019-10-14 19:59:58 +01:00
Edward Betts 039240b3c5 Chunk requests to Wikimedia Commons 2019-10-14 11:08:42 +01:00
Edward Betts 5941f28ebd Request 50 items at a time from wikibase 2019-10-14 10:45:48 +01:00
Edward Betts 66cbf3b670 Don't crash when there is no image. 2019-10-10 19:52:51 +01:00
Edward Betts d1ac75583b Refactor: move catalog code again 2019-10-10 10:58:42 +01:00
Edward Betts 312cb255c4 Refactor 2019-10-10 09:47:38 +01:00
Edward Betts bd6d13bc36 Move another function into a dedicated module 2019-10-10 09:42:16 +01:00