Commit graph

144 commits

Author SHA1 Message Date
Edward Betts 54151bb1bb Add missing code 2023-05-14 10:38:11 +02:00
Edward Betts 733ca3aa8f Update 2023-05-13 21:57:58 +02:00
Edward Betts c607351699 Update 2023-05-13 15:01:28 +02:00
Edward Betts 6d9c7fb1bc Include identifiers in item details API call 2022-04-18 12:52:11 +01:00
Edward Betts 90b83e93ad Add methods to get item identifiers 2022-04-18 12:51:44 +01:00
Edward Betts c95b58fde9 Reformat with black 2022-04-18 12:51:02 +01:00
Edward Betts 74788872a3 Add docstrings 2022-04-18 12:26:04 +01:00
Edward Betts 46db0b7401 Bug fix 2022-04-18 12:25:50 +01:00
Edward Betts 302da85e33 Optional isa_filter for wikidata_isa_counts 2022-04-18 12:25:38 +01:00
Edward Betts 87005dea18 New API call to get items in a place 2022-04-18 12:24:45 +01:00
Edward Betts a81cedaae0 Sometimes the address->country field is missing 2022-04-17 17:06:46 +01:00
Edward Betts e07af0b2a4 Various improvements 2022-04-08 10:44:39 +01:00
Edward Betts d0ddd5204c Various improvements 2022-04-08 10:41:18 +01:00
Edward Betts 697fdf1d6d Remove unused code 2022-04-08 10:37:59 +01:00
Edward Betts c1e53c727f Improve date formatting 2022-04-08 10:35:21 +01:00
Edward Betts 4645133247 Include more dates in item detail 2021-11-19 15:43:18 +00:00
Edward Betts f60b938dc1 Avoid name match crash for OSM objects with no name 2021-11-19 15:43:04 +00:00
Edward Betts c2cc7ba5b1 Bug fix slow get_part_of for items with multiple markers 2021-11-19 15:40:11 +00:00
Edward Betts cfa912102c Add name_match to nearby OSM candidates API call. 2021-11-14 09:47:55 +00:00
Edward Betts 4f6f0ed086 Remove unused code 2021-11-14 08:01:19 +00:00
Edward Betts 5693bc6265 Code formatting 2021-11-14 07:58:40 +00:00
Edward Betts 9a841921f4 Include labels for ISA items in item detail. 2021-11-13 20:19:04 +00:00
Edward Betts 1771f19f56 Alert admin about unsupported time precision 2021-11-13 16:41:15 +00:00
Edward Betts 7b181cd1b3 Better output for centuries in format_wikibase_time + tests. 2021-11-13 16:27:46 +00:00
Edward Betts fd5829f8d2 Accept precision=7 (century) for time format 2021-11-13 10:45:46 +00:00
Edward Betts b22d4058fd Add new get_tags_for_isa_item function 2021-11-13 10:44:56 +00:00
Edward Betts ed56bdc767 Add industrial park (Q329683) to stop list. 2021-11-12 12:18:53 +00:00
Edward Betts 734dd4025c Make skip_tags global. 2021-11-12 12:17:59 +00:00
Edward Betts 66f214a51b Don't call session.commit in get_item function. 2021-11-12 12:17:15 +00:00
Edward Betts 14abffe79c Avoid crash when searching for USA 2021-10-22 10:01:46 +01:00
Edward Betts 9c426b2918 Item methods to work out if it is a linear feature 2021-10-22 09:54:04 +01:00
Edward Betts 38e23ec8cc New method to get IsA details for item 2021-10-22 09:53:40 +01:00
Edward Betts f291ce993e New table to store extra tags/keys
We get the OSM tags/keys for matching from the item types in Wikidata.

Sometimes we want to check extra tags/keys without adding them to
Wikidata.

This new table is a place to store them, instead of having them in the
source code.

In the future normal users will be able to add or remove extra
tags/keys.
2021-10-22 09:44:53 +01:00
Edward Betts c1fc249a14 Remove unused code 2021-10-22 09:43:36 +01:00
Edward Betts dd7a92de77 Update extra keys 2021-10-22 09:43:14 +01:00
Edward Betts 7a3cb474ac Improve error handling
* Report errors to admin by e-mail
* Return details of error in JSON for API calls
* Show error details page for non-API calls
2021-10-22 08:02:46 +01:00
Edward Betts db7b13b706 Skip more tags 2021-10-15 09:49:08 +01:00
Edward Betts 8efbc8a9c1 assembly plant (Q47509284) should match landuse=brownfield 2021-10-09 18:04:52 +02:00
Edward Betts b4882a8e9f Add some extra tags to consider 2021-10-09 13:00:43 +02:00
Edward Betts b49d92b0bd Include heritage designation in Wikidata item details 2021-10-06 18:43:37 +02:00
Edward Betts c47590dd65 Switch save default from mock to live. 2021-08-05 08:43:15 +02:00
Edward Betts 95a9d16564 More tags to check for 2021-07-30 16:05:18 +02:00
Edward Betts 9b7f6ee878 Add item type filter 2021-07-30 16:02:41 +02:00
Edward Betts 3d578680a9 Consider roads to be streets 2021-07-23 14:39:19 +02:00
Edward Betts 641490f4ea Library items don't need to look for the Key:office tag 2021-07-23 14:38:13 +02:00
Edward Betts a1a3695857 Bug fix for items with multiple locations 2021-07-22 17:09:04 +02:00
Edward Betts 2760cdb940 Use sets in get_item_tags 2021-07-22 17:07:26 +02:00
Edward Betts 206f25b343 Add extra tags 2021-07-22 17:01:56 +02:00
Edward Betts 8d8f16d757 Remove debugging output 2021-07-22 15:10:40 +02:00
Edward Betts 867e77ab7b Switch to SQLAlchemy Core for OSM objects
osm2pgsql creates tables without primary keys. Some OSM objects are
split into multiple table rows to help with PostGIS index performance.

Adjust the code to be aware of this.

Also add name matching for streets.
2021-07-22 14:47:38 +02:00
Edward Betts 480df60d24 A thoroughfare is a type of street 2021-07-22 09:48:28 +02:00
Edward Betts a56387c4d9 Add get_osm method to Line class 2021-07-16 11:14:49 +02:00
Edward Betts 66904c061a Add per user mock upload toggle with warnings 2021-07-16 11:14:05 +02:00
Edward Betts 3e5dc908fa Adjust distance and limit for nearby OSM 2021-07-16 11:10:37 +02:00
Edward Betts dfed99a8bc Include centroids in nearby OSM list 2021-07-16 11:09:59 +02:00
Edward Betts 6d4a416f5a no need to include OSM URL in OSM with wikidata tag API reply 2021-07-16 11:09:52 +02:00
Edward Betts 9090e67bad Add more extra tags 2021-07-16 09:59:06 +02:00
Edward Betts 5a42e100c7 Improve OSM search 2021-07-11 17:19:21 +02:00
Edward Betts 072e5167db Increase nominatim search limit 2021-07-11 17:15:27 +02:00
Edward Betts df2e514b02 More detail for part_of, not just name 2021-07-11 17:14:50 +02:00
Edward Betts fd76bcaa37 Include candidate OSM type and ID in nearby search 2021-07-11 17:14:31 +02:00
Edward Betts cb1864059a Add extra tags for matching 2021-07-11 17:13:35 +02:00
Edward Betts 43e11cdfba Add code that was missing from repo 2021-07-08 14:33:32 +02:00
Edward Betts 6b413ef553 Add extra tags for natural watercourse (Q55659167) 2021-07-08 14:33:11 +02:00
Edward Betts 0658976246 Handle items with no label 2021-07-06 17:24:57 +02:00
Edward Betts 792bfa176d stream (Q4022) can match Key:waterway 2021-07-05 15:26:07 +02:00
Edward Betts 22cfe64896 Include more detail in OSM tags API call 2021-07-03 13:39:37 +02:00
Edward Betts c404c9a752 New check_is_street_number_first function 2021-07-03 13:38:37 +02:00
Edward Betts 1ab09a2864 Consider more Wikidata properties when looking for OSM tags 2021-07-03 13:37:30 +02:00
Edward Betts e62dd4d1d6 Improve OSM name handling 2021-07-02 11:14:37 +02:00
Edward Betts 906bdb7256 Add extra tags for museum and medical organization 2021-07-02 11:09:31 +02:00
Edward Betts 0aa2bfc4b7 Show date close date (P3999) in item detail 2021-07-02 11:08:53 +02:00
Edward Betts 72c32f38ce Also skip Key:addr and Key:lit 2021-07-02 11:04:43 +02:00
Edward Betts f76ace2a98 Switch from Geography to Geometry meant distances were wrong. 2021-06-28 11:51:11 +02:00
Edward Betts 238fbeef05 Avoid matching tram stops with buildings 2021-06-28 11:50:37 +02:00
Edward Betts ed113d8d71 Add Key:highway as extra tag for thoroughfare (Q83620) 2021-06-28 11:48:39 +02:00
Edward Betts 1fc822c152 Bug fix lat/lon order 2021-06-28 11:48:02 +02:00
Edward Betts 08684fd9c4 Ignore Key:lit to get better matches for streetlamps 2021-06-25 15:04:33 +02:00
Edward Betts 3f18ea2816 Key:lit should not match lit=no 2021-06-25 14:59:48 +02:00
Edward Betts 34b2d0fa05 Split API logic out of web_view.py 2021-06-25 14:52:42 +02:00
Edward Betts e25aaa5ec6 Admin page for checking skip IsA list 2021-06-25 14:52:06 +02:00
Edward Betts 2c88e5402c Add code for uploading, mocked for now. 2021-06-24 18:40:59 +02:00
Edward Betts b03ae32a9e Add EditSession table 2021-06-24 18:39:23 +02:00
Edward Betts c563d440fc Fix typo in commented out code 2021-06-24 18:39:09 +02:00
Edward Betts 7ca1229380 Switch type from Geography to Geometry
Use Geometry type for item location. Improves performance.
2021-06-24 18:37:23 +02:00
Edward Betts 7aaa18cf24 Add Changeset class 2021-06-20 15:01:23 +02:00
Edward Betts ae7d68462f Show Wikidata API reply on JSON parse fail 2021-06-20 14:47:04 +02:00
Edward Betts b4a948e9ef shopping street (Q21000333) is a type of street 2021-06-16 17:51:47 +02:00
Edward Betts 735e833fc9 Add OSM login 2021-06-16 15:42:25 +02:00
Edward Betts d407224f35 Add two methods to Item class 2021-06-15 00:08:24 +02:00
Edward Betts fa3a2880bf Column property for EWKT 2021-05-14 17:04:01 +02:00
Edward Betts 95366a76dd Add missing code 2021-05-12 16:00:51 +02:00
Edward Betts 8fea2a8aa7 Add code for downloading Wikidata items 2021-05-08 11:05:00 +02:00
Edward Betts e3cefcfcbd Show images in popups 2021-05-08 10:39:06 +02:00