edward/flickr-mail
1
0
Fork 0
Code Issues 1 Pull requests Projects Releases Packages Wiki Activity
Find photos on flickr for Wikipedia articles and contact the photographer. https://edwardbetts.com/flickr_mail/
41 commits 1 branch 0 tags 264 KiB
Find a file
Edward Betts 7b741e951f Add Flickr search term override field 
Allow users to edit the Flickr search query without changing the
Wikipedia article. Shows a text field with the current search term
(including quotes for phrase search) that can be modified and
re-submitted. The search term persists across pagination and photo
selection.

Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>
2026-02-08 13:42:18 +00:00
flickr_mail Add interaction logging and tighten model NOT NULL constraints 2026-02-08 12:34:04 +00:00
static/css Show errors, even in production. 2023-09-09 17:06:01 +03:00
templates Add Flickr search term override field 2026-02-08 13:42:18 +00:00
.gitignore Move Flickr sent-mail cookies into local config file 2026-02-07 14:41:41 +00:00
AGENTS.md Add interaction logging and tighten model NOT NULL constraints 2026-02-08 12:34:04 +00:00
download_commons_contributions.py Make commons contributions sync resilient to shallow gaps 2026-02-07 13:34:09 +00:00
download_sent_mail.example.json Move Flickr sent-mail cookies into local config file 2026-02-07 14:41:41 +00:00
download_sent_mail.py Move Flickr sent-mail cookies into local config file 2026-02-07 14:41:41 +00:00
extract_flickr_uploads.py Extract flickr_mail package with Mapped models and shared utilities 2026-02-07 13:10:49 +00:00
LICENSE Add README.md and LICENSE 2023-09-29 12:31:15 +01:00
main.py Add Flickr search term override field 2026-02-08 13:42:18 +00:00
migrate_json_to_db.py Extract flickr_mail package with Mapped models and shared utilities 2026-02-07 13:10:49 +00:00
README.md Add interaction logging and tighten model NOT NULL constraints 2026-02-08 12:34:04 +00:00
update_flickr_uploads.py Handle modern UploadWizard comments when indexing Flickr uploads 2026-02-07 13:41:27 +00:00

README.md

Flickr Mail

Tool lives here: https://edwardbetts.com/flickr_mail/

Flickr Mail is a Flask app that helps find Flickr photos for Wikipedia articles and contact photographers to request Wikipedia-compatible licensing.

What It Does

  • Searches Flickr from a Wikipedia article title/URL
  • Shows license status for each result (free vs non-free CC variants)
  • Builds a ready-to-send Flickr message for non-free licenses
  • Finds image-less articles in a Wikipedia category
  • Shows recent Commons uploads that came from Flickr mail outreach

Project Layout

  • main.py: Flask app routes and core logic
  • templates/: UI templates
  • download_sent_mail.py: sync Flickr sent messages into DB
  • download_commons_contributions.py: sync Commons contributions into DB
  • update_flickr_uploads.py: derive flickr_uploads from contributions/sent mail
  • flickr_mail.db: SQLite database

Database Pipeline

The recent uploads section depends on a 3-step pipeline:

  1. ./download_sent_mail.py updates sent_messages
  2. ./download_commons_contributions.py updates contributions
  3. ./update_flickr_uploads.py builds/updates flickr_uploads

main.py only reads flickr_uploads; it does not populate it.

UploadWizard Detection

update_flickr_uploads.py supports both Commons UploadWizard comment styles:

  • User created page with UploadWizard (older)
  • Uploaded a work by ... with UploadWizard (newer)

It first tries to extract a Flickr URL directly from the contribution comment. If absent, it falls back to Commons extmetadata.Credit.

Local Run

Install dependencies (example):

pip install flask requests beautifulsoup4 sqlalchemy

Start the app:

python3 main.py

Then open:

  • http://localhost:5000/

Refresh Data

Run in this order:

./download_sent_mail.py
./download_commons_contributions.py
./update_flickr_uploads.py

Before running ./download_sent_mail.py, create local auth config:

cp download_sent_mail.example.json download_sent_mail.local.json

Then edit download_sent_mail.local.json and set cookies_str to your full Flickr Cookie header value.

Interaction Logging

The app logs searches and message generation to the interaction_log table:

  • search_article: when a user searches for a Wikipedia article title (page 1 only)
  • search_category: when a user searches a Wikipedia category
  • generate_message: when a non-free CC message is generated for a photo

Each row records the timestamp, interaction type, client IP (from X-Forwarded-For if present), User-Agent, query, and (for message events) the Flickr and Wikipedia URLs.

Notes

  • download_commons_contributions.py uses an overlap window of known-only batches before stopping to avoid full-history scans while still catching shallow gaps.
  • If a known Commons upload is missing from flickr_uploads, re-run the full 3-step pipeline above.