Commit graph

3 commits

Author SHA1 Message Date
323a30d9e0 Read build_dir from ~/.config/newegg-hdd/config
Config file uses INI format:

  [newegg-hdd]
  build_dir = /path/to/output

Falls back to output/ in the script directory if the config file or
key is absent.

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>
2026-04-03 15:23:02 +01:00
2dc799ecaa Switch to Playwright to bypass Newegg bot detection, closes #2
Newegg now blocks requests-based scraping; replace with Playwright
using headless Chromium with mouse simulation to pass bot detection.
Also fix hardcoded build output path, use os.makedirs for nested dirs,
update category labels (HDD/SATA SSD/NVMe SSD), drop near-empty 2.5"
internal and laptop HDD categories, and fix invalid HTML in index
template (h2 inside table cells).

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>
2026-04-03 15:06:49 +01:00
55bb3697b6 Initial commit 2023-10-06 18:33:31 +01:00