Skip to content

Remove donor-repo leftovers - #5

Merged
jehrr merged 1 commit into
mainfrom
fix/donor-leftovers
Sep 28, 2026
Merged

jehrr merged 1 commit into
mainfrom
fix/donor-leftovers

Conversation

@jehrr

@jehrr jehrr commented Sep 23, 2026

Copy link
Copy Markdown
Collaborator

Fixed

  • User-visible --help: playwright_scraper.py --retries said "an empty hub category is a correct answer" (Tokopedia's wording). Now matches the pyppeteer/Selenium engines, which already said it right: an SEO landing page or a cityless URL having no grid.
  • playwright_scraper.py retry comment said "one page past the end of a listing has no products", which cannot happen on a site that ignores ?page=N. Rewritten to the two empty cases this repo measures.
  • CONTRIBUTING.md exit-code bullet: "including a hub category" -> "including an SEO landing page or a cityless URL".
  • bug_report.yml placeholder "96 products, as the README says a category page yields" (Farfetch's figure) -> "About 20 cars per scrolled batch" (README: 20 cars per batch).
  • captcha_solver.py: removed "See 'No DataDome solver' below", which points at a section that does not exist.
  • SECURITY.md said "no releases or version tags"; v0.1.0/v0.1.1 exist.

Kept, deliberately

  • hub as a page kind and a column: Spinny's own concept (the /used-cars/ SEO page; a car's location hub), not a leftover.
  • product_parser.py "a sibling site answers with Akamai" and the tokopedia <title> note, smoke_test.py MediaMarkt note, captcha_solver.py farfetch-scraper notes, .gitignore craigslist note: sibling provenance.
  • "datadome" in the vendor marker list: generic vendor name.
  • CHANGELOG released sections (they name sibling versions): history.
  • Badges: already in family order, and "runs without an account" is honest here (README: 62 cars with no key and no proxy, and no refusal ever observed).
  • Repo description/topics: Spinny-specific; price-monitoring fits (cars have prices).

Suite: 561 PASS, OK before and after (engine groups skipped, engines absent). ci_checks.py --secret-check --help-check --sample-check green.

🤖 Generated with Claude Code

- playwright_scraper --retries help and retry comment: "empty hub
  category" / "one page past the end of a listing" replaced with the
  twins' wording (SEO landing page or cityless URL); CONTRIBUTING too.
- bug_report "96 products ... category page" placeholder -> 20 cars
  per scrolled batch.
- captcha_solver.py: dangling "No DataDome solver" reference removed.
- SECURITY.md: no longer claims the project has no releases.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
@jehrr
jehrr force-pushed the fix/donor-leftovers branch from 7b7f27b to bc1e4bf Compare September 28, 2026 19:50
@jehrr
jehrr merged commit 55876b1 into main Sep 28, 2026
7 checks passed
@jehrr
jehrr deleted the fix/donor-leftovers branch September 28, 2026 22:36
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant