fix(pagination): advance from a bare page-1 URL with numbered links (1.6.4)

[vedaant00]

Fixes #187.

Problem

On the common layout where page 1 is the bare URL (/products) and only pages 2+ carry a ?page= token, _extract_page_number returns None, and the current_num is not None guard discarded the numbered links entirely — even though they already contained the answer.

scrape_url(url, max_pages=N) therefore scraped one page and reported success. It was masked only when the site also emitted <link rel="next"> or a "Next" anchor, so it bit exactly the sites that paginate with bare numbers.

soup = BeautifulSoup('<a href="?page=2">2</a><a href="?page=3">3</a>', "html.parser")
find_next_page_url(soup, "https://x.com/list")        # None   <- crawl stops
find_next_page_url(soup, "https://x.com/list?page=2") # ?page=3

Fix

When there is no current page number, follow the lowest forward link rather than stepping from an assumed 0/1.

That distinction matters for offset-style sites. A bare URL has no offset in it, so _is_offset_style is False and _page_step would return 1 — wrong for a site that steps by 20. The links themselves carry the real values, so taking min(num > 1) handles both shapes with one rule:

current URL	links	result
/list (bare)	?page=2, ?page=3	?page=2
/list (bare)	?start=20, ?start=40	?start=20
/list?page=2	?page=2, ?page=3	?page=3 (unchanged)
/list?start=20	?start=0/20/40	?start=40 (unchanged)
/list (bare)	?page=1 only	None (no loop)

Existing behavior is untouched whenever the current URL has a page number.

Tests

Four regression tests covering the issue's acceptance criteria: bare page-1, offset-style bare page-1, unordered links, and the no-forward-link case. Three of the four fail on pre-fix code (the fourth asserts None, which was already the old behavior), verified by reverting pagination.py and re-running. The 26 existing pagination tests stay green.

604 passed, ruff check + format clean. Bumped to 1.6.4.

Also

server.json advertised 22 MCP tools; the actual count is 24 (verified against the @mcp.tool decorators). Corrected in the same bump since it ships with the release metadata.

🤖 Generated with Claude Code