Package: wnpp Severity: wishlist Tags: RFP * Package name : wayparam Version : 0.3.0 Upstream Author : Aleff * URL : https://github.com/aleff-github/wayparam * License : GPL-3.0-or-later Programming Lang: Python 3 Description : Wayback CDX URL discovery and parameter normalization tool
wayparam is a cross-platform command-line tool written in Python that queries the Internet Archive Wayback Machine CDX API to retrieve historical URLs associated with a domain or a list of domains. The tool filters out "boring" URLs (such as static assets), normalizes parameterized URLs by sorting query parameters and replacing values with a placeholder, and outputs results in either plain text or JSONL format. Diagnostics and logs are written to stderr, making it safe for use in Unix pipelines. wayparam is inspired by ParamSpider, but is a complete rewrite with a more robust and maintainable architecture. Compared to ParamSpider, wayparam features async concurrency, rate limiting, retry and backoff logic, cleaner stdout/stderr separation, an included man page, and offline httpx-level integration tests using MockTransport. The project is intended for OSINT and security research workflows and does not perform any active crawling; it only queries the public Wayback CDX API. I am willing to help with maintenance and packaging if needed but honestly, I don't have much experience. -- Aleff
signature.asc
Description: OpenPGP digital signature
