Release: shot-scraper 1.11 Some minor improvements, mainly around command option consistency and making the server: mechanism used by both shot-scraper video and shot-scraper multi work if the server takes longer than a second to start serving traffic. server: processes used by shot-scraper multi and shot-scraper video now wait up to 30 seconds for the target URL to accept connections, polling for port availability and replacing the previous fixed one-second delay. #197 The shot-scrap ✦ AI generated
The multi-shot YAML configuration format was extended with a js_file key mirroring the new --js-file CLI option.
Simon Willison: shot-scraper multi supports the equivalent js_file: YAML key.
shot-scraper's internal server startup logic was changed from a fixed one-second wait to active polling for port availability, waiting up to 30 seconds, fixing failures when a server takes longer than a second to start.
Simon Willison: server: processes used by shot-scraper multi and shot-scraper video now wait up to 30 seconds for the target URL to accept connections, polling for port availability and replacing the previous fixed one-second delay.
A --timeout option was added to the javascript and html subcommands so their interface matches the rest of shot-scraper's commands.
Simon Willison: The shot-scraper javascript and shot-scraper html commands now have a --timeout option for consistency with other commands.
A new --js-file flag lets several shot-scraper commands load JavaScript from a file, stdin, or a GitHub-hosted script instead of only inline strings.
Simon Willison: The shot-scraper, pdf, html, accessibility and har commands now have a --js-file option for loading JavaScript from a local file, standard input or gh:username/script, as an alternative to --javascript which accepts the string of JavaScript directly as an argument.
extends · 1