noemi ☂️ is a user on social.coop. You can follow them or interact with them if you have an account anywhere in the fediverse.

oh, maybe you all would know this.

any tips for scraping a -based site for the urls of all posts by a particular author? I tried a few combinations of lynx -dump, wget, & grep but don't know enough about any of them.

i.e. https://site.tld/author/authorsname, https://site.tld/author/authorsname/page/2, page/3, etc., where the posts are like https://site.tld/1970/01/01/title-of-post

@nev Have you looked at the RSS feed for the author? Hopefully it will provide you the links on a more parsing-friendly format.

@noemi oh! i didn't think of that. thanks for the tip

noemi ☂️ @noemi

@nev No problem! Let me know if you need any help. :)