feat: drive gdl-sync from a file of profile URLs

Browse Source

Adds --urls-file so a run can reference a hand-maintained list rather
than repeating --profile, which is how this actually gets used: the
ARTMS accounts now live in artms_account_links.txt at the archive root.

The parser takes what a person would paste. Full URLs, scheme-less URLs
and bare usernames all work; blank lines and # comments are ignored and
duplicates dropped, so the list can be appended to carelessly. Lines that
are not profiles are rejected loudly rather than silently syncing
nothing: an Instagram post URL yields the segment "p", which would
otherwise be treated as a username and create a directory called "p".

Co-Authored-By: Claude Opus 5 <noreply@anthropic.com>

...

This commit is contained in:

ergosteur

2026-08-16 22:32:06 -04:00

co-authored by Claude Opus 5

parent 68568ef855

commit ee66b87bff

2 changed files with 70 additions and 6 deletions

Show all changes Ignore whitespace when comparing lines Ignore changes in amount of whitespace Ignore changes in whitespace at EOL

Download Patch File Download Diff File Expand all files Collapse all files

scripts/__pycache__/gdl-sync.cpython-314.pyc

BIN

Binary file not shown.