signal-bot/signal_bot
Krzysztof kuhy Rudnicki 9d546fef9a feat: import a folder of photos without importing it twice
tool/tagger.py did not run at all: 48957a1 renamed pack.default_dir to
default_dirs and missed the caller, so the tagger raised ImportError at
module scope through two releases. Nothing could have caught it -- tool/ is
outside --cov and mypy ran with [signal_bot, fake_signal]. Both are widened
here, and tests/test_tool_imports.py imports every script under tool/.

--import was a filename check and shutil.copy2. Pointed at a phone export
that overlaps the album it re-imported the same photo under whatever name
the exporter used that time. It now identifies files by magic bytes, strips
them through the same media_strip path !add_photo uses, and dedups on exact
bytes twice: the source hash, then -- only for what survives -- the hash
after stripping. sources.json records both, so a second run on the same
folder is a no-op. What the album refuses is moved to _skipped/<reason>/
beside the source, never deleted.

Two things that made "strip on import" impossible until now:

media_tags claims -all= zeroes the QuickTime date tags and allows them by
value. It does not; measured, it leaves CreateDate at its real value, and
every mp4 was being refused. -time:all= is what zeroes them.

And a tag allowlist cannot see the worst class at all. IMG_6924.mp4 carries
mebx timed-metadata holding per-frame face bounding boxes and a face id,
and those survive a complete tag strip because they live in mdat as opaque
samples. media_tracks.py drops the track with ffmpeg and verifies with
ffprobe that only video and audio survived. This is not the ffmpeg mistake
media_strip warns about: that was ffmpeg replacing exiftool for tags, this
is track removal with exiftool still doing every tag, and the gate is a
positive read-back rather than an exit code.

The roster was write-once. The setup form only appeared on an empty album,
Album.setup overwrote the file whole, and keys were positional (p{len+1}),
so inserting somebody renumbered everyone after them and repointed every
tags.json entry at the wrong person. Keys now come from the highest number
in use, the form merges, and a person can be added mid-session.

--untagged filters the page and never the server's list. /media/{index} and
/api/tag both index the full album, so a shorter list server-side would
show item i of the album while tagging item i of the filtered set.

Measured on the live album: 174 source files -> 1 not media, 82 already in
pack, 24 duplicate in batch, 67 imported, and re-running imports nothing.

Co-Authored-By: Claude Opus 5 (1M context) <noreply@anthropic.com>
Claude-Session: https://claude.ai/code/session_01WBrE1b9HvFw3xvG9bJiDFt
2026-08-31 13:22:57 +02:00
..
stats feat: serve several photo albums at once, each scoped to its own groups 2026-08-31 11:58:50 +02:00
__init__.py feat: rewrite the bot so it runs, and gate it like the other repos 2026-08-29 13:05:42 +02:00
__main__.py feat: the bot can describe an envelope without quoting anybody 2026-08-30 19:29:06 +02:00
aliases.json feat: add a photo to the album from the chat, tagged, stripped and verified 2026-08-31 11:20:00 +02:00
animals.py feat: serve several photo albums at once, each scoped to its own groups 2026-08-31 11:58:50 +02:00
announce.py release: 0.1.7 «Callistus I» — a version now says which pope, and when 2026-08-30 22:12:09 +02:00
app.py fix: find exiftool the way the service does, and self-test with a photo 2026-08-31 11:40:07 +02:00
bot.py feat: serve several photo albums at once, each scoped to its own groups 2026-08-31 11:58:50 +02:00
changelog.py feat: releases are named in Latin, and land with the pope's portrait and article 2026-08-30 21:28:41 +02:00
config_env.py feat: serve several photo albums at once, each scoped to its own groups 2026-08-31 11:58:50 +02:00
config.py feat: serve several photo albums at once, each scoped to its own groups 2026-08-31 11:58:50 +02:00
context.py feat: serve several photo albums at once, each scoped to its own groups 2026-08-31 11:58:50 +02:00
counting.py feat: the message event log, and the nightly report built on it 2026-08-30 19:14:43 +02:00
decorators.py feat: serve several photo albums at once, each scoped to its own groups 2026-08-31 11:58:50 +02:00
discovery.py feat: the message event log, and the nightly report built on it 2026-08-30 19:14:43 +02:00
dispatcher.py feat: serve several photo albums at once, each scoped to its own groups 2026-08-31 11:58:50 +02:00
endpoints.py release: 0.0.7 «Telesfor» — !papież, and the bot can test itself 2026-08-30 17:06:25 +02:00
envelope_shape.py feat: the bot can describe an envelope without quoting anybody 2026-08-30 19:29:06 +02:00
external.py feat: add a photo to the album from the chat, tagged, stripped and verified 2026-08-31 11:20:00 +02:00
folding.py fix: commands resolve when typed on another alphabet's keyboard 2026-08-30 14:22:43 +02:00
groups.py feat: refuse to commit personal data, learned from outside the repository 2026-08-30 23:28:29 +02:00
help_command.py feat: serve several photo albums at once, each scoped to its own groups 2026-08-31 11:58:50 +02:00
http_client.py release: 0.0.7 «Telesfor» — !papież, and the bot can test itself 2026-08-30 17:06:25 +02:00
liveness.py feat: refuse to look healthy while deaf, and heal the container by itself 2026-08-29 19:01:55 +02:00
logging_setup.py feat: the bot can describe an envelope without quoting anybody 2026-08-30 19:29:06 +02:00
media_sniff.py feat: serve several photo albums at once, each scoped to its own groups 2026-08-31 11:58:50 +02:00
media_strip.py feat: import a folder of photos without importing it twice 2026-08-31 13:22:57 +02:00
media_tags.py feat: import a folder of photos without importing it twice 2026-08-31 13:22:57 +02:00
media_tracks.py feat: import a folder of photos without importing it twice 2026-08-31 13:22:57 +02:00
membership.py fix: a signal-api that is not up yet no longer kills the bot at boot 2026-08-30 15:23:42 +02:00
models.py feat: add a photo to the album from the chat, tagged, stripped and verified 2026-08-31 11:20:00 +02:00
pack_add.py feat: serve several photo albums at once, each scoped to its own groups 2026-08-31 11:58:50 +02:00
pack_album.py feat: import a folder of photos without importing it twice 2026-08-31 13:22:57 +02:00
pack_command.py feat: serve several photo albums at once, each scoped to its own groups 2026-08-31 11:58:50 +02:00
pack_custom.py feat: add a photo to the album from the chat, tagged, stripped and verified 2026-08-31 11:20:00 +02:00
pack_holder.py feat: add a photo to the album from the chat, tagged, stripped and verified 2026-08-31 11:20:00 +02:00
pack_import.py feat: import a folder of photos without importing it twice 2026-08-31 13:22:57 +02:00
pack_ingest.py feat: serve several photo albums at once, each scoped to its own groups 2026-08-31 11:58:50 +02:00
pack_ledger.py feat: import a folder of photos without importing it twice 2026-08-31 13:22:57 +02:00
pack_load.py feat: add a photo to the album from the chat, tagged, stripped and verified 2026-08-31 11:20:00 +02:00
pack_people.py feat: import a folder of photos without importing it twice 2026-08-31 13:22:57 +02:00
pack_random.py feat: serve several photo albums at once, each scoped to its own groups 2026-08-31 11:58:50 +02:00
pack_replies.py feat: add a photo to the album from the chat, tagged, stripped and verified 2026-08-31 11:20:00 +02:00
pack_report.py feat: import a folder of photos without importing it twice 2026-08-31 13:22:57 +02:00
pack_store.py feat: add a photo to the album from the chat, tagged, stripped and verified 2026-08-31 11:20:00 +02:00
pack.py feat: serve several photo albums at once, each scoped to its own groups 2026-08-31 11:58:50 +02:00
popes_command.py feat: serve several photo albums at once, each scoped to its own groups 2026-08-31 11:58:50 +02:00
popes.json release: 0.0.7 «Telesfor» — !papież, and the bot can test itself 2026-08-30 17:06:25 +02:00
portcheck.py feat: make the bot actually reply on Signal, and gate every way it went silent 2026-08-29 14:37:27 +02:00
portraits.py release: 0.0.7 «Telesfor» — !papież, and the bot can test itself 2026-08-30 17:06:25 +02:00
quoting.py feat: answer the message that asked, not just the room 2026-08-29 23:01:01 +02:00
registry.py feat: serve several photo albums at once, each scoped to its own groups 2026-08-31 11:58:50 +02:00
reporting.py fix: the evening report is one message, not one per thing it has to say 2026-08-30 22:49:51 +02:00
roster.py feat: the message event log, and the nightly report built on it 2026-08-30 19:14:43 +02:00
scheduler.py feat: rewrite the bot so it runs, and gate it like the other repos 2026-08-29 13:05:42 +02:00
schema.py feat: the message event log, and the nightly report built on it 2026-08-30 19:14:43 +02:00
selftest.py fix: find exiftool the way the service does, and self-test with a photo 2026-08-31 11:40:07 +02:00
startup_retry.py feat: the message event log, and the nightly report built on it 2026-08-30 19:14:43 +02:00
startup.py feat: the message event log, and the nightly report built on it 2026-08-30 19:14:43 +02:00
store.py feat: the message event log, and the nightly report built on it 2026-08-30 19:14:43 +02:00
transport_base.py feat: add a photo to the album from the chat, tagged, stripped and verified 2026-08-31 11:20:00 +02:00
transport_fake.py feat: add a photo to the album from the chat, tagged, stripped and verified 2026-08-31 11:20:00 +02:00
transport_rest.py feat: add a photo to the album from the chat, tagged, stripped and verified 2026-08-31 11:20:00 +02:00
trust.py feat: the message event log, and the nightly report built on it 2026-08-30 19:14:43 +02:00
versioning.py release: 0.2.1 «Pontianus» — !add_photo and !random for the group 2026-08-31 12:15:02 +02:00