* setup triage user on pds, update moderator username (invalidates old token)
* initial pass on triage access on pds, limit access to email addrs
* apply moderator vs triage rules on taking and reversing mod actions for pds
* update pds tests for triage auth role
* setup moderator and triage roles on bsky appview
* apply mod and triage access rules to bsky admin endpoints
* reframe admin auth as role-based auth, tidy auth apis
* tidy
* build
* revert change to basic auth username for role-based auth
* add indices
* add record index to bsky
* sync-up bsky index migration, remove duplicate index
* backpressure on bsky backfill indexing (#1268)
* backpressure on bsky backfill indexing
* skip image resolution for text labeler
* increase background queue concurrency for backfill
* tidy
* Proxy timeline skeleton construction (#1264)
proxy timeline skeleton construction to appview
* Only pass through known params on timeline skeleton (#1270)
only pass through own params
* Require headers on getRecord proxy (#1271)
require headers on getRecord proxy
* Add boolean for enabling generic appview proxying (#1273)
* add boolean config for enabling generic proxying
* tweak
* tweak cfg var name
* tweak
* 🐛 Only ignore reports for specific at-uri when ignoreSubject contains at-uri (#1251)
* Move timeline construction to appview (#1274)
full switch timeline construction to appview
* Better propagate errors on repo streams (#1276)
better propgate errors on repo streams
* Log pds sequencer leader stats (#1277)
log pds sequencer leader stats
* Explicit dns servers (#1281)
* add ability to setup explicit dns servers
* cleanup
* fix
* reorder
* pr feedback
* Thread through id-resolver cfg (#1282)
thread through id-resolver-cfg
* Bsky log commit error (#1275)
* don't bail on bad record index
* add build
* temporarily disable check, full reindex on rabase
* don't bail on bad record index during rebase, track last commit on rebase
* log bsky repo subscription stats
* add running and waiting count to repo sub stats
* re-enable fast path for happy rebases
* only hold onto seq in cursor consecutivelist, don't hold onto whole completed messages
* Misc scaling (#1284)
* limit backsearch to 1 day instead of 3
* lower like count threshold
* bump to 6
* disable like count check
* disable with friends
* preemptively cache last commit
* inline list mutes
* actor service
* label cache
* placehodler on popular with friends
* bulk sequence
* no limit but chunk
* bump chunk to 5k
* try 10k
* fix notify
* tweaking
* syntax
* one more fix
* increase backfill allowance
* full refresh label cache
* limit 1 on mute list
* reserve aclu handle
* clean up testing with label cache
* note on with-friends
* rm defer from label cache
* label cache error handling
* rm branch build
* build appview
* update indices
---------
Co-authored-by: Devin Ivy <devinivy@gmail.com>
Co-authored-by: Foysal Ahamed <cfaion341@gmail.com>
* limit backsearch to 1 day instead of 3
* lower like count threshold
* bump to 6
* disable like count check
* disable with friends
* preemptively cache last commit
* inline list mutes
* actor service
* label cache
* placehodler on popular with friends
* bulk sequence
* no limit but chunk
* bump chunk to 5k
* try 10k
* fix notify
* tweaking
* syntax
* one more fix
* increase backfill allowance
* full refresh label cache
* limit 1 on mute list
* reserve aclu handle
* clean up testing with label cache
* note on with-friends
* rm defer from label cache
* label cache error handling
* rm branch build
* don't bail on bad record index
* add build
* temporarily disable check, full reindex on rabase
* don't bail on bad record index during rebase, track last commit on rebase
* log bsky repo subscription stats
* add running and waiting count to repo sub stats
* re-enable fast path for happy rebases
* only hold onto seq in cursor consecutivelist, don't hold onto whole completed messages
* remove post_hierarchy from db model and indexing in bsky appview
* update bsky appview getPostThread to use recursive query to build thread
* add covering index to speed-up descendents query
* tidy post/notification processing w/o post_hierarchy
* tidy, disallow infinitely following reply cycles
* run with-test-db in monorepo test
* improve pg script
* tidy
* namespace bsky pg schemas
* differentiate schemas
* clean up script
* first pass at invalid handles in appview
* tests for handle invalidation
* move mock to instance instead of prototype
* change network mocks in general
* fixing pagination on actor-search
* fix snap & normalize handles on index
* handling did pagination + update tests
* one last update
* use for no key update
* use a tx advisory lock for repo updates
* skip tests for sqlite
* move check of commit swap on rebase
* do lock before formatting rebase
* hash schema in for lock id
* no tx lock in sqlite
* move rebase formatting to tx
* move dialect check
* rm log
* make the lock ids a bit safer
* change how we do lock id
* refactor id generator
* add compression
* compress carfiles
* update package version
* add tests
* one more test
* remove compressible dep
* add gzip to appview
* fix package.json
* remove webcrypto, upgrade @noble/curves, normalize p256 interface
* cleanup
* Test vectors for secp and p256 signature verification (#737)
Add test vectors for secp and p256 signature verification
* fix up test vectors
* add explicit test vectors for high-s signatures
* tidy json to pass verify check
---------
Co-authored-by: devin ivy <devinivy@gmail.com>
* sync-up bsky appview to apply takedowns during hydration from #1232
* apply blocks and mutes on bsky appview custom algos
* hit index on with-friends algo pagination
* more performant query for fetching invite codes with uses
* tidy
* simplify query for actor typeahead for maximal use of trigram index
* add cid to ListView and ListViewBasic
* add test for mute list embed
* add support for list embeds views
* test
* port to appview
* update missing snap
---------
Co-authored-by: dholms <dtholmgren@gmail.com>
* Add languages field to post record
* helper for parsing bcp47
* add language format to lexicon
* codegen for post record langs field
* re-export language parsing in api package
* tests and tidy for lexicon language format
* index post langs, in-progress
* update snapshots, fixes record-with-media embed issue
* index post langs on bsky appview
* don't bother indexing post langs in pds appview, tidy
* temporarily lower scroll window to 3 days
* lower feed date threshold to 1 day
* verify at least one follow
* tidy
* follow count level
* fix limi
* up low follow count
* pare down with-friends query, control join order
* do takedown checks in hydration
* move more takedown checks
* don't include placeholders for takendown replies in threads
* remove follow count logic
* bump cutoff from 1 to 3
* tidy
* add back in date threshold
---------
Co-authored-by: Devin Ivy <devinivy@gmail.com>
* Don't serve high-level details about taken-down feedgens
* Takedown checks on sync routes
* Use simpler check for takedowns on sync routes
* ensure takendown feedgens are handled in bsky appview
lexicon: remove 'infos' field from subscriptions
This is unused in any current lexicons, and not actually implemented
anywhere in code. We refactored "info" messages in to regular messages
within a union.
