2067 Commits

Author SHA1 Message Date
bnewbold
9579bec720
update descriptions in Lexicons (#2110)
* lexicons: update descriptions in com.atproto.*

* lexicons: update descriptions in app.bsky.*

* Apply suggestions from code review

Thanks Emily!

Co-authored-by: Emily Liu <emilyliu7321@gmail.com>

* codegen description-only Lexicon updates

---------

Co-authored-by: Emily Liu <emilyliu7321@gmail.com>
2024-02-11 16:06:58 -08:00
devin ivy
d0be052e12
Support node v20 on pds distribution (#2157)
* upgrade node to v20, better-sqlite3 to v9

* fix tests, deps for node v20

* build

* add io_uring setting to pds dockerfile
2024-02-09 19:05:29 -05:00
Daniel Holmgren
758de8743d
PDS pipethrough (#2150)
* initial impl

* re-codegen

* tweak pipethrough

* wip

* read after write pipethrough

* integrate read after write

* setup pds pipethrough logic

* pipe through repo rev header

* fix up tests

* apply pipethrough to most pds routes

* apply pipethrough to remaining pds routes

* fix/tidy

* getRecord

* final details for passthrough in xrpc-server

* build

---------

Co-authored-by: Devin Ivy <devinivy@gmail.com>
2024-02-07 20:40:43 -05:00
github-actions[bot]
77118a66a7
Version packages (#2140)
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
2024-02-06 10:42:24 -05:00
Foysal Ahamed
e4ec7af036
Add date range and comment filter to queryModerationEvents endpoint (#2124)
*  Add date range and comment filter to queryModerationEvents endpoint

*  Add report type and label filters and tests

* tidy tests

*  commentKeyword -> comment and make comment and hasComment independent

*  Fix multiple label filter query

* 📝 Add changesets

* codegen tidy

* add changeset

* remove unused changeset

---------

Co-authored-by: Devin Ivy <devinivy@gmail.com>
2024-02-05 19:10:44 -05:00
devin ivy
4f25b0fd12
Track blob cids on ozone mod events (#2135)
track blob cids on ozone mod events
2024-02-05 15:05:31 -05:00
Foysal Ahamed
aa15789e11
🐛 Forward sendEmail event to moderationAgent instead of appview (#2125) 2024-02-04 23:18:27 -05:00
Daniel Holmgren
aaee2d0dc2
Email rate limits followup (#2133)
email rate limits followup
2024-02-03 19:06:07 -06:00
devin ivy
dd021b8b66
Remove all email tokens on email change (#2132)
remove all email tokens regardless of whether token was used to change email
2024-02-03 18:03:57 -05:00
Daniel Holmgren
b6b854afb9
Clear email tokens on email update (#2131)
delete email tokens on email update
2024-02-03 16:52:29 -06:00
Daniel Holmgren
4b1c8af6e3
Mount checkSignupQueue route on pds (#2116)
mount checkSignupQueue route on pds
2024-01-30 17:57:32 -06:00
Daniel Holmgren
cdb89c3b3b
Simplify appview automod (#2108)
* rm fuzzy matcher & abyss

* tidy dev env
2024-01-30 16:19:56 -06:00
Daniel Holmgren
f023494802
Remove appview feedgen (#2106)
* remove appview feedgen

* deprecate getTimelineSkeleton

* fix dev-env build

* rm unused test
2024-01-30 16:19:36 -06:00
bnewbold
8da034a98b
new year! 2024 (#2114)
new year
2024-01-30 12:52:52 -08:00
Daniel Holmgren
c048962632
Ozone !takedown labels (#2069)
* add purge labels on takedown

* wire up some cfg

* tests

* fix up tests

* purge -> takedown

* Temporary unspecced labels relating takedowns in ozone (#2101)

temporarily move to unspecced labels relating takedowns

---------

Co-authored-by: devin ivy <devinivy@gmail.com>
2024-01-27 17:29:36 -05:00
devin ivy
51aa369cd0
Include dids in bsky logs (#2015)
* include dids in bsky logs

* tidy
2024-01-26 16:43:33 -05:00
devin ivy
d03ddd02e1
Appview v1 handling clearly bad cursors (#2088)
* fail open on clearly bad appview cursors

* tidy tests
2024-01-26 16:30:18 -05:00
github-actions[bot]
61bf9fbe7f
Version packages (#2097)
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
2024-01-25 14:20:32 -06:00
Daniel Holmgren
8994d3633a
Signup queueing - Client & PDS (#2090)
* schema + codegen

* port session refresh

* pds updates

* typo

* changeset
2024-01-25 14:16:30 -06:00
github-actions[bot]
79ec5ad95d
Version packages (#2093)
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
2024-01-25 13:22:42 -06:00
Eric Bailey
4171c04ad8
Add interest tags to preferences (#2086)
* Add interestsPref

* Codegen

* Update lex

* Add method to agent, test

* Codegen

* Format

* Remove console

* Update lex, codegen, update tests

* Update tests

* Format

* Add changeset

* Update property name
2024-01-25 12:05:10 -06:00
Daniel Holmgren
39fe6b5dbf
Add getRelationships route to appview (#2085)
* codegen

* add getRelationships route
2024-01-24 19:38:12 -06:00
Daniel Holmgren
43eb4054a6
Fix typo in getRelationships (#2091)
fix typo in getRelationships + codegen
2024-01-24 19:23:01 -06:00
bnewbold
fb979b1cc5
lexicons: new app.bsky.graph.getRelationships endpoint (#2059)
* lexicons: new app.bsky.graph.getRelationships endpoint

* getRelationships: maxLength 30

* getRelationships: camelCase, consistent, simplify

* getRelationships: remove blocks; and handle in return

* lex: move graph relationships to defs file
2024-01-24 14:06:03 -06:00
github-actions[bot]
ffd6c25cc0
Version packages (#2082)
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
2024-01-24 13:36:00 -06:00
Eric Bailey
5368245a6e
Prep API package for publish (#2081) 2024-01-24 12:47:36 -06:00
Daniel Holmgren
dac5c9e202
Tagged suggestions (#2077)
* add tagged suggestions

* fix codegen

* rm unused err
2024-01-24 09:04:09 -06:00
devin ivy
6a318b9f76
Appview v1 maintaining device tokens and pushing notifications w/ courier (#2073)
* add courier proto to bsky, build

* update registerPush on appview to support registering device tokens with courier

* setup bsky notifications to send to either gorush or courier

* wire courier push into indexer, test

* courier push retries

* tidy and build
2024-01-23 21:17:32 -05:00
devin ivy
d108310575
Appview v1 generating and ingesting mute ops w/ bsync (#2067)
* build bsync protos in appview, standardize per-package proto gen directory

* configure appview with bsync, allow mute endpoints to use bsync

* import fixes in bsync

* configure appview ingester with bsync, ingest mute ops into db

* test bsync mutes roundtrip w/ appview, setup bsync in dev-env

* build

* ensure to propagate errors when bsyncOnlyMutes is on
2024-01-22 15:48:31 -05:00
github-actions[bot]
f069c67527
Version packages (#2065)
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
2024-01-19 17:24:16 -05:00
Foysal Ahamed
15f38560b9
Manage communication templates for moderation purposes (#2045)
*  Add initial lexicons to manage communication templates

*  All 3 endpoints are functional

*  Add list and delete endpoints

*  Add tests for communication template CRUD

* 🔒 Allow only admins to create and update templates

* 🧹 Cleanup according to PR review

*  Make updatedBy and createdBy optional in lexicon

*  Typo

*  Allow string id and update lexicon language

*  Fix tests

*  content -> contentMarkdown

*  Change column name in db table

* add changeset

---------

Co-authored-by: Devin Ivy <devinivy@gmail.com>
2024-01-19 17:06:37 -05:00
Devin Ivy
8932a445ea add bsync health check 2024-01-19 00:37:30 -05:00
github-actions[bot]
48298d545f
Version packages (#2063)
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
2024-01-18 18:09:50 -06:00
Daniel Holmgren
c6fc73aee6
Directly pass create account params in agent (#2062)
* directly pass create account params in agent

* changeset
2024-01-18 18:06:13 -06:00
Daniel Holmgren
b906c0cbea
Add uploadBlob rate limit (#2052)
uploadBlob ratelimit
2024-01-18 16:16:10 -06:00
github-actions[bot]
a7000f2be5
Version packages (#2036)
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
2024-01-18 15:27:18 -06:00
Daniel Holmgren
bf8d718cf9
Namespace lexicon codegen (#2039)
* namespace codegen

* fix test that uses namespace prototype

* changeset
2024-01-18 15:24:38 -06:00
Daniel Holmgren
e43396af09
Phone verification schemas (#2056)
* add phone verification schemas

* lint

* codegen

* changset
2024-01-18 15:17:57 -06:00
Ilya Siamionau
7a4486d51c
Run the publishing workflow in the original repository only (#2061) 2024-01-18 15:15:09 -06:00
devin ivy
de398b790c
Prepare docker builds of bsync (#2053)
* update bsync protos

* support optional migrations in bsync service, docker build fixes

* setup workflow for bsync build

* fix bsync image name
2024-01-18 14:21:55 -05:00
Daniel Holmgren
07a9c89e28
Do not enforce deleted lists (#2038)
* do not enforce deleted lists

* tests
2024-01-10 18:25:53 -06:00
Dimitris Apostolou
ff2f9db97e
Fix typos (#2022) 2024-01-10 12:24:14 -06:00
Daniel Holmgren
87e4641e0c
Tidy feed generator language headers (#2037)
* tidy code & return content-language headers in res

* tidy

* no undefined headers

* tidy
2024-01-10 12:23:22 -06:00
Cooper Edmunds
50f70453a9
Pass headers to feed generator (#2030)
* Pass headers to feed generator

* Allow-list headers rather than forward all by default
2024-01-09 17:33:10 -06:00
bnewbold
51fcba7a79
remove deprecated app.bsky.unspecced.getPopular (#1988)
* remove deprecated app.bsky.unspecced.getPopular lexicon

* codegen

* remove remaining references to getPopular

* changeset for getPopular removal
2024-01-09 15:29:07 -08:00
devin ivy
c2d0578b5a
Bsky appview sync service (#2031)
* init bsky-sync

* add bsync models and config

* rename bsky-sync to bsync

* protos and gen for bsync service

* start roughing-out bsync routes

* adjust bsync model, validation

* bsync auth, context, notify

* implement bsync scan mute ops, listen for mute op event

* setup basic bsync tests, misc fixes

* rename some files

* reorg bsync server routes

* reorg bsync server routes

* tests

* test input validation to addMuteOperation

* add db stats to bsync

* add bsync service

* redact bsync auth header from logs

* upgrade typescript to v5.3

* prettier on codegened bsync files
2024-01-09 15:40:35 -05:00
Daniel Holmgren
e41a25fa17
Automod: create reports using emitModerationAction (#2025)
* create reports using emitModerationAction

* fix input

* dont build
2024-01-08 17:49:31 -06:00
Daniel Holmgren
de2dbc2903
Split out moderation backend (#1970)
* mv appview

* copy

* finalize copy

* package names

* big WIP

* first pass at mod servce

* some tidy

* tidy & fix compiler errors

* rename to ozone, db migrations, add to dev-env & pds cfg

* getRecord & getRepo mostly working

* fix open handle

* get record tests all working

* moderation events working

* statuses working

* tidy test suite

* search repos

* server & db tests

* moderation tests

* wip daemon + push events

* pds fanout working

* fix db test

* fanning takedowns out to appview

* rm try/catch

* bsky moderation test

* introduce mod subject wrappers

* more tidy

* refactor event reversal

* tidy some db stuff

* tidy

* rename service to mod-service

* fix test

* tidy config

* refactor auth in bsky

* wip patching up auto-mod

* add label ingester in appview

* fix a couple build issues

* fix some timing bugs

* tidy polling logic

* fix up tests

* fix some pds tests

* eslint ignore

* fix ozone tests

* move seeds to dev-env

* move images around

* fix db schemas

* use service auth admin reqs

* fix remaining tests

* auth tests bsky

* another test

* random tidy

* fix up search

* clean up bsky mod service

* more tidy

* default attempts to 0

* tidy old test

* random tidy

* tidy package.json

* tidy logger

* takedownId -> takedownRef

* misc pr feedback

* split daemon out from ozone application

* fix blob takedown mgiration

* refactor ozone config

* do push event fanout on write instead of on read

* make suspend error work again

* add attempts check & add supporting index

* fix takedown test ref

* get tests working

* rm old test

* fix timing bug in event pusher tests

* attempt another fix for timing bug

* await req

* service files

* remove labelerDid cfg

* update snaps for labeler did + some cfg changes

* fix more snaps

* pnpm i

* build ozone images

* build

* make label provider optional

* fix build issues

* fix build

* fix build

* build pds

* build on ghcr

* fix syntax in entry

* another fix

* use correct import

* export logger

* remove event reverser

* adjust push event fanout

* push out multiple

* remove builds
2024-01-05 17:06:54 -06:00
github-actions[bot]
65254ab148
Version packages (#2021)
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
2024-01-04 19:55:23 -06:00
Eric Bailey
140677335f
Improve handling of resumeSession failures (#2010)
* Better handling of resumeSession errors

* Update test

* Format

* Pare back to only necessary

* Update handling for 500s

* Should really be update

* Update logic from feedback

* Update tests

* Feedback

* Revert debug change

* Changeset

* Bump minor
2024-01-04 19:50:59 -06:00