2067 Commits

Author SHA1 Message Date
devin ivy
cb2eb585e4
Fix inclusion for reposts on author feed w/ posts_and_author_threads (#2355)
appview: fix inclusion for reposts on author feed w/ posts_and_author_threads
2024-03-20 14:17:00 -04:00
bnewbold
6e552a26da
lexicon nits: use string format uri in more places (#2348)
* lexicons: use format=uri for more bsky URLs

* lexicons: use format=uri for URLs in server description (links to policies)

* codegen lex changes
2024-03-20 10:17:28 -07:00
bnewbold
f8dffa23eb
lex: deprecate getRecord commit param (#2349)
* lexicons: mark getRecord commit param as deprecated

* codgen lex description tweak
2024-03-20 10:17:09 -07:00
Matthieu Sieben
c8a5fb4c92
Avoid un-necessarily loading the keypair when creating an ActorStoreReader (#2319)
perf(pds): avoid un-necessarily loading the keypair when creating an ActorStoreReader
2024-03-20 10:34:01 +01:00
devin ivy
faa8d2faed
Exclude posts from author feed when they don't fit into a self-thread (#2347)
* appview: exclude posts from author feed when they don't fit into a self-thread

* tidy
2024-03-19 19:53:31 -04:00
github-actions[bot]
dbda260a21
Version packages (#2345)
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
2024-03-19 16:02:56 -05:00
Eric Bailey
abc6f82da3
Handle apostrophes and other punctuation when muting words (#2344)
Support muted words with apostrophes/punct
2024-03-19 15:59:20 -05:00
github-actions[bot]
b4346727f7
Version packages (#2343)
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
2024-03-19 14:09:41 -05:00
Eric Bailey
eb7668c07d
Add changeset (#2342) 2024-03-19 14:03:26 -05:00
devin ivy
c28e374868
Appview: add associated.labeler info to all profile views (#2341)
* lexicon: add associated field to profile and profile-basic views, for indicating whether labeler

* appview: add associated.labeler to profile and profile-basic views

* dev-env: downgrade get-port, non-esm-only version
2024-03-19 12:26:14 -04:00
Devin Ivy
ae4d0f9f59 fix dockerfiles, include new tsconfigs 2024-03-18 18:55:38 -04:00
github-actions[bot]
07ec9ea749
Version packages (#2339)
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
2024-03-18 18:24:07 -04:00
Paul Frazee
36f2e966cb
Fix: correctly detect blocked QPs when moderating posts (#2338)
* Fix: correctly detect blocked QPs when moderating posts

* Add changeset
2024-03-18 14:30:20 -07:00
Matthieu Sieben
f689bd51a2
Build system rework (#2169)
* refactor(crypto): remove circular dependency

* refactor(crypto): expose compress/decompress as part of the DidKeyPlugin interface

* fix(crypto): remove import from private file

* refactor: isolate tsconfig

* fix: remove unused bench file

* chore(repo): remove unused deps

* fix(ozone): properly list dependencies

* fix(services): do lint js files

* fix(services/pds): remove unused deps

* chore(pds): remove bench

* chore(dev-env): remove unused deps

* chore(api): remove bench

* remove unused babel.config.js files

* fix: remove .ts extension from import

* fix(pds): remove imports of src files

* fix(tsconfig): properly list all projects

* fix(dev-env): remove imports of src files

* fix(bsky): remove direct import to crypto src

* fix(api): remove imports to api internals

* chore(build): prevent bundling of built output

* chore(dev): add "dev" script to build in watch mode

* chore(deps): move ts-node dependency where it is actually used

* fix(deps): add dev-env as project dependency

* fix(xrpc-server): properly type kexicon

* fix(bsky): improve typings

* fix(pds): fully type formatRecordEmbedInternal return value

* fix(repo): remove imports from @ipld/car/api

* feat(dev-env): re-export BskyIngester

* fix: properly lint & type jest config & test files

* fix(ci): test after build

* fix(types): use NodeJS.Timeout instead of NodeJS.Timer

* fix(bsky): make types exportable

* fix(ozone): make types exportable

* fix(xrpc-server): make types exportable

* fix(xprc-server): make code compliant with "node" types

* fix(xrpc-server): avoid accessing properties of unknown

* chore(deps): update @types/node

* feat(tsconfig): narrow down available types depending on the package's target environment

* fix(pds): remove unused prop

* fix(bsync): Database's migrator not always initialized

* fix(dev-env): remove unreachable code

* fix(xrpc-server): remove unused import

* fix(xrpc-server): mark header property as abstract

* fix(pds): initialize LeakyTxPlugin's txOver property

* fix(bsky): initialize LeakyTxPlugin's txOver property

* fix(bsky): remove unused migrator from DatabaseCoordinator

* fix(bsky): Properly initialize LabelService's cache property

* fix(ozone): Database's migrator not initialized

* fix(ozone): initialize LeakyTxPlugin's txOver property

* fix(crypto): ignore unused variable error

* feat(tsconfig): use stricter rules

* feat(tsconfig): enable useDefineForClassFields

* feat(xrpc-server): add support for brotli incoming payload

* fix(xrpc-server): properly parse & process content-encoding

* fix(common:stream): always call cb in _transform

* tidy/fix tests and service entrypoints

* Revert "fix(xrpc-server): properly parse & process content-encoding"

This reverts commit 2b1c66e153820d3e128fc839fcc1834d52a66686.

* Revert "feat(xrpc-server): add support for brotli incoming payload"

This reverts commit e710c21e6118214ddf215b0515e68cb87299a952.

* remove special node env for tests (defaults to jest val of "test")

* kill mute sync handler on disconnect

* work around connect-es bug w/ request aborts

* style(crypto): rename imports from uint8arrays

* fix update package-lock

* fix lint

* force hbs files to be bundled as cjs

* fix: use concurrently instead of npm-run-all

npm-run-all seems not to be maintained anymore. Additionally, concurrently better forwards signals to child processes.

* remove concurrently alltogether

* ignore sqlite files in services/pds

* fix verify

* fix verify

* tidy, fix verify

* fix blob diversion test

* build rework changeset

---------

Co-authored-by: Devin Ivy <devinivy@gmail.com>
2024-03-18 17:10:58 -04:00
futur
0a2464cb67
Remove unused dependencies (#2327) 2024-03-18 16:01:15 -04:00
github-actions[bot]
f45eef3414
Version packages (#2330)
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
2024-03-16 10:19:29 -05:00
Eric Bailey
7dd9941b73
Remove unecessary escapes (#2328) 2024-03-16 10:14:50 -05:00
Foysal Ahamed
3d5ad925bb
🐛 Append path to base url when diverting blob (#2307) 2024-03-15 15:47:11 -04:00
devin ivy
011aa22b84
Labeler takedowns (alternate) (#2322)
* build hydration ctx in each handler

* test hydration w/ takendown labeler

* tidy

* handle and test labeler takedowns by label

* appview/ozone: fix admin repo search
2024-03-15 10:59:13 -04:00
devin ivy
506614fb7c
Appview: fix lookup for labeler via repo.getRecord (#2324)
appview: fix lookup for labeler via repo.getRecord
2024-03-14 19:27:48 -04:00
github-actions[bot]
a1e1d9332d
Version packages (#2323)
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
2024-03-14 13:19:30 -04:00
Devin Ivy
b95c3955d0 ozone changeset 2024-03-14 13:17:03 -04:00
devin ivy
99b6aee18e
Dedupe labels during appview hydration (#2317)
* appview: reproduce duped labels

* appview: dedupe labels in hydration

* tidy types
2024-03-14 09:57:24 -04:00
Daniel Holmgren
410bc5666c
Second pass on no false negs in labels (#2315)
second pass on no false negs in labels
2024-03-13 18:46:00 -05:00
github-actions[bot]
f42f548e1b
Version packages (#2314)
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
2024-03-13 19:19:48 -04:00
Devin Ivy
971d3e4c26 add ozone and pds changesets 2024-03-13 19:12:13 -04:00
devin ivy
722d4173ee
PDS contact email address (#2313)
* lexicon: add pds server contact email

* pds: configuration for contact email address
2024-03-13 19:05:47 -04:00
Paul Frazee
2194807644
Fix agent.clone() - copy the pdsUrl config (#2312)
* Fix agent.clone() - copy the pdsUrl config

* Add changeset
2024-03-13 15:58:10 -07:00
Daniel Holmgren
069d1432dc
Remove false neg on the labels that ozone emits (#2310)
* remove `neg` on the labels that ozone emits

* no negs in appview either

* no negs on self-labels

* no neg on self labels in ozone either

* fix query labels test
2024-03-13 17:33:50 -05:00
Daniel Holmgren
16ac2ef0b3
Add specced takedown labels (#2309)
* add specced takedown labels

* fix up tests

* fix test

* only reverse takedown labels
2024-03-13 17:33:43 -05:00
Daniel Holmgren
a0625ba40f
Ozone update sig on label overwrite (#2308)
ozone update sig
2024-03-13 13:47:40 -05:00
github-actions[bot]
b286cd1a84
Version packages (#2305)
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
2024-03-13 12:50:35 -05:00
Daniel Holmgren
4eaadc0acb
Labeler API Changeset (#2302)
add changsets for labeler api changes
2024-03-13 12:48:36 -05:00
Eric Bailey
84e72c6607
Mod sdk fixes (#2304)
* Adds fix for missing default labelers

* Update tests
2024-03-13 10:48:05 -07:00
Daniel Holmgren
89aa232531
Fix output type on subscribeLabels (#2303)
fix output type on subscribeLabels
2024-03-13 12:20:09 -05:00
Devin Ivy
6f39783c61 ozone/pds prerelease versions 2024-03-13 10:25:17 -04:00
Paul Frazee
00a567daa0
Additional 3p labeler updates (#2286)
* Rename bsky_labeler_did

* Use labeldef default setting

* Add definedBy to interpretted label defs

* Improve dev-env mocks for labels

* Remove global label defs for dmca-violation, doxxing, and !no-promote

* Change nudity global label def to default to ignore and no longer be adult-only

* Remove old !no-promote tests

* Add mod authorities header and move bsky labeler into it

* Rename modsPref and addModService/removeModService to labelersPref and add/removeLabeler

* Add defaultSetting and adultOnly to custom label value definitions

* Rename InterprettedLabelValueDefinition to InterpretedLabelValueDefinition

* Update dev-env mock

* Move muted words and hidden posts into moderationPrefs

* Add muted word and hidden post handling to moderatePost

* Add mutewords tests

* Finish muteword tests

* Add mod-authority.test to dev-env

* Rename global label value def gore to graphic-media

* Fix typo

* Stop converting old label values

* Update label target=profile behaviors: dont filter content on hide, dont blur display names, but do show the info cards

* Update label target=account behaviors: dont blur media of content

* Add muteword moderation behaviors

* Fix mock label defs

* Implement quote-post moderation handling

* Add adult content test

* Handle sync legacy labels (#2291)

* Handle sync legacy labels

* Remap values on read

* Filter out double-written legacy label values

* Better naming, fix types

* Fix test

* Update moderation docs in sdk

* Update to new atproto-accept-labelers header behavior

* Add getLabelDefinitions() helper method

* Add proxy header support to agent

* Update mock moderation

* lint

* Implement moderation for userlists and feedgens

* Add another test label

* fix labeler in dev-env agents

* fix label hydration test

* fix lint error

* fix agent test

* fix takedown labels test

---------

Co-authored-by: Eric Bailey <git@esb.lol>
Co-authored-by: dholms <dtholmgren@gmail.com>
2024-03-12 21:10:19 -07:00
Daniel Holmgren
2ea27e340a
Ozone lexicons (#2288)
* lexicons

* clean up old admin schemas

* codegen

* renaming all routes

* fix more

* fix snaps

* fix test

* format

* hook up ozone routes on pds

* publish next version

* build branch

* dont build branch
2024-03-12 18:42:11 -05:00
Daniel Holmgren
7df7d60735
Clean up PLC op submission (#2296)
* clean up plc op submission

* test
2024-03-12 16:19:51 -05:00
Daniel Holmgren
3d32d1c089
Action !takedown labels in hydrator (#2270)
* action takedown labels in hydrator

* wip tests

* fix tests & better hydration

* tidy up includeTakedowns

* update labelers header semantics

* add response header

* pds: pipe through res headers

* fix up tests

* tidy tests

* re-include example in dev-env

* fix test

* revamp parsing

* fix build err in hydrator

* fix more build errs

* fix test
2024-03-12 16:19:05 -05:00
Daniel Holmgren
7b146605c9
Updated semantics for atproto labelers header (#2292)
* update labelers header semantics

* add response header

* pds: pipe through res headers

* fix up tests

* revamp parsing
2024-03-12 16:04:12 -05:00
devin ivy
8dd67f5c81
Appview: labels on feed gens and list views (#2298)
* lexicon: add labels to feedgen and list views

* appview: hydrate labels onto lists, feedgens

* test hydration of labels on lists and feedgens

* update pds snap
2024-03-12 16:04:02 -05:00
Daniel Holmgren
40a3537b05
Allow 3p labelers to query appview account infos (#2297)
allow 3p labelers to query appview account infos
2024-03-12 16:01:40 -05:00
Daniel Holmgren
31e67a5a02
Remove sig in label hydration (#2295)
remove sig in label hydration
2024-03-12 16:01:28 -05:00
Foysal Ahamed
2802880a97
Add modEventDivertBlobs event to send blobs to abyss (#2238)
* 🚧 Working through an nullable review state

*  Update snapshots on some tests

*  Update snapshots on some tests

*  Add test for reviewOptional status mutation

*  Add divertBlobs event to send blobs to abyss

* ♻️ Rename reviewOptional -> reviewNone

* ♻️ Rename modEventDivertBlobs -> modEventDivert

* 🐛 Rename event type checker

*  Use pds resolver to get blob straight from pds

*  Use FOR UPDATE to respect db transactions

* ♻️ Refactor to use event_pusher table instead of new table

*  Bring back missing lines in pnpm-lock

* 🔨 Rebuild?

* 🚨 Formatting

* ♻️ Refactor to divert blob sync

* 🧹 Cleanup

*  Use modClient seed client in blob-divert test

* update divert blob config to use basic admin auth

* fix

* build

---------

Co-authored-by: Devin Ivy <devinivy@gmail.com>
2024-03-12 10:40:32 -04:00
Daniel Holmgren
38656e71ff
Label expiration (#2241)
* sketching out label sequencer

* refactor sequencer

* sequencer tests

* tests

* add query labels endpoint & tests

* add pagination

* fix label formatting on temp

* tidy

* format labels

* make use listen/notify for sequencer

* ensure sig on all outgoing labels from ozone

* fixing up tests

* fix sequencer tests

* fix hanging server test

* add log on failure to update label

* update description for sig

* add expiration to labels

* fix test

* use bytes for label sigs

* fix tests

* add ver to labels

* tidy up background queue

* store signing keys as ids

* fix sequencer teest
2024-03-08 19:48:45 -06:00
Daniel Holmgren
cc11adda87
Ozone: Add sigs to all labels (#2236)
* sketching out label sequencer

* refactor sequencer

* sequencer tests

* tests

* add query labels endpoint & tests

* add pagination

* fix label formatting on temp

* tidy

* format labels

* make use listen/notify for sequencer

* ensure sig on all outgoing labels from ozone

* fixing up tests

* fix sequencer tests

* fix hanging server test

* add log on failure to update label

* update description for sig

* use bytes for label sigs

* fix tests

* add ver to labels

* tidy up background queue

* store signing keys as ids

* fix sequencer teest
2024-03-08 19:41:31 -06:00
Devin Ivy
39bb3484b8 ozone prerelease 2024-03-07 17:27:33 -05:00
devin ivy
bb1f824680
Appview: include takedowns properly on follow endpoints (#2285)
bsky: include takedowns properly on follow endpoints
2024-03-07 15:55:08 -05:00
devin ivy
f192b97fdd
Ozone: configure to fetch but not pull from appview (#2284)
ozone: configure to fetch but not pull from appview
2024-03-07 14:29:08 -05:00