Commit Graph

2872 Commits

Author SHA1 Message Date
Devin Ivy d77ac35d48 pds: add changeset 2024-04-03 16:56:48 -04:00
devin ivy 9b78f06134 Fix to blob deletion w/ disk store (#2381)
pds: ensure account deletion doesn't touch others' blobs
2024-04-03 16:54:41 -04:00
Matthieu Sieben 97482da17a Update prettier & eslint (#2373)
* chore(deps): update linting tools

* style(lint): format code
2024-04-03 21:39:11 +02:00
Daniel Holmgren a1e22df57e Timeout blob uploads (#2375)
timeout blob uploads to s3
2024-03-31 00:53:33 -05:00
bnewbold 2f62faab6f lex: limit createReport size (#2362)
* lex: limit createReport size

This has actually be limited on the *output* for a long time, apparently
as a mistake/typo when locking down string length fields earlier.

Going with the existing length there (2000 graphemes). 1200 might also
be good; a longer description could be a future additional field or
out-of-band or something.

* codegen lex changes
2024-03-22 21:04:02 +00:00
devin ivy cb2eb585e4 Fix inclusion for reposts on author feed w/ posts_and_author_threads (#2355)
appview: fix inclusion for reposts on author feed w/ posts_and_author_threads
2024-03-20 14:17:00 -04:00
bnewbold 6e552a26da lexicon nits: use string format uri in more places (#2348)
* lexicons: use format=uri for more bsky URLs

* lexicons: use format=uri for URLs in server description (links to policies)

* codegen lex changes
2024-03-20 10:17:28 -07:00
bnewbold f8dffa23eb lex: deprecate getRecord commit param (#2349)
* lexicons: mark getRecord commit param as deprecated

* codgen lex description tweak
2024-03-20 10:17:09 -07:00
Matthieu Sieben c8a5fb4c92 Avoid un-necessarily loading the keypair when creating an ActorStoreReader (#2319)
perf(pds): avoid un-necessarily loading the keypair when creating an ActorStoreReader
2024-03-20 10:34:01 +01:00
devin ivy faa8d2faed Exclude posts from author feed when they don't fit into a self-thread (#2347)
* appview: exclude posts from author feed when they don't fit into a self-thread

* tidy
2024-03-19 19:53:31 -04:00
github-actions[bot] dbda260a21 Version packages (#2345)
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
2024-03-19 16:02:56 -05:00
Eric Bailey abc6f82da3 Handle apostrophes and other punctuation when muting words (#2344)
Support muted words with apostrophes/punct
2024-03-19 15:59:20 -05:00
github-actions[bot] b4346727f7 Version packages (#2343)
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
2024-03-19 14:09:41 -05:00
Eric Bailey eb7668c07d Add changeset (#2342) 2024-03-19 14:03:26 -05:00
devin ivy c28e374868 Appview: add associated.labeler info to all profile views (#2341)
* lexicon: add associated field to profile and profile-basic views, for indicating whether labeler

* appview: add associated.labeler to profile and profile-basic views

* dev-env: downgrade get-port, non-esm-only version
2024-03-19 12:26:14 -04:00
Devin Ivy ae4d0f9f59 fix dockerfiles, include new tsconfigs 2024-03-18 18:55:38 -04:00
github-actions[bot] 07ec9ea749 Version packages (#2339)
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
2024-03-18 18:24:07 -04:00
Paul Frazee 36f2e966cb Fix: correctly detect blocked QPs when moderating posts (#2338)
* Fix: correctly detect blocked QPs when moderating posts

* Add changeset
2024-03-18 14:30:20 -07:00
Matthieu Sieben f689bd51a2 Build system rework (#2169)
* refactor(crypto): remove circular dependency

* refactor(crypto): expose compress/decompress as part of the DidKeyPlugin interface

* fix(crypto): remove import from private file

* refactor: isolate tsconfig

* fix: remove unused bench file

* chore(repo): remove unused deps

* fix(ozone): properly list dependencies

* fix(services): do lint js files

* fix(services/pds): remove unused deps

* chore(pds): remove bench

* chore(dev-env): remove unused deps

* chore(api): remove bench

* remove unused babel.config.js files

* fix: remove .ts extension from import

* fix(pds): remove imports of src files

* fix(tsconfig): properly list all projects

* fix(dev-env): remove imports of src files

* fix(bsky): remove direct import to crypto src

* fix(api): remove imports to api internals

* chore(build): prevent bundling of built output

* chore(dev): add "dev" script to build in watch mode

* chore(deps): move ts-node dependency where it is actually used

* fix(deps): add dev-env as project dependency

* fix(xrpc-server): properly type kexicon

* fix(bsky): improve typings

* fix(pds): fully type formatRecordEmbedInternal return value

* fix(repo): remove imports from @ipld/car/api

* feat(dev-env): re-export BskyIngester

* fix: properly lint & type jest config & test files

* fix(ci): test after build

* fix(types): use NodeJS.Timeout instead of NodeJS.Timer

* fix(bsky): make types exportable

* fix(ozone): make types exportable

* fix(xrpc-server): make types exportable

* fix(xprc-server): make code compliant with "node" types

* fix(xrpc-server): avoid accessing properties of unknown

* chore(deps): update @types/node

* feat(tsconfig): narrow down available types depending on the package's target environment

* fix(pds): remove unused prop

* fix(bsync): Database's migrator not always initialized

* fix(dev-env): remove unreachable code

* fix(xrpc-server): remove unused import

* fix(xrpc-server): mark header property as abstract

* fix(pds): initialize LeakyTxPlugin's txOver property

* fix(bsky): initialize LeakyTxPlugin's txOver property

* fix(bsky): remove unused migrator from DatabaseCoordinator

* fix(bsky): Properly initialize LabelService's cache property

* fix(ozone): Database's migrator not initialized

* fix(ozone): initialize LeakyTxPlugin's txOver property

* fix(crypto): ignore unused variable error

* feat(tsconfig): use stricter rules

* feat(tsconfig): enable useDefineForClassFields

* feat(xrpc-server): add support for brotli incoming payload

* fix(xrpc-server): properly parse & process content-encoding

* fix(common:stream): always call cb in _transform

* tidy/fix tests and service entrypoints

* Revert "fix(xrpc-server): properly parse & process content-encoding"

This reverts commit 2b1c66e153820d3e128fc839fcc1834d52a66686.

* Revert "feat(xrpc-server): add support for brotli incoming payload"

This reverts commit e710c21e6118214ddf215b0515e68cb87299a952.

* remove special node env for tests (defaults to jest val of "test")

* kill mute sync handler on disconnect

* work around connect-es bug w/ request aborts

* style(crypto): rename imports from uint8arrays

* fix update package-lock

* fix lint

* force hbs files to be bundled as cjs

* fix: use concurrently instead of npm-run-all

npm-run-all seems not to be maintained anymore. Additionally, concurrently better forwards signals to child processes.

* remove concurrently alltogether

* ignore sqlite files in services/pds

* fix verify

* fix verify

* tidy, fix verify

* fix blob diversion test

* build rework changeset

---------

Co-authored-by: Devin Ivy <devinivy@gmail.com>
2024-03-18 17:10:58 -04:00
futur 0a2464cb67 Remove unused dependencies (#2327) 2024-03-18 16:01:15 -04:00
github-actions[bot] f45eef3414 Version packages (#2330)
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
2024-03-16 10:19:29 -05:00
Eric Bailey 7dd9941b73 Remove unecessary escapes (#2328) 2024-03-16 10:14:50 -05:00
Foysal Ahamed 3d5ad925bb 🐛 Append path to base url when diverting blob (#2307) 2024-03-15 15:47:11 -04:00
devin ivy 011aa22b84 Labeler takedowns (alternate) (#2322)
* build hydration ctx in each handler

* test hydration w/ takendown labeler

* tidy

* handle and test labeler takedowns by label

* appview/ozone: fix admin repo search
2024-03-15 10:59:13 -04:00
devin ivy 506614fb7c Appview: fix lookup for labeler via repo.getRecord (#2324)
appview: fix lookup for labeler via repo.getRecord
2024-03-14 19:27:48 -04:00
github-actions[bot] a1e1d9332d Version packages (#2323)
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
2024-03-14 13:19:30 -04:00
Devin Ivy b95c3955d0 ozone changeset 2024-03-14 13:17:03 -04:00
devin ivy 99b6aee18e Dedupe labels during appview hydration (#2317)
* appview: reproduce duped labels

* appview: dedupe labels in hydration

* tidy types
2024-03-14 09:57:24 -04:00
Daniel Holmgren 410bc5666c Second pass on no false negs in labels (#2315)
second pass on no false negs in labels
2024-03-13 18:46:00 -05:00
github-actions[bot] f42f548e1b Version packages (#2314)
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
2024-03-13 19:19:48 -04:00
Devin Ivy 971d3e4c26 add ozone and pds changesets 2024-03-13 19:12:13 -04:00
devin ivy 722d4173ee PDS contact email address (#2313)
* lexicon: add pds server contact email

* pds: configuration for contact email address
2024-03-13 19:05:47 -04:00
Paul Frazee 2194807644 Fix agent.clone() - copy the pdsUrl config (#2312)
* Fix agent.clone() - copy the pdsUrl config

* Add changeset
2024-03-13 15:58:10 -07:00
Daniel Holmgren 069d1432dc Remove false neg on the labels that ozone emits (#2310)
* remove `neg` on the labels that ozone emits

* no negs in appview either

* no negs on self-labels

* no neg on self labels in ozone either

* fix query labels test
2024-03-13 17:33:50 -05:00
Daniel Holmgren 16ac2ef0b3 Add specced takedown labels (#2309)
* add specced takedown labels

* fix up tests

* fix test

* only reverse takedown labels
2024-03-13 17:33:43 -05:00
Daniel Holmgren a0625ba40f Ozone update sig on label overwrite (#2308)
ozone update sig
2024-03-13 13:47:40 -05:00
github-actions[bot] b286cd1a84 Version packages (#2305)
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
2024-03-13 12:50:35 -05:00
Daniel Holmgren 4eaadc0acb Labeler API Changeset (#2302)
add changsets for labeler api changes
2024-03-13 12:48:36 -05:00
Eric Bailey 84e72c6607 Mod sdk fixes (#2304)
* Adds fix for missing default labelers

* Update tests
2024-03-13 10:48:05 -07:00
Daniel Holmgren 89aa232531 Fix output type on subscribeLabels (#2303)
fix output type on subscribeLabels
2024-03-13 12:20:09 -05:00
Devin Ivy 6f39783c61 ozone/pds prerelease versions 2024-03-13 10:25:17 -04:00
Paul Frazee 00a567daa0 Additional 3p labeler updates (#2286)
* Rename bsky_labeler_did

* Use labeldef default setting

* Add definedBy to interpretted label defs

* Improve dev-env mocks for labels

* Remove global label defs for dmca-violation, doxxing, and !no-promote

* Change nudity global label def to default to ignore and no longer be adult-only

* Remove old !no-promote tests

* Add mod authorities header and move bsky labeler into it

* Rename modsPref and addModService/removeModService to labelersPref and add/removeLabeler

* Add defaultSetting and adultOnly to custom label value definitions

* Rename InterprettedLabelValueDefinition to InterpretedLabelValueDefinition

* Update dev-env mock

* Move muted words and hidden posts into moderationPrefs

* Add muted word and hidden post handling to moderatePost

* Add mutewords tests

* Finish muteword tests

* Add mod-authority.test to dev-env

* Rename global label value def gore to graphic-media

* Fix typo

* Stop converting old label values

* Update label target=profile behaviors: dont filter content on hide, dont blur display names, but do show the info cards

* Update label target=account behaviors: dont blur media of content

* Add muteword moderation behaviors

* Fix mock label defs

* Implement quote-post moderation handling

* Add adult content test

* Handle sync legacy labels (#2291)

* Handle sync legacy labels

* Remap values on read

* Filter out double-written legacy label values

* Better naming, fix types

* Fix test

* Update moderation docs in sdk

* Update to new atproto-accept-labelers header behavior

* Add getLabelDefinitions() helper method

* Add proxy header support to agent

* Update mock moderation

* lint

* Implement moderation for userlists and feedgens

* Add another test label

* fix labeler in dev-env agents

* fix label hydration test

* fix lint error

* fix agent test

* fix takedown labels test

---------

Co-authored-by: Eric Bailey <git@esb.lol>
Co-authored-by: dholms <dtholmgren@gmail.com>
2024-03-12 21:10:19 -07:00
Daniel Holmgren 2ea27e340a Ozone lexicons (#2288)
* lexicons

* clean up old admin schemas

* codegen

* renaming all routes

* fix more

* fix snaps

* fix test

* format

* hook up ozone routes on pds

* publish next version

* build branch

* dont build branch
2024-03-12 18:42:11 -05:00
Daniel Holmgren 7df7d60735 Clean up PLC op submission (#2296)
* clean up plc op submission

* test
2024-03-12 16:19:51 -05:00
Daniel Holmgren 3d32d1c089 Action !takedown labels in hydrator (#2270)
* action takedown labels in hydrator

* wip tests

* fix tests & better hydration

* tidy up includeTakedowns

* update labelers header semantics

* add response header

* pds: pipe through res headers

* fix up tests

* tidy tests

* re-include example in dev-env

* fix test

* revamp parsing

* fix build err in hydrator

* fix more build errs

* fix test
2024-03-12 16:19:05 -05:00
Daniel Holmgren 7b146605c9 Updated semantics for atproto labelers header (#2292)
* update labelers header semantics

* add response header

* pds: pipe through res headers

* fix up tests

* revamp parsing
2024-03-12 16:04:12 -05:00
devin ivy 8dd67f5c81 Appview: labels on feed gens and list views (#2298)
* lexicon: add labels to feedgen and list views

* appview: hydrate labels onto lists, feedgens

* test hydration of labels on lists and feedgens

* update pds snap
2024-03-12 16:04:02 -05:00
Daniel Holmgren 40a3537b05 Allow 3p labelers to query appview account infos (#2297)
allow 3p labelers to query appview account infos
2024-03-12 16:01:40 -05:00
Daniel Holmgren 31e67a5a02 Remove sig in label hydration (#2295)
remove sig in label hydration
2024-03-12 16:01:28 -05:00
Foysal Ahamed 2802880a97 Add modEventDivertBlobs event to send blobs to abyss (#2238)
* 🚧 Working through an nullable review state

*  Update snapshots on some tests

*  Update snapshots on some tests

*  Add test for reviewOptional status mutation

*  Add divertBlobs event to send blobs to abyss

* ♻️ Rename reviewOptional -> reviewNone

* ♻️ Rename modEventDivertBlobs -> modEventDivert

* 🐛 Rename event type checker

*  Use pds resolver to get blob straight from pds

*  Use FOR UPDATE to respect db transactions

* ♻️ Refactor to use event_pusher table instead of new table

*  Bring back missing lines in pnpm-lock

* 🔨 Rebuild?

* 🚨 Formatting

* ♻️ Refactor to divert blob sync

* 🧹 Cleanup

*  Use modClient seed client in blob-divert test

* update divert blob config to use basic admin auth

* fix

* build

---------

Co-authored-by: Devin Ivy <devinivy@gmail.com>
2024-03-12 10:40:32 -04:00