5 Commits
Author | SHA1 | Message | Date | |
---|---|---|---|---|
Matthieu Sieben
|
72eba67af1
|
Drop axios dependency (#3177)
* Minor adaptation of VerifyCidTransform implementation * refactor: factorize content-encoding negotiation into new lib * bsky: Use undici to stream blob * fixup! bsky: Use undici to stream blob * disable ssrf bsky protection in dev-env * remove http requests to self to host "/img/" * drop axios from tests * fixes * fix tests * reviex changes * properly handle HEAD requests * handle client disconnection * fix tests * drop unrelated change * tidy * tidy * tidy * remove axios from dev-env * remove axios from identity package * use undici 6 * remove axios dependency from ozone * tidy * remove axios from PDS package * avoid killing bsky-pds connections * improve debugging data * Better handle invalid CID * tidy * tidy * refactor "allFulfilled" util in @atproto/common * tidy --------- Co-authored-by: devin ivy <devinivy@gmail.com> |
||
rafael
|
638f5a8312
|
Fix avatar path resolution in dev-env (#3266)
* Fix avatar path resolution in dev-env * changeset * extract dev-env assets to dedicated folder * add comment * fix fmt |
||
Daniel Holmgren
|
de2dbc2903
|
Split out moderation backend (#1970)
* mv appview * copy * finalize copy * package names * big WIP * first pass at mod servce * some tidy * tidy & fix compiler errors * rename to ozone, db migrations, add to dev-env & pds cfg * getRecord & getRepo mostly working * fix open handle * get record tests all working * moderation events working * statuses working * tidy test suite * search repos * server & db tests * moderation tests * wip daemon + push events * pds fanout working * fix db test * fanning takedowns out to appview * rm try/catch * bsky moderation test * introduce mod subject wrappers * more tidy * refactor event reversal * tidy some db stuff * tidy * rename service to mod-service * fix test * tidy config * refactor auth in bsky * wip patching up auto-mod * add label ingester in appview * fix a couple build issues * fix some timing bugs * tidy polling logic * fix up tests * fix some pds tests * eslint ignore * fix ozone tests * move seeds to dev-env * move images around * fix db schemas * use service auth admin reqs * fix remaining tests * auth tests bsky * another test * random tidy * fix up search * clean up bsky mod service * more tidy * default attempts to 0 * tidy old test * random tidy * tidy package.json * tidy logger * takedownId -> takedownRef * misc pr feedback * split daemon out from ozone application * fix blob takedown mgiration * refactor ozone config * do push event fanout on write instead of on read * make suspend error work again * add attempts check & add supporting index * fix takedown test ref * get tests working * rm old test * fix timing bug in event pusher tests * attempt another fix for timing bug * await req * service files * remove labelerDid cfg * update snaps for labeler did + some cfg changes * fix more snaps * pnpm i * build ozone images * build * make label provider optional * fix build issues * fix build * fix build * build pds * build on ghcr * fix syntax in entry * another fix * use correct import * export logger * remove event reverser * adjust push event fanout * push out multiple * remove builds |
||
Daniel Holmgren
|
d664b51c64
|
Finalize PDS in-process AppView removal (#1198)
* rm tables * rm event-stream & proxied * Remove appview services, move label service to pds * only proxy appview stuff * delete more tables * Start removing message dispatched from pds * more syncing-up removal of message dispatcher in pds * merged * remove feedgens from pds, remove getPopular * remove unused image helper from pds * fixing compiler errors * clean up sharp * rm label service * first pass on cleaning up tests * fix up a bunch of tests * moderation view tests * last admin tests * got a lil overzealous in deletes * clean up unused cfg * clean up label table * simplify admin repo search query/logic * tidy pds entrypoint * in-progress pds config changes * cfg fiddling * finish cleaning up cfg/ctx * comments * building * pds prefix on env * test env * collapse pds migrations down into a single migration * fix up dev-env * tidy * cleanup * fix pds admin tests * fix handle test * fix pds proxy tests * fix subscribe repos test * fix sqlite config in pds tests * add sqlite clause in sequencer-leader * fix actor search w/ sqlite on pds * fixes * fix dev env build * update pds service entrypoint * simple env example * make takedown ids opaque identifiers in the pds * use pds routes for api tests * update pds dockerfile with volume and correct port env var * add a couple env vars to example * add comments to env example * @atproto/pds 0.2.0-beta.0 * @atproto/aws 0.0.1-beta.0 * appview did * @atproto/aws 0.0.1 * enable logs by default * update env example * bugfixing sandbox issues * consistency in pds env var name for appview url * log on pds start and stop, configure version at runtime * @atproto/pds 0.2.0-beta.1 * fix semver matching for pds beta version * v0.2.0-beta.2 * default invites to being not required * fix flaky test * limit db connections in tests * publish 0.2.0-beta.d3 * fix invite required parsing * @atproto/pds 0.2.0-beta.5 * Proxy getPopularFeedGenerators on simplified pds (#1222) proxy getPopularFeedGenerators on pds Co-authored-by: dholms <dtholmgren@gmail.com> * tidy migrations * fix service entry * bump version * change auth order * bump version * bump version * add upgradeRepoVersion & fallback url for cdn * bump version * merging * merge pds * building dev-env * merging tests * merge service entry * test fixing * tidy * fix admin search * tidy * tidy * add snap for getListFeed * add backup nameserver cfg * tidy + pr feedback * tidy * tidy env * bit more * re-add dotenv to root package.json * fix dep * build branch * fix tests * Refactor tests to make better use of dev-env (#1690) * refactor pds tests to use dev env * refactor bsky tests * fix pds test * tidy bsky tests * build pds correctly * fix entry point * default logging to false (for now) * format service entry * Switch takedown ids back to ints on pds distribution (#1694) * switch takedown ids back to ints, consistent with live pds * tidy/fix migration * update migration for sqlite * export moderation action reversal * takedown tests * dont build branch --------- Co-authored-by: Devin Ivy <devinivy@gmail.com> |
||
devin ivy
|
4e83748545
|
Bsky app view (#716)
* Init pulling bsky app view from pds package into its own package, remove sqlite db dialect * Cull bsky config, services, auth, etc. * Sweep app view xrpc methods, tidy deps, add storage back for img server * Run repo subscription on bsky app view * Collapse db migrations down for bsky app view * Tidy app view bin * Remove mute functionality from app view, delegate to pds * Initial tidy/culling of bsky app view tests * Passing bsky app view db, server, and repo subscription tests * Passing bsky app view duplicate-records tests * Bsky app view test tidy/cull * In bsky app view replace repo_root, ipld_block, did_handle with actor and record tables. Remove assertions/confirmations. * Update bsky impl for simpler actor and record tables, removed asserion/confirmations. Skip indexing unknown collections. * Setup actor handles by did in bsky app view * Passing indexing tests on bsky app view * Passing image tests on bsky app view * Fix bsky actor reindexing, support custom lock id for testing repo subs * Sweep bsky view tests, misc tests, passing * Tidy bsky deps * Include did in resized image uris * Update bsky image process server to use getBlob * Update image server tests, misc fixes * Implement bsky blob resolver * Wire local image processing server to local blob resolver, test blob resolver * Tidy * Tidy * Tidy * Tidy app view init * Fix handle resolution, tidy * Add utils for partitioning indexing by did * Update repo sub to parallelize work per repo * Dep tidy * Tidy bsky tests for updated repo sub destroy() * Update thead indexing to handle out-of-order posts * Sketch out strategy in bsky for handling too-big commits * Set content-type on sync.getBlob * Add logging for failed transmissions in bsky blob resolver * Tidy * Tidy bsky repo indexing and supporting repo interfaces * Sort in app view based on combo of creation and indexing times * Fix types * Add retry utils to bsky * Add retries to http requests made by bsky * Test repo indexing * Update bsky db/model for lex refactor * Update bsky lexicons for lex refactor * Update bsky actor service for lex refactor * Update bsky feed service for lex refactor * Update bsky indexing service for lex refactor * Update bsky repo subscription for lex refactor * Tidy bsky repo sub * Add unspecced endpoints to bsky app view, update entrypoint * Update bsky xrpc utils for lex refactor * Update bsky xrpc methods for lex refactor * Update bsky test seeds for lex refactor, tidy api entrypoint * Update bsky non-view tests for lex refactor * Update bsky likes view test for lex refactor, minor fix * Update bsky author feed tests for lex refactor, minor test util fix * Update bsky follow, profile, repost, search view tests for lex refactor * Update bsky timeline view tests for lex refactor * Replace bsky out-of-order thread indexing logic * Update bsky thread view tests for lex refactor, general test tidying * Handle rebases and too-big commits in repo subscription, tracking commit data cid * Tidy * Ensure did resolver reports "not found" only when positively not found * Handle tombstones and handle updates in bsky * Test indexing handle updates and did tombstones * Support cors on bsky * Allow app view to serve most routes unauthed * Tests for bsky unauthed views * Tidy bsky service entrypoint and dockerfile * Remove unused storage interfaces from bsky * Bsky entrypoint and dockerfile fixes, tidy * Add workflow for bsky build to aws * Use more standard db env variables, make migration creds optional * Make bsky repo subscription optional * Fix lex->json serialization in bsky * Split bsky actor sync state into its own table * Skip invalid records on indexing full repo, tidy * Tidy * Leader test timing * Tidy/lint * Fix bsky config overrides |