Daniel Holmgren
afa28c709f
Get blobs ( #606 )
...
* refactor repo routes
* basic blob route
* getBlob route
* tidy
* move getBlob to sync
* allow mimetype on getBlob
* creator on blob table
* migration
* migration
* handle deletes & check db on getBlob
* fix content type bug
* back to octet-stream
* Update packages/pds/src/api/com/atproto/sync/getBlob.ts
Co-authored-by: devin ivy <devinivy@gmail.com>
* fix up migrations
* pr feedback
* fixing up merge & migration
* patched up migration
---------
Co-authored-by: devin ivy <devinivy@gmail.com>
2023-03-13 19:11:47 -05:00
Devin Ivy
0c58a937c9
Fix aws package exports
2023-02-06 19:39:56 -05:00
devin ivy
b91e6e96b7
Incorporate blobs into moderation actions ( #511 )
...
* Lexicon updates for moderating blobs
* Add tracking of blob takedowns to moderation system
* Handle blobs in record takedown reversal
* Apply blob takedowns w/ image invalidation
* Test blob takedowns
* Implement cloudfront image invalidator
* Update lexicons for current moderation action on records and blobs
* Fix migration for postgres
* Enforce single current action per repo and blob, present current action on repo and blob
* Test single active mod action per repo, record, and blob
* Continue to resolve handles for moderated repos
2023-02-06 11:44:26 -05:00
Daniel Holmgren
773f9e304d
Account deletion ( #488 )
...
* wip
* fleshing out repo storage
* fleshing out sql storage
* cleaning things up
* fix up tests
* dumb bug - commit log reversed
* rm staging in favor of commiting diffs to blockstore
* clean up benches
* fixing up sql storage
* some caching for sql repo store
* pr feedback
* migration
* wip
* migraiton test
* unclear param
* sql repo storage tests
* rm unused code
* fix up some diff code
* pr feedback
* enum for action types
* missed some
* wip
* ripping out auth lib
* more auth cleanup
* another lurker
* wip better sync primitives
* wip
* improving diffs & sync
* tests working!
* actually implemented checkout lol
* simplify interface & improve error handling
* writing sql storage code
* fixing up tests
* testing & bugfixes
* checkouts return records instead of cids
* one last refactor lol
* missed one
* handle other cid codecs on incoming car verification
* tests + tricky bugs
* unneeded blockstore method
* trim mst on del instead of save
* cleanup comment
* dont resolve did for every commit
* use "commit" instead of "root"
* getRoot -> getHead
* pr feedback
* very silly bug fix
* improve sync output
* reorging + sync of particular records
* serve & verify proofs. also rename some ipld methods
* fix up sync issue in mst
* find reachable records form carfile
* getRecord xrpc method
* pr feedback
* better migration test
* check migraiton result
* fixing up a couple things for pg
* explicit migrateTo
* async exceptions
* ipld car mimetype + remove updateRepo
* Update module publish scripts (#478 )
* Update pds package publishing scripts
* Update auth package publishing scripts
* Update crypto package publishing scripts
* Update did-resolver package publishing scripts
* Update handle package publishing scripts
* Update xrpc-server package publishing scripts
* Update common package publishing scripts
* Update plc package publishing scripts
* Update uri package publishing scripts
* Update repo package publishing scripts
* Sort "suggested follows" by number of posts (#477 )
* return suggestions by post count
* pr feedback
* fix up PG pagination issue
* partiion commit-history & commit-blocks by user did
* some lexicons
reworking routes
request deletion flows
delete actor rows
migration for user-partitioned-cids
move creator to be on ipld_block
migration tests
* delete records & repos
* delete blobs
* hook it up in route
* pettier ignore email templates
* testing & bugfixes
* testing blobs & bugfixes
* pr feedback
* make deletion test more robust
* change out handle for did on account deletion
* small cleanup
---------
Co-authored-by: Paul Frazee <pfrazee@gmail.com>
2023-02-02 12:34:00 -06:00
Daniel Holmgren
75e14ae102
Feature branch: storage & sync revamp ( #446 )
...
* wip
* fleshing out repo storage
* fleshing out sql storage
* cleaning things up
* fix up tests
* dumb bug - commit log reversed
* rm staging in favor of commiting diffs to blockstore
* clean up benches
* fixing up sql storage
* some caching for sql repo store
* pr feedback
* migration
* wip
* migraiton test
* unclear param
* sql repo storage tests
* rm unused code
* fix up some diff code
* pr feedback
* enum for action types
* missed some
* wip
* ripping out auth lib
* more auth cleanup
* another lurker
* wip better sync primitives
* wip
* improving diffs & sync
* tests working!
* actually implemented checkout lol
* simplify interface & improve error handling
* writing sql storage code
* fixing up tests
* testing & bugfixes
* checkouts return records instead of cids
* one last refactor lol
* missed one
* handle other cid codecs on incoming car verification
* tests + tricky bugs
* unneeded blockstore method
* trim mst on del instead of save
* cleanup comment
* dont resolve did for every commit
* use "commit" instead of "root"
* getRoot -> getHead
* pr feedback
* very silly bug fix
* improve sync output
* reorging + sync of particular records
* serve & verify proofs. also rename some ipld methods
* fix up sync issue in mst
* find reachable records form carfile
* getRecord xrpc method
* pr feedback
* better migration test
* check migraiton result
* fixing up a couple things for pg
* explicit migrateTo
* async exceptions
* ipld car mimetype + remove updateRepo
* Update module publish scripts (#478 )
* Update pds package publishing scripts
* Update auth package publishing scripts
* Update crypto package publishing scripts
* Update did-resolver package publishing scripts
* Update handle package publishing scripts
* Update xrpc-server package publishing scripts
* Update common package publishing scripts
* Update plc package publishing scripts
* Update uri package publishing scripts
* Update repo package publishing scripts
* Sort "suggested follows" by number of posts (#477 )
* return suggestions by post count
* pr feedback
* fix up PG pagination issue
* partiion commit-history & commit-blocks by user did
* fix migration type
* switch pk indexes
Co-authored-by: Paul Frazee <pfrazee@gmail.com>
2023-01-26 18:09:55 -06:00
Daniel Holmgren
9598a22ef5
Cleanup dependencies ( #410 )
...
* cleaning up & deleting unused deps
* oops we were using npm-run-all
2022-12-14 12:31:28 -06:00
devin ivy
13f8fae5c9
Fix S3 blob store, issue putting object from a stream ( #389 )
...
Fix s3.putObject when used w/ streams by using Upload
2022-12-08 12:00:33 -05:00
Daniel Holmgren
d0b7497a08
File uploads & profile image support ( #383 )
...
* Setup interface for image processing
* Implement getInfo() on SharpImageProcessor
* Reorganize pds image processing code
* Implement initial resize() on SharpImageProcessor
* Test sharp image processor, apply a couple fixes
* Tidy
* wip
* improve repo processing & add blbos
* more blob processing
* work into routes & config
* testing out w profiles
* Implement initial pds image uri builder/signer/verifier
* pr fixup & tests
* streaming
* better streaming interface
* s3 interface
* fix s3 prefixes
* readable streams as xrpc inputs
* more tests + cleaning up apis
* tests for failed references
* Initial implementation of image processing server
* Update node types for node v18
* fix clone issue
* add getStream to blobstore
* fixing up tests & dev-env
* get img info on upload
* integrating img processing
* hex for img uri & fixing build errors
* improve streams
* hook up uris to getProfile
* pr feedback on tmp
* test on getprofile
* testing avatars
* fix snapshot after hmac changed
* quick cleanup
Co-authored-by: Devin Ivy <devinivy@gmail.com>
2022-12-07 18:08:29 -06:00
