July 3. 2023 - Successful progress on tasks, extending archives and TAR archives
What did we accomplish?
- Hugh continues progress on #15
- @dannymate shares a functional prototype for offloading import to Celery. #17
- @CSDUMMI begins work & discusses further with @Ryuno-Ki about the use of TAR Archives #16.
- Further discussion occurred over possible issues with the export mechanism (#3 - Create tasks for export/import instead of performing them in the request-response loop - bookwyrm - Codeberg.org)
What’s next?
Currently we are progressing quite well. We should aim to complete #15 and #17.
We’ll have to decide on how to create the archive. Currently there appear to be three options:
- Create it in-memory (currently the case)
- Store it on disk
- Stream the archive (creating it on-demand and archiving most used parts.
See #16 for more.
While we can experiment with different ways of generating the archive and creating archive files (tars), we are blocked from implementing a completely self-contained archive until #15 is completed.
Having #17 completed would also be a huge help here.
See: socialcoding