Anki/proto/anki
Damien Elmes cf45cbf429
Rework syncing code, and replace local sync server (#2329)
This PR replaces the existing Python-driven sync server with a new one in Rust.
The new server supports both collection and media syncing, and is compatible
with both the new protocol mentioned below, and older clients. A setting has
been added to the preferences screen to point Anki to a local server, and a
similar setting is likely to come to AnkiMobile soon.

Documentation is available here: <https://docs.ankiweb.net/sync-server.html>

In addition to the new server and refactoring, this PR also makes changes to the
sync protocol. The existing sync protocol places payloads and metadata inside a
multipart POST body, which causes a few headaches:

- Legacy clients build the request in a non-deterministic order, meaning the
entire request needs to be scanned to extract the metadata.
- Reqwest's multipart API directly writes the multipart body, without exposing
the resulting stream to us, making it harder to track the progress of the
transfer. We've been relying on a patched version of reqwest for timeouts,
which is a pain to keep up to date.

To address these issues, the metadata is now sent in a HTTP header, with the
data payload sent directly in the body. Instead of the slower gzip, we now
use zstd. The old timeout handling code has been replaced with a new implementation
that wraps the request and response body streams to track progress, allowing us
to drop the git dependencies for reqwest, hyper-timeout and tokio-io-timeout.

The main other change to the protocol is that one-way syncs no longer need to
downgrade the collection to schema 11 prior to sending.
2023-01-18 12:43:46 +10:00
..
ankidroid.proto Integrate AnkiDroid's backend patches into the repo (#2290) 2023-01-03 13:11:23 +10:00
backend.proto Integrate AnkiDroid's backend patches into the repo (#2290) 2023-01-03 13:11:23 +10:00
card_rendering.proto Partially migrate type answer to backend 2022-07-22 19:28:34 +10:00
cards.proto Add card meta for persisting custom scheduling state (#2040) 2022-09-02 11:22:49 +10:00
collection.proto Integrate AnkiDroid's backend patches into the repo (#2290) 2023-01-03 13:11:23 +10:00
config.proto Remember previous choices in reposition dialog (#1950) 2022-07-08 11:28:38 +10:00
deckconfig.proto Remove untranslated 'see old deck options' notice 2022-11-03 12:05:19 +10:00
decks.proto Add non-legacy backend interface for adding new decks 2022-09-04 14:12:29 +10:00
generic.proto Add java_multiple_files option to proto files 2022-06-27 15:16:04 +10:00
i18n.proto Add java_multiple_files option to proto files 2022-06-27 15:16:04 +10:00
import_export.proto Since DupeResolution is in CsvMetadata, we don't need to pass it separately 2022-06-27 17:15:54 +10:00
links.proto Add java_multiple_files option to proto files 2022-06-27 15:16:04 +10:00
media.proto Add java_multiple_files option to proto files 2022-06-27 15:16:04 +10:00
notes.proto Add java_multiple_files option to proto files 2022-06-27 15:16:04 +10:00
notetypes.proto Introduce setting to collapse field by default (#1990) 2022-08-31 23:34:39 +10:00
scheduler.proto Fix typos (#2210) 2022-11-24 20:18:57 +10:00
search.proto Add java_multiple_files option to proto files 2022-06-27 15:16:04 +10:00
stats.proto Move more of the graph processing into the backend 2022-12-16 21:42:17 +10:00
sync.proto Rework syncing code, and replace local sync server (#2329) 2023-01-18 12:43:46 +10:00
tags.proto Add java_multiple_files option to proto files 2022-06-27 15:16:04 +10:00