Code

Logical channels + streaming encoders#66

Code

Open

sgwilym wants to merge 164 commits intomainearthstar-project/willow-rs:mainfrom logical_channelsearthstar-project/willow-rs:logical_channelsCopy head branch name to clipboard

+15,769-6,096

Commits

Commits on Nov 11, 2024

• it’s always good if you commit the changes

  sgwilym

  committed
  12b59b1

  Copy full SHA for 12b59b1

• Implement logical channel client-side logic

  AljoschaMeyer

  committed
  a7c3018

  Copy full SHA for a7c3018

Commits on Nov 12, 2024

• Add some TODOs for later

  AljoschaMeyer

  committed
  f7a2af2

  Copy full SHA for f7a2af2

Commits on Nov 13, 2024

• Complete client-side logic of logical channels

  AljoschaMeyer

  committed
  b84b24d

  Copy full SHA for b84b24d

Commits on Nov 20, 2024

• Work

  AljoschaMeyer

  committed
  4f467dc

  Copy full SHA for 4f467dc

• Merge channels into logical_channels

  sgwilym

  committed
  a1c5bf3

  Copy full SHA for a1c5bf3

• server sketching

  sgwilym

  committed
  6e0843b

  Copy full SHA for 6e0843b

Commits on Nov 21, 2024

• Working on the server!

  sgwilym

  committed
  e9e1c7b

  Copy full SHA for e9e1c7b

• Tie up loose ends from today's session

  AljoschaMeyer

  committed
  c8658a7

  Copy full SHA for c8658a7

Commits on Nov 22, 2024

• more server work

  sgwilym

  committed
  3998e86

  Copy full SHA for 3998e86

• Extend mpmc channel to allow triggering an error

  AljoschaMeyer

  committed
  4302e15

  Copy full SHA for 4302e15

Commits on Nov 24, 2024

• Restructure sync_with_peer to allow for dependencies between steps

  AljoschaMeyer

  committed
  6b4a89d

  Copy full SHA for 6b4a89d

Commits on Nov 25, 2024

• REfactor things, not complete yet

  AljoschaMeyer

  committed
  dbbf80f

  Copy full SHA for dbbf80f

Commits on Nov 26, 2024

• Implement RwLock

  AljoschaMeyer

  committed
  20fb2f9

  Copy full SHA for 20fb2f9

• Add a mutex, original work do not steal

  sgwilym

  committed
  2ee7168

  Copy full SHA for 2ee7168

• More elision

  sgwilym

  committed
  1e261a2

  Copy full SHA for 1e261a2

• Migrate from NbMutex to WB Mutex

  sgwilym

  committed
  5bc4ad5

  Copy full SHA for 5bc4ad5

• Add SharedDecoder

  sgwilym

  committed
  1bb1201

  Copy full SHA for 1bb1201

• Send ReveakCommitment message

  AljoschaMeyer

  committed
  d93d43a

  Copy full SHA for d93d43a

• Update CommitmentReveal encoding

  AljoschaMeyer

  committed
  77c3567

  Copy full SHA for 77c3567

• Fix exports of duplicate names

  AljoschaMeyer

  committed
  bd408fd

  Copy full SHA for bd408fd

• Add OnceCell and use it for task dependencies in sync_with_peer

  AljoschaMeyer

  committed
  e3030a7

  Copy full SHA for e3030a7

• Cosmetics

  AljoschaMeyer

  committed
  de9e599

  Copy full SHA for de9e599

• Add TakeCell to async utils

  AljoschaMeyer

  committed
  77f216d

  Copy full SHA for 77f216d

Commits on Nov 27, 2024

• Add rough sketch of lcmux architecture

  AljoschaMeyer

  committed
  eed37f4

  Copy full SHA for eed37f4

• Merge async_utils into logical_channels

  sgwilym

  committed
  6100536

  Copy full SHA for 6100536

• Work

  AljoschaMeyer

  committed
  6f09be2

  Copy full SHA for 6f09be2

Commits on Nov 28, 2024

• Mostly switch to ufotofu 0.5.0

  AljoschaMeyer

  committed
  8ff0846

  Copy full SHA for 8ff0846

Commits on Nov 29, 2024

• Sketch absolute ufotofu_codec traits

  AljoschaMeyer

  committed
  916b7bf

  Copy full SHA for 916b7bf

Commits on Dec 1, 2024

• Add default method implementations to ufotofu_codec

  AljoschaMeyer

  committed
  5247749

  Copy full SHA for 5247749

• Add relativity to ufotofu_codec

  AljoschaMeyer

  committed
  57b8fac

  Copy full SHA for 57b8fac

• Add ufotofu_codec_endian crate

  AljoschaMeyer

  committed
  5b11fdb

  Copy full SHA for 5b11fdb

• Wip compact_u64

  AljoschaMeyer

  committed
  d740aef

  Copy full SHA for d740aef

Commits on Dec 2, 2024

• Refactor codec apis

  AljoschaMeyer

  committed
  ba90e1a

  Copy full SHA for ba90e1a

• Delete old code

  AljoschaMeyer

  committed
  29ee69d

  Copy full SHA for 29ee69d

• Remove unused imports

  AljoschaMeyer

  committed
  eab3ae2

  Copy full SHA for eab3ae2

• Adjust ufotofu_codec_endian

  AljoschaMeyer

  committed
  284d2eb

  Copy full SHA for 284d2eb

• CompatcU64 make TagWidth opaque

  AljoschaMeyer

  committed
  ef5fd56

  Copy full SHA for ef5fd56

• Finish implementing CompactU64

  AljoschaMeyer

  committed
  59029ba

  Copy full SHA for 59029ba

Commits on Dec 3, 2024

• Tiny doc fix

  AljoschaMeyer

  committed
  7cf4ff3

  Copy full SHA for 7cf4ff3

• Add Arbitrary to endian int wrappers

  AljoschaMeyer

  committed
  57a9256

  Copy full SHA for 57a9256

• Get fuzzing to work with proptest stuff

  AljoschaMeyer

  committed
  0abf054

  Copy full SHA for 0abf054

• Write macros for fuzz testing

  AljoschaMeyer

  committed
  62b5326

  Copy full SHA for 62b5326

• wip updating path

  sgwilym

  committed
  e31efeb

  Copy full SHA for e31efeb

• Add ufotofu_codec proptest macros

  AljoschaMeyer

  committed
  9c2a1c9

  Copy full SHA for 9c2a1c9

Commits on Dec 4, 2024

• Path decoding completed. Kinda.

  sgwilym

  committed
  af00ffc

  Copy full SHA for af00ffc

• Merge logical_channels into update-traits

  sgwilym

  committed
  1def268

  Copy full SHA for 1def268

• Migrate path fuzz tests

  sgwilym

  committed
  b6a3e24

  Copy full SHA for b6a3e24

Commits on Dec 5, 2024

• Get a running fuzz test

  AljoschaMeyer

  committed
  5c120e0

  Copy full SHA for 5c120e0

• Revert back to encoding and decoding relative to distinct types

  AljoschaMeyer

  committed
  3de06e5

  Copy full SHA for 3de06e5

Commits on Dec 6, 2024

• Update everything to ufotofu 0.6.0

  AljoschaMeyer

  committed
  69d11de

  Copy full SHA for 69d11de

• Update test names

  sgwilym

  committed
  71bd4ce

  Copy full SHA for 71bd4ce

• Path rel path trait + test stubs

  sgwilym

  committed
  ae23d78

  Copy full SHA for ae23d78

• Implement absolute codec traits for CompactU64

  AljoschaMeyer

  committed
  888f22b

  Copy full SHA for 888f22b

• Absolute entry encoding

  sgwilym

  committed
  89586eb

  Copy full SHA for 89586eb

• yep

  sgwilym

  committed
  030d2ee

  Copy full SHA for 030d2ee

• Document compact_u64

  AljoschaMeyer

  committed
  b7f33ef

  Copy full SHA for b7f33ef

• Start breaking up relative encodings into smaller bits

  sgwilym

  committed
  c82ce40

  Copy full SHA for c82ce40

• Document uftofu_codec_endian

  AljoschaMeyer

  committed
  fa4917f

  Copy full SHA for fa4917f

• Add fuzz tests for ufotofu_codec_endian

  AljoschaMeyer

  committed
  e60cef7

  Copy full SHA for e60cef7

• Migrate entry <> namespaced area encoding

  sgwilym

  committed
  3144ab0

  Copy full SHA for 3144ab0

• Plish docs

  AljoschaMeyer

  committed
  3826427

  Copy full SHA for 3826427

• Complete renaming of some proptest functions

  AljoschaMeyer

  committed
  1ce5de8

  Copy full SHA for 1ce5de8

• Migrate entry <> namespaced range3d

  sgwilym

  committed
  8deb35d

  Copy full SHA for 8deb35d

• Prep area <> area encoding traits

  sgwilym

  committed
  ad9531a

  Copy full SHA for ad9531a

• Prep range3d <> range3d encodings

  sgwilym

  committed
  930bf2c

  Copy full SHA for 930bf2c

Commits on Dec 7, 2024

• Add absolute codec adapters

  AljoschaMeyer

  committed
  f094c72

  Copy full SHA for f094c72

• Implement and test encoders and decoders

  AljoschaMeyer

  committed
  d6e9672

  Copy full SHA for d6e9672

• Format and polish

  AljoschaMeyer

  committed
  1314e4a

  Copy full SHA for 1314e4a

• Merge polish into update-traits endeavour

  AljoschaMeyer

  committed
  218aacb

  Copy full SHA for 218aacb

• Make path encoding compile

  AljoschaMeyer

  committed
  dfa9d87

  Copy full SHA for dfa9d87

• Slightly refactor path encoding

  AljoschaMeyer

  committed
  89abe1e

  Copy full SHA for 89abe1e

Commits on Dec 9, 2024

• Refactor Path and its codec

  AljoschaMeyer

  committed
  62e37dc

  Copy full SHA for 62e37dc

• Not all 1am code is good code

  AljoschaMeyer

  committed
  f5f6244

  Copy full SHA for f5f6244

• Use Deref instead of Borrow for relative encoder/decoder

  AljoschaMeyer

  committed
  6b350a0

  Copy full SHA for 6b350a0

• Move u64_to_usize to ufotofu_codec, add analogous functions for other integer types

  AljoschaMeyer

  committed
  edd29d2

  Copy full SHA for edd29d2

• Add usize conversion functions to ufotofu_codec

  AljoschaMeyer

  committed
  6c78584

  Copy full SHA for 6c78584

• encountered bug with path rel path fuzz

  sgwilym

  committed
  c281c7e

  Copy full SHA for c281c7e

• Sketch shared codec encoder and decoder structs

  AljoschaMeyer

  committed
  af596f2

  Copy full SHA for af596f2

• Fix path Representation::total_length

  AljoschaMeyer

  committed
  f399171

  Copy full SHA for f399171

• Ignore the rust code examples in the docs that are not doc tests

  AljoschaMeyer

  committed
  3d0d197

  Copy full SHA for 3d0d197

• Polish docs

  AljoschaMeyer

  committed
  f2de381

  Copy full SHA for f2de381

• mini fix

  sgwilym

  committed
  9081b27

  Copy full SHA for 9081b27

• Refactor relative codecs

  AljoschaMeyer

  committed
  1a0fe4a

  Copy full SHA for 1a0fe4a

• Use Option::is_ok some more

  AljoschaMeyer

  committed
  cbf0dfb

  Copy full SHA for cbf0dfb

• Fix canonicity oversight

  AljoschaMeyer

  committed
  37e8757

  Copy full SHA for 37e8757

• Create and use PathBuilder::new_from_prefix, not optimised yet

  AljoschaMeyer

  committed
  5743fc6

  Copy full SHA for 5743fc6

• Wow

  AljoschaMeyer

  committed
  c80d044

  Copy full SHA for c80d044

Commits on Dec 10, 2024

• Another bugfix

  AljoschaMeyer

  committed
  97c2ea0

  Copy full SHA for 97c2ea0

• Typo fix in debug output

  AljoschaMeyer

  committed
  76b07d3

  Copy full SHA for 76b07d3

• Fix a bug!

  AljoschaMeyer

  committed
  5f92fe3

  Copy full SHA for 5f92fe3

• Implement some silly optimisations

  AljoschaMeyer

  committed
  269cee3

  Copy full SHA for 269cee3

• Placeholder params, abs entry encoding, entry rel entry encoding

  sgwilym

  committed
  109d4a2

  Copy full SHA for 109d4a2

• Stub out meadowcap

  sgwilym

  committed
  6db0d9c

  Copy full SHA for 6db0d9c

• Set up an lcmux crate, migrate old lcmux code into it

  AljoschaMeyer

  committed
  5289f5c

  Copy full SHA for 5289f5c

• LCMUX: Basic integration of server logic into session

  AljoschaMeyer

  committed
  5fc2298

  Copy full SHA for 5fc2298

Commits on Dec 11, 2024

• Handle all incoming lcmux fragments

  AljoschaMeyer

  committed
  a3a7732

  Copy full SHA for a3a7732

• Merge pull request #62 from earthstar-project/silly-optimisations-path-decoding

  Show description for 0026644
  sgwilym

  authored
  0026644

  Copy full SHA for 0026644

• Add missing Decodable trait for McSubspaceCapability

  sgwilym

  committed
  75ad2ae

  Copy full SHA for 75ad2ae

• Migrate entry <> area fuzz tests

  sgwilym

  committed
  8603b40

  Copy full SHA for 8603b40

• Migrate entry <> range3d fuzz tests

  sgwilym

  committed
  57c1e0b

  Copy full SHA for 57c1e0b

• Migrate area <> area encoding fuzz tests

  sgwilym

  committed
  4c05d88

  Copy full SHA for 4c05d88

• Migrate range3d rel range3d proptests

  sgwilym

  committed
  c3ce42e

  Copy full SHA for c3ce42e

• Update SillySigs

  sgwilym

  committed
  6c2e9d1

  Copy full SHA for 6c2e9d1

• Migrate McCapability rel Area fuzz tests

  sgwilym

  committed
  6df5372

  Copy full SHA for 6df5372

• Remove unused ControlProducer field

  AljoschaMeyer

  committed
  926b8af

  Copy full SHA for 926b8af

• Migrate McSubspaceCapability absolute encoding fuzz tests

  sgwilym

  committed
  dd5e297

  Copy full SHA for dd5e297

• Merge pull request #64 from earthstar-project/housekeeping

  Show description for b98dfdc
  sgwilym

  authored
  b98dfdc

  Copy full SHA for b98dfdc

• Implement sending of all bookkeeping frames (granting guarantees etc)

  AljoschaMeyer

  committed
  97a721a

  Copy full SHA for 97a721a

• Implement sending of control messages

  AljoschaMeyer

  committed
  fee2f54

  Copy full SHA for fee2f54

• My First LCMUX Encodable implementations

  sgwilym

  committed
  b17d7a0

  Copy full SHA for b17d7a0

• Aside from a few todo macros this is basically done?

  AljoschaMeyer

  committed
  34349c5

  Copy full SHA for 34349c5

• Complte lcmux implementation

  AljoschaMeyer

  committed
  693a964

  Copy full SHA for 693a964

Commits on Dec 12, 2024

• Add Encodable LCMUX messages and Decodable IncomingFragmentHeader

  sgwilym

  committed
  70a53ae

  Copy full SHA for 70a53ae

• Clean up wgps crate

  AljoschaMeyer

  committed
  ecbef70

  Copy full SHA for ecbef70

• Use lcmux in the wgps

  AljoschaMeyer

  committed
  9af7cdd

  Copy full SHA for 9af7cdd

Commits on Dec 13, 2024

• Merge lcmux-message-codec into lcmux

  sgwilym

  committed
  58d7343

  Copy full SHA for 58d7343

Commits on Dec 16, 2024

• harumph

  sgwilym

  committed
  4da38e8

  Copy full SHA for 4da38e8

Commits on Dec 18, 2024

• Work

  AljoschaMeyer

  committed
  7a4727e

  Copy full SHA for 7a4727e

Commits on Dec 19, 2024

• Untested entry <> range3d relative encodings

  sgwilym

  committed
  af1dacd

  Copy full SHA for af1dacd

Commits on Dec 20, 2024

• Finish FairlyUnsafeCell implementation

  AljoschaMeyer

  committed
  32b7acc

  Copy full SHA for 32b7acc

Commits on Jan 2, 2025

• Some small fixes Aljoscha asked for

  sgwilym

  committed
  d495a9b

  Copy full SHA for d495a9b

• Temp commit

  AljoschaMeyer

  committed
  234e8bb

  Copy full SHA for 234e8bb

• Update proptest macros to take a filtering predicate

  AljoschaMeyer

  committed
  1f3fd13

  Copy full SHA for 1f3fd13

• Snake-case things, I guess

  AljoschaMeyer

  committed
  8b40639

  Copy full SHA for 8b40639

• Merge pull request #67 from earthstar-project/lil-fixes

  sgwilym

  authored
  87637d7

  Copy full SHA for 87637d7

• Fix oversight

  AljoschaMeyer

  committed
  0e40398

  Copy full SHA for 0e40398

• Test and fix spsc

  AljoschaMeyer

  committed
  76ca0a7

  Copy full SHA for 76ca0a7

• Appease clippy

  AljoschaMeyer

  committed
  4db6cee

  Copy full SHA for 4db6cee

Commits on Jan 3, 2025

• Merge logical_channels into better_spsc

  sgwilym

  committed
  be96334

  Copy full SHA for be96334

Commits on Jan 4, 2025

• Merge pull request #68 from earthstar-project/better_spsc

  Show description for 14bb9b2
  AljoschaMeyer

  authored
  14bb9b2

  Copy full SHA for 14bb9b2

• Rename wb_async_utils ufotofu feature

  AljoschaMeyer

  committed
  c1d074c

  Copy full SHA for c1d074c

Commits on Jan 5, 2025

• Working SharedProducer

  AljoschaMeyer

  committed
  25ba591

  Copy full SHA for 25ba591

• Add doc tests to mutex

  AljoschaMeyer

  committed
  28e3d13

  Copy full SHA for 28e3d13

• Mutex: use FairlyUnsafeCell instead of UnsafeCell

  AljoschaMeyer

  committed
  541d0d3

  Copy full SHA for 541d0d3

• Merge origin/update_codec_propmacros into relative-encodings

  sgwilym

  committed
  c6d7389

  Copy full SHA for c6d7389

• Update relative encoding fuzz tests with predicates

  sgwilym

  committed
  d3e9142

  Copy full SHA for d3e9142

• Fix bugs in entry <> area / range encodings

  sgwilym

  committed
  2a1cfec

  Copy full SHA for 2a1cfec

• Add TakeCell doc tests

  AljoschaMeyer

  committed
  33643ba

  Copy full SHA for 33643ba

• Use FairlyUnsafeCell for TakeCell

  AljoschaMeyer

  committed
  7cfa183

  Copy full SHA for 7cfa183

• Add doctests for RwLock

  AljoschaMeyer

  committed
  845cc40

  Copy full SHA for 845cc40

• Use FairlyUnsafeCell in RwLock

  AljoschaMeyer

  committed
  3de9d50

  Copy full SHA for 3de9d50

• Add doctests for OnceCell

  AljoschaMeyer

  committed
  d794915

  Copy full SHA for d794915

• Use FairlyUnsafeCell for OnceCell

  AljoschaMeyer

  committed
  8815c2d

  Copy full SHA for 8815c2d

• Merge pull request #69 from earthstar-project/wb_cleanup

  Show description for 9337925
  AljoschaMeyer

  authored
  9337925

  Copy full SHA for 9337925

Commits on Jan 6, 2025

• Implement and test SharedConsumer

  AljoschaMeyer

  committed
  e517f49

  Copy full SHA for e517f49

• Run clippy and cargo fmt

  AljoschaMeyer

  committed
  c36c3e2

  Copy full SHA for c36c3e2

• Merge pull request #70 from earthstar-project/shared_consumer

  Show description for b95c32a
  AljoschaMeyer

  authored
  b95c32a

  Copy full SHA for b95c32a

• Single decoding function for entry <> entry

  sgwilym

  committed
  0fac231

  Copy full SHA for 0fac231

• okay but actually switch between canonic and not, k

  sgwilym

  committed
  5e772ce

  Copy full SHA for 5e772ce

• merry christmas aljoscha

  sgwilym

  committed
  e27a882

  Copy full SHA for e27a882

• tidy up

  sgwilym

  committed
  0db0607

  Copy full SHA for 0db0607

Commits on Jan 8, 2025

• Area <> Area relative encoding

  sgwilym

  committed
  5d7eb33

  Copy full SHA for 5d7eb33

Commits on Jan 9, 2025

• range3d <> range3d encodings!

  sgwilym

  committed
  58922f9

  Copy full SHA for 58922f9

Commits on Jan 13, 2025

• Merge pull request #71 from earthstar-project/relative-encodings

  Show description for c3db4ae
  sgwilym

  authored
  c3db4ae

  Copy full SHA for c3db4ae

Commits on Jan 16, 2025

• Meadowcap + ufotofu_codec + updated fuzz tests

  sgwilym

  committed
  a91c290

  Copy full SHA for a91c290

• All meadowcap fuzz tests now

  sgwilym

  committed
  3746f75

  Copy full SHA for 3746f75

Commits on Jan 17, 2025

• Refactor some redundant checks and branching

  sgwilym

  committed
  396194f

  Copy full SHA for 396194f

• Merge pull request #72 from earthstar-project/meadowcap-ufotofu-codec

  Show description for 662360c
  sgwilym

  authored
  662360c

  Copy full SHA for 662360c

• Remove some unused files

  sgwilym

  committed
  229a7a3

  Copy full SHA for 229a7a3

• Make Debug required on NamespaceId, SubspaceId, PayloadDigest

  sgwilym

  committed
  e191cd6

  Copy full SHA for e191cd6

• Add McNamespacePublicKey, McUserPublicKey

  sgwilym

  committed
  ed3f5eb

  Copy full SHA for ed3f5eb

Commits on Jan 18, 2025

• Merge pull request #73 from earthstar-project/traaaiiiiits

  Show description for 4ba1bce
  AljoschaMeyer

  authored
  4ba1bce

  Copy full SHA for 4ba1bce

Commits on Jan 20, 2025

• forgot something :)

  sgwilym

  committed
  e657365

  Copy full SHA for e657365