Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

stream/match: allow a single connection to maintain its own match lookup for multi-connection #1613

Open
wants to merge 108 commits into
base: master
Choose a base branch
from

Conversation

shazbert
Copy link
Collaborator

@shazbert shazbert commented Aug 15, 2024

PR Description

  • Attempts to decouple a connection from a global lookup table for outbound request to response matching. This allows for generic startup messages to be used across future multiple connections of the same type. This also minimises the chance of a signature conflict on outbound requests. Potentially reduces the semacquire slowness when dealing with many concurrently spawned and subscribed return responses.

  • This is backwards compatible.

  • Starts implementation in Gateio due to websocket/gateio: Support multi connection management and integrate with GateIO #1580 base.

Requires #1580 #1581 #1598 (tests)

Type of change

Please delete options that are not relevant and add an x in [] as item is complete.

  • Bug fix (non-breaking change which fixes an issue)
  • New feature (non-breaking change which adds functionality)
  • Breaking change (fix or feature that would cause existing functionality to not work as expected)
  • This change requires a documentation update

How has this been tested

Please describe the tests that you ran to verify your changes. Provide instructions so we can reproduce. Please also list any relevant details for your test configuration and
also consider improving test coverage whilst working on a certain feature or package.

  • go test ./... -race
  • golangci-lint run
  • Test X

Checklist

  • My code follows the style guidelines of this project
  • I have performed a self-review of my own code
  • I have commented my code, particularly in hard-to-understand areas
  • I have made corresponding changes to the documentation and regenerated documentation via the documentation tool
  • My changes generate no new warnings
  • I have added tests that prove my fix is effective or that my feature works
  • New and existing unit tests pass locally and on Github Actions with my changes
  • Any dependent changes have been merged and published in downstream modules

shazbert added 30 commits July 14, 2024 16:13
…larity on purpose. Change connections map to point to candidate to track subscriptions for future dynamic connections holder and drop struct ConnectionDetails.
…rror but websocket frame error or anything really makes the reader routine return and then connection never cycles and the buffer gets filled.

* Handle reconnection via an errors.Is check which is simpler and in that scope allow for quick disconnect reconnect without waiting for connection cycle.
* Dial now uses code from DialContext but just calls context.Background()
* Don't allow reader to return on parse binary response error. Just output error and return a non nil response
…would hang connection reader for eternity.
@shazbert shazbert added review me This pull request is ready for review medium priority and removed nomerge requires dependency This pull request is dependent on another, so it can't be merged until the dependent one is merged rebase/merge of master required labels Oct 10, 2024
Copy link
Collaborator

@gloriousCode gloriousCode left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thank you for adding this. I would just like to see a test from gateio_test.go along similar lines to this: #1601 (comment)
which would allow for your changes to be hit

@shazbert
Copy link
Collaborator Author

shazbert commented Nov 5, 2024

Thank you for adding this. I would just like to see a test from gateio_test.go along similar lines to this: #1601 (comment) which would allow for your changes to be hit

If you want that I will just wait until #1598 is merged it has all the auth and outbound inbound testing done there.

@shazbert shazbert added nomerge requires dependency This pull request is dependent on another, so it can't be merged until the dependent one is merged and removed review me This pull request is ready for review medium priority labels Nov 5, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
nomerge requires dependency This pull request is dependent on another, so it can't be merged until the dependent one is merged
Projects
Status: In review
Development

Successfully merging this pull request may close these issues.

3 participants