Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

in-flight buffer credits #171

Merged
merged 7 commits into from
Dec 15, 2024
Merged

in-flight buffer credits #171

merged 7 commits into from
Dec 15, 2024

Conversation

vortigont
Copy link
Collaborator

@vortigont vortigont commented Dec 13, 2024

Depends on mathieucarbou/AsyncTCP#33

implement in-flight buffer credits and event moderation for large/chunked responses

in-flight buffer credits are intended to moderate buffer fill callbacks in AsyncAbstractResponse

Refer: #165

@vortigont vortigont marked this pull request as draft December 13, 2024 08:42
@vortigont
Copy link
Collaborator Author

only testing this for now. Do not care about 8266

@mathieucarbou
Copy link
Owner

For discussion: => #165 (comment)

Repository owner locked and limited conversation to collaborators Dec 13, 2024
Repository owner unlocked this conversation Dec 14, 2024
…nked responses

Referer to #165
Relates to #169

in-flight buffer credits are intended to moderate buffer fill callbacks in AsyncAbstractResponse
it could prevent bad designed slow user-callbacks to flood the queue in chunked responces.

for response data we need to control the queue and in-flight fragmentation. Sending small chunks could give low latency,
but flood asynctcp's queue and fragment socket buffer space for large responses.
Let's ignore polled acks and acks in case when we have more in-flight data then the available socket buff space.
That way we could balance on having half the buffer in-flight while another half is filling up, while minimizing events in asynctcp q
@vortigont vortigont marked this pull request as ready for review December 15, 2024 05:43
@mathieucarbou
Copy link
Owner

mathieucarbou commented Dec 15, 2024

moving to draft until testing is done

@mathieucarbou mathieucarbou marked this pull request as ready for review December 15, 2024 17:26
@mathieucarbou mathieucarbou merged commit eef1bab into main Dec 15, 2024
44 checks passed
@mathieucarbou mathieucarbou deleted the buffcredit branch December 15, 2024 17:33
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants