Repository navigation
Conversation
- After a network drop mid-answer, fx notices that the server no longer knows the connection within about 5 seconds of the network returning, and retries the request instead of waiting up to 10 minutes on a silent stream. - During a longer outage, fx reports the connection as lost 45 seconds after the last data arrived and keeps retrying until the network returns. - A model that thinks silently for minutes keeps its connection, because the server answers the keepalive probes. - The same detection covers the AI Gateway and the chat completions, OpenAI Codex, and xAI providers. - If the system refuses a keepalive option on a connection, the request continues as before and the debug trace records which option failed.
During a model request, fx compared two clocks every 10 ms and closed the connection when they drifted more than 100 ms apart, taking that as a sign the Mac had slept. Even a brief sleep closed a healthy answer in the middle and restarted it. fx no longer watches for sleep. A connection that died while the Mac slept is found by the dead-peer probes after it wakes and is resent like any other dropped connection.
This branch has not been deployed
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Summary