how to set TCP and HTTP "keepalive" ?

[stargazer33]

Sometime I get this

com.openai.errors.OpenAIIoException: Request failed; java.io.InterruptedIOException: timeout

com.openai.errors.OpenAIInvalidDataException: Error reading response; java.io.InterruptedIOException: timeout

for some long-running (about 3 minutes) calls.

I think this might be related to keepalive settings.

As far as I know, there are keepalive settings on TCP and on HTTP level.

How to configure all this correctly using Java 8 and openai-java ?

Documentation should mention this.

[FanYaning]

try set the timeout

        openAIClient = OpenAIOkHttpClient.builder()
                .baseUrl(apiUrl)
                .apiKey(apiKey)
                .timeout(Duration.ofMinutes(15))
                .build();