Is your feature request related to a problem? Please describe.
We need to horizontally scale instances of Data Prepper. However gRPC clients will not re-resolve the DNS to find the new IPs to use for new channels. The suggested workaround is to set the server side only KeepAlive configuration options Max Connection Age+Grace to force new channel creation periodically.
It’s a server-side option, so it would be set on the Data Prepper source, however I can’t see it as an option for either Otel Logs nor OTLP.
Describe the solution you'd like
Data Prepper Otel/gRPC-based sources expose gRPC KeepAlive Max Connection Age and Max Connection Age Grace configuration options.
Describe alternatives you've considered (Optional)
Attempted setting MAX_CONNECTION_AGE and MAX_CONNECTION_AGE_GRACE environment variables
Additional context
Is your feature request related to a problem? Please describe.
We need to horizontally scale instances of Data Prepper. However gRPC clients will not re-resolve the DNS to find the new IPs to use for new channels. The suggested workaround is to set the server side only KeepAlive configuration options Max Connection Age+Grace to force new channel creation periodically.
It’s a server-side option, so it would be set on the Data Prepper source, however I can’t see it as an option for either Otel Logs nor OTLP.
Describe the solution you'd like
Data Prepper Otel/gRPC-based sources expose gRPC KeepAlive Max Connection Age and Max Connection Age Grace configuration options.
Describe alternatives you've considered (Optional)
Attempted setting
MAX_CONNECTION_AGEandMAX_CONNECTION_AGE_GRACEenvironment variablesAdditional context