Add configurable queue_message_timeout_duration parameter in endpoint service configs#709

ValentineDragan wants to merge 5 commits into

mainscaleapi/llm-engine:mainfrom

feat/add-queue-timeout-duration-param-to-endpointsscaleapi/llm-engine:feat/add-queue-timeout-duration-param-to-endpointsCopy head branch name to clipboard