LovroG05
8bb62a1c20
All checks were successful
ci/woodpecker/push/woodpecker Pipeline was successful
Any model can name another model as its backup. The gateway tries the backup when the model is offline, rate limited, or its upstream fails before the client has received anything. The response reports the requested model, so the client sees no switch. The request log records each failed attempt and the address that served the request, and the cost uses the backup's prices.
3 lines
130 B
SQL
3 lines
130 B
SQL
ALTER TABLE request_logs DROP COLUMN IF EXISTS served_model;
|
|
ALTER TABLE provider_models DROP COLUMN IF EXISTS fallback_model_id;
|