A Small Reliability Checklist for OpenAI-Compatible AI APIs
Most AI API reliability work is not about adding another provider. It is about making ordinary failure states visible before a Friday deploy turns them into a support thread. Here is the small checklist I keep next to any model change. 1. Resolve the exact model ID before deploy A model name in a launch post is not an API identifier. Copy the exact ID from the live model catalog or models endpoint, put it in configuration, and log the value used by each request. This makes a rollback boring: change one reviewed config value, not several strings scattered through the codebase. 2. Give every request a client-side correlation ID Generate a request ID before calling the API. Carry it through your application logs, background jobs, and user-facing error reports. A client-side ID will not replace provider logs, but it gives your team one stable handle when the request crosses several services. 3. Separate retryable failures from fix-the-request failures Do not put every non-200 respons...