Workers AI model @cf/meta/llama-3.1-8b-instruct returning empty responses

HTTP/3 performance regression

Starting as early as at least 2022-10-26, users may experience a significant performance degradation when enabling HTTP/3 on their sites. Users are advised to disable HTTP/3 for better performance.

Update: Improvements have been made to HTTP/3 performance recently that greatly reduce the impact of this regression.

Sources:

https://twitter.com/adam_janis/status/1617193830775660545
https://twitter.com/CherryJimbo/status/1628070338683625472

Incident Report for Cloudflare

Resolved

This incident is now resolved.

Posted Nov 26, 2024 - 00:46 UTC

Monitoring

The cause of this issue was identified and a fix was implemented. We are currently monitoring the results.

Posted Nov 25, 2024 - 23:41 UTC

Investigating

We are currently investigating an issue where the Workers AI model @cf/meta/llama-3.1-8b-instruct is returning empty responses under specific prompts.

Posted Nov 25, 2024 - 23:02 UTC

This incident affected: Cloudflare Sites and Services (Workers AI).

Unofficial and Honest Cloudflare System Status