Manifest LLM Router Deprecation After Four Months of Use

Manifest has officially deprecated its LLM router after four months of operation, which began in March and will shut down on September 1st. During its usage, the router served approximately 7,000 cloud users. Manifest reported that cache reads were between 75% and 90% cheaper than uncached inputs, but also noted that LLM routers can break behavior consistency and introduce unpredictability, which has associated costs. Manifest stated, “Complexity cannot be deduced from the prompt alone,” highlighting the challenges in managing LLM behavior. This decision follows a trend in the industry where companies are reassessing the utility of LLM routers, as seen in recent developments from other organizations. For practitioners, the deprecation signals a need to reconsider reliance on LLM routers for consistent performance in AI applications. More details can be found in the Hacker News (AI filtered) report.