Optimize Azure OpenAI Applications with Semantic Caching
Introduction
One of the ways to optimize cost and performance of Large Language Models (LLMs) is to cache the responses from LLMs, this is sometimes referred to as “semantic caching”. In this blog, we will discuss the approaches, benefits, common scena… Continue reading Optimize Azure OpenAI Applications with Semantic Caching
