Effortless Rewrite in Bulk with Local LLMs in Microsoft Word

How does it work? You can easily perform multiple rewrites in Microsoft Word using local LLMs. The speed can be significantly faster after the first rewrite (though not evident in this demo due to the short length) because the input prompt to the LLM is cached. Here’s a quick demo.