Choosing the font when we are working on a digital document is trivial. We can always choose the preferred font in the drop-down font list in the editor. How about changing the font of the text in an…
Running large language models (LLMs) on consumer hardware can be challenging. If the LLM doesn’t fit on the GPU memory, quantization is usually applied to reduce its size. However, even after…
This article is about optimizing the communication between your Python app and a database so that your app runs smoothly and your database server doesn’t melt. This article addresses a common…
Within this article, I share some of the basics to create a LLM-driven web-application, using various technologies, such as: Python, FastAPI, Pydantic, VertexAI and more. Disclaimer: I am using data…
