CGI, FastCGI, WSGI, and ASGI are all protocols or interfaces that define how web servers communicate with web applications. Here are the differences between them. 1. CGI (Common Gateway Interface)...

Message queues can be used for asynchronous communication between services and for processing batched workloads. As applications become decoupled, they often need mechanisms to share state, mutate ...

To make the LLM-based system work as you wish, there are 2 common approaches: retrieval-augmented and fine-tuning. Fine-tuning Usually, you want to avoid pre-training an LLM as the cost can be up...

Rate Limiter Architecture The main architectural question is: where should we place the rate limiter in our application stack? This largely depends on the configuration of the application stack. ...

Recently, OWASP(Open Source Web Application Security Project) has been released the OWASP LLM Top 10 list 1) LLM01:2023 - Prompt Injections 2) LLM02:2023 - Data Leakage 3) LLM03:2023 - Inadequat...

Python dataclasses are fantastic. Pydantic is fantastic. It is a tough choice if indeed we are confronted with choosing one or the other. I would say that comparing these two great modules is like ...

Pros FastAPI is very fast and efficient, making it a great choice for building high-performance APIs. It has a simple and intuitive syntax that makes it easy to learn and use, even for beginn...

Introduction LLMOps, or Language and Learning Model Operations, is a relatively new concept in the field of machine learning. It is a combination of natural language processing (NLP) and machine l...

Embeddings are generated by AI models (such as Large Language Models) and have a large number of attributes or features, making their representation challenging to manage. In the context of AI and ...

This post introduces basic commands for measuring the performance of a server. Table of Contents Performance measurement CPU Memory Disk Network Performa...