Arpit Bhayani
Description
Blogs on Database Internals, Engineering Explorations, and Career Growth by Arpit Bhayani
Feed Activity
Similar Feeds
Indie Retro News
www.indieretronews.com
The BEST and ONLY site for Indie Games and Retro Gaming News!
Ed Zitron's Where's Your Ed At
www.wheresyoured.at
The Words of Ed Zitron, a PR person and writer.
Latest Posts
G-Eval, Explained
G-Eval is a reference-free evaluation framework that uses large language models to assess the quality of generated text. This article explains how G-Eval works, including rubric-based prompting, chain-of-thought evaluation, and...
AI Workflows Need Topological Sort
Every AI workflow is a dependency problem. You have steps that produce outputs, other steps that consume those outputs, and a hard constraint: consumers cannot run before their producers finish....
Temporal Primer - Building Long-Running Systems
If you have ever taped together a cron job, message queue, a database table for state, and a retry loop - only to watch the whole thing break during a...
What Matters in Production RAG
Most of us build RAG the same way: follow a tutorial that embeds a handful of PDFs, stores the vectors in a local Chroma instance, and chains everything together with...
Structure of Every LLM Chat
Role tagging is not cosmetic. It shapes how the model responds, how context is managed across multiple turns, and how application developers constrain and direct model behaviour at a structural...
How LLMs Really Work
If you have used ChatGPT, Gemini, or Claude, you have already formed an intuition about what these systems do. You type something in, and text comes back that feels coherent,...
Your Monolith Is Already A Distributed System
You have a monolith, and you are proud of it. One repo, one deployment, one database - no Kubernetes, no service mesh. You have watched teams burn months “extracting microservices”...
Databases Were Not Designed For This
There is an implicit contract at the foundation of every database architecture decision you have ever made. You probably never wrote it down. Nobody does. It just… existed.
BM25
There is a particular kind of respect reserved in engineering for the algorithm that outlives its era. BM25 is one of them. BM25 was born out of information retrieval research...
JOIN Algorithms
When you write a SQL query with a JOIN clause, you probably do not think much about what happens next. You just expect the database to return the right rows....
Venting at Work Comes at a Reputation Cost
We all vent at work. That is normal. Tough sprints, messy decisions, frustrating meetings - it happens, and letting off steam is okay and, in fact, healthy.
Why Half Your Skills Expire Every Few Years
That is the half-life of knowledge in computer science and software engineering - the time it takes for half of what you know to be replaced by better tools, approaches,...
Multi-Paxos - Consensus in Distributed Databases
Distributed databases face an interesting challenge: how do you ensure that multiple servers scattered across different machines, data centers, or even continents agree on the order and outcome of database...
MySQL Replication Internals
MySQL replication enables data synchronization across databases, powering read scaling and even some complex distributed architectures. At the core lies the binary log (binlog), which is the authoritative record of...
Bloom Filters
A Bloom filter is a probabilistic data structure that answers a very specific question - have I seen this thing before? - while using almost no memory.
Clock Synchronization Is a Nightmare
Time seems simple. But we engineers lose sleep over something as basic as keeping clocks in sync. Here’s why…
When You Increase Kafka Partitions
Partitions sit right in the middle of how Kafka works. They define ordering, parallelism, and how far it can scale. But what actually happens when you need more of them?...
Product Quantization
Recommendation engines, image retrieval platforms, document matching services, and RAG pipelines all rely on finding the nearest neighbors to a given query vector in high-dimensional space. This is where vector...
The Q, K, V Matrices
At the core of the attention mechanism in LLMs are three matrices: Query, Key, and Value. These matrices are how transformers actually pay attention to different parts of the input....
The Day I Accidentally Deleted Production
Back in 2015-16, I once accidentally deleted the "entire production" at Practo. Slight exaggeration, but here's what happened...