MyBlog

Blogging to document my path & share what I learn along the way 😊

July 21, 2025

State-of-the-Art Embedding Retrieval: Gemini + pgvector for Production Chat Systems

How we achieved 2x faster vector search with identical recall using Gemini embeddings, task-optimized retrieval, and pgvector's half-precision quantization.

June 21, 2025

A Review of Agentic Design Patterns

This review maps out key design patterns in agentic workflows and provides practical guidance on when and how to use them effectively.

June 20, 2025

Model Context Protocol (MCP) and MCP Servers in LLM Agent Systems

The Model Context Protocol (MCP) is an open standard for connecting LLMs to external tools, creating a universal 'USB-C port' for AI agents. This artcile covers MCP's core concepts, real-world implementations by Anthropic, LangChain, and OpenAI, and best practices for building servers.

January 1, 2025

Building AI Agents for Automated Multi-Format Content: From News to Podcasts

How I built an automated multi-agent system that transforms AI news into weekly podcasts, newsletters, and social media content using LangGraph, topic modeling, and TTS - all running autonomously on ECS.

December 2, 2024

Rediscovering Cursor

I gave Cursor another shot and finally figured out what I was doing wrong. Turns out it's pretty awesome when you know how to work with it!

September 16, 2024

How to Find the Right Co-Founder

Finding the right co-founder can be one of the most critical and daunting tasks in building a startup. This post covers why co-founder relationships succeed or fail, the benefits of having a co-founder, and how to build a co-founding team that thrives long-term.

August 8, 2024

GraphRAG > Traditional Vector RAG

Traditional Vector based RAG has too many shortcoming. GraphRAG instead uses a Knowledge Graph richly understanding text datasets, and makes RAG great again

July 20, 2024

Cultural Bias in LLMs

An experiment into cultural biases in LLMs using the Inglehart-Welzel Cultural Map method - revealing unexpected value alignment across both Western and Chinese LLMs

July 7, 2024

Mapping out the AI Landscape with Topic Modelling

Tackling information overload by using topic modeling techniques to map out the AI landscape, helping us access valuable AI news and trends!

June 27, 2024

Sustainable Cloud Computing: Carbon-Aware AI

When selecting a cloud compute region for your ML workloads you will often need to account for latency, cost, services and features, compliance, etc. But in this article I explore how you can also consider your carbon footprint as part of your selection criteria.

June 24, 2024

Defensive Technology for the Next Decade of AI

Exploring defensive technologies to mitigate AI risks and ensure safe and secure advancements in the next decade.

June 13, 2024

Situational Awareness: The Decade Ahead

As developers, we often just focus on the technical aspects of AI without ever considering the broader geopolitical implications. From Leopold Aschenbrenner's 'Situational Awareness', I summarise his insights on the rapid development of AI and the path to AGI & ASI, as well as the geopolitical and security challenges we face with AI.

June 7, 2024

Mechanistic Interpretability: A Survey

Mechanistic interpretability in AI: unsupervised sparse autoencoders being used to generate interpretable features from LLMs in order to enhance our understanding of, trust in, and safety of AI systems.

May 24, 2024

Why I Left Ubuntu

I recently upgraded to Ubuntu 20.04 LTS, but my experience wasn't as smooth as I'd hoped. Here's why I decided to switch back to Windows and my setup process for an optimal development environment.

May 20, 2024

AI’s Role in Healthcare

AI is making significant strides across various industries, and healthcare is no exception. From improving diagnostic accuracy to easing administrative burdens, AI is ready to transform the way healthcare is delivered and experienced.

April 16, 2024

Autonomous Agents & Multi-Agent Collaboration

Exploring Autonomous Agents and multi-agent systems, this post goes into how collaborative autonomous agents can improve complex problem-solving, from behavior simulation and data construction to performance enhancement and software development

March 28, 2024

Embeddings and Vector Databases: Enhancing Retrieval Systems

Explore how embedding models and vector databases can enhance retrieval systems in AI, with practical tips and insights for optimizing retrieval-augmented generation (RAG) systems.

February 3, 2024

Building an Automated Newsletter-to-Summary Pipeline with OpenAI: Zapier AI Actions vs AWS SES & Lambda

This post goes through creating an automated system that utilizes Zapier and Telegram (and then AWS SES & Lambda) to transform newsletters landing in our Gmail account into AI-generated Summary threads - a process designed to operate autonomously, 24/7.

December 15, 2023

Local AI Image Generation

The ability to generate stunning AI images has become accessible to everyone. In this post I explore how you can generate AI Images locally using Stable Diffusion XL and checkpoints like Juggernaut.

November 15, 2023

MLOps: Deploying a Distributed Ray Python Server with Kubernetes, EKS & KubeRay

In this post I go through the end-to-end process of deploying a distributed Python server using Kubernetes, covering both local Kubernetes deployment using Kind, as well as a cloud-based deployment on AWS using EKS

October 24, 2023

Making the Switch to Linux for Development: A Developer's Experience

In this post, I share why I switched from Windows to Linux for development and how I set up my system for various tasks, including web-dev, machine learning, AI, etc.

October 1, 2023

Scaling Option Pricing with Ray

Ray is a framework that makes it simple to scale Python applications. The Binomial model is a basic technique for option pricing. This post showed how using Ray makes it easy to take your existing Python code that runs sequentially and transform it into a distributed application with minimal code changes.

September 23, 2023

Using Async Worker Pool in Python for Efficient Task Execution

When developing applications that require high-concurrency, efficiency, and robust error-handling, the Async Worker Pool pattern in Python can be a valuable pattern.

September 8, 2023

Browser Fingerprinting: Introducing My First NPM Package

Browser fingerprinting with a zero-dependency NPM package that offers a swift, synchronous function for browser fingerprint computation without user permissions or cookies.

August 14, 2023

My Favorite GitBash Aliases

This blog article explains the use and customization of the .bashrc file in GitBash. It details how to access the file and create custom aliases, providing examples for simplifying common Git commands and quickly activating an Anaconda environment.

July 6, 2023

Reading Data from @socket.io/redis-emitter without Using a Socket.io Client

In this article, we explore the challenge of reading data from @socket.io/redis-emitter without a socket.io client and present a clean and effective solution by decoding using the notepack.io.

July 1, 2023

Socket.io Middleware for Redux Store Integration

Integrating Socket.io with Redux through middleware for a robust and elegant solution for handling real-time communication in React. Using a singleton creation pattern and custom middleware provide a structured and scalable approach to managing Socket.io connections and dispatching Redux actions seamlessly.

April 21, 2023

Sharing TypeScript Code Between Microservices: A Guide Using Git Submodules

Share TypeScript code between microservices using Git submodules, allowing for modular code management and easy updates. Set up path mapping and handle external dependencies for a cleaner, more maintainable codebase.

April 17, 2023

Using Objects as Keys in JavaScript Maps: Short Notes on Key Equality

Use objects as keys in JavaScript Maps by understanding how JavaScript compares objects by reference. By using a single object reference as the key, you can avoid unexpected behavior and achieve key equality.

February 3, 2023

Efficient Dataset Storage: Beyond CSVs

One of the crucial aspects of your work is managing and storing datasets efficiently. How should you be storing your datasets though? CSV's may be common, and are handy when you want to share and read your data, but Binary formats like Pickle and Parquet offer enhanced performance for both reading and compression.

November 8, 2022

Embracing Next.js 13: Why I switched from Plain React

Making the switch from React to Next.js? This article explores how Next.js 13 revolutionizes the scene with upgraded development, performance, and user experience functionalities.

November 3, 2022

Deploy & Scale Socket.io Containers in ECS with Elasticache

Explore the process of deploying and scaling a Socket.io server in Amazon Elastic Container Service (ECS) with Redis using Elasticache

September 13, 2022

Implementing TOTP (Time-Based One-Time Password) Authentication in Python using PyOTP

Implement Time-Based One-Time Password (TOTP) authentication in Python using PyOTP, integrate with popular mobile authenticator apps like Google Authenticator,

September 9, 2022

Simplifying Lambda Layer ARNs and Creating Custom Layers in AWS

AWS Lambda deployments using pre-existing Lambda Layers as well as creating custom Lambda Layers from scratch using Flask as an example.

June 23, 2022

Provisioning Real-Time PostgreSQL with TimeScaleDB: Local Docker Container with Passthrough Mount & Cloud Configuration in an EC2

In this article, we'll explore how to provision and configure TimeScaleDB for two different setups: running it within a Docker container locally with a passthrough mount to a local directory as well as setting it up manually on an Amazon EC2 instance as a cloud-based database.

March 13, 2022

Refactoring Python Packages: Embracing Best Practices

In this article, as a developer refactoring old Python code, I'll explore adopting industry-standard best practices to improve maintainability, readability, and overall code quality of Python packages.

January 27, 2022

Efficiently Storing Website Submissions using AWS Lambda and S3

A lightweight solution to handle occasional website submissions without the need for a full-fledged database: AWS Lambda and Amazon S3.

December 16, 2021

How to SSH into an EC2 Instance Using PuTTY

If you're working with Amazon Web Services (AWS) and need to access your EC2 instances securely, PuTTY can be a valuable tool.

October 22, 2021

JavaScript Sets: Techniques and Performance Tips

JavaScript Sets with methods for finding differences between sets

September 6, 2021

Python Asynchronous Programming Basics

Python asynchronous programming, for more efficient applications, making the most out of concurrent execution for various tasks.