Astarag MohapatraAdaptive LoRA (AdaLORA) paper explanationIn this article, we will dive deeper into the paper AdaLORA, which is based on Singular value decomposition (SVD) to dynamically choose low…8 min read·May 6, 2024----
Astarag MohapatraColBERT: Contextualized Late Interaction BERT explained with a tutorialIn this article, we will go over the Colbert architecture, both v1 and v2. It is a neural Information Retrieval technique that can help us…30 min read·Mar 9, 2024----
Astarag MohapatraNeo4j: Analyzing the supplier's list of Apple and SamsungIn this article, we will review Neo4j basics by getting data about Apple and Samsung supplier lists. We are analyzing the supplier list of…6 min read·Feb 3, 2024----
Astarag MohapatraMAMBA and State Space Models ExplainedThis article will go through a new class of deep learning models called Structured State Spaces and Mamba.8 min read·Feb 1, 2024--1--1
Astarag MohapatraRoFormer paper explained and implemented in JAXIn this article, we will go through the RoFormer paper, which introduced rotary positional embedding for transformer architecture and…·5 min read·Nov 13, 2023----
Astarag MohapatravLLM: A faster inference pipeline for LLMs paper explainedIn this article, we will be going over the paper vLLM titled Efficient Memory Management for Large Language Model Serving with…13 min read·Oct 26, 2023----
Astarag MohapatraSEC FILINGS QUESTION ANSWERING AND SUMMARIZATION: CHROMA DB, LANGCHAIN AND LLAMA INDEXThis article talks about my project on SEC filings question answering and summarization. Every publicly listed company has to file a yearly…·11 min read·Aug 27, 2023----
Astarag MohapatraQLoRA: Quantized Low-Rank Adaptation paper explainedContinuing my fine-tuning journey, you can find the first article on LoRA, let’s get into the QLoRA paper which was released on May 2023.·6 min read·Aug 7, 2023----
Astarag MohapatraLoRA (Low-Rank Adaptation) paper in-depth explanationThis article series will explain the two papers on finetuning neural networks and large language models. First, we will start with LoRA and…7 min read·Aug 2, 2023----
Astarag MohapatraSENTIMENT ANALYSIS OF SEC FILINGS USING Loughran-McDonald Master DictionaryThis article covers the sentiment analysis of SEC filings like 10-K (filed annually) and 10-Q (filed quarterly) using the Loughran-McDonald…·4 min read·May 1, 2023--3--3