Astarag Mohapatra – Medium

Astarag Mohapatra

DoRA paper deep dive

In this article, we will be going through the paper DoRA, which came after LoRA and QLoRA. I have discussed AdaLORA and Representation…

10h ago

DoRA paper deep dive

10h ago

ReFT: Representation Finetuning Paper deep dive

This article will dive deeper into the paper ReFT (Representation fine-tuning). It is a parameter-efficient finetuning (PEFT) method that…

5d ago

ReFT: Representation Finetuning Paper deep dive

5d ago

JSON vs YAML function calling Finetuning comparison

WANDB TRAINING RUNS AND CHECKPOINTS

Nov 20, 2024

JSON vs YAML function calling Finetuning comparison

Nov 20, 2024

Character.ai optimized inference blog post explained

Recently, character.ai, a role-playing based LLM startup, released a blog post on their inference pipeline. The blog posts mentioned three…

Jun 30, 2024

Character.ai optimized inference blog post explained

Jun 30, 2024

Adaptive LoRA (AdaLORA) paper explanation

In this article, we will dive deeper into the paper AdaLORA, which is based on Singular value decomposition (SVD) to dynamically choose low…

May 6, 2024

Adaptive LoRA (AdaLORA) paper explanation

May 6, 2024

ColBERT: Contextualized Late Interaction BERT explained with a tutorial

In this article, we will go over the Colbert architecture, both v1 and v2. It is a neural Information Retrieval technique that can help us…

Mar 9, 2024

ColBERT: Contextualized Late Interaction BERT explained with a tutorial

Mar 9, 2024

Neo4j: Analyzing the supplier's list of Apple and Samsung

In this article, we will review Neo4j basics by getting data about Apple and Samsung supplier lists. We are analyzing the supplier list of…

Feb 3, 2024

Neo4j: Analyzing the supplier's list of Apple and Samsung

Feb 3, 2024

MAMBA and State Space Models Explained

This article will go through a new class of deep learning models called Structured State Spaces and Mamba.

Feb 1, 2024

MAMBA and State Space Models Explained

Feb 1, 2024

RoFormer paper explained and implemented in JAX

In this article, we will go through the RoFormer paper, which introduced rotary positional embedding for transformer architecture and…

Nov 13, 2023

RoFormer paper explained and implemented in JAX

Nov 13, 2023

vLLM: A faster inference pipeline for LLMs paper explained

In this article, we will be going over the paper vLLM titled Efficient Memory Management for Large Language Model Serving with…

Oct 26, 2023

vLLM: A faster inference pipeline for LLMs paper explained

Oct 26, 2023

Astarag Mohapatra

Astarag Mohapatra

Hi Astarag here, I am interested in topics about Deep learning and other topics. If you have any queries I am one comment away

Following

Help
Status
About
Careers
Press
Blog
Privacy
Terms
Text to speech
Teams