Astarag Mohapatra – Medium

Astarag Mohapatra

Direct Preference Optimization (DPO) and SimPO paper explanation

In this article, we will discuss the Direct Preference Optimization paper and the Simple Preference Optimization paper. Both of these are…

3d ago

Direct Preference Optimization (DPO) and SimPO paper explanation

3d ago

PPO to GRPO in Large Language Models Alignment

In this article, I will discuss the theory behind Proximal Policy Optimization and Group Relative Policy Optimization (which was used in…

Mar 5

PPO to GRPO in Large Language Models Alignment

Mar 5

DoRA paper deep dive

In this article, we will be going through the paper DoRA, which came after LoRA and QLoRA. I have discussed AdaLORA and Representation…

Feb 3

DoRA paper deep dive

Feb 3

ReFT: Representation Finetuning Paper deep dive

This article will dive deeper into the paper ReFT (Representation fine-tuning). It is a parameter-efficient finetuning (PEFT) method that…

Jan 29

ReFT: Representation Finetuning Paper deep dive

Jan 29

JSON vs YAML function calling Finetuning comparison

WANDB TRAINING RUNS AND CHECKPOINTS

Nov 20, 2024

JSON vs YAML function calling Finetuning comparison

Nov 20, 2024

Character.ai optimized inference blog post explained

Recently, character.ai, a role-playing based LLM startup, released a blog post on their inference pipeline. The blog posts mentioned three…

Jun 30, 2024

Character.ai optimized inference blog post explained

Jun 30, 2024

Adaptive LoRA (AdaLORA) paper explanation

In this article, we will dive deeper into the paper AdaLORA, which is based on Singular value decomposition (SVD) to dynamically choose low…

May 6, 2024

Adaptive LoRA (AdaLORA) paper explanation

May 6, 2024

ColBERT: Contextualized Late Interaction BERT explained with a tutorial

In this article, we will go over the Colbert architecture, both v1 and v2. It is a neural Information Retrieval technique that can help us…

Mar 9, 2024

ColBERT: Contextualized Late Interaction BERT explained with a tutorial

Mar 9, 2024

Neo4j: Analyzing the supplier's list of Apple and Samsung

In this article, we will review Neo4j basics by getting data about Apple and Samsung supplier lists. We are analyzing the supplier list of…

Feb 3, 2024

Neo4j: Analyzing the supplier's list of Apple and Samsung

Feb 3, 2024

MAMBA and State Space Models Explained

This article will go through a new class of deep learning models called Structured State Spaces and Mamba.

Feb 1, 2024

MAMBA and State Space Models Explained

Feb 1, 2024

Astarag Mohapatra

Astarag Mohapatra

Hi Astarag here, I am interested in topics about Deep learning and other topics. If you have any queries I am one comment away

Following

Help
Status
About
Careers
Press
Blog
Privacy
Terms
Text to speech
Teams