Multimodal Deep Learning

(VLM survey) (Part 6; Performance Comparison & Future Works)

3 minute read

arxiv 2024

(VLM survey) (Part 5; VLM Knowledge Distillation)

10 minute read

arxiv 2024

(VLM survey) (Part 4; VLM Transfer Learning)

11 minute read

arxiv 2024

(VLM survey) (Part 3; VLM Pretraining)

8 minute read

arxiv 2024

(VLM survey) (Part 2; VLM Foundations & Datasets)

3 minute read

arxiv 2024

(VLM survey) (Part 1; Intro & Background)

6 minute read

arxiv 2024

Large Language Models; A Survey (Part 4)

7 minute read

arxiv 2024

Large Language Models; A Survey (Part 3)

7 minute read

arxiv 2024

Large Language Models; A Survey (Part 2)

9 minute read

arxiv 2024

Large Language Models; A Survey (Part 1)

7 minute read

arxiv 2024

(Diffusion survey) (Part 1; xxx)

4 minute read

Diffusion Models and Representation Learning; A Survey (TPAMI 2024)

(Diffusion survey) (Part 1; xxx)

6 minute read

Diffusion Models and Representation Learning; A Survey (TPAMI 2024)

TinyGPT-V; Efficient Multimodal Large Language Model via Small Backbones

1 minute read

arxiv 2023

NExT-GPT; Any-to-Any Multimodal LLM

2 minute read

ICML 2024 Oral

ImageBind; One Embedding Space To Bind Them All

1 minute read

CVPR 2023 Highlighted Paper

DeepSpeed

2 minute read

Offload

1 minute read

Offload, DeepSpeed

Meta-Transformer; A Unified Framework for Multimodal Learning

less than 1 minute read

arxiv 2023

Janus-Pro; Unified Multimodal Understanding and Generation with Data and Model Scaling

3 minute read

arxiv 2025

Gradient Checkpointing

1 minute read

Sapiens; Foundation for Human Vision Models

less than 1 minute read

ECCV 2024

Q-LoRA

2 minute read

Quantization

less than 1 minute read

Float32 vs Float16 vs BFloat16

LLM 모델 파인튜닝을 위한 GPU 최적화 (4)

6 minute read

분산 처리 기법

Revisiting Feature Prediction for Learning Visual Representations from Video

1 minute read

TMLR 2024

LLM 모델 파인튜닝을 위한 GPU 최적화 (3)

2 minute read

Hugging Face & PEFT

LCM-LoRA; A Universal Stable-Diffusion Acceleration Module

less than 1 minute read

arxiv 2023

LLM 모델 파인튜닝을 위한 GPU 최적화 (2)

3 minute read

GPU vs CPU

Vision Transformers Need Registers

2 minute read

ICLR 2024 Oral

LLM 모델 파인튜닝을 위한 GPU 최적화 (1)

3 minute read

LLM & GPU

GPU 설명

2 minute read

feat ChatGPT

Emu; Enhancing Image Generation Models Using Photogenic Needles in a Haystack

1 minute read

arxiv 2023

FACET; Fairness in Computer Vision Evaluation Benchmark

less than 1 minute read

ICCV 2023

DINOv2; Learning Robust Visual Features without Supervision

1 minute read

TMLR 2024

I-JEPA; The First Human-Like Computer Vision Model

1 minute read

CVPR 2023

Consistency Models – Optimizing Diffusion Models Inference

1 minute read

ICML 2023

DeepSeek-R1; Incentivizing Reasoning Capability in LLMs via Reinforcement Learning

3 minute read

arxiv 2025

Titans; Learning to Memorize at Test Time

4 minute read

arxiv 2024

Large Concept Models; Language Modeling in a Sentence Representation Space

4 minute read

arxiv 2024

LLaMA-Mesh; Unifying 3D Mesh Generation with Language Models

1 minute read

arxiv 2024

DALL-E; Zero-Shot Text-to-Image Generation

1 minute read

ICML 2021

Speech LLMs; 3) Multimodal Information Fusion and Training Strategies

2 minute read

A Survey on Speech Large Language Models

Speech LLMs; 2) Recent Advances in Speech LLMs

12 minute read

A Survey on Speech Large Language Models

Speech LLMs; 1) Introduction

1 minute read

A Survey on Speech Large Language Models

[multimodal] Multimodal Transformer

1 minute read

Multimodal Transformer, Cross-modal attention, self-attention

[multimodal] Neural FE of signal data - (2) SincNet

2 minute read

Signal Data, Wav2Vec, SincNet, PASE

[multimodal] Neural FE of signal data - (1) Wav2Vec

1 minute read

Signal Data, Wav2Vec, SincNet, PASE

[multimodal] FE of signal data - (2) MFCC

2 minute read

Signal Data, Fourier Transform, MFCC

[multimodal] FE of signal data - (1) Fourier Transform

6 minute read

Signal Data, Fourier Transform, MFCC

[multimodal] (3) Alignment, (4) Fusion

3 minute read

Multimodal Learning, Multimodal Representations

[multimodal] (2) Translation

2 minute read

Multimodal Learning, Translation

[multimodal] (1) Multimodal Representations

4 minute read

Multimodal Learning, Multimodal Representations

[multimodal] Multimodal Learning 소개

2 minute read

Multimodal Deep Learning에 대한 소개글