PaliGemma 구현 Part 2
modeling_gemma
Multimodal Deep Learning
PaliGemma 구현 Part 1
modeling_siglip, processing_paligemma
All about SAM
Segment Anything
All about Mistral
Mistral 7B, Mixtral 8x7b
(sLM-6c) Prompt Engineering 실습 3
Phi-3-3.8B (Multi-turn PE, Generated Knowledge PE)
(sLM-6b) Prompt Engineering 실습 2
Mistral-7B (CoT PE, Zero-shot PE)
(sLM-6a) Prompt Engineering 실습 1
LLaMA-3-8B (Multi-turn PE, Few-shot PE)
(sLM-6) Prompt Engineering
Flash Attention 개념, 코드 실습
(sLM-5) Flash Attention
Flash Attention 개념, 코드 실습
(sLM-3) sLM 구축을 위한 기반 기술
Hugging Face, OLLaMA, LangChain, VectorDB, RAG
(sLM-2) LLM 모델 평가방법
LLM 평가, LLM 기반 시스템 평가
(sLM-1) Introduction to sLM
sLLM, sLLM vs LLM, sLLM 예시
VLM survey - slides
94 Architectures
VLM summary
94 Architectures
VLM downstream tasks
VLM downstream tasks
All about DeepSeek
arxiv 2024
LLM Fine-tuning 실습 프로젝트 - Part 7
Inference
LLM Inference를 위한 라이브러리
LLM Inference를 위한 라이브러리
LLM Fine-tuning 실습 프로젝트 - Part 6
DPO 데이터셋 구축 & DPO 수행
LLM Fine-tuning 실습 프로젝트 - Part 5
SFT 데이터 & Full-finetuning 하기
LLM Fine-tuning 실습 프로젝트 - Part 4
Evolving
LLM Fine-tuning 실습 프로젝트 - Part 3
LLM을 통한 데이터 생성
LLM Fine-tuning 실습 프로젝트 - Part 2
Open Source Model 종류 및 특징
DPO 데이터 관련 실습
DPO 데이터 전처리 & 생성하기
LLM 모델 파인튜닝을 위한 GPU 최적화 (4) 실습2
Multi-GPU
FSDP, ZeRO 예제
FSDP, ZeRO 예제
LLM 모델 파인튜닝을 위한 GPU 최적화 (5)
분산 처리 기법
LLM 모델 파인튜닝을 위한 GPU 최적화 (4) 실습
Single GPU 환경에서 LLM 돌리기
LLM 모델 파인튜닝을 위한 GPU 최적화 (3)
Hugging Face & PEFT
LLM 모델 파인튜닝을 위한 GPU 최적화 (2)
GPU vs CPU
LLM 모델 파인튜닝을 위한 GPU 최적화 (1)
LLM & GPU
Unveiling Encoder-Free Vision-Language Models
NeurIPS 2024
(VLM survey) (Part 4; VLM Transfer Learning)
arxiv 2024
(VLM survey) (Part 3; VLM Pretraining)
arxiv 2024
(VLM survey) (Part 1; Intro & Background)
arxiv 2024
Large Language Models; A Survey (Part 4)
arxiv 2024
Large Language Models; A Survey (Part 3)
arxiv 2024
Large Language Models; A Survey (Part 2)
arxiv 2024
Large Language Models; A Survey (Part 1)
arxiv 2024
(Diffusion survey) (Part 1; xxx)
Diffusion Models and Representation Learning; A Survey (TPAMI 2024)
(Diffusion survey) (Part 1; xxx)
Diffusion Models and Representation Learning; A Survey (TPAMI 2024)
MLLM Benchmarks
MME, MMMU, GQA, ChartQA, POPE, NoCaps, TextVQA
NExT-GPT; Any-to-Any Multimodal LLM
ICML 2024 Oral
DeepSeek-VL2; Mixture-of-Experts Vision-Language Models for Advanced Multimodal Understanding
arxiv 2024
ImageBind; One Embedding Space To Bind Them All
CVPR 2023 Highlighted Paper
Qwen-VL; A Versatile Vision-Language Model for Understanding, Localization, Text Reading, and Beyond
arxiv 2023
PPO in RLHF vs DPO
Proximal Policy Optimization, Direct Preference Optimization
Offload
Offload, DeepSpeed
Quantization
Float32 vs Float16 vs BFloat16
Visual Instruction Tuning
NeurIPS 2023 Oral
Vision Transformers Need Registers
ICLR 2024 Oral
GPU 설명
feat ChatGPT
Titans; Learning to Memorize at Test Time
arxiv 2024
Speech LLMs; 3) Multimodal Information Fusion and Training Strategies
A Survey on Speech Large Language Models
Speech LLMs; 2) Recent Advances in Speech LLMs
A Survey on Speech Large Language Models
Speech LLMs; 1) Introduction
A Survey on Speech Large Language Models
[multimodal] Multimodal Transformer
Multimodal Transformer, Cross-modal attention, self-attention
[multimodal] Neural FE of signal data - (2) SincNet
Signal Data, Wav2Vec, SincNet, PASE
[multimodal] Neural FE of signal data - (1) Wav2Vec
Signal Data, Wav2Vec, SincNet, PASE
[multimodal] FE of signal data - (2) MFCC
Signal Data, Fourier Transform, MFCC
[multimodal] FE of signal data - (1) Fourier Transform
Signal Data, Fourier Transform, MFCC
[multimodal] (3) Alignment, (4) Fusion
Multimodal Learning, Multimodal Representations
[multimodal] (2) Translation
Multimodal Learning, Translation
[multimodal] (1) Multimodal Representations
Multimodal Learning, Multimodal Representations
[multimodal] Multimodal Learning 소개
Multimodal Deep Learning에 대한 소개글