Self-SL

Deconstructing Denoising Diffusion Models for Self-Supervised Learning

4 minute read

TimesURL; Self-supervised Contrastive Learning for Universal Time Series Representation Learning

4 minute read

AAAI 2024

Time-LLM; TS Forecasting by Reprogrammming LLM

5 minute read

ICLR 2024

Parametric Augmentation for Time Series Contrastive Learning

4 minute read

ICLR 2024

Enhancing Representation Learning for Periodic TS with Floss; A Frequency Domain Regularization Approach

2 minute read

TimeSiam; A Pre-Training Framework for Siamese Time-Series Modeling

5 minute read

Self-supervised Contrastive Forecasting

8 minute read

ICLR 2024

DYffusion; A Dynamics-informed Diffusion Model for Spatio-temporal Forecasting

4 minute read

NeurIPS 2023

Data Augmentation for Seizure Prediction with Generative Diffusion Model

less than 1 minute read

arXiv 2023

Lag-Llama; Towards Foundation Models for Time Series Forecasting

3 minute read

Workshop on Robustness of Few-shot and Zero-shot Learning in Foundation Models at NeurIPS 2023

TimeGPT-1

4 minute read

arxiv 2023

All About Score-based Models

less than 1 minute read

All About Score-based Models

All About Diffusion

less than 1 minute read

All About Diffusion Models

T-Rep; Representation Learrning for TS using Time-Embeddings

3 minute read

NeurIPS 2023

T-Rep; Representation Learrning for TS using Time-Embeddings

3 minute read

ICLR 2024 (?)

Toward Enhancing TS Contrastive Learning; A Dynamic Bad Pair Mining Approach

4 minute read

ICLR 2024 (?)

PatchMixer; A Patch-Mixing Architecture for Long-term Time Series Forecasting

2 minute read

ICLR 2024(?)

DAM; Towards a Foundation Model for Time Series Forecasting

6 minute read

ICLR 2024(?)

Siamese Masked Autoencoders

3 minute read

NeurIPS 2023

FilterAugment; An Acoustic Environmental Data Augmentation Method

4 minute read

Interspeech 2022

SpecAugment++; A Hidden Space Data Augmentation Method for Acoustic Scene Classification

less than 1 minute read

Interspeech 2021

SpecSwap; A Simple Data Augmentation Method for End-to-End Speech Recognition

less than 1 minute read

Interspeech 2020

SpecAugment on Large Scale Datasets

3 minute read

ICASSP 2019

SpecAugment; A Simple Data Augmentation Method for Automatic Speech Recognition

less than 1 minute read

arxiv 2019

Patch-Mix Contrastive Learning with Audio Spectrogram Transformer on Respiratory Sound Classification

2 minute read

Interspeech 2023

CLAR; Contrastive Learning of Auditory Representations

2 minute read

AISTATS 2021

Unsupervised Contrastive Learning of Sound Event Representations

2 minute read

arxiv 2020

Contrastive Learning of General Purpose Audio Representations

2 minute read

ICASSP 2020

Self-Supervised Learning with Random-Projection Quantizer for Speech Recognition

6 minute read

ICML 2022

MAE-AST; Masked Autoencoding Audio Spectogram Transformer

3 minute read

Interspeech 2022

Contrastive Audio-Visual Masked Autoencoder

7 minute read

ICLR 2023

Score-based Generative Modeling by Diffusion Process

4 minute read

Score-based Generative Modeling by Diffusion Process

Masked Spectrogram Prediction For Self-Supervised Audio Pre-Training

3 minute read

arxiv 2022

CMKD; CNN/Transformer-Based Cross-Model Knowledge Distillation for Audio Classification

7 minute read

arxiv 2022

Rethinking CNN Models for Audio Classification

3 minute read

arxiv 2020

Learning Problem-agnostic Speech Representations from Multiple Self-supervised Tasks

3 minute read

arxiv 2019

Wav2Vec 2; A Framework for Self-Supervised Learning of Speech Representations

3 minute read

NeurIPS 2020

Wav2Vec; Unsupervised Pre-training for Speech Recognition

2 minute read

arxiv 2019

Audio Self-supervised Learning; A Survey

11 minute read

arxiv 2022

SSAST; Self-Supervised Audio Spectrogram Transformer

4 minute read

AAAI 2022

BEATs; Audio Pre-Training with Acoustic Tokenizers

13 minute read

ICML 2023

Masked Autoencoders that Listen

12 minute read

NeurIPS 2022

Unsupervised feature learning for audio classification using convolutional deep belief networks

1 minute read

NeurIPS 2009

Transfer Learning with Deep Tabular Models

2 minute read

ICLR 2023

On Embeddings for Numerical Features in Tabular Deep Learning

2 minute read

NeurIPS 2022

TransTab; Learnable Transferable Tabular Transformers across Tables

5 minute read

TransTab (NeurIPS 2022)

SAINT; Improved Neural Networks for Tabular Data via Row Attention and Contrastive Pre-training

8 minute read

SAINT

TabTransformer; Tabular Data Modeling Using Contextual Embeddings

5 minute read

TabTransformer

Semi-SL & Self-SL for Tabular Data

3 minute read

VIME, SubTab, SCARF, Contrastive Mixup

(paper 102) DCdetector; Dual Attention Contrastive Representation Learning for TS Anomaly Detection

5 minute read

KDD 2023

(paper 101) LLM4TS; Two-stage Fine-tuning for TSF with Pretrained LLMs

4 minute read

2023

(paper 85) SSL for TS Analysis; Taxonomy, Progress, and Prospects

8 minute read

2023

(paper 95) CALDA; Improving Multi-Source Time Series Domain Adaptation with Contrastive Adversarial Learning

8 minute read

2021

(paper 93) Contrastive Learning for Unsupervised Domain Adaptation of Time Series

6 minute read

2023

(paper 92) Diffusion-based TS Imputation and Forecasting with SSSM

3 minute read

2022

(paper 89) PatchTST Experiments

3 minute read

2023

(paper 88) Novel Class Discovery; an Introduction and Key Concepts

14 minute read

2023

(paper 87) Self-Damaging Contrastive Learning

7 minute read

2021

(paper 86) CReST; A Class-Rebalancing Self-Training Framework for Imbalanced Semi-Supervised Learning

8 minute read

2021

(paper 85) M2m; Imbalanced Classification via Major-to-Minor Translation

14 minute read

2020

(paper 84) SSL is More Robust to Dataset Imbalance

8 minute read

2022

(paper 83) The Tunnel Effect; Building Data Representations in Deep Neural NEtworks

9 minute read

2023

(paper 83) Rethinking the Value of Labels for Improving Class-Imbalanced Learning

10 minute read

2020

(paper 82) Self-supervised learning of Split Invariant Equivariant representations

8 minute read

2023

(발표 자료) Beit; Bert pre-training of image transformers

less than 1 minute read

(발표 자료) SSL with TS data

(발표 자료) MIM, CL

less than 1 minute read

(발표 자료) MIM, CL

(paper 78) MICN; Multi-Scale Local and Global Context Modeling for LTSF

9 minute read

2023

(paper 77) ScaleFormer; Iterative Multi-scale Refining Transformers for TS Forecasting

3 minute read

2023

(paper 76) CrossFormer; Transformer Utilizing Cross-dimension Dependency for MTS Forecasting

10 minute read

2023

(paper 75) SimTS; Rethinking Contrastive Representation Learning for Time Series Forecasting

5 minute read

2023

(paper 74) Layer Grafted Pretraining; Briding Contrastive Learning and Masked Image Modeling for Label-Efficient Representations

5 minute read

2023

(paper 73) Masked Image Modeling with Denoising Contrast

7 minute read

2023

(paper 72) DINOv2; Learning Robust Visual Featurers without Supervision

3 minute read

2023

(발표 자료) SSL with TS data 3

less than 1 minute read

연세대학교 기초연구실 발표자료

(paper) CAN; A Simple, Efficient and Scalable CMAE framework for learning Visual Representations

3 minute read

2023

(paper) Contrastive Masked Autoencoders are Stronger Vision Learners

6 minute read

2022

(paper) Manifold Mixup; Better Representations by Interpolating Hidden States

5 minute read

2019

(paper) mixup; Beyound Empirical Risk Minimization

3 minute read

ICLR 2018

(paper) SimMTM; A Simple Pre-Training Framework for Masked Time-Series Modeling

6 minute read

2023

(paper) Soft Neighbors are Positive Supporters in Contrastive Visual Representation Learning

4 minute read

2023

(paper) Leaves; Learning Views for TS Data in Contrastive Learning

5 minute read

2023

(발표 자료) SSL with TS data

less than 1 minute read

연세대학교 기초연구실 발표자료

(paper) A Time Series is Worth 64 Words ; Long-term Forecasting with Transformers

7 minute read

2023

(paper 71) Adaptive Soft Contrastive Learning

5 minute read

2022

(paper 70) Vision Transformer for Small-Size Datasets

5 minute read

2021

(paper) Ti-MAE ; Self-Supervised Masked TS Auto Encoders

8 minute read

2023

(paper 70) Contrastive Vicinal Space for Unsupervised Domain Adaptation

8 minute read

2021

(paper 69) Efficient Training of Visual Transformers with Small Datasets

3 minute read

2021

(paper 69) Similarity Contrastive Estimation for Self-Supervised Soft Contrastive Learning

3 minute read

2022

(paper 68) Contrastive and Non-Contrastive Self-Supervised Learning Recover Global and Local Spectral Embedding Methods

6 minute read

2022

(발표 자료) T-Loss with MTS, TNC

less than 1 minute read

연세대학교 기초연구실 발표자료

(paper 67) A Data-Augmentation Is Worth A Thousand Samples

8 minute read

2022

(발표 자료) SwAV, DeepDPM

less than 1 minute read

연세대학교 기초연구실 발표자료

(paper 66) SemiTime

1 minute read

2021

(paper 65) SeqCLR

1 minute read

2020

(paper 64) Mixing Up CL ; SSL for TS

3 minute read

2022

(paper 63) SSL for Semi-Supervised TSC

2 minute read

2020

(paper 62) SSL for TS Anomaly Detection

5 minute read

2022

(paper 61) CA-TCC

8 minute read

2022

(paper 60) Semi-unsupervised Learning for TSC

3 minute read

2022

(paper 59) Large Scale Time-Series Representation Learning via Simultaneous Low and High Frequency Feature Bootstrapping

4 minute read

2022

(code) Temporal Neighborhood Coding (TNC)

3 minute read

Temporal Neighborhood Coding (TNC)

(paper 58) CaSS

8 minute read

2022

(code) Causal CNN

3 minute read

Causal CNN

(paper 57) Contrastive Learning based self-supervised TS analysis

4 minute read

2022

(code) Triplet Loss for Time Series

4 minute read

Triplet Loss for Time Series

(paper 56) SS Pre-training for TSC

4 minute read

2021

(paper 55) TF-C

7 minute read

2022

(paper 54) Self-Supervised TS Representation Learning with Temporal-Instance Similarity Distillation

3 minute read

2022

(paper 53) Self-Time

5 minute read

2021

(paper 52) CORE

1 minute read

2021

(paper 51) TabNet

2 minute read

2021

(paper 50) Contrastive Mixup

4 minute read

2021

(paper 49) VIME

7 minute read

2020

(paper 48) VICReg

2 minute read

2022

(paper 47) DINO

2 minute read

2021

(paper 46) Barlow Twins

1 minute read

2021

(paper 45) CAE

2 minute read

2022

(paper 44) SimMIM

1 minute read

2022

(paper 43) BEIT

3 minute read

2022

(paper 42) MSN

3 minute read

2022

(paper 41) ConvMAE ; Masked Convolution Meets Masked Autoencoders

1 minute read

2022

(paper 40) GraphCL

2 minute read

2021

(paper 39) AugSelf

1 minute read

2021

(paper 38) i-Mix

4 minute read

2021

(paper 37) Augmenting Supervised Neural Networks with Unsupervised Objectives for Large-scale Image Classification

1 minute read

2016

(paper 36) Supervised Contrastive Learning

2 minute read

2021

(paper 35) Mitigating Embedding and Class Assignment Mismatch in Unsupervised Image Classification

3 minute read

2020

(paper 34) SCAN

2 minute read

2020

(paper 33) TS2Vec

3 minute read

2022

(paper 32) TS-TCC

4 minute read

2021

(paper 31) Invariance Propagation

less than 1 minute read

2020

(paper 30) Self-Labeling via Simultaneous Clustering and Representation Learning

1 minute read

2020

(paper 29) Automatic Shortcut Removal for-Self-Supervised Representation Learning

1 minute read

2020

(paper 28) Self-supervised Label Augmentation via Input Transformations

3 minute read

2020

(paper 27) Boosting Few-Shot Visual Learning with Self-Supervision

3 minute read

2019

(paper 26) Unsupervised Pre-training of Image Features on Non-Curated Data

3 minute read

2019

(paper 25) Self-Supervised Generalization with Meta Auxiliary Learning

4 minute read

2019

(paper 24) Selfie

1 minute read

2019

(paper 23) S4L

2 minute read

2019

(paper 22) DeepCluster

1 minute read

2019

(paper 21) BigBiGAN

less than 1 minute read

2019

(paper 20) AMDIM

2 minute read

2019

(발표 자료) SimCLR, MoCo v1&v2

less than 1 minute read

연세대학교 기초연구실 발표자료

(paper 19) Auto-Encoding Transformation (AET)

1 minute read

2019

(paper 18) Contrastive Multiview Coding (CMC)

2 minute read

2019

(paper 17) Self-Supervised GAN

1 minute read

2019

(paper 16) Revisiting SSL

less than 1 minute read

2019

(paper 15) Rotation Feature Decoupling

2 minute read

2019

(paper 14) Contrastive Predictive Coding (CPC)

2 minute read

2019

(paper 13) TeachAugment

3 minute read

2021

(paper 12) SelfAugment

4 minute read

2021

(paper 11) With a Little Help from My Friends; Nearest-Neighbor Contrastive Learning of Visual Representations

1 minute read

2021

(paper 10) Your Contrastive Learning is Secretly Doing Stochastic Neighbor Embedding

5 minute read

2022

(paper 9) SwAV

6 minute read

2021

(paper 8) DeepDPM

5 minute read

2022

(paper 7) Prototypical Contrastive Learning (PCL)

1 minute read

2021

(paper 6) CSI

4 minute read

2020

(paper 5) SimSiam

1 minute read

2020

(paper 4) BYOL

2 minute read

2020

(paper 3) MoCo v2

less than 1 minute read

2020

(paper 2) MoCo v1

3 minute read

2020

(paper 1) SimCLR

2 minute read

2020

Contrastive Learning 소개 (2)

2 minute read

Contrastive Learning

Contrastive Learning 소개

1 minute read

Contrastive Learning

(paper) Mixing Up Contrastive Learning ; Self-Supervised Representation Learning for TS

2 minute read

Time Series Representation, Contrastive Learning (2022)

(paper) Unsupervised Representation Learning for TS with Temporal Neighborhood Coding

3 minute read

Representation Learning (2021, 14)

(code) Global, Local, Global & Local

less than 1 minute read

Global, Local, Global & Local

(code) DTW inverse sample

1 minute read

DTW inverse sample

(paper) Unsupervised Scalable Representation Learning for Multivariate Time Series

2 minute read

2019, Triplet Loss