Issues

Gradient overflow. Skipping step, loss scaler 0 reducing loss scale to xxxx
SwinTransformer/Transformer-SSL#19 · opened on Oct 27, 2023
pretrain fails when image categories are similar
SwinTransformer/Transformer-SSL#18 · opened on Aug 31, 2023
Will apex mixed precision training affect the accuracy of the model?
SwinTransformer/Transformer-SSL#17 · opened on Apr 3, 2023
Download links of DeiT-S and Swin-T backbone models are interchanged
SwinTransformer/Transformer-SSL#16 · opened on Nov 28, 2022
Have you tried any other initial patch size in the swin transformer apart from the patch size = 4?
SwinTransformer/Transformer-SSL#13 · opened on Apr 1, 2022
The interpolation method for BYOL augmentation is wrong
SwinTransformer/Transformer-SSL#12 · opened on Dec 11, 2021
1
Train MoBy-SwinT on local machine with one GPU
SwinTransformer/Transformer-SSL#11 · opened on Nov 12, 2021
2
Some questions about relative_position_index and attn_mask
SwinTransformer/Transformer-SSL#10 · opened on Oct 31, 2021
300 epoch DeiT-S and Swin-T checkpoints dowload links are same
SwinTransformer/Transformer-SSL#9 · opened on Oct 19, 2021
dataloader error
SwinTransformer/Transformer-SSL#8 · opened on Sep 23, 2021
How to load a checkpoint when using the swin transformer as the backbone in a Mask-RCNN model
SwinTransformer/Transformer-SSL#7 · opened on Sep 17, 2021
Question about the detection/segmentation results
SwinTransformer/Transformer-SSL#6 · opened on Sep 15, 2021
TypeError: 'Compose' object is not iterable
SwinTransformer/Transformer-SSL#5 · opened on Jul 26, 2021
2
config setting "NORM_BEFORE_MLP" takes no effect
SwinTransformer/Transformer-SSL#4 · opened on Jun 23, 2021
Cannot import vit_deit_small
SwinTransformer/Transformer-SSL#3 · opened on Jun 9, 2021
1
Strange output log
SwinTransformer/Transformer-SSL#2 · opened on May 28, 2021
12
Multi-machine training
SwinTransformer/Transformer-SSL#1 · opened on May 13, 2021