Solider with ViT architecture

[VVebSharE]

1. Have you done any experiments with ViT architecture for Solider.
2. Do you have any idea how will results(any small scale experiments) with ViT as it could be comparable to other pretraining strategies with uses ViT backbones.
3. If you also trained ViT version of Solider would you like to share the pretrained weights.