That depends on your dataset. If you have a small dataset, you should first try the simplest model like ResNet50 and apply the Umap technique to evaluate the extracted features. As you know the feature extraction method is very quick, so don’t hesitate to test different versions of ResNet to better understand the influence of model architecture on the feature extraction task.