You can also refer to transfer learning with fine tuning technique for such a classification problem. There are a lot of pretrained models which are available on keras: https://keras.io/api/applications/