About loss/accuracy curve

Hello everyone!
I am trying to train the model on slightly different setup, initializing from the author's weights. At the moment it reaches acc ~83-85 quite fast, but then struggles.
Can anyone share any observations on how accuracy or loss behaved for you. Or maybe there are any insights on how to train  