This is a known issue that the developers are actively working on. It seems to be related to specific troops on your side or enemy side. Though not everyone has these crashes.
For the most part, it seems related to Horse Archers. Khuzait Horse Archers of T4 and T5 have been confirmed multiple times to cause crashes. Leaving these troops in a city should help with the crashes.