Had the same issue. Bannerlord online for some reason defaults to using the native processor on your machine - AKA your graphics card is not processing what it should be. You can easily change this in the game by:
Options>Video>Change "Selected Adapter" to your GPU
After this, your GPU memory should be back at 3500mb
