Are you shutting down all non-essential programs (especially anti-virus) before starting the game?

If your friend's system specs are essentially the same as your and your brother's systems (comparable CPU / GPU / HHD or SSD?), then the difference would have to be drivers/software or some kind of system dependant issue with the game.

Does your brother also have compatible load times for single player?