When I was doing a bunch of learning about linguistics, situations like this were very interesting and confusing to me. I still don't have a good working intuition for how this is possible. I don't understand what maintains the sound differences in the face of the continuous exposure to substantially different accents. It's empirically possible, but it's never made sense to me. Why don't you and your brothers end up talking the same after a while?