I've been gradually switching my brass track to stainless. I have not noticed any problems, but I've put anti-corrosion paste on all the joints where I have different metals. I have some brass clamps, for example, on stainless track. I used anti-sieze compound from the auto parts store
On my track the trains tend to slow down a bit on the brass, unless it's just been cleaned. But otherwise no problem