But also consider that there are Muslims who are opposed to this because they know this is not the correct way to build tolerance and acceptance.

Many religions have pasts but this isn't just about their past, this could very well affect their future. I think having a mosque there is going to increase anger towards Muslims and many, including some Muslims, agree with this.