Salaamu Alaikum,
No, you are not wrong. I don't want to give my own Fatwa but insha Allah you can read the Fatwa below by our beloved Shaikh Abdul Aziz Bin Baz.
The Ruling on Celebrating the Prophet's Birthday
Question: Is it permissible for Muslims to celebrate in the Masjid with...