UP CM Yogi Adityanath on Sunday took a dig at the Opposition over the Ram Mandir issue, saying only the BJP could build the temple in Ayodhya.