I mean it's not like they were the only ones fooled by the glasses thing. Lex Luthor is supposed to be a genius and even he doesn't know. (*1) And Jimmy Olsen is his biggest fan. Although this might explain why Clarks' pissy all the time--he's sick of all the dumb people on Earth.
*1 Actually there was a non-Silver Age story that had Luthor figure it out but he dismissed it because the idea was too ridiculous.