Of course it will.
Just shows you are in an AT&T 4G LTE area. Doesn't mean you are connected at 4G.
Seems stupid to me and ridiculous. Should show what you are connected as
Might also be subtle marketing. Makes you long to upgrade to the next iPhone that comes out knowing you have 4G coverage around you but can't get it with the current iPhones around