The largest portion of Biden voters are convinced that his age does not work in his favor