For the person with the influence totem, the votes are counted twice. If the person is affected by a Pacifism Totem or a Narcolepsy Totem, their vote doesn't count anyway, so that totem is useless in that scenario.