LOST: 1804 to Thomas Jefferson 1808 to James Madison In 1800, he was the Federalist candidate for vice-president, and for president in 1804 and again in 1808, receiving 14 electoral votes in the former and 47 in the latter year.