That depends on your definition of the "North."
If, by the "North," you mean those that voted for Lincoln in 1860, then that's about right, however, if you mean the states composing the United States of America in 1864, that's not true. Missouri, Kentucky, Maryland, West Virginia, and...