Wigan Genealogy

Several of my distant relatives seem to have come from Little Milton in Oxfordshire certainly by the 1870's. Their surnames were Wharton and Busby. That's two families who came from there to Wigan and were married here. Just wondering what was happening at that time to make them come up north.