You will find a lot of towns and cities in the USA are named after English settlements.
New York is an example. York is a place in England.
Before it was New York, it was New Amsterdam, Amsterdam being the Dutch capital (As New York use to be a Dutch settlement)
Hence Norfolk suits well as it is an English settlement originally, the Americans just like to steal things like that:P