I fear it is not as simple as that. For the US for instance there are counties between cities and states, at the other hand zip codes may cross counties and cities.
For most countries the administrative divisions have grown over the centuries, the US is a rather young country and it is therefore more structured than in most other countries.
A nice source for this kind of information is http://statoids.com/