Even though you can go through the museum in just 20 minutes and there are no English descriptions, it can still be a well-spent time to get a basic overview of what Icelandic nature, and especially its fauna, actually looks like.
It is located at Hamraborg 6 in Kópavogur, right next to the Hamraborg bus stop.
