I have learned that not all castle are made of stones, some are made of wood, like that of Japanese castles, and that's how I understood that We could not find the remains of these castles.
When I watched the olympics held at London, they did not even show the age of medieval period, as if they (British are ashamed to show that period} in their history.