The author is claiming he knows why the fence was built, but now we've torn it down, which is not the normal way of using the CF idiom... but... doesn't mean it's not a reasonable usage.