Canada's Building permits fell 3.9 percent in November, following a revised gain of 11.6 percent and better than median estimates of -5.0 percent.