Yes. When digging too close to the house, you most likely will be removing some gravel along with sand or dirt. When this happens, water will over saturate that area causing shifting which leads to cracking foundations and walls. Also, sometimes the drain tile will become clogged causing slow water drainage that attract termites. Thanks Thaddius!