Sprinkle black pepper in the areas where they're coming in from. It'll keep the ants away and it won't harm your cats...they'll just sneeze a bit.