Too much CO2 CAN kill fish. If this were the culprit, you should see the fish gasping for oxygen at the water surface or hovering at the flow outlet of the filter. If the fish are not doing this, I would not suspect CO2 (but I've been wrong before...

) .
CO2 supplementation will also lower your pH to some extent. Have you checked what your pH is?
-Dave