Interruptions in voice chat can be caused by software faults in your router. Try rebooting the router.
Voice chat can function incorrectly in networks that include some types of NAT transversal or firewall components.
Note that running Xfire while playing disables voice keyboard bindings. A workaround for this is to use the middle mouse button as your talk key.
Make sure that your router is updated and running the very latest software.
Test your voice connection with the default settings (SIP ALG enabled, SPI Firewall enabled, and special forwarding rules disabled).
If voice chat doesn't work reliably, try disabling SIP ALG first (if possible).
If voice chat still doesn't work reliably, try disabling the SPI Firewall as well (if possible).
If none of this helps, check voice chat by connecting to another router, or connect your computer directly to the cable router.