To be pedantic, it’s trademarks you have to actively defend. With copyright and patents there’s different exceptions, but you can usually sue for at minimum expected license fees (although sometimes you give up the possibility to sue for willful infringement & additional damages if you wait)