It's not permanent regen, but it's not on a timer. Therefore to remove it, you need to use a tag-out move or an ability that removes buffs (Silent Kill, Dublicious, Eliza's Chaos Banish, etc). It may also be possible to remove those regen stacks by applying a Bleed debuff, but I have not personally tried this.