If he knew that she was still running around, eating people, then yes. If she killed Sam or someone he knew really well, he won't just kill, he'll draw out the pain for as long as he can. Dean does have his vindictive moments, even if they are few and in between.