Building willpower is similar to building muscle. Continually exercising without giving yourself a break is not the best way to increase your strength or performance.
Don't allow yourself to be in a position where you constantly have to exercise self-control. It will eventually deplete your resolve. Allow yourself some recovery time away from temptation.