After just doing what ended up being a in frame rebuild, my little willys ran great, but then it devolved a BAD tappet knock. With the engine idling, I noticed if I put sideways pressure on the noisy valve, it became quieter. On a hunch, the valve retainer was swapped with one from my parts engine. Problem solved. This is what the old one looked like.

The valve retainers are uneven, I'm guessing that was causing the spring to rock back and forth just enough to pop. Any thoughts?