I got to pondering this last night. After playing a round of Sengoku 3 (one of the best Beat em ups ever)
I asked around the consensus seems to be Metal Slug 3, Garou, and Samurai Shodown 2.
Crystalis also got a few mentions.
I'm gonna poll here. These games almost always come up in a disucssion about SNK.