I don't know exactly how it is in New York, but in the Bay Area you simply can't get a concealed carry permit. Legally such a thing exists but the sheriff's office just doesn't issue any. (corruption scandal excluded)
Non-residents may not posses a handgun in the city at all. The concept of Peacable Journey is basically ignored in NYC.