Yah, out of state doesn't matter. I had a car with Florida plates for a few years, parked curbside for part of that time. Never had trouble on account of the out of state plates (you see them all over the place, btw) though I got a couple of tickets for whatever parking sins I committed.
Just heed hours posted on the street-cleaning signs and don't block someone's driveway or park near a parking meter (unless you intend to feed it).
I think over your way there is at least one street with no side-of-street parking rules. 46th St.? I've seen cars parked there for months, maybe years.
I think the only plates that come with any immunity are Diplomatic Consular U.N. types.