If you want to go into Manhattan, I recommend any of the hotels in the Newport/Jersey City area. There are two PATH train stations in the area that will take you either to Midtown (Harold Square) or downtown (World Trade Center). Even if you just want to say in Jersey there is a ton of restaurants and shopping in walking distance. It is also super convenient to the port, only 20 minutes and you don't have to deal with NYC tunnel traffic.