We did a trip to Key West in July and tried out several Key Lime Pies while we were there. Our favorite was Kermits (they have a few locations around town, one very close to the port) with the Key Lime Pie Co. as a close 2nd. Nearly all of the restaurants and bars we passed had live music at some point so that should be easy for you to find.