As long as you have a valid access pass and fishing license I don't see why not. Swimming is not allowed. So it's not a clear cut go. I suspect that if you are wearing waders or hip boots your alright. If your standing there in a bathing suit you might have a problem. So call the DEP and get a clear answer.
Good Luck