The 3D isn't really distracting like most movies, unless your troubles are with the glasses not the actual 3D part. But it's really subtle, just enough to give the movie depth which is really awesome.
I have an eye condition (akin to a lazy eye) that refuses to let me do the 3D thing. I had surgery to fix it a few years back, when I was around 19 or 20. It was so bad then I was unable to drive. :/ Constant double vision, awful headaches, concave lenses on my glasses. So much fun. Even after they cut into my eye muscles to fix it, I still have problems sometimes, especially when I get tired or read too much. :/
I sat through the first 5 minutes of the 3D version and it was way too fuzzy for me without the glasses. With the glasses, I wouldn't be able to even focus. It'd be a constant double image. :<
I'm making it my mission to see it this weekend! Errg!