I'm surprised E6000 didn't work for you. It's one of the best flexible adhesives out there.
I would not suggest epoxy because it is stiff and brittle. As the barrette is flexed the epoxy is likely to crack away from the barrette. I DO think epoxy is great for many uses. I've made 1000's of Swarovski crystal posts with it. But it's too stiff for a barretter that will flex with use.
The only suggestion I can make is to clean both parts with alcohol and to roughen up the polymer clay so it has enough "tooth" to hold.
When your work fell apart, did the glue stay on the metal or on the clay? Or did it separate from both parts? That will give you some indication of what stuck and what didn't.