Security comes first from inside of you. Then, if you are very lucky, you will be in a position to find other people who also possess that same sort of security, and build some sort of family or community as a team.

A real relationship doesn't properly begin until the NRE burns away. That's when you have to start dealing with this person as an all-around human being, replete with irritating little habits. When disillusion sets in, love can begin.

(In reference to swingers) In the meantime, if you wish to declare yourself polyamorous, get used to the fact that the confusion is gong to remain as a pejorative. Sure, clear up the misunderstanding as much as you can, but don't put too much effort into setting yourself up as a "good", responsible, community-oriented polyamorist by contrasting yourself to the "bad" swingers - they may not be your siblings, but they're definitely your cousins.

Polyamorous people are wary of having others' values inflicted upon themselves, and so tend to stay very far away from making such pronouncements, to the point that they will actively ignore predatory behavior that is affecting their own "community.

So, a little advice. Relax. You're not filling a job position. You're looking for a pleasant acquaintance.. who might become a good friend... who turns out to be attractive to your senses... and a rewarding lover... then a committed partner whose heart will not stray. If you don't see those signposts and in that order, then you're probably on the wrong road and getting more lost with every step.