I must respond to this, seeing that stirner and egoists have been a huge inspiration to me and have gotten me more deeply into anarchist thought, especially primitivism (ill explain in a second!)
basically most of my life, i've been a fairly depressing negative person to be around (so other people say), even as young as elementary school. I've never been able to find interest in positivity, because to me it's usually so fake and bland. When I was finishing up high school I saw some more leftist shock-umentaries (like about how fucked up things actually are in the world when no one is realizing it) and I also learned about some really deep evils that were going on the poorer part of west virginia (where I live) that I didn't know about. Seriously, the coal industry down here in the 80's poisoned the drinking water of an entire community, killing 40 people and giving serious nuerological problems and property damage to so many more (this is the Rawl water case if you want to look it up.) I also read Ishmael during this time period, which really blew my mind but I didn't really care too much about it at the time because I thought it irrelevant that hunter-gatherers may have lived a better existence than we do, so i got much more into the leftist type activist activity and I didn't like anarchists I thought they were just stupid time wasters.
However, after i got really "passionate" about leftist activism (i was really just trying to escape a severe depression and anxiety i still have today at times), i just become a self-rightous prick. I started to push out other people's ideas and i wanted to be more militant, and this ended up stressing me out immensely so i just kinda dropped out and didn't even really think too much about politics for the next couple years.
I got really into individualist anarchism by accident when i was considering revamping some of my leftist energies....i was argueing with libertarians on facebook and screwed up a relationship with a great friend of mind because i thought he was a "stupid brainwashed conservative". So reading some individualist anarchism at the time was really the perfect thing for me, it took me a while to catch on to it. While im not the shining example of a happy self-actualized person today, it is absolutely true that you can't be happy denying yourself in sacrifice of ideals, which is basically what the left and every other political movement (like anarchism) is.
What your getting at with the "connection" between facism and individualist anarchism is is the fact that all ideas are interconnected in some way or another. There's just as much truth in the current trend of american conservatism as there are lies. This is why the left fails miserably in accomplishing its goals, because they play the game. If you point out how strip mining is poisoning the water and contaminating the air for the stupid rednecks nobody cares about, the conservative will just say "well, how are they gonna survive? strip mining is an opportunity for the poor people in the region" and the actual rednecks will say "stop trying to take our jobs you tree hugging faggot!". Now the current leftist trend is to promote solar energy, which undoubtably destroys mountains in china from the mining of rare earths.
but i have no illusions about individualism: it's ultimately a dead end because a life based on your desires and whims will be just as tragic as your life as a sweatshop worker. However, this in no way means we should continue down the road of masochistic slavery to morality. You can't save the proletariat, so as a middle class/upper middle class person you might as well just not get hung up in that delusion, because were all just intellectuals and most of us don't know anything about living in a working class background. I remember how Renzo Novatore wrote an essay about how people involved in the creative arts should "not stoop down to matters of the belly" because the proletariat are better at that, truly contemptuous thing to say about the working class but contains some truth in it.
all ideology is inherently limiting, which is the point. Once you accept the premises of the ideology you live to attain it and reject every clear contradiction that it contains. I learned this from arguing with anarcho-capitalist libertarians, who simply will not acknowledge the fact that the free market conditions of the industrial revolution created some of the worst lives possible for the majority of the population (only difference now is we export it!). It's pointless to talk to them about politics or really anybody else for that matter. However, political and social thought are definitely NOT irrelevant, they are constantly surrounding us! SHUT UP AND GET BACK TO WORK!
thats why the only way to really reject facism is to get back in touch with the natural world, everything else is tainted by it. Forests are a hell of a lot more beautiful than consumerism, money, monarchy, political screaming matches, artistic prestige, utopian sexual delusions, beer, movies, marxism, anarchism.....