Opportunists. The cabal routinely sits near the Fortress or near Battle trying to pick off opponents there. The majority of them don't have the skill to 'bring it' and instead sit around waiting to pick off other cabals raiding/retrieving. The irritating part is that in the pecking order of cabal opponents and cabal dogma, you'll rarely see Fort or Battle reacting or proactively going after Outlander.

Plus, it's too easy to hide/escape/trap/gank due to chameleon.

There have been some great Outlanders. But the positioning of the cabal skews things a bit too much.