@Ripleysbaby I can relate - though my solution often involves taking more than one camera - that's what day bags are for, after all
But that's only true if I go out to take images ...
Seriously, as long as it's a fun thing ("I like to be able to shoot a variety of subjects") and not a sort of advance panic ("I might not be able to shoot the best image ever"), there's not a lot to it. But I fully agree it's easy to overdo, and I surely have agonised over my choices in the past, more than once.
Today, if photography isn't going to be the main purpose, I carry one camera, mostly the LX100 or my previous first choice, the E-PM1 with 12-32mm; the latter's a beater anyway, so there's no point in being overly careful. I went with
to be able to do that, after all - in my earlier film days, I carried a Minox GT, later a GT-E, whereever I went.
However, when I'm going into town, the GR is more suitable and convenient (it's the real "GT-E" replacement, to be honest - though the GR is a much more serious camera).
For everything else, I'd need a bag anyway - which would, in theory, open up countless opportunities. Happily, I actually have a "go-to" camera I always pick when I'm undecided: the D5500 with one lens, usually the Sigma 30mm f/1.4 Art - sort of frugal, slightly flawed (the lens, that is ...), but heaps of fun.
M.