I can only give you my experience, others here have a hell of a lot more of that than me....
When I first bought my '74 CB, I talked to an old mechanic (whom I trust a great deal) that worked on these back in the day (and he currently wrenches to this day). He basically said the exact same thing, leave it alone, it's easy to break stuff, highly recommended leaving it alone and said it was probably just fine anyway. Well, that's hard info to take when you want to do things "right".
I did take that advice, but it wasn't long after getting the bike running that the timing chain jumped a tooth and I ended up doing a top end rebuild. The oil filter was removed and sure enough, there was hardly anything in there after all these years (of course I don't know when the last time it was "checked" either).
However, Franz was just describing in the Zinc thread that after changing to a certain kind of oil that scrubs the engine clean, it was necessary to clean this filter many times.
I imagine if you're careful and handy and know what you're doing there's no problem at all.