I upshift without the clutch pretty much every time. It's very easy to make it smooth by just backing off a bit on the throttle.
I downshift without the clutch a lot, but not every time. It can work very smoothly if you are coming to a stop and back off on the regen a little, but it doesn't always work as well as upshifting, especially if you have multiple gears to shift. I sometimes do it in traffic, but since it doesn't always work I don't rely on it in that case. If it fails to work it usually just resists and you can tell without making any crunching noises. It usually either doesn't go, or it goes smoothly.
As far as I can tell, especially on the upshifts, it snicks so smoothly into the next gear that I can't imagine it is doing anything bad to the transmission. Nothing odd showed up at my break-in transmission oil change, but it will be more interesting to see the first maintenance oil change shows any evidence of unusual wear...