I usually start popping the trees at the rear lower corner as there's one right in the corner; that lets you squeeze a finger behind the panel and "feel" for where the rest are so you can try to get the tool right on them instead of to the side where you're more likely to accidentally snap them out of the panel. They twist into slotted holes in the panel - some into MDF and some into plastic. It should be noted the large plastic piece facing the mounting area of the side mirror is plastic-welded to the inside panel and also has a christmas tree fastener behind it.
And yeah, once you have the switch bezel popped loose (use the door panel on it too, just take care) it can easily be fenagled through its corresponding hole in the panel as you remove the panel; no biggie at all. If you choose to replace the handle assembly you'll need to disconnect the window and lock switches which is a little bit of a pain. You might take a quick d-cam pic of the layout of the switches and also the wiring on them before disassembly. It's a little tricky getting the switches disconnected.
Richard