You don´t need to remove the rivets, only the screws. The handle screws won´t come out totally. When they are loose and the third screw is out, you just need to force the back cover until it comes out! I use the screwdriver as a lever because it requires some strength. Sorry about my bad english.