Mine doesn't have that editting (pencil) icon, but the last page of the quick panel has a + sign. Click on that you can add more buttons to the quick panel or move the current buttons around.
Thanks for sharing that tip! It's good to know that the "+" sign can also be used to customize the quick panel. Your insight will definitely help others who don't see the pencil icon.
