I would assume that Allah Subhannu Wa Taala would be pleased that his creation would show modesty in his house during worship. Your entire focus during Hajj is Worshipping Allah your heart, brain, and soul must be focused on the objective of Worshiping Allah. You must be able to see the Kaaba but not blind. “Allah has seventy thousand veils of light and darkness; if He were to remove them, the radiant splendors of His Face would burn up whoever (or 'whatever creature') was reached by His Gaze.” My Lord, grant me complete severance of my relations with everything else and total submission to You. Enlighten the eyes of our hearts with the light of their looking at You to the extent that they penetrate the veils of light and reach the Source of Grandeur, and let our souls get suspended by the glory of Your sanctity.