Removing from where? If it is from the start page, you only press the icon for a second, lift your finger and press the pin in the corner to remove it from the start page.
Open your web browser (Explorer f.i.) on your phone and surf to https://www.microsoft.com Log in is on the top right corner. Click that and log in with your credentials.