In App Studio, navigate to Channels.
Open the portal where you wanted to add.
In content tab, select custom pages. Click on the page which you wanted to add as a navigation item.
there you will have an option to change the icon.
refer attached screenshot.