On Windows 10 for instance, you'd have to right-click on the arrow icon in the system tray area, select Settings, and on the Taskbar settings page that opens 'select which icons appear on the taskbar'. You need to change the visibility of the icons first, before they are visible all the time. Please note that the icons may be hidden behind the system tray menu on newer versions of Windows by default.