You can change the theme in Outlook on the web follows:
1. In the upper right corner, click on the cog wheel icon and select Change theme:
2. Select a theme and click OK:
Outlookin selainliittymän teeman muuttaminen