You can drink tap water. But, you will also find mineral water everywhere.
It is important to make sure you drink a lot, especially when out walking and on hot days.