app_offline.htm in Sharepoint 2010 Farm Environment

Hi,

We have a SP 2010 Farm Environment with 3 WFE's and 4 App Servers. To bring the sites offline for maintenance, Do we have to place the app_offline.htm file in all the servers or just the WFE's ?

Thanks,

Grace