Can I deploy the web project to two different locations with one update?

Yes, you can do that. One project can have multiple ftp or local destinations. But for each destination, you need to deploy the project individually.