Are there specific URLs or ports we need to open on our firewall?

You need to open port 80, 443, 1640, and 5223 in order to get a connection to the ATMS cloud and app upgrade services.