To change your business address in California you need to file an updated Statement of Information, as well as forms with the IRS, CA EDD, CA Franchise Tax Board, and other entities.