I applaud you for how quick hotfixes are coming out, so amazing work.
BTW if you want to avoid a full download each time, have you tried using a git workflow like this?
That would mean that only changed files get uploaded by you and downloaded by clients each time any change happens. It does however require people to use a manager such as github desktop, but if you're making big changes it can be a lot easier for you. (Happy to talk you through it if needed).