Set up Mirror Sites of services

[butler]

AS part of our effort to increase robustness, it would be nice to have mirror sites with automatic rollover for our "privately managed" cloud resources so that we are not blocked by the currently rather rare instances of service failures (power outages at UTK or DMSC, disk crashes, etc). In a first instance mirroring all the services at UTK at 2 other sites should be an achievable goal. If purchased right and if the build servers and Jenkins system at DMSC can be put into VMs/containers it might be possible to get the DMSC services mirrored using the same hardware?

Steps needed:

• Design system (how will it work)
• Identify hardware needed
• Identify location to house hardware
• Identify funding for hardware
• purchase and install hardware
• set up mirroring