A more deliberate (some might say sneaky, but I'd prefer it if I was in the situation) move would be to take an extra week or two to have some of your management do some feeling out of who would be 100% opposed to remote so you could include them in the layoff list, but also don't force people to uproot just to be laid off.

But at least you could avoid some of the "unregretted attrition" of people you decided to keep.

(This assumes Musk isn't intentionally sequencing things to limit the "official" size of the layoff while actually wanting to cut a significantly larger percentage.)