https://github.com/huggingface/diffusers/blame/92a57a8e84a98a4da87b6a0621615eed4a23edc4/src/diffusers/pipelines/stable_diffusion/convert_from_ckpt.py#L1344
init_empty_weights() is imported from accelerate if is_accelerate_available() returns true. However if that's not the case there is no fallback.
We had to pin diffusers to 0.18.1 in nod-ai/AMD-SHARK-Studio#1648