I've found a gem! A wabi-sabi hot spring minsu inside Xinzhou Ancient City.

Shanxi's very own hot spring town. Just outside the door is Xinzhou Ancient City. Wabi-sabi style rooms. Double beds, twin beds, rooms for parents and children, and family rooms meet the travel needs of different groups of people. And don't worry about the cleanliness of public hot springs, here, the hot spring water comes directly into your room. You can get up and comfortably enter the hot spring pool. They also have a super cute puppy. Remember to play with it when you have free time. Qieman Hot Spring Minsu (Xinzhou Ancient City Branch)