The compression test in air_llm/tests/test_compression.py verifies that compress_layer_state_dict / uncompress_layer_state_dict achieves lossless round-trip for None compression and RMSE < 0.1 for '4bit' and '8bit' modes on float16 tensors — see Compression for the underlying API and behavior.[1] Test tensors are randomly generated with shape (32, 128) in float16 dtype and placed on CUDA, so a CUDA-capable GPU is required to run the suite.[1]
Sources