idZddlZddlmZmZmZddlmZmZddl m Z ddl m Z ddl mZmZmZmZmZmZmZdd lmZdd lmZeee eee d Zeeeeeed ZGd d Zy)z Adapted from https://github.com/huggingface/transformers/blob/c409cd81777fb27aadc043ed3d8339dbc020fb3b/src/transformers/quantizers/auto.py N)DictOptionalUnion)BnB4BitDiffusersQuantizerBnB8BitDiffusersQuantizer) GGUFQuantizer)NVIDIAModelOptQuantizer)BitsAndBytesConfigGGUFQuantizationConfigNVIDIAModelOptConfigQuantizationConfigMixinQuantizationMethod QuantoConfig TorchAoConfig)QuantoQuantizer)TorchAoHfQuantizer)bitsandbytes_4bitbitsandbytes_8bitggufquantotorchaomodeloptceZdZdZedefdZedeeeffdZ edZ edee efde efdZ y ) DiffusersAutoQuantizerz The auto diffusers quantizer class that takes care of automatically instantiating to the correct `DiffusersQuantizer` given the `QuantizationConfig`. quantization_config_dictc |jdd}|jdds|jddr*|jddrdnd}tj|z}n | td|tj vr,td|d t tj t|}|j|S) N quant_method load_in_8bitF load_in_4bit_4bit_8bitzThe model's quantization config from the arguments has no `quant_method` attribute. Make sure that the model has been correctly quantizedUnknown quantization type, got  - supported types are: ) getrBITS_AND_BYTES ValueError AUTO_QUANTIZATION_CONFIG_MAPPINGkeyslistAUTO_QUANTIZER_MAPPING from_dict)clsrrsuffix target_clss c/home/obispo/Crisostomo_bridge/mision_env/lib/python3.12/site-packages/diffusers/quantizers/auto.pyr,z DiffusersAutoQuantizer.from_dict?s/33NDI # ' ' >BZB^B^_motBu 8 < <^U SWY`F-<r5rrFr1r0rr9s >>>(9e4KT4Q.R990 4 4#"4)@#@A#(00G'H##r1r)rJrCtypingrrr bitsandbytesrrrr rr r2r r r rrrrrrrrr+r(rrLr1r0rOsy ((N-$'32 !' ,+ "$ $ ]#]#r1