jerryzh168 commited on
Commit
c771efd
·
verified ·
1 Parent(s): 3837f89

Update app.py

Browse files
Files changed (1) hide show
  1. app.py +0 -6
app.py CHANGED
@@ -551,12 +551,6 @@ with gr.Blocks(css=css) as demo:
551
  ## 📝 Quantization Options
552
 
553
  ### Quantization Types
554
- "Int4WeightOnly",
555
- "GemliteUIntXWeightOnly"
556
- "Int8WeightOnly",
557
- "Int8DynamicActivationInt8Weight",
558
- "Float8WeightOnly",
559
- "Float8DynamicActivationFloat8Weight",
560
  - **Int4WeightOnly**: 4-bit weight-only quantization
561
  - **GemliteUIntXWeightOnly**: uintx gemlite quantization (default to 4 bit only for now)
562
  - **Int8WeightOnly**: 8-bit weight-only quantization
 
551
  ## 📝 Quantization Options
552
 
553
  ### Quantization Types
 
 
 
 
 
 
554
  - **Int4WeightOnly**: 4-bit weight-only quantization
555
  - **GemliteUIntXWeightOnly**: uintx gemlite quantization (default to 4 bit only for now)
556
  - **Int8WeightOnly**: 8-bit weight-only quantization