Adlik model zoo provides related pre-training models for model optimization and deployment in image classification object detection and instance segmentation tasks.
| Content | State |
|---|---|
| Model optimizer | • Support image classification object detection and instance segmentation model |
| • Support model optimization methods such as pruning and knowledge distillation • Support quantification on different inference engines |
|
| SmoothQuant+ | • 4-bit weight-only quantization models of Code Llama family used by vLLM |
| • Including Code Llama-7B, Code Llama-13B, Code Llama-34B |
This tutorial is contributed by Adlik and licensed under the Apache License 2.0.