[ICML24] Pruner-Zero: Evolving Symbolic Pruning Metric from scratch for LLMs
-
Updated
Nov 25, 2024 - Python
[ICML24] Pruner-Zero: Evolving Symbolic Pruning Metric from scratch for LLMs
Open source code for ICML 2025 Paper: Eigenspectrum Analysis of Neural Networks without Aspect Ratio Bias
[ICLR 2024] Jaiswal, A., Gan, Z., Du, X., Zhang, B., Wang, Z., & Yang, Y. Compressing llms: The truth is rarely pure and never simple.
[EMNLP 2024] Is C4 Dataset Optimal for Pruning? An Investigation of Calibration Data for LLM Pruning
Trim a tokenizer's vocabulary, and optionally its model's embedding table, down to the subset you actually need. You can specify "what you need" explicitly, by presets, or by providing a corpus (one or more datasets) as an anchor for what you'd actually like to keep.
To associate your repository with the llm-pruning topic, visit your repo's landing page and select "manage topics."