Hi HuggingFace community! ![]()
I’m Archit Thorat, an independent researcher from India.
I need an arXiv cs.LG endorsement for my first paper.
Paper: “AutoCompress: Autonomous Compression of Small
Language Models via Critical Layer Isolation”
Key finding: Layer 0 in small transformers carries ~98%
of task-critical information — consistent across 6-layer
and 16-layer models.
This motivated Critical Layer Isolation (CLI):
- Layer 0 runs at full capacity
- All other layers compressed to shared bottleneck dim
- Result: 34.8% compression matching baseline quality
All experiments done on free Colab T4 GPU overnight.
Zero paid compute.
Would anyone be willing to endorse my submission? ![]()
Endorsement link: Log in to arXiv | arXiv e-print repository
Thank you so much!
Archit