research
∙
07/02/2023
TensorGPT: Efficient Compression of the Embedding Layer in LLMs based on the Tensor-Train Decomposition
High-dimensional token embeddings underpin Large Language Models (LLMs),...
research
∙
11/24/2022