Inference Optimizations for Large Language Models: Effects, Challenges, and Practical Considerations

mehr
Titel Inference Optimizations for Large Language Models: Effects, Challenges, and Practical Considerations
Medien Arxiv
Verfasser Leo Donisch, Prof. Dr. Sigurd Schacht, Carsten Lanquillon
Veröffentlichungsdatum 06.08.2024
Zitation Donisch, Leo; Schacht, Sigurd; Lanquillon, Carsten (2024): Inference Optimizations for Large Language Models: Effects, Challenges, and Practical Considerations. Arxiv. DOI: 10.48550/arXiv.2408.03130