Infini-AI-Lab

Popular repositories Loading

Sequoia Sequoia Public

scalable and robust tree-based speculative decoding algorithm

Python 282 29
TriForce TriForce Public

[COLM 2024] TriForce: Lossless Acceleration of Long Sequence Generation with Hierarchical Speculative Decoding

Python 145 12
MagicPiG MagicPiG Public

3
Sequoia-Page Sequoia-Page Public

JavaScript
lm-evaluation-harness lm-evaluation-harness Public

Forked from EleutherAI/lm-evaluation-harness

A framework for few-shot evaluation of language models.

Python 2

MagicPiG Public

Infini-AI-Lab/MagicPiG’s past year of commit activity

3 0 0 0 Updated Jul 26, 2024
TriForce Public
[COLM 2024] TriForce: Lossless Acceleration of Long Sequence Generation with Hierarchical Speculative Decoding

Infini-AI-Lab/TriForce’s past year of commit activity

Python 145 12 3 (3 issues need help) 0 Updated Jul 4, 2024
lm-evaluation-harness Public Forked from EleutherAI/lm-evaluation-harness
A framework for few-shot evaluation of language models.

Infini-AI-Lab/lm-evaluation-harness’s past year of commit activity

Python 0 MIT 1,602 0 0 Updated Jun 10, 2024
Sequoia Public
scalable and robust tree-based speculative decoding algorithm

Infini-AI-Lab/Sequoia’s past year of commit activity

Python 282 29 7 3 Updated Jun 7, 2024
Sequoia-Page Public

Infini-AI-Lab/Sequoia-Page’s past year of commit activity

JavaScript 0 0 0 0 Updated May 21, 2024

This organization has no public members. You must be a member to see who’s a part of this organization.

efficiency inference llm speculative-decoding