add FinchPress#64

Closed

giulio98 wants to merge 45 commits intoNVIDIA:mainfrom

miriam-16:features/finch_press

Commits on Apr 4, 2025

first commit

FaureElia
authored and
giulio98
committed
created setup

FaureElia
authored and
giulio98
committed
first basic implementation of FinchPress

authored and
giulio98
committed
adjusted FinchPress

FaureElia
authored and
giulio98
committed
introduce new parameter condition_len (still have to modify compute_finch_attention), introduce context/question handling in pipeline.

FaureElia
authored and
giulio98
committed
Adapted compute_finch_attention to condition_len. TODO: Normalization step

miriam-16
authored and
giulio98
committed
fix question len, adjusted the question ids for generation.
giulio98
committed
fix: parameter condition_len in function

miriam-16
authored and
giulio98
committed
add nomralization

FaureElia
authored and
giulio98
committed
clean FinchPress

FaureElia
authored and
giulio98
committed
normalization
giulio98
committed
fix len question ids
giulio98
committed
add self
giulio98
committed
chunked forward -- not working(gibberish output), check shapes and lengths across iterations
giulio98
committed
Fixed attention mask and binary mask in compute_finch_attention

FaureElia
authored and
giulio98
committed
updated gitignore

FaureElia
authored and
giulio98
committed
n_kept value at last iteration (TODO: further checks)

miriam-16
authored and
giulio98
committed
fixed pipeline for other presses and finished adjusting number of token selected

FaureElia
authored and
giulio98
committed
Fix: n_kept at last iteration considers condition_len

miriam-16
authored and
giulio98
committed
adjusted n_kept, at final chunk keeps 90% of context+full question

FaureElia
authored and
giulio98
committed
added docstring and general code cleaning

miriam-16
authored and
giulio98
committed
reorder indices, add normalization parameter, add sink tokens
giulio98
committed
partially fixed finch press

FaureElia
authored and
giulio98
committed
fixed finch press, aligned to original code

FaureElia
authored and
giulio98
committed
preparing for pr
giulio98
committed
add ChunkKV

Dominic789654
authored and
giulio98
committed
Update copyright date (#60)

SimJeg
authored and
giulio98
committed
Add QFilterPress (#54)

NathanGodey
authored and
giulio98
committed
Add longbench benchmark

Xnhyacinth
authored and
giulio98
committed
Add DuoAttention on the fly (#63)

SimJeg
authored and
giulio98
committed
Resolve stash conflict in tests/default_presses.py
giulio98
committed
Fix: remove conflict markers after saving changes
giulio98
committed
test passes
giulio98
committed
add readme
giulio98
committed
commit
giulio98
committed
Merge branch 'main' into features/finch_press
giulio98
committed
make style
giulio98
committed
remove leftovers
giulio98
committed

Commits on Apr 6, 2025

Commits on Apr 15, 2025

add import snapkv
giulio98
committed

⚡