Support enable_gqa and only support 4D Q, K, and V
#10919
| Job | Run time |
|---|---|
| 7s | |
| 3m 33s | |
| 4m 27s | |
| 18m 4s | |
| 20m 4s | |
| 17m 26s | |
| 17m 38s | |
| 18m 30s | |
| 19m 2s | |
| 8m 32s | |
| 8m 13s | |
| 8m 9s | |
| 20m 38s | |
| 16m 59s | |
| 8m 2s | |
| 15m 42s | |
| 7m 46s | |
| 15m 4s | |
| 11m 11s | |
| 7m 45s | |
| 13m 42s | |
| 9m 25s | |
| 7m 32s | |
| 19m 14s | |
| 4h 56m 45s |