Support vLLM

[ruidongtd]

Support for VLLM, how is the progress of the work?

[kasatgauravv]

Any updates here?

[hongyanz]

Thank you @abhigoyal1997 for merging. I will close this issue.