vLLM compatibility

#8
by Sayan01 - opened

Is it possible to make the code, i.e. modeling_mobilellm.py vLLM compatible? I tried to register the model with vLLM but I am getting errors.

Sign up or log in to comment