Text Generation
Transformers
PyTorch
code
gpt2
custom_code
Eval Results
text-generation-inference

make santacoder onnx compatible

#21

This fixes the forward function for ONNX in santacoder.
The bug is not seen in HF's generate function since the if conditional is never hit.

mayank-mishra changed pull request status to open
mayank-mishra changed pull request status to merged

@mayank31398 Is this working with the merged request? Any insights how onnx works?

Sign up or log in to comment