How to use Azure GPT Models in LLMLingua

[Shrijayan (shrijayan)]

Question: How can I integrate Azure GPT Models into LLMLingua?
Hey everyone,

I’ve been working on a project using LLMLingua and I’m curious if it’s possible to integrate Azure’s GPT models into the framework. I understand that LLMLingua is typically used with open-source or Hugging Face models, but I’d like to leverage the Azure OpenAI services for my project.

LLMLingua uses Huggingface models
LLMLingua 2 uses its model "microsoft/llmlingua-2-xlm-roberta-large-meetingbank"

Has anyone here successfully used Azure GPT models with LLMLingua? If so, could you please guide me on how to set up the connection, API integration, and any modifications needed in the LLMLingua codebase?

Thanks in advance!