pip install transformers[agents] To use openAI models, you instantiate an [OpenAiAgent] after installing the openai dependency: pip install openai from transformers import OpenAiAgent agent = OpenAiAgent(model="text-davinci-003", api_key="") To use BigCode or OpenAssistant, start by logging in to have access to the Inference API: from huggingface_hub import login login("") Then, instantiate the agent from transformers import HfAgent Starcoder agent = HfAgent("https://api-inference.huggingface.co/models/bigcode/starcoder") StarcoderBase agent = HfAgent("https://api-inference.huggingface.co/models/bigcode/starcoderbase") OpenAssistant agent = HfAgent(url_endpoint="https://api-inference.huggingface.co/models/OpenAssistant/oasst-sft-4-pythia-12b-epoch-3.5") This is using the inference API that Hugging Face provides for free at the moment.