meta-llama

/

Meta-Llama-3-8B-Instruct

like 2.42k

im using javascript api inference and this returns an error in the console>>

"Uncaught (in promise) SyntaxError: Unexpected token 'E', "Expected r"... is not valid JSON"

the problem seems to be with

query({"inputs": "Hi? "}).then((response) => {
console.log(JSON.stringify(response));
});

when i use the default it works and returns a response in the console:

query({"inputs": "Can you please let us know more details about your "}).then((response) => {
console.log(JSON.stringify(response));
});

here is the full code, replaced my key with the default:

async function query(data) {
const response = await fetch(
"https://api-inference.huggingface.co/models/meta-llama/Meta-Llama-3-8B-Instruct",
{
headers: { Authorization: "Bearer xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx" },
method: "POST",
body: JSON.stringify(data),
}
);
const result = await response.json();
return result;
}

query({"inputs": "Hi? "}).then((response) => {
console.log(JSON.stringify(response));
});