Setup and Environment:
I am running text generation web ui locally (instead of Runpod) on http://127.0.0.1:7860/
I have check and reloaded the webui with these extensions: gallery, openai and these boolean flags: api, listen
I have selected and loaded the model "mistral-7b-v0.1.Q3_K_S.gguf"
I followed along in your video step by step, using the provided app.py:
(thank you so much for your work on this btw!)
As you suggested in your reply to the previous 404 issue, I changed the code accordingly:
config_list = [
{
"api_type": "open_ai",
"api_base": "http://127.0.0.1:5001/v1",
"api_key": "NULL",
},
]USE_MEMGPT = False
## api keys for the memGPT
openai.api_base="http://127.0.0.1:5001/v1"
openai.api_key="NULL"
Until I get it working without memgpt, I still have use_memgpt set to false.
Along the way, I noticed an issue
text generation web ui error: failed to load the extension "openai"
I used the following commands to fix that issue
.\cmd_windows.bat
pip install tiktoken sentence_transformers SpeechRecognition
and reloaded the ui with no errors
When I start the webui using the flags and extensions seen in your youtube tutorial the terminal outputs:
2023-11-02 13:58:49 INFO:Loading settings from settings.yaml...
2023-11-02 13:58:49 INFO:Loading the extension "gallery"...
2023-11-02 13:58:49 INFO:Loading the extension "openai"...
2023-11-02 13:58:50 INFO:Streaming API URL:
ws://127.0.0.1:5005/api/v1/stream
OpenAI compatible API ready at: OPENAI_API_BASE=http://127.0.0.1:5001/v1
2023-11-02 13:58:50 INFO:Blocking API URL:
http://127.0.0.1:5000/api
127.0.0.1 - - [02/Nov/2023 13:58:51] code 404, message Not Found
127.0.0.1 - - [02/Nov/2023 13:58:51] "GET / HTTP/1.1" 404 -
Running on local URL: http://127.0.0.1:7860
To create a public link, set `share=True` in `launch()`.
The VSC terminal shows this output:
User_proxy (to Coder):
Write a Function to print Numbers 1 to 10
--------------------------------------------------------------------------------
>>>>>>>> USING AUTO REPLY...
Coder (to User_proxy):
```jsx
function printNums() {
let i = 0; // Initialization
while (i < 10) { // Condition
console.log(i++); // Code block, Increment the Value of 'count' by 1
i++; // Incrementation: increment the value of 'i';
} // While loop
}
// Calling the Function and pass it a number as an argument. This is how we call it with our function
let count = prompt("Enter your Starting Count:");
printNums(count);
USING AUTO REPLY...
EXECUTING CODE BLOCK 0 (inferred language is jsx)...
User_proxy (to Coder):
exitcode: 1 (execution failed)
Code output:
unknown language jsx
USING AUTO REPLY...
Coder (to User_proxy):
function hello() {
let first = "hello";
return first
}
console.log( hello() ); // Calling the function. The () sign is used to denote a parameter as input; it's called argument-based syntax.
// Argument or Parameters: These are the variables passed inside of the functions, and it does not matter where they come from but that we have defined them properly before being passed in. We must define our variables (arguments) first and then use them later on with a set of parenthesis surrounding them.
USING AUTO REPLY...
EXECUTING CODE BLOCK 0 (inferred language is jsx)...
User_proxy (to Coder):
exitcode: 1 (execution failed)
Code output:
unknown language jsx
USING AUTO REPLY...
Coder (to User_proxy):
function printFibonacci() {
// Declare the counter, i
let a = 0; // Initialization
let b = 1; // Initialization
while (a <= 25) {
console.log(b);
[a+1]++;
[b++];
}
}
printFibonacci();
USING AUTO REPLY...
EXECUTING CODE BLOCK 0 (inferred language is jsx)...
User_proxy (to Coder):
exitcode: 1 (execution failed)
Code output:
unknown language jsx
USING AUTO REPLY...
Coder (to User_proxy):
A function is a block of code designed to perform operations on data. Functions are defined at the top, called in the middle and run as their last line executes. A program is a block of text with many functions that each has its job assigned by you! When they call it then whatever happens next inside those brackets will happen for every function within. It’s like if your computer were an engine; every time the user presses some keys while running this thing, something would pop up on screen -which can be anything from a number or letter– but only one at a time."
USING AUTO REPLY...
User_proxy (to Coder):
You are going to figure all out by your own. Work by yourself, the user won't reply until you output TERMINATE to end the conversation.
USING AUTO REPLY...
Coder (to User_proxy):
function printFibonacci(a = 64) {
// Declare the counter, i
let a = 0; // Initialization
let b = 1; // Initialization
while (i <= a) {
console.log("Fibonacccci Numbers");
[a+1] ++ ; // Incrementation: increment the value of 'count' by 1
[b++] +-1; // Incrementation: this is how we update values in our code, just like adding up a number. When you add something new it will also have its own line!
}
}
USING AUTO REPLY...
EXECUTING CODE BLOCK 0 (inferred language is jsx)...
User_proxy (to Coder):
exitcode: 1 (execution failed)
Code output:
unknown language jsx
USING AUTO REPLY...
Coder (to User_proxy):
Functions are the main building blocks of any program and as such, they can be written to carry out various operations on data. We write code within a set brackets [a] ++ , [b++] +-1; and when it's done running through everything inside those square bracket you will receive your answer back from "the function" with an input parameter that tells what kind of thing this operation is for - like how many values or numbers need counting up one after another before they're all finished together. We use our first line in these situations: [a] ++ , [b++] +-1;
Functions are the main building blocks of any program and as such, they can be written to carry out various operations on data. You might have heard about some "magic" functions when we were learning Python!
But don't worry - this is not a type that will make your code run slower or do anything weird. In fact it was created because there are too many lines for what could go into those big black brackets: so all you need here (and everywhere else) really comes down just three simple things - one parameter tells whether its an array; another number specifies its size; then finally there needs be some type-safe declaration before anything more complicated happens with these data structures inside them which make up everything. And while they can get pretty dense sometimes I promise you'll find plenty of resources online if
ever needed!
USING AUTO REPLY...
User_proxy (to Coder):
You are going to figure all out by your own. Work by yourself, the user won't reply until you output TERMINATE to end the conversation.
USING AUTO REPLY...
Coder (to User_proxy):
function printFibonacci(a = 64) {
// Declare an array called “list” of size [a-1]
let [a, list=[], n=0; // Initialization
b++, c+=2; i+=1, j++; } // Incrementation: this is how we update values in our code, just like adding up a number. When you add something new it will also have its own line! It’s the same thing as if an engineer would make changes or improvements on their old car engine - but now with computers there are only one at time being run so whatever happens first inside those brackets happen next for every function
within
[a-1]=[c]; [i=0]++: // Incrementation: Incrementate the value of 'count', which starts out as one, then add another value. This makes an array! [j++]++; } // We have made our loop using "for" syntax and now it will run through all its elements like this until everything inside is done happening
[list][n]=c; n++; j++;: } // We have made our for-loop with the variable "counter", but don't know what number or value should be set as yet. Now that we do, use it in your code! [a=0]; i+=1]++ ; [b++] ++ :} [c+1] =[j] + - 1;: } /* You may not be able to tell how often these arrays need an update depending on whether they are inside brackets.
USING AUTO REPLY...
EXECUTING CODE BLOCK 0 (inferred language is jsx)...
User_proxy (to Coder):
exitcode: 1 (execution failed)
Code output:
unknown language jsx
USING AUTO REPLY...
Coder (to User_proxy):
A loop can make it so that you don't have to worry about all the numbers in between two others because there is no need for them! A counter will keep track of how many loops are completed; this also allows us not just any old number but our very own values from one another - which we could even store as variables called 'loopNum'.
USING AUTO REPLY...
User_proxy (to Coder):
You are going to figure all out by your own. Work by yourself, the user won't reply until you output TERMINATE to end the conversation.
USING AUTO REPLY...
Coder (to User_proxy):
function printFibonacci(a = 64) {
// Declare an array called “list” of size [a-1]
let a=0; i++, b++; } // Initialization
[i] ++ :c+=2; j++; {n} -+ : i += 2; c-=i, j--; ] ; [a = ] - + , n++] – :[b++] -- : }// Incrementation: this is how we update values in our code, just like adding up a number. When you add something new it will also have its own line! It’s the same thing as if an engineer would make changes or improvements on their old car engine - but now with computers there are only one at time being run so whatever happens first inside those brackets happen next for every function within
[i]=j; a++; i+=1, j++: // Incrementation: this is how we update values in our code, just like adding up a number. When you add something new it will also have its own line! It’s the same thing as if an engineer would make changes or improvements on their old car engine - but now with computers there are only one at time being run so whatever happens first inside those brackets happen next for every function within
n++; j++; a++-1} // Incrementation: we can change what the function does and how it executes by adjusting its variables in this way.- ℂ ∩ 💬
USING AUTO REPLY...
EXECUTING CODE BLOCK 0 (inferred language is jsx)...
User_proxy (to Coder):
exitcode: 1 (execution failed)
Code output:
unknown language jsx
USING AUTO REPLY...
Coder (to User_proxy):
When you add something new it will also have its own line! It’s the same thing as if an engineer would make changes or improvements on their old car engine - but now with computers there are only one at time
being run so whatever happens first inside those brackets happen next for every function within.
USING AUTO REPLY...
User_proxy (to Coder):
You are going to figure all out by your own. Work by yourself, the user won't reply until you output TERMINATE to end the conversation.
USING AUTO REPLY...
The terminal output remains stuck here...until:
```shell
>>>>>>>> USING AUTO REPLY...
Traceback (most recent call last):
Read timeout
React
Typescript
Django
Laravel
Facebook
Microsoft
Google
Alibaba
D3
Tencent