falconvn2006 / gpast

GPT for Pascal code generation :)

GPasT

GPT for Pascal code generation :)

Required dependencies

If you want to run the project locally. Here are the required dependencies that you have to download

// From HuggingFace
tokenizers
transformers 
datasets

// Raw data collection
pygithub

Running the model

You can run it on Google Colab, HuggingFace or locally if you preferred.

For locally you have to run the script in this order
(if you don't want to create a new dataset, or train a new tokenizer then you can skip 1,2,3,4.
After that you must go to the HuggingFace website and find my dataset [Falcon2006VN/pascal-code-generation-2mb]
then you can retrain the model the way you like by adjusting the train.py then use the run.py to run the model)

1.raw_data.py
2.clean.py
3.preprocess.py
4.tokenizer.py
5.train.py
6.run.py

Usage

This Pascal AI code generation can be use for simple code generation. Currently my setup can only train small models (20 batch size of data on Google Colab)
So this AI won't propably has many improvements.
I also only creating this to put in my portfolio :). But if I have a chance I will improve this AI...

End

If you download this repo for some reasons and use this AI instead of ChatGPT or Github Copilot... I guess thank you...