GPT for Pascal code generation :)
If you want to run the project locally. Here are the required dependencies that you have to download
// From HuggingFace
tokenizers
transformers
datasets
// Raw data collection
pygithub
You can run it on Google Colab, HuggingFace or locally if you preferred.
For locally you have to run the script in this order
(if you don't want to create a new dataset, or train a new tokenizer then you can skip 1,2,3,4.
After that you must go to the HuggingFace website and find my dataset [Falcon2006VN/pascal-code-generation-2mb]
then you can retrain the model the way you like by adjusting the train.py then use the run.py to run the model)
1.raw_data.py
2.clean.py
3.preprocess.py
4.tokenizer.py
5.train.py
6.run.py
This Pascal AI code generation can be use for simple code generation. Currently my setup can only train small models (20 batch size of data on Google Colab)
So this AI won't propably has many improvements.
I also only creating this to put in my portfolio :). But if I have a chance I will improve this AI...
If you download this repo for some reasons and use this AI instead of ChatGPT or Github Copilot... I guess thank you...