premai-io / state-of-open-source-ai Goto Github PK
View Code? Open in Web Editor NEW:closed_book: Clarity in the current fast-paced mess of Open Source innovation
Home Page: https://book.premai.io/state-of-open-source-ai
License: Other
:closed_book: Clarity in the current fast-paced mess of Open Source innovation
Home Page: https://book.premai.io/state-of-open-source-ai
License: Other
Have you considered adding a chapter dedicated to security of open source AI? Can help contribute.
new chapter
Something else
No response
new chapter
models
Although MoE has been there in general Deep learning, just now Mistral Released their second models with MoE, so now it is very important to release those also.
https://book.premai.io/state-of-open-source-ai/eval-datasets/
new chapter
eval-datasets
The evaluation page is really good, however, it would be awesome if we could add some information on the following evaluation frameworks.
The content should be mainly regarding how they are trying to do evaluation and how to get started with each.
new chapter
Something else
No response
Follow-up to #42
- should we have
:valid
and:invalid
CSS?- also can hitting the Enter key work (for keyboard warriors who don't like clicking buttons)?
Have had reports of people giving up on accessing the book because they didn't realise they currently have to use the mouse to click Submit
while following state-of-open-source-ai/#editing-the-book, it breaks on line jupyter-book build -b dirhtml --all .
with the following error:
➜ jupyter-book build -b dirhtml --all .
Usage: jupyter-book build [OPTIONS] PATH_SOURCE
Try 'jupyter-book build -h' for help.
Error: No such option: -b
other (e.g. typos, factual errors, etc.)
Something else
For many people the most effective way to read a book is in audiobook format.
I would like to ask to have some text-to-speech transcription available, or, considering the involved costs, a text-to-speech friendly artifact available, so I can execute the TTS by myself.
I volunteer to provide the generated "audiobook" to be shared among this book audience.
other (e.g. typos, factual errors, etc.)
Something else
Ascetic issue, not serious
https://github.com/premAI-io/state-of-open-source-ai/issues
it's difficult to keep track of all the innovations. There's been enormous progress in the field in {term}the last year .
this links to sota? why that it doesn't make sense
new chapter
Something else
No response
Hey Team,
As you know, we've been trying to incorporate a custom index.html
page in our [Jupyter Book/Sphinx] book that does not adhere to the standard theme and I've hit a roadblock.
After exploring various options, it appears that Jupyter Book and Sphinx are not designed to easily allow a completely custom index.html
that diverges from the set themes so the https://premai-book.netlify.app seems unusable at this point.
The fastest way to implement our custom index.html
seems to be post-build where we'd:
index.html
with our custom version.I'm not aware of any licence that works for both code & text. I'd suggest separate licences for each (this is quite common elsewhere):
thoughts @filopedraz?
other (e.g. typos, factual errors, etc.)
Something else
Use new Prem logo and guidelines.
new URL/reference/table row
fine-tuning
Expand the Finetuning chapter in order to include the DRLX technique.
new chapter
Something else
No response
new chapter
Something else
Doing training or inference models are fairly easy, when we have smaller number of parameters. But when the scale of parameters and data increases, it becomes increasingly difficult to optimize that (interms of compute and performance). So a dedicated chapter on inference optimization and arithmetics on resource calculations becomes very useful.
Some reference links:
Issue description:
Problem reading book from multiple devices. I have subscribed to newsletter using my email on my computer, now I can read book without pop-up.
I switch to my phone and get pop-up for newsletter, enter same email get error that email is already used. Pop-up stays. I don't see any way to close without dev tools.
This is usability issue. I suspect any session that does not share cookies will be same. Different devices, browsers, incognito etc.
root: index.md
) #13
dirhtml
builder #13linkcheck
s #13static.premai.io
#17book.premai.io
#24
CITATION.cff
/.zenodo.json
) #41arxiv
)Follow-up to #11
TODO
notes{{ wip_chapter }}
/% TODO
/Work in Progress
noteslinkcheck
+ html
+ pdf
#69pdf
docker container? (easier since https://github.com/xu-cheng/latex-action/releases/tag/3.0.0) (alternatively, use different/quicker pdf
action?)pdf
LaTeX to DevContainer (and use https://github.com/devcontainers/ci)?new chapter
Something else
No response
https://github.com/premAI-io/state-of-open-source-ai/blob/main/desktop-apps.md
Use markdown-MyST syntax (e.g. source ➡️ rendered)
Please also report anyjupyter-book build
framework-related problems/questions in #12 :)
https://book.premai.io/state-of-open-source-ai/mlops-engines/
new chapter
fine-tuning
Similar to LLMs, we use similar fine-tuning strategies for diffusion models too. So this chapter should include different ways of fine-tuning those models.
new chapter
Something else
I suggest that we have a separate chapter on Quantization
. The chapter should include all the new methods created to handle quantization and the most famous libraries associated with them.
other (e.g. typos, factual errors, etc.)
fine-tuning
The fine-tuning chapter should include all the tools and frameworks in order to do fine-tuning.
new chapter
Something else
mlops-engines.md
(see e.g. 70892bd for adding a chapter)Use markdown-MyST syntax (e.g. source ➡️ rendered)
Potential subheadings:
Please also report any jupyter-book build
framework-related problems/questions in #12 :)
new chapter
Something else
No response
new chapter
fine-tuning
The contents on this chapter should be the following:
new chapter
Something else
Right now RAG is written under Fine-tuning section. However, I am not very much sure, whether that would be the correct place. Since, RAG does not change any parameters of the model or adds new parameters.
So, it would be much better to add it under different section or a dedicated chapter or add it to the VectorDatabase chapter. The concept of RAG is actually not very new. FAISS was used readily before the surge if LLMs (mostly in image search or semantic search).
In the RAG chapter we can populate by these contents:
other (e.g. typos, factual errors, etc.)
Something else
We need to go back to the email wall, but we need to make sure that email provided are valid.
A declarative, efficient, and flexible JavaScript library for building user interfaces.
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
An Open Source Machine Learning Framework for Everyone
The Web framework for perfectionists with deadlines.
A PHP framework for web artisans
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
Some thing interesting about web. New door for the world.
A server is a program made to process requests and deliver data to clients.
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
Some thing interesting about visualization, use data art
Some thing interesting about game, make everyone happy.
We are working to build community through open source technology. NB: members must have two-factor auth.
Open source projects and samples from Microsoft.
Google ❤️ Open Source for everyone.
Alibaba Open Source for everyone
Data-Driven Documents codes.
China tencent open source team.