Comments (2)
I am just curious about in what case you need fine-tuning? Maybe checkpoint is needed sometimes.
There isn't a perfect support for that, but you can do it in the Python code. Suppose you have created two GraphSolver with the same dimension for embeddings.
solver1.train()
with open(file_name, "wb") as fout:
pickle.dump(solver1.vertex_embeddings, fout)
pickle.dump(solver1.context_embeddings, fout)
For the same graph, you can fine tune like this.
with open(file_name, "rb") as fin:
# Note LRS must use index. You should never directly assign value to vertex_embeddings.
solver2.vertex_embeddings[:] = pickle.load(fin)
solver2.context_embeddings[:] = pickle.load(fin)
solver2.train(resume=True)
Because embeddings correspond to nodes, this requires two solvers to use the same node set. If you use two graphs with different edges, the orders of nodes are usually different. You can rearrange them using the following code.
embeddings = solver1.vertex_embeddings
new_embeddings = np.empty_like(embeddings)
for id, embedding in enumerate(embeddings):
new_embeddings[solver2.name2id[solver1.id2name[id]]] = embedding
solver2.vertex_embeddings[:] = new_embeddings
from graphvite.
Added in v0.2.1.
from graphvite.
Related Issues (20)
- Is it normal to falling in an infinite loop?
- CMake Error when using 'cd build && cmake .. && make && cd -' command HOT 3
- Raise KeyError: 'PREFIX' when import HOT 6
- mute output of graphvite solver
- url link bug HOT 1
- Is network augmentation necessary?
- The kernel for network/line.ipynb appears to have died. It will restart automatically.
- KnowledgeGraphSolver Error
- Check failed: error == cudaSuccess CUDA error
- Non-pickle version of pretrained embeddings
- How to install without Conda
- Cannot install graphvite on colab HOT 1
- When running with quick_start.yaml with own dataset getting the following error HOT 1
- Cannot import graphvite
- Running out of memory when loading pre-trained embeddings
- CUDA unknown error with running the quick start
- Cannot install graphvite HOT 6
- AttributeError: module 'graphvite' has no attribute 'dataset' HOT 1
- cannot install graphvite from source HOT 4
- Error when loading pre-trained Wikidata5M models (.pkl files) HOT 1
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from graphvite.