Comments (7)
There is no straightforward interface for that. The easiest way is to manually initialize the relation embeddings, and then follow the fine-tune procedure.
Could you describe in what case you need such interface? If it is general, we will consider it in the update of our interface.
from graphvite.
Thanks for that! My inputs entities are effectively innumerable, so I want to be able to reason over substitutable embeddings rather than hard-coding an entity name/id in the triplets. I don't know how else I would go about that.
from graphvite.
Ok. So you have all entity embeddings and you can't afford training them together. How large is that? You are going to split the large graph into small subsets, and you would like to train on each subset, with fixed entity embeddings for each subset and shared relation embeddings across subsets, right?
from graphvite.
Yes, I can't retrain those embeddings. I've embedded ~10million entities, but really am only concerned with a smaller subset on the order of 10k in the immediate. Eventually I would want to share those relations across the full graph.
from graphvite.
Can I suppose that you only need to fix the entity embeddings, i.e. set lr to 0 for them? If so, we can make a separate learning rate multiplier for each kind of embeddings.
from graphvite.
I'm actually not too sure... I think I might want to be able to tune these embeddings with structural rules I put on after the fact--but unclear if it just makes sense to retrain full from scratch down the road when that's feasible. Either way I think being able to set the specific lr will be useful and the relation embeddings on top of relatively static entity embeddings will be helpful.
from graphvite.
Ok. We'll consider separate initialization and lr for different embeddings.
from graphvite.
Related Issues (20)
- Is it normal to falling in an infinite loop?
- CMake Error when using 'cd build && cmake .. && make && cd -' command HOT 3
- Raise KeyError: 'PREFIX' when import HOT 6
- mute output of graphvite solver
- url link bug HOT 1
- Is network augmentation necessary?
- The kernel for network/line.ipynb appears to have died. It will restart automatically.
- KnowledgeGraphSolver Error
- Check failed: error == cudaSuccess CUDA error
- Non-pickle version of pretrained embeddings
- How to install without Conda
- Cannot install graphvite on colab HOT 1
- When running with quick_start.yaml with own dataset getting the following error HOT 1
- Cannot import graphvite
- Running out of memory when loading pre-trained embeddings
- CUDA unknown error with running the quick start
- Cannot install graphvite HOT 6
- AttributeError: module 'graphvite' has no attribute 'dataset' HOT 1
- cannot install graphvite from source HOT 4
- Error when loading pre-trained Wikidata5M models (.pkl files) HOT 1
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from graphvite.