Comments (5)
Hi! Did you unzip the cifar.zip
and place it in the root directory?
Ref: See lines 13-15 in main.py below
PATH_TO_CIFAR = "./cifar/"
sys.path.append(PATH_TO_CIFAR)
import train as cifar_train
from otfusion.
Thanks for your reply. In fact, I am very interested in this research. After reading your paper, I have some questions about 'Table1'. Is the test accuracy established in all categories? In addition, I found that Model0 and Model1 shared the same trainset in the code (=.=,maybe I haven't fully understood the code ),so, can I think this reduces the difficulty of model fusion? The last question, I did an experiment with the model fusion method of your code (Weight-based), but the effect is not as good as I imagined. Am I ignoring anything?
\\ | test ac in 0~4 | test ac in 5~9 | test ac in 0~9 |
---|---|---|---|
model0 | 98.52 | 0 | 49.26 |
model2 | 0 | 97.86 | 48.93 |
OTfusion | 15.85 | 47.35 | 31.17 |
fedavg | 22.00 | 46.59 | 33.96 |
PS:model0 and model1 have different initialization parameters.
from otfusion.
Hi, thanks for your interest.
In Table1, the test accuracy is across all categories. It is the global test accuracy which is mentioned in all the tables.
First, you have to realize there are two main settings under which the model fusion code is organized.
(1) Models that differ only in their initialization -> main.py
(2) Models that differ in their trainset -> split_main.py
So, I think you are probably looking at the wrong file (see lines 119-150 in split_main)!
Next, can you first try the CIFAR10 + VGG11
command mentioned in the Readme? I believe you might have accidentally missed passing an important argument (also please share with which arguments you ran).
(Btw, please expect delays due to submission deadlines)
from otfusion.
Also, a general comment. Averaging models with different initialization, in general, is pretty hard. Vanilla averaging/FedAvg should perform even worse. (For example, try passing--diff-init
in split_main.py
)
from otfusion.
Hey!
I assume the issue was resolved, so I am closing the issue. Feel free to reopen if you still have questions.
Thanks.
from otfusion.
Related Issues (8)
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from otfusion.