Trim out data transformations operators that are downstream of the last classification step about tpot

[kadarakos]

Could we solve this by having a multi-objective fitness function? Combined from:

• reward accuracy/f-score
• penalize the number of operations
• penalize runtime

As far as I understand deap supports multi-objective optimization out-of-the-box.

[rhiever]

I'm currently developing and testing a multi-objective version of TPOT.
Including various measures of model complexity as an axis to minimize does
indeed eliminate cases like this.

On Tuesday, January 5, 2016, kadarakos [email protected] wrote:

Could we solve this by having a multi-objective fitness function? Combined
from:

• reward accuracy/f-score
• penalize the number of operations
• penalize runtime

As far as I understand deap supports multi-objective optimization
out-of-the-box.

—
Reply to this email directly or view it on GitHub
#70 (comment).

Randal S. Olson, Ph.D.
Postdoctoral Researcher, Institute for Biomedical Informatics
University of Pennsylvania

E-mail: [email protected] | Twitter: @randal_olson
https://twitter.com/randal_olson
http://www.randalolson.com

[kadarakos]

What kind of measures are you using for complexity?

[rhiever]

The two you mentioned -- number of pipeline operators and runtime -- but
also the number of features in the pipeline. Interested to hear more ideas
if you have some.

On Wed, Jan 6, 2016 at 12:49 AM, kadarakos [email protected] wrote:

What kind of measures are you using for complexity?

—
Reply to this email directly or view it on GitHub
#70 (comment).

Randal S. Olson, Ph.D.
Postdoctoral Researcher, Institute for Biomedical Informatics
University of Pennsylvania

E-mail: [email protected] | Twitter: @randal_olson
https://twitter.com/randal_olson
http://www.randalolson.com

[rhiever]

This is now encapsulated in #206, so I'm going to close this issue.