Performance improvement about ish_parser

[haydenth]

i am 100% interested in this :)

[haydenth]

OK Sat and thought about this for a few mins.

• vectorized == parallized or threaded?
• love the idea of requesting only specific fields; that would speed it up dramatically

[vtoupet]

vectorized means not scalar. Instead of applying a function to a scalar and iterate over a list of scalar, we apply the same function to a vector (of dimension 1 x n). This is the main principle of Numpy and Pandas. This is much quicker.

I'll try to initiate something by september.

[haydenth]

Oh I see what you are saying.. I don't think it would be crazy hard to make a layer above ish_report that vectorizes the individual ish_report objects so they can be used in a library like that.