Apply guarantee rewriter to sql workflow about arrow-datafusion

[alamb]

As I understand it, the usecase for GuaranteeRewriter when @wjones127 (maybe?) added it was for providing external information (outside of information that came from SQL). I don't think we should just remove the ability to do so

I would personally recommend add code that translates Statistics into Guarantees to pass to GuaranteeRewriter

We could discuss reworking how GuaranteeRewriter works as a follow on PR

[jayzhan211]

@jayzhan211 Do I understand correctly that the best option is to incorporate the guarantee logic into the simplifier based on statistics and remove the old version of the guarantee?

I think so.

[yyy1000]

Update: #10463 is not what this issue expects, I will see what to do next.
I can help it. :) An experimental PR is #10463

[yyy1000]

On a second glance, I feel it's difficult. 😥
When simplifying a logicalplan, it seems impossible to get the underlying data which could making guarantees.

[alamb]

I think this may be another example of what @samuelcolvin was suggesting on #10400

I think we could use ExecutionPlan::statistics to get the guarantee information

[dmitrybugakov]

@jayzhan211
Do I understand correctly that the best option is to incorporate the guarantee logic into the simplifier based on statistics and remove the old version of the guarantee?

[alamb]

old version of the guarantee?

What does "old version of the guarantee?" refer to?

[dmitrybugakov]

What does "old version of the guarantee?" refer to?

datafusion/datafusion/optimizer/src/simplify_expressions/guarantees.rs

Line 60 in 1d4b808

impl<'a> TreeNodeRewriter for GuaranteeRewriter<'a> {