google / debaised-analysis

Debiased Analysis Add-on

Debiased Analysis Add-on

Composing analysis in Sheets using formulas is hard to learn and master, particularly for more advanced intents such as trend, top-k, slice comparisons.The goal of the project is to describe user intents as Sheets formula functions. Implementation of each formula will be in Python, which returns not only the result (formula) but also a set of debiasing suggestions.

Source Code Headers

Every file containing source code must include copyright and license information. This includes any JS/CSS files that you might be serving out to browsers. (This is to help well-intentioned people avoid accidental copying that doesn't comply with the license.)

Apache header:

Copyright 2020 Google LLC

Licensed under the Apache License, Version 2.0 (the "License");
you may not use this file except in compliance with the License.
You may obtain a copy of the License at

    https://www.apache.org/licenses/LICENSE-2.0

Unless required by applicable law or agreed to in writing, software
distributed under the License is distributed on an "AS IS" BASIS,
WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
See the License for the specific language governing permissions and
limitations under the License.

debaised-analysis's Issues

Comparing Multiple Subgroups

• Feature of being able to compare multiple subgroups in Compare Subgroups intent (slice-compare) will enhance its usability and scope.
• For example : "Comparing all the branches of engineering in a university on basis of average marks" is not possible currently in slice-compare intent.

Division by zero not handled in some Oversights

• standard_deviation = 0 will lead to an error https://github.com/googleinterns/debaised-analysis/blob/0b487833aa9ad88e668db1cdb0cc697adc6204c8/intents/oversights/looking_at_tails.py#L111-L112
  https://github.com/googleinterns/debaised-analysis/blob/0b487833aa9ad88e668db1cdb0cc697adc6204c8/intents/oversights/more_than_just_topk.py#L85-L87

• (abs(val1) + abs(val2)) = 0 will lead to an error https://github.com/googleinterns/debaised-analysis/blob/0b487833aa9ad88e668db1cdb0cc697adc6204c8/intents/oversights/benchmark_set_too_different.py#L176-L180

Adding checks for these corner cases will avoid these division by zero errors.

Having a redundant column of 'Summary Operator' in show intent when no grouping happens

Credits for finding the issue : @bhagyakjain

https://github.com/googleinterns/debaised-analysis/blob/8ef883508feee364eaa7cb02fd398207657af24f/intents/test_show.py#L216-L217

Here the column 'Summary Operator' is redundant and we can drop it.
For user to know which operator was applied #62 PR changes the column names to 'Operator of ....' (E.g : Mean of Marks)

Security Policy violation Binary Artifacts

This issue was automatically created by Allstar.

Security Policy Violation
Project is out of compliance with Binary Artifacts policy: binaries present in source code

Rule Description
Binary Artifacts are an increased security risk in your repository. Binary artifacts cannot be reviewed, allowing the introduction of possibly obsolete or maliciously subverted executables. For more information see the Security Scorecards Documentation for Binary Artifacts.

Remediation Steps
To remediate, remove the generated executable artifacts from the repository.

Artifacts Found

• intents/data/spider_eval/pycache/evaluation.cpython-37.pyc
• intents/data/spider_eval/pycache/process_sql.cpython-37.pyc
• intents/data/spider_eval/process_sql.pyc

Additional Information
This policy is drawn from Security Scorecards, which is a tool that scores a project's adherence to security best practices. You may wish to run a Scorecards scan directly on this repository for more details.

---

Allstar has been installed on all Google managed GitHub orgs. Policies are gradually being rolled out and enforced by the GOSST and OSPO teams. Learn more at http://go/allstar

This issue will auto resolve when the policy is in compliance.

Issue created by Allstar. See https://github.com/ossf/allstar/ for more information. For questions specific to the repository, please contact the owner or maintainer.

Handle dynamic headers, do not assume that the headers are always part of the first row.

Table can start from anywhere in the sheet.

Option to insert as column for Trend intent for Growth Column

• It would be great to insert a growth column within the sheet itself when there is no grouping happening.
• It will allow users to do more composition queries.