tomzhang255 / ccr

An R package for NLP

Hello there, it's Tom 👋

• Education:
  • Harvard University '23 - MS in Data Science
  • St. Lawrence University '22 - BS in Stat & CS
• Interests:
  • Statistical modeling & machine learning
  • Data wrangling & visualization
  • Data pipeline implementation
  • Database design & management
  • Web app & API development

ccr's Issues

supporting Excel

Let's make sure that users can read either CSVs or Excel files.

new issues--August 22nd, 2022

1. while the model is running, the user gets the following:
   "Downloading: 100%|██████████| 1.18k/1.18k [00:00<00:00, 123kB/s]
   Downloading: 100%|██████████| 190/190 [00:00<00:00, 36.1kB/s]
   ..."
   These are not self-explanatory. Explain to the user what exactly is being downloaded...

2. Incorrect identification of language: when in the questionnaire file, there are NAs, the user gets this warning: "1: In encode_column(model, q_file, q_col, "q") :
   Non-English language detected in column Individualism from Desktop/CCR/CCR Experiment/CCR experiment measures.xlsx . Languages detected by cld3: en, NA"
   --NA should not be detected as a language of course. Please resolve.

3. Another problem with language detection: I inserted a fully English data and got this warning: "In encode_column(model, data_file, data_col, "d") :
   Non-English language detected in column texts from Desktop/CCR/data_test.csv . Languages detected by cld3: en, NA, pt, ht
   " .
   Maybe we should use a different package for lang. detection?

initial checks

--checking language in both CSVs. [issue warning if not English]
--checking column names [issue warning if not consistent]
--checking length of questionnaire items [issue error if 1 word; issue warning if 2 or 3 words]
--checking length of text [issue warning if fewer than 4 words]

CCR_shiny dependencies

ccr_shiny needs these two dependencies right now: "rhandsontable" and "shinydashboard".