jorymorrison / mld Goto Github PK

• figure out new method of addressing
• rewrite code to reflect new method
• update readme to reflect code changes

Decide on how server will be run wether with AWS or on other cloud service and program.

Decide on how corpus will be generated and how web crawler will act.

When saving the results of the program, the program uses a forward slash after attempting to save to the MLD folder resulting in the saving of the file in the home directory as MLD{tittle}.

Create a schema for the readme.

It appears that in the two years since this was maintained the Watson API has been updated.

It appears that Watson API only expects a secret key, not a username and password.

Current output of .json file is invalid in format and must be updated to save properly.
Additional elements will be added to the .json:

• save timestamp within .json
• save tone within .json
• save url within .json
• save publishing date within .json
  In addition the saving of the body text must be corrected to save the entirety of the text.

Save tone analysis in json file. currently saved as variable logoutput.

Line 27:
let COUNTER=COUNTER+1

of your crawler results on a dependency for bash because of let. There should be other ways to increment without introducing dependency on bash.

It would be great if we could create a function to handle output of the software.

It would be great to define a function that takes all of our values (tone, sentiment, lexical signature, date, title, etc...) and handles formatting for us using json_dumps. We could pretty print to a file.

Using goose gather publishing date and store in article section of json output file.
continuation of json output enhancement.

MLD should support the input of an article as an argument.

Example usage:

mld.py https://cnn.com/fadsfdsafadsfdsa

It would also be convenient for it to take as input a list of urls in text format.

Example usage:

mld.py -i myfile.txt

I suggest looking at ArgParse or a similiar library as argument parsing can be difficult and unmaintainable.

Please update the README to reflect any new usages/functionality as part of this work.

• [ x] create project
• refactor code
• write documentation
• release pipeline to publish package