harishkamathuk / harishkamath-needle Goto Github PK

What is the feature that is being added to the Parking Log?

Currently, all messages are printed to the script - this needs to go to a log 
file.

How critical is it to the function of the application i.e. is it a show
stopper or nice-to-have?

This is critical as it is easier to review a log file rather than printing out 
to the screen.

Please provide any additional information below. Links, resources etc.

Use default CakeLog features - should be a quick thing to implement.

What is the feature that is being added to the Parking Log?

Email functionality in the needle application

How critical is it to the function of the application i.e. is it a show
stopper or nice-to-have?

Nice to have - this is existing behaviour in the scrape application as it 
emails a CSV file with the NAVs


Please provide any additional information below. Links, resources etc.

What is the feature that is being added to the Parking Log?
Make the application needle as a Plugin for CakePHP application

How critical is it to the function of the application i.e. is it a show
stopper or nice-to-have?
This is a high priority as the ultimate goal is to integrate this into the main 
pman application.

Please provide any additional information below. Links, resources etc.
See CakePHP documentation on how to build a plugin
Things to look out:

- decouple the application to be re-usable
- how to incorporate db dependencies

What is the feature that is being added to the Parking Log?

Ability to associate multiple needles with a URL. This will allow the 
application to search for different text in the haystack. Store the results in 
the separate location for future reference

How critical is it to the function of the application i.e. is it a show
stopper or nice-to-have?
It is a show stopper - will need to prioritised


Please provide any additional information below. Links, resources etc.

What is the feature that is being added to the Parking Log?

The current implementation is very basic. Need the ability to post data if 
required. Input parameter should be better handled.


How critical is it to the function of the application i.e. is it a show
stopper or nice-to-have?

Nice to have - can be prototype of input argument processing for custom 
functions


Please provide any additional information below. Links, resources etc.

What steps will reproduce the problem?
1. Fetch Haystack
2. Mine for Needle
3. No valid NeedleHit found - scrapped data was invalid

What is the expected output? What do you see instead?
Expect to view NAV and IMA Sector for the URLs in question - no data retrieved.

What version of the product are you using? On what operating system?


Please provide any additional information below.

What is the feature that is being added to the Parking Log?

Build a Helper for the application in general. This can contain function not 
available in CakePHP. For example converting UTF strung into ASCII that is not 
removed by simple string function. 

How critical is it to the function of the application i.e. is it a show
stopper or nice-to-have?

This is critical as it will ensure that we use the needle found for the plan 
application.

Please provide any additional information below. Links, resources etc.

What is the feature that is being added to the Parking Log?

Currently, the default behaviour of the "mine function is to look for first 
instance of the needle start and needle end values. The function should have 
flag that indicate whether the function call should be greedy or not i.e. it 
should return as much (greedy = true) or as little (greedy=false) feature.

How critical is it to the function of the application i.e. is it a show
stopper or nice-to-have?

Nice to have. This will ensure that there are more relevant needles that can be 
created. For example, the ISIN needle does not work as the word is present 
twice on the Morningstar website and the function returns a lot more data than 
it should.


Please provide any additional information below. Links, resources etc.

What is the feature that is being added to the Parking Log?

Since we are scraping various website, it makes sense to scrap all the HTML 
from the URL being scrapped.

How critical is it to the function of the application i.e. is it a show
stopper or nice-to-have?

Often websites have complex HTML and JS code that is not required to be stored 
in the database - something that can strip off the HTML will be useful.


Please provide any additional information below. Links, resources etc.

http://book.cakephp.org/2.0/en/core-utility-libraries/sanitize.html

http://htmlpurifier.org/

What is the feature that is being added to the Parking Log?

Good practice and get to learn more about unit testing

How critical is it to the function of the application i.e. is it a show
stopper or nice-to-have?

Nice to have - personal knowledge


Please provide any additional information below. Links, resources etc.

What is the feature that is being added to the Parking Log?

Populate the data required for BAU use

How critical is it to the function of the application i.e. is it a show
stopper or nice-to-have?

Critical

Please provide any additional information below. Links, resources etc.

What is the feature that is being added to the Parking Log?

Create a CakePHP Console application to run the screen scrapper

How critical is it to the function of the application i.e. is it a show
stopper or nice-to-have?

This is critical task in order to move away from GoDaddy.


Please provide any additional information below. Links, resources etc.

Note that the UTF-8 character bug.

What is the feature that is being added to the Parking Log?

This is to ensure that the application can ported easily using config files

How critical is it to the function of the application i.e. is it a show
stopper or nice-to-have?

Critical as there are many hard coded values in the code base today


Please provide any additional information below. Links, resources etc.

See Config file section in the CakePHP documentation

What steps will reproduce the problem?
1. Mine any Haystack for the needles associate with Url (for Haystack)
2. No hatstack reference is stored in the database before saving the Needle Hit.

What is the expected output? What do you see instead?
The listing should display the Haystack id

What version of the product are you using? On what operating system?
v1.0.0-alpha

Please provide any additional information below.

What is the feature that is being added to the Parking Log?

Create task in task scheduler to run everyday to retrieve the data from 
Morningstar

How critical is it to the function of the application i.e. is it a show
stopper or nice-to-have?

Critical as this will ensure that we can turn the Godaddy scrape application in 
the future.

Please provide any additional information below. Links, resources etc.

N/A

What is the feature that is being added to the Parking Log?

Currently, the data is extracted into CSV file from the scrape application for 
direct import into Quicken

How critical is it to the function of the application i.e. is it a show
stopper or nice-to-have?

Critical feature as this is the purpose of the application - however, this 
requires the pman application to be set up.


Please provide any additional information below. Links, resources etc.

What is the feature that is being added to the Parking Log?

Currently this is an input parameter - make this hardcoded non-editable value.

How critical is it to the function of the application i.e. is it a show
stopper or nice-to-have?

Nice to have but required for first release.


Please provide any additional information below. Links, resources etc.

What is the feature that is being added to the Parking Log?

Hosting the needle CakePHP application at an external site - to provided 
redundancy.

Options: AWS 

http://docs.aws.amazon.com/elasticbeanstalk/latest/dg/create_deploy_PHP_cakePHP.
html

How critical is it to the function of the application i.e. is it a show
stopper or nice-to-have?

This is a nice to have. It will also give exposure to these external services 
provided by Amazon.


Please provide any additional information below. Links, resources etc.

- https://aws.amazon.com/documentation/elasticbeanstalk/