miragecoa / wallstreetpulse Goto Github PK
View Code? Open in Web Editor NEWLicense: Apache License 2.0
License: Apache License 2.0
We only wanna visit a post once using GPT, so after we finish our visit, we should mark the post as visited and store our result data locally.
Goal: Create a jsonHelper.py that supports the following:
1. Create
2. Search if some topics/titles already created
3. Edit
4. Delete
Users should be able to pass in multiple parameters(Can be a dictionary of {Title: "something", upvotes: 10, ETC. }). Make sure you handle these requests correctly
This helper function is intended to be a local database similar to MySQL and MongoDB.
update: we tried sqlite3. Looks like a good approach
We need to create a helper class that can fetch and plot stock market data from various sources, such as Yahoo Finance or Alpha Vantage. This will allow us to compare our predictions from the GPT analysis with the actual market trends and performance.
Consider registering for APIs on Yahoo Finance or Alpha Vantage
The helper class should have
Currently, we have a working version of getting posts from Reddit using Praw module. Relevant codes are in Reddit_Posts.py and main.py. However, when retrieving posts/comments, Praw returns a generator and it runs extremely slow even with a few posts/comments.
Potential solutions
Connecting issue 9: #9
Consider we have 2 tables in SQL with the following tables (achievable using SQLhelper.py)
table 1 for main post information: id, url, article_id, poster_username, post_content, published_date, visited_date, upvotes, downvotes
table 2 for comments; id, article_id(to know which post this comment is under), username, content, parent_comment_id(if this comment replies to a previous comment), upvotes, downvotes
We have already implemented access functions for Custom Search Engine to apply a time filter search on Reddit posts. We also implemented a SQL helper function that uses sqlite3 for storing dictionaries into a local .db file, functioning the same as an SQL database.
Goal:
Make use of both access functions and SQL functions to retrieve as much post information as possible into a local file for future analysis, Including poster username, post content, comments, commenters username.
Workflow:
Custom Search Engine get post URLs -> Reddit API get post info by article id -> SQL helper
I suggest making 2 tables with the following structure
table 1 for main post information: id, url, article_id, poster_username, post_content, published_date, visited_date, upvotes, downvotes
table 2 for comments; id, article_id(to know which post this comment is under), username, content, parent_comment_id(if this comment replies to a previous comment), upvotes, downvotes
We will eventually visualize a graph with nodes(users) and edges(connections)
We are capable of retrieving post data using Reddit_Posts.py. Now we wanna interact with our language model (GPT in this case) to get useful data.
Goal:
Check gpt_api.py. Use get_response function.
I might introduce functions capable of doing online search in the future
We are entering the final stage of this project. We need to show the results/findings of our research.
Task: Give codes to try different models and find the appropriate models on our WallStreetBets forum data.
Models can be found on Netlogo models: https://ccl.northwestern.edu/netlogo/models/
Here is a list of models we can try and see which one fits:
Bidding Market: https://ccl.northwestern.edu/netlogo/models/BiddingMarket
Preferential Attachment: https://ccl.northwestern.edu/netlogo/models/PreferentialAttachment3D
Rumor Mill: https://ccl.northwestern.edu/netlogo/models/RumorMill
Virus on a Network: https://ccl.northwestern.edu/netlogo/models/VirusonaNetwork
Wealth Distribution: https://ccl.northwestern.edu/netlogo/models/WealthDistribution
Minority Game: https://ccl.northwestern.edu/netlogo/models/MinorityGame
Scatter: https://ccl.northwestern.edu/netlogo/models/Scatter
Small Worlds: https://ccl.northwestern.edu/netlogo/models/SmallWorlds
The question here is 1. Does this model fit to our data? 2. What result can we show to others as our final project report?
Appropriate results can be: whether the market will crash given data at a specific date of GME event.
Come chat with me if you have any thoughts/findings or any idea about what our result should be.
Currently, our Reddit_Posts.py has titles, contents, upvotes, downvotes, etc. We will need some data to determine the "influential" posts.
Think about something like upvote/downvote ratios, how often the poster posts, the number of different users appear in our retrieved post,
Or any numbers/ratios that might be helpful for determining the "influential" posts/users
Add appropriate functions and comments to Reddit_Posts.py or a new .py file
Goal:
Consider num_posts, num_followers, upvotes in a given time span
A declarative, efficient, and flexible JavaScript library for building user interfaces.
๐ Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
An Open Source Machine Learning Framework for Everyone
The Web framework for perfectionists with deadlines.
A PHP framework for web artisans
Bring data to life with SVG, Canvas and HTML. ๐๐๐
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
Some thing interesting about web. New door for the world.
A server is a program made to process requests and deliver data to clients.
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
Some thing interesting about visualization, use data art
Some thing interesting about game, make everyone happy.
We are working to build community through open source technology. NB: members must have two-factor auth.
Open source projects and samples from Microsoft.
Google โค๏ธ Open Source for everyone.
Alibaba Open Source for everyone
Data-Driven Documents codes.
China tencent open source team.