doreapp / my_data_analyser

Analyser of 'my data' on several sites such as Facebook or spotify

My_data_analyser

Analyser of 'my data' on several site such as Facebook or spotify

This goal is to extract interesting information from your personnal data, that can be accessed from sites/apps. There aren't no internet use, or share of your data.

Environement

I use IntelliJ IDEA, but it also work with Android Studio

Developpement is in Kotlin

Doing

Folders/Files in analyse progress

• messages
  • [*] > Photos+Messages...
• posts
  • your_posts > Every posts + date
• comments
  • comments.json > Contains every comments that I posted

TODOS

Folders/files that I want to analyse:

• events
  • your_event_responses.json > Contains joined+declined+interested events
  • Display a chrat abouot number of joined events
  • Allow browsing throught joined, declined and intrested events
• friends
  • friends.json > name + date of add
  • Just need to display a chart showing the number of added friends
• groups
  • your_posts....json > every posts (including photos) + comments in groups
  • your..membership....json > groups joined and left + dates
  • Browse through groups, while showing the number of interactions
  • Display details about posts in a group, and joining date
• interactions
  • groups.json > groups + number of interactions with
  • I don't know if it is useful... The information is also in "groups" folder
• photos_and_videso
  • contains every albums + posted photos (with dates)
  • ..?

Spotify !

• Evolution of stream counts
• Evolution of stream time
• Best artists (in stream time)
  • Best artists of a period
• Best songs (in stream time)
  • Best songs of a period
• Search data ?
  • Evolution
  • History
  • Bests ?
• Thoses statistics but only about the last Year / the last month ...

Google

YouTube

• Evolution of watch time / counts
• Best Youtubers (in time and counts)
• Search history
• Thoses statistics but only about the last Year / the last month ...

Libraries

I use MPAndroidChart for displaying graphs (Javadoc).

my_data_analyser's Issues

Create an icon

Add a galery view

An activity used to see photos (and dates)

• May be used for see photos of a conversation (first)
• But also then for photos posted and albums

Create an evolution graph for the number of message of a conversation

Showing the number of message posted in a conversation during a period of time

• Use the first and last message date
• separate in x (10,20?) sub-periods and show a graph

Change colors

for something darker, and more "sobre"

Change colors of the app

Make a better manifest.xml

Between other, setting that the app must be in portrait orientation

Make loading of conversation stats async (with a loading dialog)

On a fullscreen photo [Gallery Activity], be able to see who send it, and when

Add percentage in **numbered_list**

Comment Database classes

Search for a conversation

Be able to open a photo in the device app

In the gallery activity, as the photo is already downloaded, just ask (with an intent) to open in the photo default app

Comment the "Conversation" Module (including views)

An activity for see posts one by one

With

• Content
• Date
• Where
• Fast scrolling

Add view for displaying messages of a conversation

Display every messages

• With an easy scroll to - between other - see the firsts messages of a conversation

[Conversations View] Change number display --> from 123456 to 123K

Manage text encoding (while parsing for the best)

Adding the information"progress" into the Task Notifier (and show it...)

Make the app easily translatable

Make every string extracted from string.xml

Add a back arrow to non-root activities

Allow sorting conversations by name/date/number of messages

Check if we can re-open the folder of a conversation using the saved `path`

Optimize the date assignement to the pictures of a conversation (and the loading+sorting of pictures)

[Spotify] Add track analysis view

From a click on a track, be able to view

• Time streamed, stream count
  • Their evolutions in time

View of a conversation : Create

Create the workflow and the v1 of the view

• Retrieve the whole data (by parsing)
• Show information
  • nb of message / person
  • start
  • number of message

[Gallery] Show fullscreen image on click

See artist stats

From a view showing an artist detail, be able to open an activity showing artist stats, such as

• number of stream
• time streamed
• song steamed (count and total time)
• first stream date
• evolution of steam count / time

Create model

Be able to see empty periods on graphs

Period graphs doesn't show empty period because array doesn't contains "0" values in empty periods.
Add it in the visualization (set attribute)

Add progress to the load of cache-stored conversation values (database reading)

[Gallery] Show dates in Gallery view

Make the loading of the picture of a conversation async (w/ loading dialog...)

Do not count empty values in percentage total [NumberedListView]

Display statistics about posts

• Evolution through time
• "Where" rank
• Posts count
• Photo count

Load the whole zip file

Identify content of the zip, and create (empty) methods in order to load information from each sub-directories and files

[Gallery] Add actions to navigate easily

• Go to bottom (newer photos)

Create Gallery activity

Needs to show 3 by 3 image views. Test it with in-project test images

[Spotify] Add artist analysis

From a click on an artist, be able to view

• Evolution of streams and time streamed
• Number of total streams / total streamed duration
• Most streamed song (in counts and total duration)

Explore Conversation Folder

• Number of Conversations in different folders
• Names of conversations
• Number of messages in conversations

[Gallery] Enable scrolling with scrollbar and show the date while scrolling

Parse posts

Find and save the date of the first message sent while parsing

See track stats

From a View showing track details, view stats about it

• number + time of steam

Manage the number of shown items by a *numbered_list* with a "show more" button