kalharbi / appsrepo

appsrepo: A tool chain for extracting, analyzing, loading, and retrieving Android apps from NoSQL databases.

appsrepo

appsrepo: A tool chain for extracting, analyzing, loading, and retrieving Android apps from NoSQL databases.

1- APK Bucket

This includes a Python tool that stores apk files in a common MongoDB bucket using GridFS, and a Java based tool that retrieves them.

2- Public Features MongoDB Ruby Driver

This is the Ruby MongoDB driver for the public collection of the database. It retrieves various public information of apps and stores the results in text files.

3- Public Features Collection

This tool reads raw JSON files and stores them into a MongoDB collection named public.

4- Smali Methods Finder

This is a Ruby based tool that extracts Android API methods and user's defined methods from .smali files.

5- Manifest Features Collection

This tool parses AndroidManifest.xml files and stores them into a MongoDB collection named manifest.

6- Manifest Mongodb Driver

This is the Python MongoDB driver for the manifest collection of the database. It retrieves AndroidManifest features from MongoDB and stores the results into text files.

7- Android UI GraphML Writer

This tool writes the UIs of Android apps in a GraphML format, a file format for graphs. It parses layout and resources files, identifies the relationships between UI components, stores the result in a GraphML file that describes the structural properties of the UI. The GraphML file can be imported into the tinkerpop stack or any graph databse (e.g, neo4j, titan, etc).

8- Android UI GraphDB Writer

This tool takes the input of the Android UI GraphML Writer (#7) as an input and loads it into the graph database (neo4j).

9- UI XML

A tool for parsing Android XML layout files and storing them in one XML file to simplify UI analysis. It resolves resource references (e.g., @string/cancel_btn) and embeded layouts (e.g., using the <include/> and <merge/> tags). The final xml file is saved inside the unpacked apk directory under a sub-directory named ui-xml.

10- UI Delta

This tool extracts the views of Android apps from neo4j and computes the delta of Views between two app versions.

11- Smali Solr Indexer

This tool indexes smali invoked methods text files in Apache Solr.

12- Tools

Python & shell script tools for batch processing a list of apk files.

13- Shell

An interactive shell to query the collection of apps using a Domain Specfic Language (DSL).

---

Sample APK Files

• 10 apps, two versions each, target sdk 17. Download
• 7 apps, two versions each, target sdk 16. Download
• 9 apps, two versions each, target sdk 14. Download
• 10 apps, two versions each, minimum sdk 8. Download
• 30 apps, two versions each. Download
• 100 apps, two versions each. Download
• Android Framework files for the following devices: Samsung Galaxy S3, Google Nexus 10, and Google Nexus5. Download