This software is the outcome of our accademic research. See our arXiv paper: arxiv
If you use this code, please cite our accademic paper as:
@inproceedings{massarelli2018safe,
title={SAFE: Self-Attentive Function Embeddings for Binary Similarity},
author={Massarelli, Luca and Di Luna, Giuseppe Antonio and Petroni, Fabio and Querzoni, Leonardo and Baldoni, Roberto},
booktitle={Proceedings of 16th Conference on Detection of Intrusions and Malware & Vulnerability Assessment (DIMVA)},
year={2019}
}You need radare2 installed in your system.
To create the embedding of a function:
git clone https://github.com/gadiluna/SAFE.git
pip install -r requirements
chmod +x download_model.sh
./download_model.sh
python safe.py -m data/safe.pb -i helloworld.o -a 100000F30
Once you have two embeddings embedding_x and embedding_y you can compute the similarity of the corresponding functions as:
from sklearn.metrics.pairwise import cosine_similarity
sim=cosine_similarity(embedding_x, embedding_y)
SAFE needs few information to work. Two are essentials, a model that tells safe how to convert assembly instructions in vectors (i2v model) and a model that tells safe how to convert an binary function into a vector. Both models can be downloaded by using the command
./download_model.sh
the downloader downloads the model and place them in the directory data. The directory tree after the download should be.
safe/-- githubcode
\
\--data/-----safe.pb
\
\---i2v/
The safe.pb file contains the safe-model used to convert binary function to vectors. The i2v folder contains the i2v model.
This section contains details that are needed to replicate our experiments, if you are an user of safe you can skip it.
This is the freezed tensorflow trained model for AMD64 architecture. You can import it in your project using:
import tensorflow as tf
with tf.gfile.GFile("safe.pb", "rb") as f:
graph_def = tf.GraphDef()
graph_def.ParseFromString(f.read())
with tf.Graph().as_default() as graph:
tf.import_graph_def(graph_def)
sess = tf.Session(graph=graph)
see file: neural_network/SAFEEmbedder.py
The i2v folder contains two files. A Matrix where each row is the embedding of an asm instruction. A json file that contains a dictonary mapping asm instructions into row numbers of the matrix above. see file: asm_embedding/InstructionsConverter.py
If you want to train the model using our datasets you have to first use:
python3 downloader.py -td
This will download the datasets into data folder. Note that the datasets are compressed so you have to decompress them yourself. This data will be an sqlite databases. To start the train use neural_network/train.sh. The db can be selected by changing the parameter into train.sh. If you want information on the dataset see our paper.
If you want to create your own dataset you can use the script ExperimentUtil into the folder dataset creation.
If you want to use SAFE binary code search engine you can use the script ExperimentUtil to create the knowledge base. Then you can search through it using the script into function_search
- YARASAFE: Automatic Binary Function Similarity Checks with Yara (https://github.com/lucamassarelli/yarasafe)
- SAFEtorch: Pytorch implemenation of the SAFE neural network (https://github.com/facebookresearch/SAFEtorch)
In our code we use godown to download data from Google drive. We thank circulosmeos, the creator of godown.
We thank Davide Italiano for the useful discussions.
React
Typescript
Django
Laravel
Facebook
Microsoft
Google
Alibaba
D3
Tencent