Framework for MSR


Keywords
git, mining-software-repositories, msr, python, python-framework, python3, software-engineering
License
Apache-2.0
Install
pip install PyDriller==1.6.3

Documentation

Build Status BCH compliance codecov Build status

PyDriller

PyDriller is a Python framework that helps developers in analyzing Git repositories. With PyDriller you can easily extract information such as commits, developers, modifications, diffs, and source codes.

Alt Text

Table of contents

REQUIREMENTS

Very few! Just:

  • Python3
  • Git

The list of dependencies is shown in ./requirements.txt, however the installer takes care of installing them for you.

INSTALL

Installing PyDriller is easily done using pip. Assuming it is installed, just run the following from the command-line:

pip install pydriller

This will also install the necessary dependencies.

SOURCE CODE

If you like to clone from source, you can do it with very simple steps. First, clone the repo:

> git clone https://github.com/ishepard/pydriller.git
> cd pydriller

OPTIONAL

It is suggested to make use of virtualenv:

> virtualenv -p python3 venv
> source venv/bin/activate

INSTALL THE REQUIREMENTS AND RUN THE TESTS

Install the requirements:

> pip install -r requirements.txt

to run the tests (using pytest):

> unzip test-repos.zip
> pip install -r test-requirements.txt
> pytest

TUTORIAL

For information on how to use PyDriller, refer to the official documentation:

or have a look at our example folder.

How to contribute

Fork the project and follow the instructions on how to get started with source code. I tend to not accept a Pull Request without tests, so:

  • unzip the test-repos.zip zip file
  • inside you will find many "small repositories" that I manually created to test PyDriller. Choose the one you prefer the most, and test your feature (check the tests I have already written, you'll find inspiration there)
  • if you do not find a repository that is suitable to test your feature, create a new one. Be careful: if you create a new one, do not forget to upload a new zip file test-repos.zip that includes your new repository, otherwise the tests will fail.

How to cite PyDriller

@inbook{PyDriller,
	title = "PyDriller: Python Framework for Mining Software Repositories",
	abstract = "Software repositories contain historical and valuable information about the overall development of software systems. Mining software repositories (MSR) is nowadays considered one of the most interesting growing fields within software engineering. MSR focuses on extracting and analyzing data available in software repositories to uncover interesting, useful, and actionable information about the system. Even though MSR plays an important role in software engineering research, few tools have been created and made public to support developers in extracting information from Git repository. In this paper, we present PyDriller, a Python Framework that eases the process of mining Git. We compare our tool against the state-of-the-art Python Framework GitPython, demonstrating that PyDriller can achieve the same results with, on average, 50% less LOC and significantly lower complexity.URL: https://github.com/ishepard/pydrillerMaterials: https://doi.org/10.5281/zenodo.1327363Pre-print: https://doi.org/10.5281/zenodo.1327411",
	author = "Spadini, Davide and Aniche, Maurício and Bacchelli, Alberto",
	year = "2018",
	doi = "10.1145/3236024.3264598",
	booktitle = "The 26th ACM Joint European Software Engineering Conference and Symposium on the Foundations of Software Engineering (ESEC/FSE)",
}

This project has received funding from the European Unions’ Horizon 2020 research and innovation programme under the Marie Sklodowska-Curie grant agreement No. 642954.

License

This software is licensed under the Apache 2.0 License.