Taxadb

⚠️ **This project will not receive updates for the time being ⚠️

Taxadb is an application to locally query the ncbi taxonomy. Taxadb is written in python, and access its database using the peewee library.

In brief Taxadb:

• is a small tool to query the ncbi taxonomy.
• is written in python >= 3.5.
• has built-in support for SQLite, MySQL and PostgreSQL.
• has available pre-built SQLite databases.
• has a comprehensive API documentation.

Installation

Taxadb requires python >= 3.5 to work. To install taxadb with sqlite support, simply type the following in your terminal:

pip3 install taxadb

If you wish to use MySQL or PostgreSQL, please refer to the full documentation

Usage

Querying the Database

Firstly, make sure you have built the database

Below you can find basic examples. For more complete examples, please refer to the complete API documentation

    >>> from taxadb.taxid import TaxID

    >>> taxid = TaxID(dbtype='sqlite', dbname='mydb.sqlite')
    >>> name = taxid.sci_name(33208)
    >>> print(name)
    Metazoa

    >>> lineage = taxid.lineage_name(33208)
    >>> print(lineage)
    ['Metazoa', 'Opisthokonta', 'Eukaryota', 'cellular organisms']
    >>> lineage = taxid.lineage_name(33208, reverse=True)
    >>> print(lineage)
    ['cellular organism', 'Eukaryota', 'Opisthokonta', 'Metazoa']

    >>> taxid.has_parent(33208, 'Eukaryota')
    True

Get the taxid from a scientific name.

    >>> from taxadb.names import SciName

    >>> names = SciName(dbtype='sqlite', dbname='mydb.sqlite')
    >>> taxid = names.taxid('Physisporinus cinereus')
    >>> print(taxid)
    2056287

Get the taxonomic information for accession number(s).

    >>> from taxadb.accessionid import AccessionID

    >>> my_accessions = ['X17276', 'Z12029']
    >>> accession = AccessionID(dbtype='sqlite', dbname='mydb.sqlite')
    >>> taxids = accession.taxid(my_accessions)
    >>> taxids
    <generator object taxid at 0x1051b0830>

    >>> for tax in taxids:
        print(tax)
    ('X17276', 9646)
    ('Z12029', 9915)

You can also use a configuration file in order to automatically set database connection parameters at object build. Either set config parameter to __init__ object method:

   >>> from taxadb.accessionid import AccessionID

   >>> my_accessions = ['X17276', 'Z12029']
   >>> accession = AccessionID(config='/path/to/taxadb.cfg')
   >>> taxids = accession.taxid(my_accessions)
   >>> ...

or set environment variable TAXADB_CONFIG which point to configuration file:

   $ export TAXADB_CONFIG='/path/to/taxadb.cfg'

then

   >>> from taxadb.accessionid import AccessionID

   >>> my_accessions = ['X17276', 'Z12029']
   >>> accession = AccessionID()
   >>> taxids = accession.taxid(my_accessions)
   >>> ...

Check documentation for more information.

Creating the Database

Download data

The following commands will download the necessary files from the ncbi ftp into the directory taxadb.

$ taxadb download -o taxadb

Insert data

SQLite

$ taxadb create -i taxadb --dbname taxadb.sqlite

You can then safely remove the downloaded files

$ rm -r taxadb

MySQL

Creating databases is a very vendor specific task. Peewee, as most ORMs, can create tables but not databases. In order to use taxadb with MySQL, you'll have to create the database yourself.

Connect to your mysql server

$ mysql -u $user -p
$ mysql> CREATE DATABASE taxadb;

Load data

$ taxadb create -i taxadb --dbname taxadb --dbtype mysql --username <user> --password <pwd> ...

PostgreSQL

Creating databases is a very vendor specific task. Peewee, as most ORMs, can create tables but not databases. In order to use taxadb with PosgreSQL, you'll have to create the database yourself.

Connect to your postgresql server

$ psql -U $user -d postgres
$ psql> CREATE DATABASE taxadb;

Load data

$ taxadb create -i taxadb --dbname taxadb --dbtype postgres --username <user> --password <pwd> ...

You can easily rerun the same command, taxadb is able to skip already inserted taxid as well as accession.

Tests

You can easily run some tests. Go to the root directory of this projects cd /path/to/taxadb and run nosetests.

This simple command will run tests against an SQLite test database called test_db.sqlite located in taxadb/test directory.

It is also possible to only run tests related to accessionid or taxid as follow

$ nosetests -a 'taxid'
$ nosetests -a 'accessionid'

You can also use the configuration file located in root distribution taxadb.ini as follow. This file should contains database connection settings:

$ nosetests --tc-file taxadb.ini

You can easily override configuration file settings using command line options --tc such as:

$ nosetest --tc-file taxadb.ini --tc=sql.dbname:another_dbname

More info at nose-testconfig

Running tests against PostgreSQL or MySQL

First create a test database to insert test data

• PostgreSQL

$ createdb <test_db>

or

$ psql -U postgres
psql> CREATE DATABASE <test_db>;

• MySQL

$ mysql -u root
mysql> CREATE DATABASE <test_db>;

Load test data

• PostgreSQL

$ gunzip -c /path/to/taxadb/taxadb/test/test_mypg_db.sql.gz | psql -d <test_db> -U <user>

• MySQL

$ gunzip -c /path/to/taxadb/taxadb/test/test_mypg_db.sql.gz | mysql -D <test_db> -u <user> -p

Run tests

Either edit taxadb.ini to fit database configuration or use --tc command line option and set appropriate values like username, password, port, hostname, dbtype(postgres or mysql), dbname.

1. PostgreSQL

$ nosetests --tc-file taxadb.ini
OR
$ nosetests -tc-file taxadb.ini --tc=sql.dbtype:postgres --tc=sql.username:postgres --tc=sql.dbname:test_db2

2. MySQL

$ nosetests --tc-file taxadb.ini
OR
$ nosetests -tc-file taxadb.ini --tc=sql.dbtype:mysql --tc=sql.username:root --tc=sql.dbname:newdbname

License

Code is under the MIT license.

Issues

Found a bug or have a question? Please open an issue

Contributing

Thought about a new feature that you'd like us to implement? Open an issue or fork the repository and submit a pull request