Tornado Elasticsearch Client
Tornado HTTP client for Elasticsearch. Its goal is to provide common ground for all Elasticsearch-related code in tornado and provide a similar api to the official elasticsearch python client (elasticsearch-py). However, this client only works for HTTP (no thrift or memcache) and doesn't support connection pooling at this time (one client per instance). This allows for you to design your own pooling/handling of callbacks.
Elasticsearch Compatibility
The library is compatible with Elasticsearch 2.X
Installation
pip install elasticsearch_tornadoDocumentation
http://elasticsearch-tornado.readthedocs.org/en/latest/
CLI
Elasticsearch Tornado also provides a handy cli for interacting with Elasticsearch clusters. Here are a few handy commands:
# indexing
$ cat data.json
{ "index" : { "_index" : "test", "_type" : "type1", "_id" : "1" } }
{ "user" : "foo", "age": 100 }
{ "index" : { "_index" : "test", "_type" : "type1", "_id" : "2" } }
{ "user" : "bar", "age": 99 }
$ cat data.json | et index
{"took":19,"errors":false,"items":[{"index":{"_index":"test","_type":"type1","_id":"1","_version":8,"_shards":{"total":2,"successful":1,"failed":0},"status":200}}]}
# searching
$ et search -q 'age:99'
{"took":5,"timed_out":false,"_shards":{"total":8,"successful":8,"failed":0},"hits":{"total":2,"max_score":1.5108256,"hits":[{"_index":"test","_type":"type1","_id":"2","_score":1.5108256},{"_index":"test","_type":"test_type","_id":"2","_score":1.5108256,"_source":{ "user" : "bar", "age": 99 }}]}}
# cat API
$ et cat master
127.0.0.1 127.0.0.1 8 20 0.05 d * Randall Shire
$ et cat nodes
127.0.0.1 127.0.0.1 8 20 0.05 d * Randall Shire
$ et cat shards
index 2 p STARTED 0 131b 127.0.0.1 Randall Shire
index 2 r UNASSIGNED
index 4 p STARTED 1 3.7kb 127.0.0.1 Randall Shire
index 4 r UNASSIGNED
index 3 p STARTED 0 131b 127.0.0.1 Randall Shire
index 3 r UNASSIGNED
index 1 p STARTED 0 131b 127.0.0.1 Randall Shire
index 1 r UNASSIGNED
index 0 p STARTED 0 131b 127.0.0.1 Randall Shire
index 0 r UNASSIGNED
test 0 p STARTED 0 159b 127.0.0.1 Randall Shire
test 0 r UNASSIGNED
.scripts 0 p STARTED 1 2.7kb 127.0.0.1 Randall ShireExample use
Simple use-case:
from __future__ import print_function
from elasticsearch_tornado import EsClient, serialize
from functools import partial
from tornado import ioloop, gen
import json
c = EsClient()
@gen.coroutine
def index(doc):
p = partial(
c.index_doc,
'test_index',
'test_doctype',
serialize(doc),
)
res = yield gen.Task(p)
raise gen.Return(res)
@gen.coroutine
def get(doc_id):
p = partial(
c.get_doc,
'test_index',
doc_id,
)
res = yield gen.Task(p)
raise gen.Return(res)
@gen.coroutine
def main_coro():
res = yield index({"user": "foo", "age": 100})
doc_id = json.loads(res.body).get('_id', '')
res = yield get(doc_id)
print(res.body)
ioloop.IOLoop.instance().run_sync(main_coro){"_index":"test_index","_type":"test_doctype","_id":"AVQmGdzo66UC-UgKXqlX","_version":1,"found":true,"_source":{"age": 100, "user": "foo"}
}Python Compatibility
Tested with python: 2.6, 2.7, 3.2, 3.3, 3.4, 3.5 and pypy
License
Copyright 2014-2016 Daniel Hodges
Licensed under the Apache License, Version 2.0 (the "License"); you may not use this file except in compliance with the License. You may obtain a copy of the License at
http://www.apache.org/licenses/LICENSE-2.0
Unless required by applicable law or agreed to in writing, software distributed under the License is distributed on an "AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. See the License for the specific language governing permissions and limitations under the License.
Requirements
Build status
