[SOLVED] Python Requests Query Elasticsearch

snowman81 · 11-21-2017, 10:32 PM

I have the following code but I seem to be getting an error related to lists? I'm not totally sure why. I eventually want the return of the query into a variable:

Code:

import requests

headers = {
    'apikey': 'myapikey'
          }

data = {
    '{ "query" : {"bool": { "must": [{ "match": { "message": "gmail.com yahoo.com" } },{ "range" : { "@timestamp": { "gte" : "now-7d"} } } ]}}}'
       }

r = requests.get('https://myelasticsearch.com/pastebin-*/_search', headers=headers, data=data)

Error:

Code:

Traceback (most recent call last):
  File "elastic-test.py", line 13, in <module>
    r = requests.get('https://myelasticsearch.com/pastebin-*/_search', headers=headers, data=data)
  File "/usr/local/lib/python2.7/dist-packages/requests/api.py", line 72, in get
    return request('get', url, params=params, **kwargs)
  File "/usr/local/lib/python2.7/dist-packages/requests/api.py", line 58, in request
    return session.request(method=method, url=url, **kwargs)
  File "/usr/local/lib/python2.7/dist-packages/requests/sessions.py", line 508, in request
    resp = self.send(prep, **send_kwargs)
  File "/usr/local/lib/python2.7/dist-packages/requests/sessions.py", line 618, in send
    r = adapter.send(request, **kwargs)
  File "/usr/local/lib/python2.7/dist-packages/requests/adapters.py", line 440, in send
    timeout=timeout
  File "/usr/local/lib/python2.7/dist-packages/urllib3/connectionpool.py", line 601, in urlopen
    chunked=chunked)
  File "/usr/local/lib/python2.7/dist-packages/urllib3/connectionpool.py", line 357, in _make_request
    conn.request(method, url, **httplib_request_kw)
  File "/usr/lib/python2.7/httplib.py", line 1057, in request
    self._send_request(method, url, body, headers)
  File "/usr/lib/python2.7/httplib.py", line 1097, in _send_request
    self.endheaders(body)
  File "/usr/lib/python2.7/httplib.py", line 1053, in endheaders
    self._send_output(message_body)
  File "/usr/lib/python2.7/httplib.py", line 901, in _send_output
    self.send(message_body)
  File "/usr/lib/python2.7/httplib.py", line 873, in send
    self.sock.sendall(data)
  File "/usr/lib/python2.7/ssl.py", line 743, in sendall
    v = self.send(data[count:])
TypeError: 'set' object has no attribute '__getitem__'

dugan · 11-22-2017, 11:53 AM

So your "data" variable is a string in squiggly brackets? In Python 3, that's a set containing a string.

You wanted it to be a dictionary, right?

Code:

data = {'query': 'contents of the query'}

snowman81 · 11-22-2017, 12:13 PM

Sorry, I should have specified, this is Python 2.7.

dugan · 11-22-2017, 01:59 PM

Quote:

Originally Posted by snowman81

Sorry, I should have specified, this is Python 2.7.

The fix I gave you still applies.

camp0 · 11-23-2017, 02:40 AM

I see two problems on the variable data:

- The first is that you are creating a dict with no value

Code:

data = {
    '{ "query" : {"bool": { "must": [{ "match": { "message": "gmail.com yahoo.com" } },{ "range" : { "@timestamp": { "gte" : "now-7d"} } } ]}}}'
       }

Code:

data = { 'mykey' }

- The second is that the key is not hashable in terms that you are using a dictionary as key.

The correct solution (I think) should be

Code:

data = { 'query' :  {"bool": { "must"......

snowman81 · 11-23-2017, 03:19 PM

Thanks guys! That seemed to work!