Ruby gem for operating Zyte.com API.
Outline:
gem install zyte-clientYou many need to install the jq package too.
sudo apt install jqrequire 'zyte-client'
url = 'https://www.google.com/search?q=Hola+Mundo'
client = ZyteClient.new(key: '<your Zyte API key here>')
html = client.extract(url: url)
File.open("getting-started.html", 'w') { |file| file.write(html) }
puts htmlYou can specify additonal Zyte API's options to the default request. Default request is just this: {"url": url}.
require 'zyte-client'
url = 'https://www.google.com/search?q=Hola+Mundo'
client = ZyteClient.new(key: '<your Zyte API key here>')
html = client.extract(
url: url,
options: {
"sessionContext": [
{
"name": "id",
"value": "2"
}
],
"sessionContextParameters": {
"actions": [
{
"action": "waitForTimeout",
"timeout": 5,
"onError": "return"
}
]
},
"httpResponseBody": true
}
)
File.open("data/options.html", 'w') { |file| file.write(html) }
puts htmlBy default the JSON response from Zyte is parsed and decoded using the bash commands jq and base64, and return the value of the httpResponseBody key.
If you want to get the entire JSON response, disable the json_parsing parameter.
require 'zyte-client'
url = 'https://www.google.com/search?q=Hola+Mundo'
client = ZyteClient.new(key: ZYTE_API_KEY)
ret = client.extract(
url: url,
json_parsing: false,
options: {
"sessionContext": [
{
"name": "id",
"value": "2"
}
],
"sessionContextParameters": {
"actions": [
{
"action": "waitForTimeout",
"timeout": 5,
"onError": "return"
}
]
},
"httpResponseBody": true
}
)
File.open("data/parsing.json", 'w') { |file| file.write(ret.to_json) }
puts ret.to_json
