Skip to content

Instantly share code, notes, and snippets.

@charlesmims
Created December 5, 2016 19:58
Show Gist options
  • Save charlesmims/8ea789e918c70465890ef4d4624069ff to your computer and use it in GitHub Desktop.
Save charlesmims/8ea789e918c70465890ef4d4624069ff to your computer and use it in GitHub Desktop.
Elastic.co's past-releases section of their website is unuseable.
I wrote this script to parse all the pages of that site and just spit out all the links
so you can just search for what you want.
Isn't it ironic not being able to search for something on elasticsearch's website?
#!/usr/bin/env python
import requests
import re
url = 'https://www.elastic.co/downloads/past-releases'
x = 1
while True:
page = requests.get(url+"?page="+str(x)).text
links = [str(line.strip(' ')) for line in page.split('\n') if "downloads/past-releases" in line and not "Download" in line and not "Click Here" in line and not "data-value" in line and not "alternate" in line and not "canonical" in line and not "localeUrl" in line and not "relative_url_prefix" in line]
for link in links:
href=re.search('href\=\"(\S+)\">',link).group(1)
print 'https://www.elastic.co' + href
if href == '/downloads/past-releases/logstash-1-4-4':
exit()
x+=1
Here's the result at time of writing this.
https://www.elastic.co/downloads/past-releases/elastic-cloud-enterprise-1-0-0-alpha4
https://www.elastic.co/downloads/past-releases/x-pack-5-0-2
https://www.elastic.co/downloads/past-releases/elasticsearch-5-0-2
https://www.elastic.co/downloads/past-releases/elasticsearch-apache-hadoop-5-0-2
https://www.elastic.co/downloads/past-releases/kibana-5-0-2
https://www.elastic.co/downloads/past-releases/logstash-5-0-2
https://www.elastic.co/downloads/past-releases/winlogbeat-5-0-2
https://www.elastic.co/downloads/past-releases/metricbeat-5-0-2
https://www.elastic.co/downloads/past-releases/filebeat-5-0-2
https://www.elastic.co/downloads/past-releases/packetbeat-5-0-2
https://www.elastic.co/downloads/past-releases/elasticsearch-apache-hadoop-2-4-2
https://www.elastic.co/downloads/past-releases/elasticsearch-apache-hadoop-2-4-1
https://www.elastic.co/downloads/past-releases/x-pack-5-0-1
https://www.elastic.co/downloads/past-releases/elasticsearch-5-0-1
https://www.elastic.co/downloads/past-releases/kibana-4-6-3
https://www.elastic.co/downloads/past-releases/elasticsearch-apache-hadoop-5-0-1
https://www.elastic.co/downloads/past-releases/kibana-5-0-1
https://www.elastic.co/downloads/past-releases/elasticsearch-2-4-2
https://www.elastic.co/downloads/past-releases/elasticsearch-1-7-6
https://www.elastic.co/downloads/past-releases/winlogbeat-5-0-1
https://www.elastic.co/downloads/past-releases/packetbeat-5-0-1
https://www.elastic.co/downloads/past-releases/metricbeat-5-0-1
https://www.elastic.co/downloads/past-releases/filebeat-5-0-1
https://www.elastic.co/downloads/past-releases/logstash-5-0-1
https://www.elastic.co/downloads/past-releases/logstash-2-4-1
https://www.elastic.co/downloads/past-releases/logstash-5-0-0
https://www.elastic.co/downloads/past-releases/elasticsearch-5-0-0
https://www.elastic.co/downloads/past-releases/winlogbeat-5-0-0
https://www.elastic.co/downloads/past-releases/x-pack-5-0-0
https://www.elastic.co/downloads/past-releases/packetbeat-5-0-0
https://www.elastic.co/downloads/past-releases/filebeat-5-0-0
https://www.elastic.co/downloads/past-releases/metricbeat-5-0-0
https://www.elastic.co/downloads/past-releases/kibana-5-0-0
https://www.elastic.co/downloads/past-releases/elasticsearch-apache-hadoop-5-0-0
https://www.elastic.co/downloads/past-releases/kibana-4-6-2
https://www.elastic.co/downloads/past-releases/elasticsearch-5-0-0-rc1
https://www.elastic.co/downloads/past-releases/x-pack-5-0-0-rc1
https://www.elastic.co/downloads/past-releases/logstash-5-0-0-rc1
https://www.elastic.co/downloads/past-releases/kibana-5-0-0-rc1
https://www.elastic.co/downloads/past-releases/elasticsearch-apache-hadoop-5-0-0-rc1
https://www.elastic.co/downloads/past-releases/winlogbeat-5-0-0-rc1
https://www.elastic.co/downloads/past-releases/packetbeat-5-0-0-rc1
https://www.elastic.co/downloads/past-releases/metricbeat-5-0-0-rc1
https://www.elastic.co/downloads/past-releases/filebeat-5-0-0-rc1
https://www.elastic.co/downloads/past-releases/elasticsearch-2-4-1
https://www.elastic.co/downloads/past-releases/shield-2-4-1
https://www.elastic.co/downloads/past-releases/elasticsearch-apache-hadoop-5-0-0-beta1
https://www.elastic.co/downloads/past-releases/elasticsearch-5-0-0-beta1
https://www.elastic.co/downloads/past-releases/kibana-5-0-0-beta1
https://www.elastic.co/downloads/past-releases/logstash-5-0-0-beta1
https://www.elastic.co/downloads/past-releases/winlogbeat-5-0-0-beta1
https://www.elastic.co/downloads/past-releases/metricbeat-5-0-0-beta1
https://www.elastic.co/downloads/past-releases/packetbeat-5-0-0-beta1
https://www.elastic.co/downloads/past-releases/filebeat-5-0-0-beta1
https://www.elastic.co/downloads/past-releases/packetbeat-1-3-1
https://www.elastic.co/downloads/past-releases/winlogbeat-1-3-1
https://www.elastic.co/downloads/past-releases/filebeat-1-3-1
https://www.elastic.co/downloads/past-releases/topbeat-1-3-1
https://www.elastic.co/downloads/past-releases/kibana-4-6-1
https://www.elastic.co/downloads/past-releases/elasticsearch-apache-hadoop-2-4-0
https://www.elastic.co/downloads/past-releases/elasticsearch-2-4-0
https://www.elastic.co/downloads/past-releases/kibana-4-6-0
https://www.elastic.co/downloads/past-releases/marvel-2-4-1
https://www.elastic.co/downloads/past-releases/graph-2-4-0
https://www.elastic.co/downloads/past-releases/logstash-2-4-0-all-plugins
https://www.elastic.co/downloads/past-releases/logstash-2-4-0
https://www.elastic.co/downloads/past-releases/winlogbeat-1-3-0
https://www.elastic.co/downloads/past-releases/packetbeat-1-3-0
https://www.elastic.co/downloads/past-releases/topbeat-1-3-0
https://www.elastic.co/downloads/past-releases/filebeat-1-3-0
https://www.elastic.co/downloads/past-releases/elasticsearch-5-0-0-alpha5
https://www.elastic.co/downloads/past-releases/elasticsearch-apache-hadoop-5-0-0-alpha5
https://www.elastic.co/downloads/past-releases/kibana-5-0-0-alpha5
https://www.elastic.co/downloads/past-releases/logstash-5.0.0-alpha5
https://www.elastic.co/downloads/past-releases/winlogbeat-5-0-0-alpha5
https://www.elastic.co/downloads/past-releases/metricbeat-5-0-0-alpha5
https://www.elastic.co/downloads/past-releases/packetbeat-5-0-0-alpha5
https://www.elastic.co/downloads/past-releases/filebeat-5-0-0-alpha5
https://www.elastic.co/downloads/past-releases/elasticsearch-2-3-5
https://www.elastic.co/downloads/past-releases/elasticsearch-apache-hadoop-2-3-4
https://www.elastic.co/downloads/past-releases/kibana-4-1-11
https://www.elastic.co/downloads/past-releases/kibana-4-5-4
https://www.elastic.co/downloads/past-releases/kibana-4-1-10
https://www.elastic.co/downloads/past-releases/kibana-4-5-3
https://www.elastic.co/downloads/past-releases/logstash-2-3-4-all-plugins
https://www.elastic.co/downloads/past-releases/kibana-4-1-9
https://www.elastic.co/downloads/past-releases/elasticsearch-apache-hadoop-2-3-3
https://www.elastic.co/downloads/past-releases/kibana-4-5-2
https://www.elastic.co/downloads/past-releases/logstash-2-3-4
https://www.elastic.co/downloads/past-releases/elasticsearch-5-0-0-alpha4
https://www.elastic.co/downloads/past-releases/elasticsearch-apache-hadoop-5-0-0-alpha4
https://www.elastic.co/downloads/past-releases/kibana-5-0-0-alpha4
https://www.elastic.co/downloads/past-releases/logstash-5.0.0-alpha4
https://www.elastic.co/downloads/past-releases/winlogbeat-5-0-0-alpha4
https://www.elastic.co/downloads/past-releases/packetbeat-5-0-0-alpha4
https://www.elastic.co/downloads/past-releases/filebeat-5-0-0-alpha4
https://www.elastic.co/downloads/past-releases/metricbeat-5-0-0-alpha4
https://www.elastic.co/downloads/past-releases/logstash-2-3-3
https://www.elastic.co/downloads/past-releases/logstash-2-3-3-all-plugins
https://www.elastic.co/downloads/past-releases/kibana-4-1-8
https://www.elastic.co/downloads/past-releases/logstash-5.0.0-alpha3
https://www.elastic.co/downloads/past-releases/elasticsearch-apache-hadoop-5-0-0-alpha3
https://www.elastic.co/downloads/past-releases/elasticsearch-5-0-0-alpha3
https://www.elastic.co/downloads/past-releases/kibana-5-0-0-alpha3
https://www.elastic.co/downloads/past-releases/winlogbeat-5-0-0-alpha3
https://www.elastic.co/downloads/past-releases/packetbeat-5-0-0-alpha3
https://www.elastic.co/downloads/past-releases/metricbeat-5-0-0-alpha3
https://www.elastic.co/downloads/past-releases/filebeat-5-0-0-alpha3
https://www.elastic.co/downloads/past-releases/elasticsearch-2-3-4
https://www.elastic.co/downloads/past-releases/kibana-4-1-7
https://www.elastic.co/downloads/past-releases/elasticsearch-2-3-3
https://www.elastic.co/downloads/past-releases/kibana-4-5-1
https://www.elastic.co/downloads/past-releases/elasticsearch-apache-hadoop-2-3-2
https://www.elastic.co/downloads/past-releases/filebeat-1-2-3
https://www.elastic.co/downloads/past-releases/winlogbeat-1-2-3
https://www.elastic.co/downloads/past-releases/topbeat-1-2-3
https://www.elastic.co/downloads/past-releases/packetbeat-1-2-3
https://www.elastic.co/downloads/past-releases/logstash-5.0.0-alpha2
https://www.elastic.co/downloads/past-releases/elasticsearch-5-0-0-alpha2
https://www.elastic.co/downloads/past-releases/kibana-5-0-0-alpha2
https://www.elastic.co/downloads/past-releases/elasticsearch-apache-hadoop-5-0-0-alpha2
https://www.elastic.co/downloads/past-releases/elasticsearch-apache-hadoop-2-3-1
https://www.elastic.co/downloads/past-releases/winlogbeat-5-0-0-alpha2
https://www.elastic.co/downloads/past-releases/filebeat-5-0-0-alpha2
https://www.elastic.co/downloads/past-releases/topbeat-5-0-0-alpha2
https://www.elastic.co/downloads/past-releases/packetbeat-5-0-0-alpha2
https://www.elastic.co/downloads/past-releases/elasticsearch-2-3-2
https://www.elastic.co/downloads/past-releases/logstash-2-3-2
https://www.elastic.co/downloads/past-releases/logstash-2-3-2-all-plugins
https://www.elastic.co/downloads/past-releases/winlogbeat-1-2-2
https://www.elastic.co/downloads/past-releases/filebeat-1-2-2
https://www.elastic.co/downloads/past-releases/packetbeat-1-2-2
https://www.elastic.co/downloads/past-releases/topbeat-1-2-2
https://www.elastic.co/downloads/past-releases/elasticsearch-apache-hadoop-2-3-0
https://www.elastic.co/downloads/past-releases/elasticsearch-apache-hadoop-2-2-1
https://www.elastic.co/downloads/past-releases/logstash-2.3.1
https://www.elastic.co/downloads/past-releases/winlogbeat-1-2-1
https://www.elastic.co/downloads/past-releases/filebeat-1-2-1
https://www.elastic.co/downloads/past-releases/packetbeat-1-2-1
https://www.elastic.co/downloads/past-releases/topbeat-1-2-1
https://www.elastic.co/downloads/past-releases/logstash-2-3-1-all-plugins
https://www.elastic.co/downloads/past-releases/logstash-2.2.4
https://www.elastic.co/downloads/past-releases/kibana-5-0-0-alpha1
https://www.elastic.co/downloads/past-releases/logstash-5.0.0-alpha1
https://www.elastic.co/downloads/past-releases/winlogbeat-5-0-0-alpha1
https://www.elastic.co/downloads/past-releases/filebeat-5-0-0-alpha1
https://www.elastic.co/downloads/past-releases/topbeat-5-0-0-alpha1
https://www.elastic.co/downloads/past-releases/packetbeat-5-0-0-alpha1
https://www.elastic.co/downloads/past-releases/elasticsearch-2-3-1
https://www.elastic.co/downloads/past-releases/logstash-2-3-0-all-plugins
https://www.elastic.co/downloads/past-releases/logstash-2-2-3
https://www.elastic.co/downloads/past-releases/logstash-2-3-0
https://www.elastic.co/downloads/past-releases/elasticsearch-2-2-2
https://www.elastic.co/downloads/past-releases/kibana-4-5-0
https://www.elastic.co/downloads/past-releases/elasticsearch-2-3-0
https://www.elastic.co/downloads/past-releases/winlogbeat-1-2-0
https://www.elastic.co/downloads/past-releases/filebeat-1-2-0
https://www.elastic.co/downloads/past-releases/topbeat-1-2-0
https://www.elastic.co/downloads/past-releases/packetbeat-1-2-0
https://www.elastic.co/downloads/past-releases/elasticsearch-5-0-0-alpha1
https://www.elastic.co/downloads/past-releases/elasticsearch-2-2-1
https://www.elastic.co/downloads/past-releases/kibana-4-4-2
https://www.elastic.co/downloads/past-releases/kibana-4-3-3
https://www.elastic.co/downloads/past-releases/kibana-4-1-6
https://www.elastic.co/downloads/past-releases/winlogbeat-1-1-2
https://www.elastic.co/downloads/past-releases/filebeat-1-1-2
https://www.elastic.co/downloads/past-releases/topbeat-1-1-2
https://www.elastic.co/downloads/past-releases/packetbeat-1-1-2
https://www.elastic.co/downloads/past-releases/logstash-2-2-2
https://www.elastic.co/downloads/past-releases/logstash-2-2-1
https://www.elastic.co/downloads/past-releases/logstash-2-1-3
https://www.elastic.co/downloads/past-releases/kibana-4-4-1
https://www.elastic.co/downloads/past-releases/kibana-4-3-2
https://www.elastic.co/downloads/past-releases/kibana-4-1-5
https://www.elastic.co/downloads/past-releases/winlogbeat-1-1-1
https://www.elastic.co/downloads/past-releases/filebeat-1-1-1
https://www.elastic.co/downloads/past-releases/topbeat-1-1-1
https://www.elastic.co/downloads/past-releases/packetbeat-1-1-1
https://www.elastic.co/downloads/past-releases/logstash-2-2-0-all-plugins
https://www.elastic.co/downloads/past-releases/logstash-2-1-2
https://www.elastic.co/downloads/past-releases/logstash-2-2-0
https://www.elastic.co/downloads/past-releases/kibana-4-4-0
https://www.elastic.co/downloads/past-releases/elasticsearch-2-2-0
https://www.elastic.co/downloads/past-releases/elasticsearch-apache-hadoop-2-2-0
https://www.elastic.co/downloads/past-releases/elasticsearch-apache-hadoop-2-1-3
https://www.elastic.co/downloads/past-releases/elasticsearch-1-7-5
https://www.elastic.co/downloads/past-releases/elasticsearch-2-1-2
https://www.elastic.co/downloads/past-releases/filebeat-1-1-0
https://www.elastic.co/downloads/past-releases/winlogbeat-1-1-0
https://www.elastic.co/downloads/past-releases/topbeat-1-1-0
https://www.elastic.co/downloads/past-releases/packetbeat-1-1-0
https://www.elastic.co/downloads/past-releases/elasticsearch-apache-hadoop-2-2-0-rc1
https://www.elastic.co/downloads/past-releases/kibana-4-3-1
https://www.elastic.co/downloads/past-releases/kibana-4-2.2
https://www.elastic.co/downloads/past-releases/kibana-4-1-4
https://www.elastic.co/downloads/past-releases/elasticsearch-2-1-1
https://www.elastic.co/downloads/past-releases/elasticsearch-2-0-2
https://www.elastic.co/downloads/past-releases/elasticsearch-1-7-4
https://www.elastic.co/downloads/past-releases/filebeat-1-0-1
https://www.elastic.co/downloads/past-releases/packetbeat-1-0-1
https://www.elastic.co/downloads/past-releases/topbeat-1-0-1
https://www.elastic.co/downloads/past-releases/logstash-2-1-1
https://www.elastic.co/downloads/past-releases/logstash-1-5-6
https://www.elastic.co/downloads/past-releases/logstash-2-1-0
https://www.elastic.co/downloads/past-releases/kibana-4-3-0
https://www.elastic.co/downloads/past-releases/elasticsearch-2-1-0
https://www.elastic.co/downloads/past-releases/topbeat-1-0-0
https://www.elastic.co/downloads/past-releases/packetbeat-1-0-0
https://www.elastic.co/downloads/past-releases/filebeat-1-0-0
https://www.elastic.co/downloads/past-releases/elasticsearch-2-0-1
https://www.elastic.co/downloads/past-releases/topbeat-1-0-0-rc2
https://www.elastic.co/downloads/past-releases/packetbeat-1-0-0-rc2
https://www.elastic.co/downloads/past-releases/filebeat-1-0-0-rc2
https://www.elastic.co/downloads/past-releases/kibana-4-2.1
https://www.elastic.co/downloads/past-releases/kibana-4-1-3
https://www.elastic.co/downloads/past-releases/logstash-all-plugins-2-1-0
https://www.elastic.co/downloads/past-releases/filebeat-1-0-0-rc1
https://www.elastic.co/downloads/past-releases/packetbeat-1-0-0-rc1
https://www.elastic.co/downloads/past-releases/topbeat-1-0-0-rc1
https://www.elastic.co/downloads/past-releases/logstash-1-5-5
https://www.elastic.co/downloads/past-releases/elasticsearch-apache-hadoop-2-2-0-beta1
https://www.elastic.co/downloads/past-releases/elasticsearch-apache-hadoop-2-1-2
https://www.elastic.co/downloads/past-releases/logstash-2-0-0
https://www.elastic.co/downloads/past-releases/kibana-4-2.0
https://www.elastic.co/downloads/past-releases/elasticsearch-2-0-0
https://www.elastic.co/downloads/past-releases/packetbeat-1-0-0-beta4
https://www.elastic.co/downloads/past-releases/logstash-2-0-0-rc1
https://www.elastic.co/downloads/past-releases/logstash-2-0-0-beta3
https://www.elastic.co/downloads/past-releases/elasticsearch-1-7-3
https://www.elastic.co/downloads/past-releases/filebeat-1-0-0-beta4
https://www.elastic.co/downloads/past-releases/logstash-2-0-0-beta2
https://www.elastic.co/downloads/past-releases/elasticsearch-2-0-0-rc1
https://www.elastic.co/downloads/past-releases/kibana-4-2-0-beta-2
https://www.elastic.co/downloads/past-releases/elasticsearch-2-0-0-beta2
https://www.elastic.co/downloads/past-releases/logstash-2-0-0-beta1
https://www.elastic.co/downloads/past-releases/elasticsearch-1-7-2
https://www.elastic.co/downloads/past-releases/kibana-4-1-2
https://www.elastic.co/downloads/past-releases/packetbeat-1-0-0-beta3
https://www.elastic.co/downloads/past-releases/topbeat-1-0-0-beta4
https://www.elastic.co/downloads/past-releases/topbeat-1-0-0-beta3
https://www.elastic.co/downloads/past-releases/kibana-4-2-0-beta-1
https://www.elastic.co/downloads/past-releases/elasticsearch-apache-hadoop-2-2-0-m1
https://www.elastic.co/downloads/past-releases/elasticsearch-apache-hadoop-2-1-1
https://www.elastic.co/downloads/past-releases/elasticsearch-2-0-0-beta1
https://www.elastic.co/downloads/past-releases/logstash-1-5-4
https://www.elastic.co/downloads/past-releases/kibana-3-1-3
https://www.elastic.co/downloads/past-releases/elasticsearch-1-7-1
https://www.elastic.co/downloads/past-releases/elasticsearch-1-6-2
https://www.elastic.co/downloads/past-releases/logstash-1-4-4
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment