Mercurial > logstash

annotate Kibana-external-config-patch @ 31:e84d1f4fe2bf

Find changesets by keywords (author, files, the commit message), revision number or hash, or revset expression.
logstash manifest depends on results of elasticsearch build
author Carl Byington <carl@five-ten-sg.com>
date Sat, 11 May 2013 09:38:59 -0700
parents 610835fb4209
children
Ignore whitespace changes - Everywhere: Within whitespace: At end of lines:
rev   line source
26
610835fb4209 external configuration for kibana
Carl Byington <carl@five-ten-sg.com>
parents:
diff changeset
1 --- KibanaConfig.rb 2013-05-02 15:22:03.011877891 -0700
610835fb4209 external configuration for kibana
Carl Byington <carl@five-ten-sg.com>
parents:
diff changeset
2 +++ KibanaConfig.new.rb 2013-05-02 15:26:57.419447970 -0700
610835fb4209 external configuration for kibana
Carl Byington <carl@five-ten-sg.com>
parents:
diff changeset
3 @@ -3,26 +3,14 @@
610835fb4209 external configuration for kibana
Carl Byington <carl@five-ten-sg.com>
parents:
diff changeset
4 # Your elastic search server(s). This may be set as an array for round robin
610835fb4209 external configuration for kibana
Carl Byington <carl@five-ten-sg.com>
parents:
diff changeset
5 # load balancing
610835fb4209 external configuration for kibana
Carl Byington <carl@five-ten-sg.com>
parents:
diff changeset
6 # Elasticsearch = ["elasticsearch1:9200","elasticsearch2:9200"]
610835fb4209 external configuration for kibana
Carl Byington <carl@five-ten-sg.com>
parents:
diff changeset
7 - Elasticsearch = "localhost:9200"
610835fb4209 external configuration for kibana
Carl Byington <carl@five-ten-sg.com>
parents:
diff changeset
8 + Elasticsearch = ENV['KIBANA_ES'] ? ENV['KIBANA_ES'] : "localhost:9200"
610835fb4209 external configuration for kibana
Carl Byington <carl@five-ten-sg.com>
parents:
diff changeset
9
610835fb4209 external configuration for kibana
Carl Byington <carl@five-ten-sg.com>
parents:
diff changeset
10 #Set the Net::HTTP read/open timeouts for the connection to the ES backend
610835fb4209 external configuration for kibana
Carl Byington <carl@five-ten-sg.com>
parents:
diff changeset
11 ElasticsearchTimeout = 500
610835fb4209 external configuration for kibana
Carl Byington <carl@five-ten-sg.com>
parents:
diff changeset
12
610835fb4209 external configuration for kibana
Carl Byington <carl@five-ten-sg.com>
parents:
diff changeset
13 - # The port Kibana should listen on
610835fb4209 external configuration for kibana
Carl Byington <carl@five-ten-sg.com>
parents:
diff changeset
14 - KibanaPort = 5601
610835fb4209 external configuration for kibana
Carl Byington <carl@five-ten-sg.com>
parents:
diff changeset
15 -
610835fb4209 external configuration for kibana
Carl Byington <carl@five-ten-sg.com>
parents:
diff changeset
16 - # The adress ip Kibana should listen on. Comment out or set to
610835fb4209 external configuration for kibana
Carl Byington <carl@five-ten-sg.com>
parents:
diff changeset
17 - # 0.0.0.0 to listen on all interfaces.
610835fb4209 external configuration for kibana
Carl Byington <carl@five-ten-sg.com>
parents:
diff changeset
18 - KibanaHost = '127.0.0.1'
610835fb4209 external configuration for kibana
Carl Byington <carl@five-ten-sg.com>
parents:
diff changeset
19 -
610835fb4209 external configuration for kibana
Carl Byington <carl@five-ten-sg.com>
parents:
diff changeset
20 - # Below is an example showing how to configure the same variables
610835fb4209 external configuration for kibana
Carl Byington <carl@five-ten-sg.com>
parents:
diff changeset
21 - # using environment variables, which can be set in an init script
610835fb4209 external configuration for kibana
Carl Byington <carl@five-ten-sg.com>
parents:
diff changeset
22 - # es_ip = ENV['ES_IP'] ? ENV['ES_IP'] : '127.0.0.1'
610835fb4209 external configuration for kibana
Carl Byington <carl@five-ten-sg.com>
parents:
diff changeset
23 - # es_port = ENV['ES_PORT'] ? ENV['ES_PORT'] : 9200
610835fb4209 external configuration for kibana
Carl Byington <carl@five-ten-sg.com>
parents:
diff changeset
24 - # Elasticsearch = "#{es_ip}:#{es_port}"
610835fb4209 external configuration for kibana
Carl Byington <carl@five-ten-sg.com>
parents:
diff changeset
25 - # KibanaPort = ENV['KIBANA_PORT'] ? ENV['KIBANA_PORT'] : 5601
610835fb4209 external configuration for kibana
Carl Byington <carl@five-ten-sg.com>
parents:
diff changeset
26 - # KibanaHost = ENV['KIBANA_HOST'] ? ENV['KIBANA_HOST'] : 'localhost'
610835fb4209 external configuration for kibana
Carl Byington <carl@five-ten-sg.com>
parents:
diff changeset
27 -
610835fb4209 external configuration for kibana
Carl Byington <carl@five-ten-sg.com>
parents:
diff changeset
28 + # The port and adress ip Kibana should listen on.
610835fb4209 external configuration for kibana
Carl Byington <carl@five-ten-sg.com>
parents:
diff changeset
29 + KibanaPort = ENV['KIBANA_PORT'] ? ENV['KIBANA_PORT'] : 5601
610835fb4209 external configuration for kibana
Carl Byington <carl@five-ten-sg.com>
parents:
diff changeset
30 + KibanaHost = ENV['KIBANA_HOST'] ? ENV['KIBANA_HOST'] : 'localhost'
610835fb4209 external configuration for kibana
Carl Byington <carl@five-ten-sg.com>
parents:
diff changeset
31
610835fb4209 external configuration for kibana
Carl Byington <carl@five-ten-sg.com>
parents:
diff changeset
32 # The record type as defined in your logstash configuration.
610835fb4209 external configuration for kibana
Carl Byington <carl@five-ten-sg.com>
parents:
diff changeset
33 # Seperate multiple types with a comma, no spaces. Leave blank
610835fb4209 external configuration for kibana
Carl Byington <carl@five-ten-sg.com>
parents:
diff changeset
34 @@ -44,19 +32,19 @@
610835fb4209 external configuration for kibana
Carl Byington <carl@five-ten-sg.com>
parents:
diff changeset
35 # Do not use isoUtcDatetime or the "UTC:" prefix described in the above
610835fb4209 external configuration for kibana
Carl Byington <carl@five-ten-sg.com>
parents:
diff changeset
36 # article, as timezone correction is already performed by the "Timezone"
610835fb4209 external configuration for kibana
Carl Byington <carl@five-ten-sg.com>
parents:
diff changeset
37 # config variable.
610835fb4209 external configuration for kibana
Carl Byington <carl@five-ten-sg.com>
parents:
diff changeset
38 - # Time_format = 'isoDateTime'
610835fb4209 external configuration for kibana
Carl Byington <carl@five-ten-sg.com>
parents:
diff changeset
39 + # Time_format = 'isoDateTime'
610835fb4209 external configuration for kibana
Carl Byington <carl@five-ten-sg.com>
parents:
diff changeset
40 Time_format = 'mm/dd HH:MM:ss'
610835fb4209 external configuration for kibana
Carl Byington <carl@five-ten-sg.com>
parents:
diff changeset
41
610835fb4209 external configuration for kibana
Carl Byington <carl@five-ten-sg.com>
parents:
diff changeset
42 # Change which fields are shown by default. Must be set as an array
610835fb4209 external configuration for kibana
Carl Byington <carl@five-ten-sg.com>
parents:
diff changeset
43 # Default_fields = ['@fields.vhost','@fields.response','@fields.request']
610835fb4209 external configuration for kibana
Carl Byington <carl@five-ten-sg.com>
parents:
diff changeset
44 Default_fields = ['@message']
610835fb4209 external configuration for kibana
Carl Byington <carl@five-ten-sg.com>
parents:
diff changeset
45
610835fb4209 external configuration for kibana
Carl Byington <carl@five-ten-sg.com>
parents:
diff changeset
46 - # If set to true, Kibana will use the Highlight feature of Elasticsearch to
610835fb4209 external configuration for kibana
Carl Byington <carl@five-ten-sg.com>
parents:
diff changeset
47 + # If set to true, Kibana will use the Highlight feature of Elasticsearch to
610835fb4209 external configuration for kibana
Carl Byington <carl@five-ten-sg.com>
parents:
diff changeset
48 # display highlighted search results
610835fb4209 external configuration for kibana
Carl Byington <carl@five-ten-sg.com>
parents:
diff changeset
49 - Highlight_results = true
610835fb4209 external configuration for kibana
Carl Byington <carl@five-ten-sg.com>
parents:
diff changeset
50 + Highlight_results = false
610835fb4209 external configuration for kibana
Carl Byington <carl@five-ten-sg.com>
parents:
diff changeset
51
610835fb4209 external configuration for kibana
Carl Byington <carl@five-ten-sg.com>
parents:
diff changeset
52 - # A field needs to be specified for the highlight feature. By default,
610835fb4209 external configuration for kibana
Carl Byington <carl@five-ten-sg.com>
parents:
diff changeset
53 - # Elasticsearch doesn't allow highlighting on _all because the field has to
610835fb4209 external configuration for kibana
Carl Byington <carl@five-ten-sg.com>
parents:
diff changeset
54 + # A field needs to be specified for the highlight feature. By default,
610835fb4209 external configuration for kibana
Carl Byington <carl@five-ten-sg.com>
parents:
diff changeset
55 + # Elasticsearch doesn't allow highlighting on _all because the field has to
610835fb4209 external configuration for kibana
Carl Byington <carl@five-ten-sg.com>
parents:
diff changeset
56 # be either stored or part of the _source field.
610835fb4209 external configuration for kibana
Carl Byington <carl@five-ten-sg.com>
parents:
diff changeset
57 Highlighted_field = "@message"
610835fb4209 external configuration for kibana
Carl Byington <carl@five-ten-sg.com>
parents:
diff changeset
58
610835fb4209 external configuration for kibana
Carl Byington <carl@five-ten-sg.com>
parents:
diff changeset
59 @@ -99,18 +87,18 @@
610835fb4209 external configuration for kibana
Carl Byington <carl@five-ten-sg.com>
parents:
diff changeset
60 # indexing
610835fb4209 external configuration for kibana
Carl Byington <carl@five-ten-sg.com>
parents:
diff changeset
61 Smart_index = true
610835fb4209 external configuration for kibana
Carl Byington <carl@five-ten-sg.com>
parents:
diff changeset
62
610835fb4209 external configuration for kibana
Carl Byington <carl@five-ten-sg.com>
parents:
diff changeset
63 - # You can define your custom pattern here for index names if you
610835fb4209 external configuration for kibana
Carl Byington <carl@five-ten-sg.com>
parents:
diff changeset
64 - # use something other than daily indexing. Pattern needs to have
610835fb4209 external configuration for kibana
Carl Byington <carl@five-ten-sg.com>
parents:
diff changeset
65 - # date formatting like '%Y.%m.%d'. Will accept an array of smart
610835fb4209 external configuration for kibana
Carl Byington <carl@five-ten-sg.com>
parents:
diff changeset
66 - # indexes.
610835fb4209 external configuration for kibana
Carl Byington <carl@five-ten-sg.com>
parents:
diff changeset
67 - # Smart_index_pattern = ['logstash-web-%Y.%m.%d', 'logstash-mail-%Y.%m.%d']
610835fb4209 external configuration for kibana
Carl Byington <carl@five-ten-sg.com>
parents:
diff changeset
68 + # You can define your custom pattern here for index names if you
610835fb4209 external configuration for kibana
Carl Byington <carl@five-ten-sg.com>
parents:
diff changeset
69 + # use something other than daily indexing. Pattern needs to have
610835fb4209 external configuration for kibana
Carl Byington <carl@five-ten-sg.com>
parents:
diff changeset
70 + # date formatting like '%Y.%m.%d'. Will accept an array of smart
610835fb4209 external configuration for kibana
Carl Byington <carl@five-ten-sg.com>
parents:
diff changeset
71 + # indexes.
610835fb4209 external configuration for kibana
Carl Byington <carl@five-ten-sg.com>
parents:
diff changeset
72 + # Smart_index_pattern = ['logstash-web-%Y.%m.%d', 'logstash-mail-%Y.%m.%d']
610835fb4209 external configuration for kibana
Carl Byington <carl@five-ten-sg.com>
parents:
diff changeset
73 # Smart_index_pattern = 'logstash-%Y.%m.%d'
610835fb4209 external configuration for kibana
Carl Byington <carl@five-ten-sg.com>
parents:
diff changeset
74 # here is an example of how to set the pattern using an environment variable
610835fb4209 external configuration for kibana
Carl Byington <carl@five-ten-sg.com>
parents:
diff changeset
75 # Smart_index_pattern = ENV['SMART_INDEX'] ? ENV['SMART_INDEX'] : 'logstash-%Y.%m.%d'
610835fb4209 external configuration for kibana
Carl Byington <carl@five-ten-sg.com>
parents:
diff changeset
76 Smart_index_pattern = 'logstash-%Y.%m.%d'
610835fb4209 external configuration for kibana
Carl Byington <carl@five-ten-sg.com>
parents:
diff changeset
77 -
610835fb4209 external configuration for kibana
Carl Byington <carl@five-ten-sg.com>
parents:
diff changeset
78 +
610835fb4209 external configuration for kibana
Carl Byington <carl@five-ten-sg.com>
parents:
diff changeset
79 # Number of seconds between each index. 86400 = 1 day.
610835fb4209 external configuration for kibana
Carl Byington <carl@five-ten-sg.com>
parents:
diff changeset
80 - Smart_index_step = 86400
610835fb4209 external configuration for kibana
Carl Byington <carl@five-ten-sg.com>
parents:
diff changeset
81 + Smart_index_step = 86400
610835fb4209 external configuration for kibana
Carl Byington <carl@five-ten-sg.com>
parents:
diff changeset
82
610835fb4209 external configuration for kibana
Carl Byington <carl@five-ten-sg.com>
parents:
diff changeset
83 # ElasticSearch has a default limit on URL size for REST calls,
610835fb4209 external configuration for kibana
Carl Byington <carl@five-ten-sg.com>
parents:
diff changeset
84 # so Kibana will fall back to _all if a search spans too many
610835fb4209 external configuration for kibana
Carl Byington <carl@five-ten-sg.com>
parents:
diff changeset
85 @@ -120,7 +108,7 @@
610835fb4209 external configuration for kibana
Carl Byington <carl@five-ten-sg.com>
parents:
diff changeset
86
610835fb4209 external configuration for kibana
Carl Byington <carl@five-ten-sg.com>
parents:
diff changeset
87 # Elasticsearch has an internal mechanism called "faceting" for performing
610835fb4209 external configuration for kibana
Carl Byington <carl@five-ten-sg.com>
parents:
diff changeset
88 # analysis that we use for the "Stats" and "Terms" modes. However, on large
610835fb4209 external configuration for kibana
Carl Byington <carl@five-ten-sg.com>
parents:
diff changeset
89 - # data sets/queries facetting can cause ES to crash if there isn't enough
610835fb4209 external configuration for kibana
Carl Byington <carl@five-ten-sg.com>
parents:
diff changeset
90 + # data sets/queries facetting can cause ES to crash if there isn't enough
610835fb4209 external configuration for kibana
Carl Byington <carl@five-ten-sg.com>
parents:
diff changeset
91 # memory available. It is suggested that you limit the number of indices that
610835fb4209 external configuration for kibana
Carl Byington <carl@five-ten-sg.com>
parents:
diff changeset
92 # Kibana will use for the "Stats" and "Terms" to prevent ES crashes. For very
610835fb4209 external configuration for kibana
Carl Byington <carl@five-ten-sg.com>
parents:
diff changeset
93 # large data sets and undersized ES clusers, a limit of 1 is not unreasonable.