Skip to content

Log collection through Filebeat daemonset #88

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Closed
wants to merge 13 commits into from
Closed

Log collection through Filebeat daemonset #88

Changes from 1 commit
Commits
Show all changes
13 commits
Select commit Hold shift + click to select a range
3a0b097
Copies the result of the original filebeat branch ...
solsson Nov 4, 2017
760cff5
filebeat 6.0.0-rc2
solsson Nov 4, 2017
fcc184a
Fixes pod start in GKE, read-only file system
solsson Nov 4, 2017
7f0e564
Adds test (without asserts) for filebeat topic, jq-compatible log
solsson Nov 4, 2017
a401bda
Tentative RBAC; kubectl describe's error messages are helpful
solsson Nov 4, 2017
f0b7fde
ClusterRoleBinding fixes RBAC for filebeat
solsson Nov 4, 2017
52c28e8
Fixes JSON syntax getting broken by "Reached end of topic"
solsson Nov 4, 2017
504911a
Fixes kubernetes metadata inclusion
solsson Nov 4, 2017
8878b5c
Removes kubernetes debug as the result is ...
solsson Nov 4, 2017
e04a403
Dropped the logs- prefix now in the logs-kafka namespace
solsson Nov 4, 2017
d61b341
Memory use little higher than fluent-bit and tail+kafkacat
solsson Nov 4, 2017
a83c6eb
Got OOMKilled
solsson Nov 4, 2017
65d902f
Had lots of restarts still. Memory is now 10x that of tail+kafkacat.
solsson Nov 7, 2017
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
Prev Previous commit
Next Next commit
Removes kubernetes debug as the result is ... 
lots and lots of messages like
2017/11/04 16:16:03.383326 indexing.go:58: DBG Using container id: %!(EXTRA string=509e0dd0dcfdf526779c116ca3634c31c1b58102e762671ee31ab41febe22e3e)
2017/11/04 16:16:03.386038 indexing.go:52: DBG Incoming source value: %!(EXTRA string=/var/lib/docker/containers/509e0dd0dcfdf526779c116ca3634c31c1b58102e762671ee31ab41febe22e3e/509e0dd0dcfdf526779c116ca3634c31c1b58102e762671ee31ab41febe22e3e-json.log)
  • Loading branch information
@solsson
solsson committed Nov 4, 2017
commit 8878b5cac56b9dd579ce28aa0749da04526e8471
2 changes: 1 addition & 1 deletion logs-streaming/filebeat-logs-kube-kafka.yml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -26,7 +26,7 @@ spec:
- -c
- /etc/filebeat/filebeat.yml
- -d
- "service,beat,kubernetes"
- "service,beat"
env:
- name: TOPIC
value: ops-kube-logs-filebeat-001
Expand Down