Skip to content

Log collection through Filebeat daemonset #88

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Closed
wants to merge 13 commits into from
Closed

Log collection through Filebeat daemonset #88

Show file tree
Hide file tree
Changes from 1 commit
Commits
Show all changes
13 commits
Select commit Hold shift + click to select a range
3a0b097
Copies the result of the original filebeat branch ...
solsson Nov 4, 2017
760cff5
filebeat 6.0.0-rc2
solsson Nov 4, 2017
fcc184a
Fixes pod start in GKE, read-only file system
solsson Nov 4, 2017
7f0e564
Adds test (without asserts) for filebeat topic, jq-compatible log
solsson Nov 4, 2017
a401bda
Tentative RBAC; kubectl describe's error messages are helpful
solsson Nov 4, 2017
f0b7fde
ClusterRoleBinding fixes RBAC for filebeat
solsson Nov 4, 2017
52c28e8
Fixes JSON syntax getting broken by "Reached end of topic"
solsson Nov 4, 2017
504911a
Fixes kubernetes metadata inclusion
solsson Nov 4, 2017
8878b5c
Removes kubernetes debug as the result is ...
solsson Nov 4, 2017
e04a403
Dropped the logs- prefix now in the logs-kafka namespace
solsson Nov 4, 2017
d61b341
Memory use little higher than fluent-bit and tail+kafkacat
solsson Nov 4, 2017
a83c6eb
Got OOMKilled
solsson Nov 4, 2017
65d902f
Had lots of restarts still. Memory is now 10x that of tail+kafkacat.
solsson Nov 7, 2017
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
Prev Previous commit
Next Next commit
Tentative RBAC; kubectl describe's error messages are helpful
  • Loading branch information
@solsson
solsson committed Nov 4, 2017
commit a401bdafca9734c267536146a94d83cb74076ff6
1 change: 1 addition & 0 deletions logs-streaming/filebeat-logs-kube-kafka.yml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -16,6 +16,7 @@ spec:
version: v1
kubernetes.io/cluster-service: "true"
spec:
serviceAccountName: filebeat
containers:
- name: filebeat
image: solsson/kafka-filebeat-kubernetes@sha256:c2a68766e718d354b565b20f92baf0f50047b4bdf90a5055a20107a1131bee80
Expand Down
24 changes: 24 additions & 0 deletions logs-streaming/rbac/filebeat.yml
View file
Open in desktop
Original file line number Diff line number Diff line change
@@ -0,0 +1,24 @@
---
apiVersion: v1
kind: ServiceAccount
metadata:
name: filebeat
namespace: logs-kafka
annotations:
manifest-origin: 'github.com/Yolean/kubernetes-kafka'
---
kind: RoleBinding
apiVersion: rbac.authorization.k8s.io/v1
metadata:
name: filebeat-sa-view
namespace: logs-kafka
annotations:
manifest-origin: 'github.com/Yolean/kubernetes-kafka'
subjects:
- kind: ServiceAccount
name: filebeat
namespace: logs-kafka
roleRef:
kind: ClusterRole
name: view
apiGroup: rbac.authorization.k8s.io