-
Notifications
You must be signed in to change notification settings - Fork 2k
Open
Labels
type: bugA code related bug.A code related bug.
Description
A note for the community
- Please vote on this issue by adding a 👍 reaction to the original issue to help the community and maintainers prioritize this request
- If you are interested in working on this issue or have submitted a pull request, please leave a comment
Problem
When I set the endpoint, whether it's an AWS endpoint or an AWS-compatible endpoint, I get an error.
2026-01-22T09:10:07.190510Z ERROR source{component_kind="source" component_id=log_files_source component_type=aws_s3}: vector::internal_events::aws_sqs: Internal log [Failed to fetch SQS events.] is being suppressed to avoid flooding.
2026-01-22T09:10:07.345716Z INFO vector::topology::builder: Internal log [Healthcheck passed.] is being suppressed to avoid flooding.
2026-01-22T09:10:17.561493Z ERROR source{component_kind="source" component_id=log_files_source component_type=aws_s3}: vector::internal_events::aws_sqs: Internal log [Failed to fetch SQS events.] has been suppressed 15 times.
2026-01-22T09:10:17.561748Z ERROR source{component_kind="source" component_id=log_files_source component_type=aws_s3}: vector::internal_events::aws_sqs: Failed to fetch SQS events. error=service error error_code="failed_fetching_sqs_events" error_type="request_failed" stage="receiving"
2026-01-22T09:10:17.583109Z ERROR source{component_kind="source" component_id=log_files_source component_type=aws_s3}: vector::internal_events::aws_sqs: Internal log [Failed to fetch SQS events.] is being suppressed to avoid flooding.
2026-01-22T09:10:43.132137Z ERROR source{component_kind="source" component_id=log_files_source component_type=aws_s3}: vector::internal_events::aws_sqs: Internal log [Failed to fetch SQS events.] has been suppressed 7 times.
2026-01-22T09:10:43.132410Z ERROR source{component_kind="source" component_id=log_files_source component_type=aws_s3}: vector::internal_events::aws_sqs: Failed to fetch SQS events. error=service error error_code="failed_fetching_sqs_events" error_type="request_failed" stage="receiving"
2026-01-22T09:10:43.137201Z ERROR source{component_kind="source" component_id=log_files_source component_type=aws_s3}: vector::internal_events::aws_sqs: Internal log [Failed to fetch SQS events.] is being suppressed to avoid flooding.
2026-01-22T09:11:13.964092Z ERROR source{component_kind="source" component_id=log_files_source component_type=aws_s3}: vector::internal_events::aws_sqs: Internal log [Failed to fetch SQS events.] has been suppressed 3 times.
2026-01-22T09:11:13.964354Z ERROR source{component_kind="source" component_id=log_files_source component_type=aws_s3}: vector::internal_events::aws_sqs: Failed to fetch SQS events. error=service error error_code="failed_fetching_sqs_events" error_type="request_failed" stage="receiving"
2026-01-22T09:11:14.124109Z ERROR source{component_kind="source" component_id=log_files_source component_type=aws_s3}: vector::internal_events::aws_sqs: Internal log [Failed to fetch SQS events.] is being suppressed to avoid flooding.Configuration
config:
swr.cn-north-4.myhuaweicloud.com
sqs.us-west-1.amazonaws.com
sqs.cn-north-4.myhuaweicloud.com
sources:
internal_metrics:
type: "internal_metrics"
scrape_interval_secs: 5
log_files_source:
type: "aws_s3"
region: "us-west-1"
auth:
access_key_id: ***
secret_access_key: ***
endpoint: "https://s3.us-west-1.amazonaws.com"
force_path_style: false
sqs:
delete_message: true # It can be useful to set this to false for debugging or during the initial setup.
queue_url: "https://sqs.us-west-1.amazonaws.com/***/s3-object-queue"
transforms:
process_logs:
type: "remap"
inputs:
- "log_files_source"
source: |
###logic
sinks:
output_to_files:
type: "aws_s3"
inputs:
- "process_logs"
auth:
access_key_id: ***
secret_access_key: ***
region: "us-west-1"
bucket: log-demo-sqs
endpoint: "https://s3.us-west-1.amazonaws.com"
force_path_style: false
key_prefix: "parsed_log/"
filename_time_format: "%s"
encoding:
codec: "csv"
csv:
fields: ["bucket", "hive", "db_name", "table_name", "query", "object_size", "key"]
compression: "none"
out_metrics:
type: "prometheus_exporter"
inputs:
- "internal_metrics"
api:
enabled: true
address: "0.0.0.0:8092"
Version
0.52.0
Debug Output
Example Data
No response
Additional Context
No response
References
No response
Metadata
Metadata
Assignees
Labels
type: bugA code related bug.A code related bug.