Skip to content

Failed to fetch SQS events. #24531

@luxin88

Description

@luxin88

A note for the community

  • Please vote on this issue by adding a 👍 reaction to the original issue to help the community and maintainers prioritize this request
  • If you are interested in working on this issue or have submitted a pull request, please leave a comment

Problem

When I set the endpoint, whether it's an AWS endpoint or an AWS-compatible endpoint, I get an error.

2026-01-22T09:10:07.190510Z ERROR source{component_kind="source" component_id=log_files_source component_type=aws_s3}: vector::internal_events::aws_sqs: Internal log [Failed to fetch SQS events.] is being suppressed to avoid flooding.
2026-01-22T09:10:07.345716Z  INFO vector::topology::builder: Internal log [Healthcheck passed.] is being suppressed to avoid flooding.
2026-01-22T09:10:17.561493Z ERROR source{component_kind="source" component_id=log_files_source component_type=aws_s3}: vector::internal_events::aws_sqs: Internal log [Failed to fetch SQS events.] has been suppressed 15 times.
2026-01-22T09:10:17.561748Z ERROR source{component_kind="source" component_id=log_files_source component_type=aws_s3}: vector::internal_events::aws_sqs: Failed to fetch SQS events. error=service error error_code="failed_fetching_sqs_events" error_type="request_failed" stage="receiving"
2026-01-22T09:10:17.583109Z ERROR source{component_kind="source" component_id=log_files_source component_type=aws_s3}: vector::internal_events::aws_sqs: Internal log [Failed to fetch SQS events.] is being suppressed to avoid flooding.
2026-01-22T09:10:43.132137Z ERROR source{component_kind="source" component_id=log_files_source component_type=aws_s3}: vector::internal_events::aws_sqs: Internal log [Failed to fetch SQS events.] has been suppressed 7 times.
2026-01-22T09:10:43.132410Z ERROR source{component_kind="source" component_id=log_files_source component_type=aws_s3}: vector::internal_events::aws_sqs: Failed to fetch SQS events. error=service error error_code="failed_fetching_sqs_events" error_type="request_failed" stage="receiving"
2026-01-22T09:10:43.137201Z ERROR source{component_kind="source" component_id=log_files_source component_type=aws_s3}: vector::internal_events::aws_sqs: Internal log [Failed to fetch SQS events.] is being suppressed to avoid flooding.
2026-01-22T09:11:13.964092Z ERROR source{component_kind="source" component_id=log_files_source component_type=aws_s3}: vector::internal_events::aws_sqs: Internal log [Failed to fetch SQS events.] has been suppressed 3 times.
2026-01-22T09:11:13.964354Z ERROR source{component_kind="source" component_id=log_files_source component_type=aws_s3}: vector::internal_events::aws_sqs: Failed to fetch SQS events. error=service error error_code="failed_fetching_sqs_events" error_type="request_failed" stage="receiving"
2026-01-22T09:11:14.124109Z ERROR source{component_kind="source" component_id=log_files_source component_type=aws_s3}: vector::internal_events::aws_sqs: Internal log [Failed to fetch SQS events.] is being suppressed to avoid flooding.

Configuration

config:


swr.cn-north-4.myhuaweicloud.com
sqs.us-west-1.amazonaws.com

sqs.cn-north-4.myhuaweicloud.com

sources:
  internal_metrics:
    type: "internal_metrics"
    scrape_interval_secs: 5
  log_files_source:
    type: "aws_s3"
    region: "us-west-1"
    auth:
      access_key_id: ***
      secret_access_key: ***
    endpoint: "https://s3.us-west-1.amazonaws.com"
    force_path_style: false
    sqs:
      delete_message: true # It can be useful to set this to false for debugging or during the initial setup.
      queue_url: "https://sqs.us-west-1.amazonaws.com/***/s3-object-queue"

transforms:
  process_logs:
    type: "remap"
    inputs:
      - "log_files_source"
    source: |
      ###logic

sinks:
  output_to_files:
    type: "aws_s3"
    inputs:
      - "process_logs"
    auth:
      access_key_id: ***
      secret_access_key: ***
    region: "us-west-1"
    bucket: log-demo-sqs
    endpoint: "https://s3.us-west-1.amazonaws.com"
    force_path_style: false
    key_prefix: "parsed_log/"
    filename_time_format: "%s"
    encoding:
      codec: "csv"
      csv:
        fields: ["bucket", "hive", "db_name", "table_name", "query", "object_size", "key"] 
    compression: "none"
  out_metrics:
    type: "prometheus_exporter"
    inputs:
      - "internal_metrics"
api:
  enabled: true
  address: "0.0.0.0:8092"

Version

0.52.0

Debug Output


Example Data

No response

Additional Context

No response

References

No response

Metadata

Metadata

Assignees

No one assigned

    Labels

    type: bugA code related bug.

    Type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions