fix auth issues for data-prepper

Signed-off-by: YANGDB <[email protected]>

docker-compose.yml

@@ -591,7 +591,6 @@ services:
     volumes:
       - ./src/dataprepper/trace_analytics_no_ssl_2x.yml:/usr/share/data-prepper/pipelines/pipelines.yaml
       - ./src/dataprepper/data-prepper-config.yaml:/usr/share/data-prepper/config/data-prepper-config.yaml
-      - ./src/dataprepper/root-ca.pem:/usr/share/data-prepper/root-ca.pem
     ports:
       - "21890:21890"
     depends_on:

src/dataprepper/README.md

@@ -0,0 +1,52 @@
+![data-prepper](dataPrepper.svg)
+
+# What is Data Prepper
+
+[Data Prepper](https://github.com/opensearch-project/data-prepper/blob/main/docs/overview.md) is an open source utility service. Data Prepper is a server side data collector with abilities to filter, enrich, transform, normalize and aggregate data for downstream analytics and visualization. The broader vision for Data Prepper is to enable an end-to-end data analysis life cycle from gathering raw logs to facilitating sophisticated and actionable interactive ad-hoc analyses on the data.
+
+# What is Data Prepper Integration
+
+Data Prepper integration is concerned with the following aspects
+
+- Allow simple and automatic generation of all schematic structured
+    - traces ( including specific fields mapping to map to SS4O schema)
+    - services ( adding support for specific service mapping category)
+    - metrics (using the standard SS4O schema)
+
+- Add Dashboard Assets for correlation between traces-services-metrics
+
+- Add correlation queries to investigate traces based metrics
+
+# Data - Prepper Trace Fields
+Data Prepper uses the following [Traces](https://github.com/opensearch-project/data-prepper/blob/main/docs/schemas/trace-analytics/otel-v1-apm-span-index-template.md) mapping file
+The next fields are used:
+```text
+
+- traceId - A unique identifier for a trace. All spans from the same trace share the same traceId.
+- spanId - A unique identifier for a span within a trace, assigned when the span is created.
+- traceState - Conveys information about request position in multiple distributed tracing graphs.
+- parentSpanId - The spanId of this span's parent span. If this is a root span, then this field must be empty.
+- name - A description of the span's operation.
+- kind - The type of span. See OpenTelemetry - SpanKind.
+- startTime - The start time of the span.
+- endTime - The end time of the span.
+- durationInNanos - Difference in nanoseconds between startTime and endTime.
+- serviceName - Currently derived from the opentelemetry.proto.resource.v1.Resource associated with the span, the resource from the span originates.
+- events - A list of events. See OpenTelemetry - Events.
+- links - A list of linked spans. See OpenTelemetry - Links.
+- droppedAttributesCount - The number of attributes that were discarded.
+- droppedEventsCount - The number of events that were discarded.
+- droppedLinksCount - The number of links that were dropped.
+- span.attributes.* - All span attributes are split into a list of keywords.
+- resource.attributes.* - All resource attributes are split into a list of keywords.
+- status.code - The status of the span. See OpenTelemetry - Status.
+
+```
+There are some additional `trace.group` related fields which are not part of the [OTEL spec](https://github.com/open-telemetry/opentelemetry-specification/blob/main/specification/trace/api.md) for traces
+```text
+- traceGroup - A derived field, the name of the trace's root span.
+- traceGroupFields.endTime - A derived field, the endTime of the trace's root span.
+- traceGroupFields.statusCode - A derived field, the status.code of the trace's root span.
+- traceGroupFields.durationInNanos - A derived field, the durationInNanos of the trace's root span.
+
+```

src/dataprepper/trace_analytics_no_ssl_2x.yml

@@ -17,7 +17,7 @@ raw-pipeline:
   sink:
     - opensearch:
         hosts: [ "https://opensearch-node1:9200" ]
-        cert: "/usr/share/data-prepper/root-ca.pem"
+        insecure: true
         username: "admin"
         password: "admin"
         index_type: trace-analytics-raw
@@ -31,7 +31,7 @@ service-map-pipeline:
   sink:
     - opensearch:
         hosts: ["https://opensearch-node1:9200"]
-        cert: "/usr/share/data-prepper/root-ca.pem"
+        insecure: true
         username: "admin"
         password: "admin"
         index_type: trace-analytics-service-map