feat(bedrock): expose bda parsing strategy for data sources (#1096)

krokoko · web-flow · commit c50e62c84c9a · 2025-04-23T11:09:35.000-07:00
* feat(parsing): add bda support as a parsing strategy for data sources
diff --git a/apidocs/@cdklabs/namespaces/bedrock/README.md b/apidocs/@cdklabs/namespaces/bedrock/README.md
@@ -33,7 +33,7 @@
 - [ModalityType](enumerations/ModalityType.md)
 - [OrchestrationType](enumerations/OrchestrationType.md)
 - [ParsingModality](enumerations/ParsingModality.md)
-- [ParsingStategyType](enumerations/ParsingStategyType.md)
+- [ParsingStrategyType](enumerations/ParsingStrategyType.md)
 - [PromptTemplateType](enumerations/PromptTemplateType.md)
 - [RelayConversationHistoryType](enumerations/RelayConversationHistoryType.md)
 - [SalesforceDataSourceAuthType](enumerations/SalesforceDataSourceAuthType.md)
@@ -80,7 +80,7 @@
 - [Memory](classes/Memory.md)
 - [OrchestrationExecutor](classes/OrchestrationExecutor.md)
 - [ParentActionGroupSignature](classes/ParentActionGroupSignature.md)
-- [ParsingStategy](classes/ParsingStategy.md)
+- [ParsingStrategy](classes/ParsingStrategy.md)
 - [Prompt](classes/Prompt.md)
 - [PromptBase](classes/PromptBase.md)
 - [PromptOverrideConfiguration](classes/PromptOverrideConfiguration.md)
@@ -128,7 +128,7 @@
 - [CustomTopicProps](interfaces/CustomTopicProps.md)
 - [DataSourceAssociationProps](interfaces/DataSourceAssociationProps.md)
 - [FoundationModelContextEnrichmentProps](interfaces/FoundationModelContextEnrichmentProps.md)
-- [FoundationModelParsingStategyProps](interfaces/FoundationModelParsingStategyProps.md)
+- [FoundationModelParsingStrategyProps](interfaces/FoundationModelParsingStrategyProps.md)
 - [GraphKnowledgeBaseAttributes](interfaces/GraphKnowledgeBaseAttributes.md)
 - [GraphKnowledgeBaseProps](interfaces/GraphKnowledgeBaseProps.md)
 - [GuardrailAttributes](interfaces/GuardrailAttributes.md)
diff --git a/apidocs/@cdklabs/namespaces/bedrock/classes/ParsingStrategy.md b/apidocs/@cdklabs/namespaces/bedrock/classes/ParsingStrategy.md
@@ -2,9 +2,9 @@
 
 ***
 
-[@cdklabs/generative-ai-cdk-constructs](../../../../README.md) / [bedrock](../README.md) / ParsingStategy
+[@cdklabs/generative-ai-cdk-constructs](../../../../README.md) / [bedrock](../README.md) / ParsingStrategy
 
-# Class: `abstract` ParsingStategy
+# Class: `abstract` ParsingStrategy
 
 Represents an advanced parsing strategy configuration for Knowledge Base ingestion.
 
@@ -16,11 +16,11 @@ https://docs.aws.amazon.com/bedrock/latest/userguide/kb-chunking-parsing.html#kb
 
 ### Constructor
 
-> **new ParsingStategy**(): `ParsingStategy`
+> **new ParsingStrategy**(): `ParsingStrategy`
 
 #### Returns
 
-`ParsingStategy`
+`ParsingStrategy`
 
 ## Properties
 
@@ -42,9 +42,23 @@ The CloudFormation property representation of this configuration
 
 ***
 
+### bedrockDataAutomation()
+
+> `static` **bedrockDataAutomation**(): `ParsingStrategy`
+
+Creates a Bedrock Data Automation-based parsing strategy for processing multimodal data.
+It leverages generative AI to automate the transformation of multi-modal data into structured formats.
+If the parsing fails, the Amazon Bedrock default parser is used instead.
+
+#### Returns
+
+`ParsingStrategy`
+
+***
+
 ### foundationModel()
 
-> `static` **foundationModel**(`props`): `ParsingStategy`
+> `static` **foundationModel**(`props`): `ParsingStrategy`
 
 Creates a Foundation Model-based parsing strategy for extracting non-textual information
 from documents such as tables and charts.
@@ -55,11 +69,11 @@ from documents such as tables and charts.
 
 ##### props
 
-[`FoundationModelParsingStategyProps`](../interfaces/FoundationModelParsingStategyProps.md)
+[`FoundationModelParsingStrategyProps`](../interfaces/FoundationModelParsingStrategyProps.md)
 
 #### Returns
 
-`ParsingStategy`
+`ParsingStrategy`
 
 #### See
 
diff --git a/apidocs/@cdklabs/namespaces/bedrock/enumerations/ParsingStrategyType.md b/apidocs/@cdklabs/namespaces/bedrock/enumerations/ParsingStrategyType.md
@@ -2,9 +2,9 @@
 
 ***
 
-[@cdklabs/generative-ai-cdk-constructs](../../../../README.md) / [bedrock](../README.md) / ParsingStategyType
+[@cdklabs/generative-ai-cdk-constructs](../../../../README.md) / [bedrock](../README.md) / ParsingStrategyType
 
-# Enumeration: ParsingStategyType
+# Enumeration: ParsingStrategyType
 
 Enum representing the types of parsing strategies available for Amazon Bedrock Knowledge Bases.
 
diff --git a/apidocs/@cdklabs/namespaces/bedrock/interfaces/ConfluenceDataSourceAssociationProps.md b/apidocs/@cdklabs/namespaces/bedrock/interfaces/ConfluenceDataSourceAssociationProps.md
@@ -200,7 +200,7 @@ The KMS key to use to encrypt the data source.
 
 ### parsingStrategy?
 
-> `readonly` `optional` **parsingStrategy**: [`ParsingStategy`](../classes/ParsingStategy.md)
+> `readonly` `optional` **parsingStrategy**: [`ParsingStrategy`](../classes/ParsingStrategy.md)
 
 The parsing strategy to use.
 
diff --git a/apidocs/@cdklabs/namespaces/bedrock/interfaces/ConfluenceDataSourceProps.md b/apidocs/@cdklabs/namespaces/bedrock/interfaces/ConfluenceDataSourceProps.md
@@ -220,7 +220,7 @@ The knowledge base to associate with the data source.
 
 ### parsingStrategy?
 
-> `readonly` `optional` **parsingStrategy**: [`ParsingStategy`](../classes/ParsingStategy.md)
+> `readonly` `optional` **parsingStrategy**: [`ParsingStrategy`](../classes/ParsingStrategy.md)
 
 The parsing strategy to use.
 
diff --git a/apidocs/@cdklabs/namespaces/bedrock/interfaces/CustomDataSourceAssociationProps.md b/apidocs/@cdklabs/namespaces/bedrock/interfaces/CustomDataSourceAssociationProps.md
@@ -148,7 +148,7 @@ The KMS key to use to encrypt the data source.
 
 ### parsingStrategy?
 
-> `readonly` `optional` **parsingStrategy**: [`ParsingStategy`](../classes/ParsingStategy.md)
+> `readonly` `optional` **parsingStrategy**: [`ParsingStrategy`](../classes/ParsingStrategy.md)
 
 The parsing strategy to use.
 
diff --git a/apidocs/@cdklabs/namespaces/bedrock/interfaces/CustomDataSourceProps.md b/apidocs/@cdklabs/namespaces/bedrock/interfaces/CustomDataSourceProps.md
@@ -152,7 +152,7 @@ The knowledge base to associate with the data source.
 
 ### parsingStrategy?
 
-> `readonly` `optional` **parsingStrategy**: [`ParsingStategy`](../classes/ParsingStategy.md)
+> `readonly` `optional` **parsingStrategy**: [`ParsingStrategy`](../classes/ParsingStrategy.md)
 
 The parsing strategy to use.
 
diff --git a/apidocs/@cdklabs/namespaces/bedrock/interfaces/DataSourceAssociationProps.md b/apidocs/@cdklabs/namespaces/bedrock/interfaces/DataSourceAssociationProps.md
@@ -121,7 +121,7 @@ The KMS key to use to encrypt the data source.
 
 ### parsingStrategy?
 
-> `readonly` `optional` **parsingStrategy**: [`ParsingStategy`](../classes/ParsingStategy.md)
+> `readonly` `optional` **parsingStrategy**: [`ParsingStrategy`](../classes/ParsingStrategy.md)
 
 The parsing strategy to use.
 
diff --git a/apidocs/@cdklabs/namespaces/bedrock/interfaces/FoundationModelParsingStrategyProps.md b/apidocs/@cdklabs/namespaces/bedrock/interfaces/FoundationModelParsingStrategyProps.md
@@ -2,9 +2,9 @@
 
 ***
 
-[@cdklabs/generative-ai-cdk-constructs](../../../../README.md) / [bedrock](../README.md) / FoundationModelParsingStategyProps
+[@cdklabs/generative-ai-cdk-constructs](../../../../README.md) / [bedrock](../README.md) / FoundationModelParsingStrategyProps
 
-# Interface: FoundationModelParsingStategyProps
+# Interface: FoundationModelParsingStrategyProps
 
 Properties for configuring a Foundation Model parsing strategy.
 
diff --git a/apidocs/@cdklabs/namespaces/bedrock/interfaces/S3DataSourceAssociationProps.md b/apidocs/@cdklabs/namespaces/bedrock/interfaces/S3DataSourceAssociationProps.md
@@ -170,7 +170,7 @@ The KMS key to use to encrypt the data source.
 
 ### parsingStrategy?
 
-> `readonly` `optional` **parsingStrategy**: [`ParsingStategy`](../classes/ParsingStategy.md)
+> `readonly` `optional` **parsingStrategy**: [`ParsingStrategy`](../classes/ParsingStrategy.md)
 
 The parsing strategy to use.
 
diff --git a/apidocs/@cdklabs/namespaces/bedrock/interfaces/S3DataSourceProps.md b/apidocs/@cdklabs/namespaces/bedrock/interfaces/S3DataSourceProps.md
@@ -182,7 +182,7 @@ The knowledge base to associate with the data source.
 
 ### parsingStrategy?
 
-> `readonly` `optional` **parsingStrategy**: [`ParsingStategy`](../classes/ParsingStategy.md)
+> `readonly` `optional` **parsingStrategy**: [`ParsingStrategy`](../classes/ParsingStrategy.md)
 
 The parsing strategy to use.
 
diff --git a/apidocs/@cdklabs/namespaces/bedrock/interfaces/SalesforceDataSourceAssociationProps.md b/apidocs/@cdklabs/namespaces/bedrock/interfaces/SalesforceDataSourceAssociationProps.md
@@ -186,7 +186,7 @@ The KMS key to use to encrypt the data source.
 
 ### parsingStrategy?
 
-> `readonly` `optional` **parsingStrategy**: [`ParsingStategy`](../classes/ParsingStategy.md)
+> `readonly` `optional` **parsingStrategy**: [`ParsingStrategy`](../classes/ParsingStrategy.md)
 
 The parsing strategy to use.
 
diff --git a/apidocs/@cdklabs/namespaces/bedrock/interfaces/SalesforceDataSourceProps.md b/apidocs/@cdklabs/namespaces/bedrock/interfaces/SalesforceDataSourceProps.md
@@ -202,7 +202,7 @@ The knowledge base to associate with the data source.
 
 ### parsingStrategy?
 
-> `readonly` `optional` **parsingStrategy**: [`ParsingStategy`](../classes/ParsingStategy.md)
+> `readonly` `optional` **parsingStrategy**: [`ParsingStrategy`](../classes/ParsingStrategy.md)
 
 The parsing strategy to use.
 
diff --git a/apidocs/@cdklabs/namespaces/bedrock/interfaces/SharePointDataSourceAssociationProps.md b/apidocs/@cdklabs/namespaces/bedrock/interfaces/SharePointDataSourceAssociationProps.md
@@ -186,7 +186,7 @@ The KMS key to use to encrypt the data source.
 
 ### parsingStrategy?
 
-> `readonly` `optional` **parsingStrategy**: [`ParsingStategy`](../classes/ParsingStategy.md)
+> `readonly` `optional` **parsingStrategy**: [`ParsingStrategy`](../classes/ParsingStrategy.md)
 
 The parsing strategy to use.
 
diff --git a/apidocs/@cdklabs/namespaces/bedrock/interfaces/SharePointDataSourceProps.md b/apidocs/@cdklabs/namespaces/bedrock/interfaces/SharePointDataSourceProps.md
@@ -202,7 +202,7 @@ The knowledge base to associate with the data source.
 
 ### parsingStrategy?
 
-> `readonly` `optional` **parsingStrategy**: [`ParsingStategy`](../classes/ParsingStategy.md)
+> `readonly` `optional` **parsingStrategy**: [`ParsingStrategy`](../classes/ParsingStrategy.md)
 
 The parsing strategy to use.
 
diff --git a/apidocs/@cdklabs/namespaces/bedrock/interfaces/WebCrawlerDataSourceAssociationProps.md b/apidocs/@cdklabs/namespaces/bedrock/interfaces/WebCrawlerDataSourceAssociationProps.md
@@ -208,7 +208,7 @@ no web pages will be ingested.
 
 ### parsingStrategy?
 
-> `readonly` `optional` **parsingStrategy**: [`ParsingStategy`](../classes/ParsingStategy.md)
+> `readonly` `optional` **parsingStrategy**: [`ParsingStrategy`](../classes/ParsingStrategy.md)
 
 The parsing strategy to use.
 
diff --git a/apidocs/@cdklabs/namespaces/bedrock/interfaces/WebCrawlerDataSourceProps.md b/apidocs/@cdklabs/namespaces/bedrock/interfaces/WebCrawlerDataSourceProps.md
@@ -228,7 +228,7 @@ no web pages will be ingested.
 
 ### parsingStrategy?
 
-> `readonly` `optional` **parsingStrategy**: [`ParsingStategy`](../classes/ParsingStategy.md)
+> `readonly` `optional` **parsingStrategy**: [`ParsingStrategy`](../classes/ParsingStrategy.md)
 
 The parsing strategy to use.
 
diff --git a/src/cdk-lib/bedrock/data-sources/README.md b/src/cdk-lib/bedrock/data-sources/README.md
@@ -453,24 +453,42 @@ two parsing strategies:
 
 - **Foundation Model Parsing Strategy**: This strategy uses a foundation model to describe
   the contents of the document. It is particularly useful for improved processing of PDF files
-  with tables and images. To use this strategy, set the `parsingStrategy` in a data source as below.
+  with tables and images. To use this strategy, set the `parsingStrategy` in a data source as below. 
+  For the list of supported models, please refer to the [documentation](https://docs.aws.amazon.com/bedrock/latest/userguide/knowledge-base-supported.html#knowledge-base-supported-parsing)
 
 #### TypeScript
 
   ```ts
-  bedrock.ParsingStategy.foundationModel({
+  bedrock.ParsingStrategy.foundationModel({
     model: BedrockFoundationModel.ANTHROPIC_CLAUDE_SONNET_V1_0,
   });
   ```
 
 #### Python
 
   ```python
-  bedrock.ParsingStategy.foundation_model(
+  bedrock.ParsingStrategy.foundation_model(
       parsing_model=BedrockFoundationModel.ANTHROPIC_CLAUDE_SONNET_V1_0
   )
   ```
 
+- **Bedrock Data Automation**: A fully-managed service that effectively processes multimodal data, without the need to provide any additional prompting. The cost of this parser depends on the number of pages in the document or number of images to be processed. Currently, only documents and images are supported, using standard output.
+
+#### TypeScript
+   ```ts
+   const parsingStrategy = ParsingStrategy.bedrockDataAutomation();
+   ```
+
+#### Python
+  ```python
+  bedrock.ParsingStrategy.bedrock_data_automation()
+  ```
+
+If the chosen parsing strategy fails to parse a file, the Amazon Bedrock default parser is used as a fallback.
+
+> warning
+> If you choose Amazon Bedrock Data Automation or foundation models as a parser, the method that you choose will be used to parse all .pdf files in your data source, even if  the .pdf files contain only text. The default parser won’t be used to parse these .pdf files. Your account incurs charges for the use of Amazon Bedrock Data Automation or the foundation model in parsing these files.
+
 For additional information regarding parsing, please refer to the [parsing documentation](https://docs.aws.amazon.com/bedrock/latest/userguide/kb-advanced-parsing.html)
 
 ### Context Enrichment
diff --git a/src/cdk-lib/bedrock/data-sources/base-data-source.ts b/src/cdk-lib/bedrock/data-sources/base-data-source.ts
@@ -21,7 +21,7 @@ import { IKnowledgeBase } from './../knowledge-bases/knowledge-base';
 import { ChunkingStrategy } from './chunking';
 import { ContextEnrichment } from './context-enrichment';
 import { CustomTransformation } from './custom-transformation';
-import { ParsingStategy } from './parsing';
+import { ParsingStrategy } from './parsing';
 /**
  * Specifies the policy for handling data when a data source resource is deleted.
  * This policy affects the vector embeddings created from the data source.
@@ -153,7 +153,7 @@ export interface DataSourceAssociationProps {
    *
    * @default - No Parsing Stategy is used.
    */
-  readonly parsingStrategy?: ParsingStategy;
+  readonly parsingStrategy?: ParsingStrategy;
 
   /**
    * The custom transformation strategy to use.
diff --git a/src/cdk-lib/bedrock/data-sources/parsing.ts b/src/cdk-lib/bedrock/data-sources/parsing.ts
@@ -11,6 +11,7 @@
  *  and limitations under the License.
  */
 
+import { Aws } from 'aws-cdk-lib';
 import { CfnDataSource } from 'aws-cdk-lib/aws-bedrock';
 import { PolicyStatement } from 'aws-cdk-lib/aws-iam';
 import { DEFAULT_PARSING_PROMPT } from './default-parsing-prompt';
@@ -26,7 +27,7 @@ export enum ParsingModality {
  * Enum representing the types of parsing strategies available for Amazon Bedrock Knowledge Bases.
  * @see https://docs.aws.amazon.com/bedrock/latest/userguide/kb-advanced-parsing.html
  */
-export enum ParsingStategyType {
+export enum ParsingStrategyType {
   /**
    * Uses a Bedrock Foundation Model for advanced parsing of non-textual information from documents.
    */
@@ -43,7 +44,7 @@ export enum ParsingStategyType {
 /**
  * Properties for configuring a Foundation Model parsing strategy.
  */
-export interface FoundationModelParsingStategyProps {
+export interface FoundationModelParsingStrategyProps {
   /**
    * The Foundation Model to use for parsing non-textual information.
    * Currently supported models are Claude 3 Sonnet and Claude 3 Haiku.
@@ -69,7 +70,7 @@ export interface FoundationModelParsingStategyProps {
  * Represents an advanced parsing strategy configuration for Knowledge Base ingestion.
  * @see https://docs.aws.amazon.com/bedrock/latest/userguide/kb-chunking-parsing.html#kb-advanced-parsing
  */
-export abstract class ParsingStategy {
+export abstract class ParsingStrategy {
   // ------------------------------------------------------
   // FM Parsing Strategy
   // ------------------------------------------------------
@@ -80,8 +81,8 @@ export abstract class ParsingStategy {
    * - There are limits on file types (PDF) and total data that can be parsed using advanced parsing.
    * @see https://docs.aws.amazon.com/bedrock/latest/userguide/knowledge-base-ds.html#kb-ds-supported-doc-formats-limits
    */
-  public static foundationModel(props: FoundationModelParsingStategyProps): ParsingStategy {
-    class FoundationModelTransformation extends ParsingStategy {
+  public static foundationModel(props: FoundationModelParsingStrategyProps): ParsingStrategy {
+    class FoundationModelTransformation extends ParsingStrategy {
       /** The CloudFormation property representation of this configuration */
       public readonly configuration = {
         bedrockFoundationModelConfiguration: {
@@ -90,7 +91,7 @@ export abstract class ParsingStategy {
             parsingPromptText: props.parsingPrompt ?? DEFAULT_PARSING_PROMPT,
           },
         },
-        parsingStrategy: ParsingStategyType.FOUNDATION_MODEL,
+        parsingStrategy: ParsingStrategyType.FOUNDATION_MODEL,
       };
 
       public generatePolicyStatements(): PolicyStatement[] {
@@ -105,6 +106,43 @@ export abstract class ParsingStategy {
 
     return new FoundationModelTransformation();
   }
+
+  /**
+   * Creates a Bedrock Data Automation-based parsing strategy for processing multimodal data.
+   * It leverages generative AI to automate the transformation of multi-modal data into structured formats.
+   * If the parsing fails, the Amazon Bedrock default parser is used instead.
+   */
+  public static bedrockDataAutomation(): ParsingStrategy {
+    class BedrockDataAutomationTransformation extends ParsingStrategy {
+      /** The CloudFormation property representation of this configuration */
+      public readonly configuration = {
+        bedrockDataAutomationConfiguration: {
+          parsingModality: ParsingModality.MULTIMODAL,
+        },
+        parsingStrategy: ParsingStrategyType.DATA_AUTOMATION,
+      };
+
+      public generatePolicyStatements(): PolicyStatement[] {
+        return [
+          new PolicyStatement({
+            actions: ['bedrock:InvokeDataAutomationAsync'],
+            resources: [
+              `arn:${Aws.PARTITION}:bedrock:${Aws.REGION}:${Aws.PARTITION}:data-automation-project/public-rag-default`,
+              `arn:${Aws.PARTITION}:bedrock:*:${Aws.ACCOUNT_ID}:data-automation-profile/us.data-automation-v1`, // see https://docs.aws.amazon.com/bedrock/latest/userguide/bda-cris.html
+            ],
+          }),
+          new PolicyStatement({
+            actions: ['bedrock:GetDataAutomationStatus'],
+            resources: [
+              `arn:${Aws.PARTITION}:bedrock:${Aws.REGION}:${Aws.ACCOUNT_ID}:data-automation-invocation/*`,
+            ],
+          }),
+        ];
+      }
+    }
+
+    return new BedrockDataAutomationTransformation();
+  }
   // ------------------------------------------------------
   // Properties
   // ------------------------------------------------------
diff --git a/src/cdk-lib/bedrock/knowledge-bases/README.md b/src/cdk-lib/bedrock/knowledge-bases/README.md
diff --git a/test/cdk-lib/bedrock/data-sources/s3-data-source.test.ts b/test/cdk-lib/bedrock/data-sources/s3-data-source.test.ts
