Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Update Tap Iceberg to add AWS configuration support #1809

Merged
merged 4 commits into from
Jul 25, 2024
Merged

Update Tap Iceberg to add AWS configuration support #1809

Changes from all commits
Commits
Show all changes
4 commits
Select commit Hold shift + click to select a range
2053830
Update Iceberg connector config
BTheunissen Jul 22, 2024
3c7e7f5
Update
BTheunissen Jul 24, 2024
4909730
Fix lint
BTheunissen Jul 24, 2024
bd6dfdb
Merge branch 'main' into shaped-tap-iceberg-aws
edgarrmondragon Jul 25, 2024
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
34 changes: 23 additions & 11 deletions _data/meltano/extractors/tap-iceberg/shaped-ai.yml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -47,22 +47,34 @@ settings:
kind: string
label: Batch Config Storage Root
name: batch_config.storage.root
- description: The name of the Iceberg catalog
kind: string
- description: The name of the catalog to connect to.
label: Catalog Name
name: catalog_name
- description: Additional properties for the Iceberg catalog
kind: object
label: Catalog Properties
name: catalog_properties
- description: The type of Iceberg catalog (e.g., 'hive', 'rest', 'glue')
kind: string
- description: The type of catalog to connect to.
label: Catalog Type
name: catalog_type
- description: The URI of the Iceberg catalog
kind: string
label: Catalog Uri
- description: The URI of the catalog to connect to.
label: Catalog URI
name: catalog_uri
- description: Additional properties to pass to the catalog connection.
kind: object
label: Catalog Properties
edgarrmondragon marked this conversation as resolved.
Show resolved Hide resolved
name: catalog_properties
- description: The access key of the AWS Glue Data Catalog.
label: Access Key
name: client_access_key_id
edgarrmondragon marked this conversation as resolved.
Show resolved Hide resolved
sensitive: true
- description: The secret access key of the AWS Glue Data Catalog.
label: Secret Access Key
name: client_secret_access_key
edgarrmondragon marked this conversation as resolved.
Show resolved Hide resolved
sensitive: true
- description: The session token of the AWS Glue Data Catalog.
label: Session Token
name: client_session_token
edgarrmondragon marked this conversation as resolved.
Show resolved Hide resolved
sensitive: true
- description: The region of the AWS Glue Data Catalog.
label: Region
name: client_region
- description: 'One or more LCID locale strings to produce localized output for: https://faker.readthedocs.io/en/master/#localization'
kind: array
label: Faker Config Locale
Expand Down