Every index as a table
Indices are discovered automatically and each becomes its own schema.
AWS OpenSearch
Polytomic connects AWS OpenSearch to your data warehouse, databases, and SaaS tools for search index ETL. Replicate documents from your OpenSearch indices into your data warehouse and other systems so log and search data can be analyzed alongside the rest of your business, without writing code.
Consistent snapshot reads
Point in time snapshots with search after paging keep large reads stable.
Incremental on any sortable field
Track on a timestamp, a sequence, or any sortable field you choose.
Example workflows
Replicate OpenSearch indices into your data warehouse
What you can sync
AWS OpenSearch is supported as a source. Read documents from your indices and land them in your data warehouse, databases, or SaaS tools.
From AWS OpenSearch
Concrete indices, each exposed as its own table
Top level fields from each index mapping
Object and nested fields kept as object values
Point in time snapshot reads with search after paging
Incremental reads on any sortable field
To your destinations
Data warehouses including Snowflake, BigQuery, and Databricks
Databases including PostgreSQL and MySQL
Cloud storage including Amazon S3 and Azure Blob Storage
SaaS tools including Salesforce, HubSpot, and spreadsheets
How it works
Connect your OpenSearch domain with AWS credentials and Polytomic discovers your indices, treating each as a table. Documents are read into your data warehouse, databases, or SaaS tools, so data that only existed for search becomes available for analysis and joining.
Reads use a point in time snapshot with search after paging rather than the older scroll approach, which keeps a long running read consistent even while the index continues receiving writes.
- Connect with AWS access keys signed for your OpenSearch domain
- Discover concrete indices and expose each as a table
- Build a schema from the index mapping's top level fields
- Read with point in time snapshots and search after paging
- Sync incrementally by nominating any sortable field
- Monitor sync health, record volume, and failures from one interface
How to set up
Polytomic authenticates with AWS access key and secret credentials, signing requests with SigV4 against your OpenSearch domain endpoint and region. The IAM principal needs read access to the indices you want to sync, plus permission to create and delete point in time contexts.
How to get connected
- 1In AWS, create an IAM user or principal with OpenSearch read access
- 2Ensure it can also create and delete point in time contexts
- 3In Polytomic, navigate to Connections, then Add Connection, then AWS OpenSearch
- 4Enter the access key, secret, region, and domain endpoint
- 5Test the connection
- 6Select the indices you want to sync and click Save
See the documentation for full setup details.
Frequently asked questions
Why teams choose Polytomic
No engineering required
Set up and manage syncs without writing code.
Flexible data modeling
Use SQL to define exactly what data gets synced.
Handles scale automatically
Supports large datasets with incremental syncs and bulk APIs.
Start syncing your data with AWS OpenSearch in minutes
No credit card required. Free trial available.