Any S3-compatible endpoint
Point Polytomic at the endpoint for MinIO, Ceph, or any other store that implements the S3 API, not just AWS.
S3 Compatible
Polytomic connects S3-compatible object storage, like MinIO, Wasabi, or Backblaze B2, to your data warehouse, databases, and SaaS tools for ETL and reverse ETL. Read CSV, JSON, and Parquet files into your systems, or write synced data back to your own bucket, without writing code.
Automatic field discovery
Polytomic samples your CSV, JSON, and Parquet files and infers their fields automatically.
Read and write in both directions
Sync files into your data warehouse and databases, or write synced data back out to your bucket.
Example workflows
Load CSV, JSON, and Parquet exports into your data warehouse
What you can sync
Move files between S3-compatible object storage and your data warehouse, databases, and SaaS tools, in either direction.
From S3 Compatible
CSV files
JSON files, line delimited or as an array
Parquet files
Multiple files grouped into one table by folder pattern
Gzip, zstd, and bzip2 compressed files, decompressed automatically
To S3 Compatible
CSV files
JSON files, line delimited or as an array
Parquet files
Files replaced in place or written as timestamped snapshots
Incremental files containing only changed records
How it works
Point Polytomic at any endpoint that implements the S3 API using the bucket name, region, and access key credentials you already have. Polytomic reads CSV, JSON, and Parquet files as objects, sampling each one to infer its fields automatically.
Files can be grouped into tables three ways: each file as its own table, files under a folder pattern grouped into one table, or the whole bucket treated as a single table for time-based snapshots. Polytomic also skips reprocessing the bucket if nothing has changed since the last run.
- Objects and fields inferred automatically from CSV, JSON, and Parquet files
- Read gzip, zstd, and bzip2 compressed files without extra configuration
- Group files into tables by folder pattern, or as one table
- Point at any endpoint that speaks the S3 API, not just AWS
- Write files as CSV, JSON lines, JSON arrays, or Parquet
- Replace files in place, snapshot each run, or write only changed records
How to set up
S3 Compatible uses the same access key and secret key credentials as AWS S3, so any endpoint that implements the S3 API works, including self-hosted and third-party object stores.
How to get connected
- 1In Polytomic, go to Connections, click Add connection, and select S3 Compatible
- 2Enter the endpoint, access key ID, and secret access key for your S3-compatible store
- 3Enter the bucket name and any remaining visible fields, then click Save
Frequently asked questions
Why teams choose Polytomic
No engineering required
Set up and manage syncs without writing code.
Flexible data modeling
Use SQL to define exactly what data gets synced.
Handles scale automatically
Supports large datasets with incremental syncs and bulk APIs.
Start syncing your data with S3 Compatible in minutes
No credit card required. Free trial available.