Schema read, not guessed
Types come from the Parquet schema itself rather than sampled rows.
Parquet
Polytomic reads and writes Parquet files through your cloud storage connectors. Sync Parquet in Amazon S3, Google Cloud Storage, or Azure Blob Storage to and from your data warehouse, databases, and SaaS tools, without writing code.
Flexible file layouts
Single files, subfolders, and directory tables, with path parts as fields.
Read and write
Land Parquet in storage, or read existing Parquet as a sync source.
Example workflows
Load Parquet from cloud storage into your data warehouse
What you can sync
Parquet is a file format supported on Polytomic's cloud storage connectors, readable as a source and writable as a destination.
From your sources
Amazon S3
Google Cloud Storage
Azure Blob Storage
Single files, subfolders, and directory table patterns
To your destinations
Data warehouses including Snowflake, BigQuery, and Databricks
Databases including PostgreSQL and MySQL
Parquet written back to cloud storage
SaaS tools including Salesforce and HubSpot
How it works
Parquet is not a system you connect to. It is a file format Polytomic reads and writes through the cloud storage connectors, so you set up an Amazon S3, Google Cloud Storage, or Azure Blob Storage connection and choose Parquet as the format.
Because Parquet carries its own schema, Polytomic reads column names and types directly from the file rather than inferring them from sampled values. That makes typing more reliable than with CSV or JSON, where everything has to be guessed.
- Set up an Amazon S3, Google Cloud Storage, or Azure Blob connection
- Choose Parquet as the format for your source or destination
- Column names and types are read from the Parquet schema
- Point at a single file, a subfolder, or a directory table pattern
- Capture path components as fields where your layout encodes them
- Write back as a replaced file or timestamped snapshot files
How to set up
Authentication and bucket configuration happen on the storage connector, so follow the setup for Amazon S3, Google Cloud Storage, or Azure Blob Storage. Parquet is then a format choice on the source or destination rather than a separate connection.
How to get connected
- 1In Polytomic, add an Amazon S3, Google Cloud Storage, or Azure Blob connection
- 2Supply the credentials and bucket for that storage connector
- 3Test the connection
- 4Create a sync and select Parquet as the file format
- 5For sources, choose a single file, subfolder, or directory table pattern
- 6For destinations, pick a subfolder and choose replace or snapshot output
See the documentation for full setup details.
Frequently asked questions
Why teams choose Polytomic
No engineering required
Set up and manage syncs without writing code.
Flexible data modeling
Use SQL to define exactly what data gets synced.
Handles scale automatically
Supports large datasets with incremental syncs and bulk APIs.
Start syncing your data with Parquet in minutes
No credit card required. Free trial available.