Question 1

Which format should I pick?

Accepted Answer

CSV, JSON Lines, JSON array and Parquet are all available. For MongoDB specifically, JSON Lines or Parquet are usually the right answer, because embedded documents and arrays arrive as single JSON valued fields and a CSV column full of serialized JSON is awkward for whatever reads the file next.

Question 2

Which write modes are available?

Accepted Answer

Replicate writes one stable file and replaces it with the full dataset. Snapshot writes a new timestamped file each run. Replicate with write incremental files enabled uses the snapshot layout but writes only the changes, deletion tombstones included.

Question 3

How do I get only the changes?

Accepted Answer

Turn on use change stream for bulk syncs on the MongoDB connection, then enable incremental files on the sync. Polytomic takes an initial position from cluster time, performs the baseline load, then consumes insert, update, replace and delete events with resume tokens checkpointing progress. Your deployment has to be a replica set or a sharded cluster for this, since a standalone mongod cannot provide change streams at all.

Question 4

What happens if the sync falls behind?

Accepted Answer

Oplog retention decides. Resume tokens let Polytomic pick up where it left off, but if the retained oplog history rolls past the point it needs before it has caught up, a full resync is required. Give yourself enough retention that a long outage or a paused sync does not force one.

Question 5

Why files rather than a direct sync?

Accepted Answer

Usually because something else owns the loading, or the data is heading somewhere with no direct connector. It is also the least demanding option for a document store, since a file carries the JSON shape as it is rather than forcing a decision about how to type nested structure on arrival.

Sync MongoDB to Google Cloud Storage

Sync MongoDB to Google Cloud Storage with Polytomic

Four output formats

Nested data survives

Changes only, if you want

Or sync Google Cloud Storage to MongoDB

Trusted by businesses worldwide

Step-by-step integration guide

Connect MongoDB in Polytomic

Connect Google Cloud Storage in Polytomic

Create a sync between MongoDB and Google Cloud Storage

Map fields and enable the sync

Frequently asked questions

The sync and ETL platform that does it all

Powerful data sync

Advanced analytics

Enterprise security

Easy setup

Ready to connect MongoDB with Google Cloud Storage?