How Privy Streamlined a Tangled Web of Data Pipelines with Polytomic

Key takeaways
- With Polytomic, Privy consolidated multiple data movement tools and custom integrations into one platform.
- Brendan and his team were able to establish the data warehouse as a single source of truth across business systems.
- Data pipelines became easier to operate, troubleshoot, and update with less engineering involvement.
Privy is an email and SMS marketing platform for ecommerce companies. It gives brands a simpler and more approachable way to engage customers across marketing channels.
Behind that experience is a data operation run by Brendan Couche, Director of Engineering. Sales, marketing, customer success, and Privy’s executive team all rely on up-to-date data to understand customers and make business decisions. Maintaining this data operation requires Brendan’s team to keep information moving between Privy’s application database, data warehouse, and business systems.
But the pipelines supporting that movement were built at different times for different reasons. Some connections were slow or difficult to troubleshoot, while others required ongoing engineering involvement. Each fix solved a particular problem but ended up contributing to a tangled web of pipelines that was difficult to operate as a single system.
Privy needed a consistent and reliable foundation for moving data across the company. With Polytomic, Brendan’s team has been able to replace disconnected processes with an architecture that is easier to understand, control, and expand.
“Our data movement now feels intentional instead of a patchwork of separate fixes. Everything feels much more manageable with Polytomic.”
How Polytomic Brought Clarity and Control to Privy’s Data Operation
While Privy initially relied on a hodgepodge of point tools and custom integrations, the company now uses Polytomic to move data into its warehouse and make modeled data available in its business systems. This gives Brendan’s team a consistent and reliable way to manage Privy’s data movement from one platform.
Consolidating Data Movement in One Platform
Over time, Brendan and his team found themselves managing a sprawling collection of data movement tools. Moving data from the application database to the data warehouse was handled through Sling, while data inherited through an acquisition relied on Airbyte. Third-party data was brought into the warehouse through Stitch, and custom integrations had to be built into Privy’s application to push data into business systems. Each workflow gave Brendan’s team another process to operate, monitor, and troubleshoot.
Polytomic gives Privy a way to support different types of data movement through one platform. The company can bring operational data into the data warehouse, then move modeled data into business systems. Instead of approaching each workflow as a separate integration problem, Brendan’s team can manage all of them with one tool.
“Managing a different tool for every type of data movement gets exhausting. Polytomic gives us a much simpler foundation, and that takes a real weight off the team.”
Maintaining a Single Source of Truth
The number of tools was not the only issue that Brendan was dealing with. Before Polytomic, Privy had several different paths for moving data.
Privy’s data syncs between HubSpot and Salesforce were a prime example of this. Data synced independently from the Privy application to HubSpot and Salesforce, while HubSpot and Salesforce each synced with each other as well. This led to potential conflicts where updates in one system could collide with updates in another.
After implementing Polytomic, Brendan’s team disconnected the other syncs and established the data warehouse as the single source of truth. The team now models the relevant data in the warehouse, then uses Polytomic to send the modeled data directly to its destination.
Salesforce and HubSpot now receive data through separate, controlled workflows instead of syncing with one another. Neither system acts as the source of truth for data it does not own. Brendan and his team manage the data in the warehouse and determine what should be sent to each destination.
This architecture gives teams across Privy consistent access to current data in their business systems. Sales, marketing, customer success, and company leadership can all make decisions based on a single source of truth.
With Polytomic, this new workflow took approximately one week to build. Two to three additional weeks were needed to carefully verify that no older syncs remained active.
“Thanks to Polytomic, we were able to build an architecture we can trust to keep data consistent across the company. Now I know that every team is working from the same source of truth.”
Running Reliable Data Pipelines With Less Overhead
Managing Privy’s old data pipelines took more than keeping track of different tools. Some third-party transfers took hours to complete and occasionally failed without giving Brendan’s team enough information to diagnose the problem. Other workflows were difficult to change without extensive engineering involvement.
Polytomic gives Privy a more straightforward way to configure and adjust data pipelines. Once the initial connection is in place, the team can easily add new tables, select additional fields or objects, and change the sync cadence without rebuilding the entire workflow.
Privy’s PostgreSQL replication is an example of this. Previously, Privy used Sling to move application data into Snowflake. The pipeline ran once per day, and modifying it required engineering expertise. Privy now uses Polytomic’s CDC streaming to automatically capture changes from PostgreSQL and keep the corresponding data in Snowflake current. Adding another table, including more data, or changing the update schedule is simple with Polytomic.
Polytomic’s intuitive interface also makes routine changes more accessible for users outside engineering. If Privy’s VP of Sales wants to add an existing modeled field to Salesforce, for example, he can select the field in Polytomic and map it to the appropriate Salesforce property. Engineering still controls the underlying models and architecture, but it does not have to implement every update. Brendan has introduced numerous colleagues to Polytomic and they’ve all found it easy to understand.
Polytomic also gives Brendan’s team greater visibility when things go wrong. His team can inspect the current checkpoint of its database replication, investigate lag, and initiate a new sync when necessary. If the cause of the problem is not immediately clear, Brendan can reach out to the Polytomic team and get answers quickly.
“Polytomic takes a lot of the burden out of operating our data pipelines. The platform is easy to understand, and when something does go wrong, I know their team will help us get to the bottom of it quickly.”
Simplifying Privy’s Data Stack as Its Needs Expand
Polytomic has given Brendan a simpler and more reliable way to manage Privy’s data workflows. As the company’s needs continue to evolve and expand, he aims to bring more pipelines onto the platform. This will allow Privy to support new workflows without having to rely on new tools.
By helping Privy consolidate data movement, maintain a reliable source of truth, and operate pipelines with less engineering overhead, Polytomic provides a foundation that can continue growing with the company.
“With Polytomic, a new data requirement does not feel like another system we have to bolt onto the stack. I feel much more confident that we can support what comes next without adding unnecessary complexity.”