Equnix Data Integration Management, an Automated High Performance ETL Tool for PostgreSQL
Presented by:
Lucky Haryadi
Doing migration or synchronize data from multiple data sources might be confusing and bothersome, especially from different RDBMS or data format. To managed such activity, ETL Process is the common mechanism and tool, but there is no automated yet high performance tool before. Equnix Data Integration Management (EDIM) comes to the rescue, as a lightweight tools and small memory footprint, running in multi-process way. EDIM is an ETL Tools that is built using C application, very handy to configure, and running fast for synchronizing millions of data within minutes. Since it is running in multi-process manner, synchronizing multiple tables can be done in parallel. EDIM also has capabilities to transform data in the middle of transactions, by enriching, validating, filtering, masking, hashing, synergizing, aggregating, distributing, and even more. On this talk, I will demonstrate also EDIM peformance to migrate from Oracle and from PostgreSQL using logical decoding to PostgreSQL.
- Date:
- 2020 November 19 15:30 CST
- Duration:
- 40 min
- Room:
- Virtual - English Sub-Conference A
- Conference:
- CHINA 2020 And PGConf.Asia 2020
- Language:
- Track:
- Migrations
- Difficulty:
- Medium