12-23-2022, 08:00 AM
To use data sync in pipeline,
First we have to create a data sync in pipeline setting by specifying the host , port , databasename ,username , password ,driver(ex:mongodb , MySQL,Clickhouse , postgres, oracle)
Than we can use the data sync across pipeline.
To access the data sync to pipeline , we can access in toggle panel in pipeline with plus button ,create it and drag and drop to panel .
Than we can specify the table name and save mode (append or upsert) in data sync component . There is no need of using Kafka component before data sync.
(Upsert: One extra field will be displayed for upsert save mode i.e.: Composite Key)
First we have to create a data sync in pipeline setting by specifying the host , port , databasename ,username , password ,driver(ex:mongodb , MySQL,Clickhouse , postgres, oracle)
Than we can use the data sync across pipeline.
To access the data sync to pipeline , we can access in toggle panel in pipeline with plus button ,create it and drag and drop to panel .
Than we can specify the table name and save mode (append or upsert) in data sync component . There is no need of using Kafka component before data sync.
(Upsert: One extra field will be displayed for upsert save mode i.e.: Composite Key)