Forums
How to create Data sync and use in pipelines - Printable Version

+- Forums (https://bdn.bdb.ai)
+-- Forum: BDB Knowledge Base (https://bdn.bdb.ai/forumdisplay.php?fid=13)
+--- Forum: BDB Data Pipeline (https://bdn.bdb.ai/forumdisplay.php?fid=48)
+---- Forum: BDB Data Pipeline Q & A (https://bdn.bdb.ai/forumdisplay.php?fid=17)
+---- Thread: How to create Data sync and use in pipelines (/showthread.php?tid=456)



How to create Data sync and use in pipelines - manjunath - 12-23-2022

To use data sync in pipeline, 
 First we have to create a data sync in pipeline setting by specifying the host , port , databasename ,username , password ,driver(ex:mongodb , MySQL,Clickhouse , postgres, oracle)
 Than we can use the data sync across pipeline.
 
 To access the data sync to pipeline , we can access in toggle panel in pipeline with plus button ,create it and drag and drop to panel .
 Than we can specify the table name and save mode (append or upsert) in data sync component . There is no need of using Kafka component before data sync.
 (Upsert: One extra field will be displayed for upsert save mode i.e.: Composite Key)