Welcome, Guest |
You have to register before you can post on our site.
|
Latest Threads |
What is the maximum numbe...
Forum: BDB Designer Q & A
Last Post: sariga.vr@bdb.ai
12-28-2022, 07:59 AM
» Replies: 0
» Views: 8,015
|
Inbuilt Capability of VC...
Forum: BDB - Platform
Last Post: shivani.jaipuria
12-27-2022, 05:23 AM
» Replies: 0
» Views: 1,183
|
Can dataset/cube refresh...
Forum: BDB - Platform
Last Post: shivani.jaipuria
12-27-2022, 05:08 AM
» Replies: 0
» Views: 1,225
|
How to load business stor...
Forum: BDB Designer Q & A
Last Post: sariga.vr@bdb.ai
12-26-2022, 04:47 PM
» Replies: 0
» Views: 3,175
|
How to load business stor...
Forum: BDB Designer Q & A
Last Post: sariga.vr@bdb.ai
12-26-2022, 04:46 PM
» Replies: 0
» Views: 3,233
|
How to load business stor...
Forum: BDB Designer Q & A
Last Post: sariga.vr@bdb.ai
12-26-2022, 04:45 PM
» Replies: 0
» Views: 2,251
|
How to load business stor...
Forum: BDB Designer Q & A
Last Post: sariga.vr@bdb.ai
12-26-2022, 04:44 PM
» Replies: 0
» Views: 2,229
|
Data Preparation operati...
Forum: BDB-Data Prep & ETL
Last Post: shivani.jaipuria
12-26-2022, 10:09 AM
» Replies: 0
» Views: 1,203
|
Plugability Feature of B...
Forum: BDB Platform Q & A
Last Post: shivani.jaipuria
12-26-2022, 08:32 AM
» Replies: 0
» Views: 1,083
|
How to use environment va...
Forum: BDB Platform Q & A
Last Post: archana
12-26-2022, 05:57 AM
» Replies: 0
» Views: 1,085
|
|
|
How to read data from clickhouse database using python? |
Posted by: shreekantgosavi - 12-23-2022, 11:25 AM - Forum: BDB Data Pipeline Q & A
- No Replies
|
|
import pyodbc
import pandas as pd
# Connect to the ClickHouse database
conn = pyodbc.connect(
'Driver={ClickHouse ODBC Driver};'
'Server=localhost;'
'Port=9000;'
'Database=mydatabase;'
'UID=user;'
'PWD=password'
)
# Create a cursor
cursor = conn.cursor()
# Execute a SELECT statement to retrieve data from a table
cursor.execute('SELECT * FROM mytable')
# Fetch the rows from the cursor and create a DataFrame
df = pd.DataFrame.from_records(cursor.fetchall())
# Close the cursor and connection
cursor.close()
conn.close()
# Print the DataFrame
print(df)
|
|
|
Pull from VCS feature |
Posted by: aishwarya.rajan@bdb.ai - 12-23-2022, 11:24 AM - Forum: BDB Data Pipeline Q & A
- No Replies
|
|
This feature is for pulling the previously moved versions of a pipeline that are committed by the user. This can help a user significantly to recover the lost pipelines or avoid unwanted modifications made to the pipeline.
|
|
|
What is ETL process |
Posted by: manjunath - 12-23-2022, 11:24 AM - Forum: BDB ETL and Data Prep Q & A
- No Replies
|
|
ETL (extract, transform, load) is a process used to move data from one or more sources to a destination system, typically for the purpose of preparing the data for analysis or reporting. ETL involves three main steps:
· Extract: The first step in an ETL process is to extract the data from one or more sources. This may involve connecting to a database, reading files from a local or remote file system, or accessing data from a streaming platform such as Apache Kafka.
· Transform: The next step is to transform the data to fit the needs of the destination system. This may involve tasks such as filtering, aggregating, or reshaping the data, as well as applying data cleansing and data validation processes.
· Load: The final step in the ETL process is to load the transformed data into the destination system. This may involve writing the data to a database, writing it to a file system, or streaming it to another system.
ETL is often used in data pipelines to move data from various sources to a destination system for further analysis or reporting. The destination system may be a data warehouse, a big data processing platform, or another type of data storage or analysis system. ETL is typically used when the destination system has specific requirements for the data, such as a specific data format or schema, or when the data needs to be cleaned or transformed before it can be loaded into the destination system.
|
|
|
user restriction for data in platform |
Posted by: harshabalan - 12-23-2022, 11:22 AM - Forum: BDB Platform Q & A
- No Replies
|
|
How to give user restriction to the data in platform
(12-23-2022, 11:22 AM)harshabalan Wrote: How to give user restriction to the data in platform
Ans: We can define the custom field in admin module and assign respective values for each of the users so that the person has the visibility to the given value only. The data restriction has to be added in the datasets as well using env variables.
|
|
|
What is a Data Sheet? |
Posted by: aishwarya.rajan@bdb.ai - 12-23-2022, 11:20 AM - Forum: BDB Platform Q & A
- No Replies
|
|
The Data Sheet stores data in a visually appealing & easy-to-use spreadsheet.
It can act as a powerful database that allows to remove the data silos and store or share the structured data across.
|
|
|
|