Thread Rating:
  • 0 Vote(s) - 0 Average
  • 1
  • 2
  • 3
  • 4
  • 5
How to test Components in Data pipeline?
#1
* Basically we can test only Transformation components of our pipeline to Ensure that the component is working properly or not.

As we know that on the top of the pipeline page there is one option called Testing pipeline,,,

1)we need to click the option Testing pipeline -it shows the components at left side of the page which is present in our pipeline

example :we have sql or python component in pipeline, it shows two components at left side of a page

2)we need to select which component we want to test first then we can select Create test case.it gives multiple options like:-

a)Test case name
b)test case description(optional)
c)input data file -(input data file of Max 10 records has to be uploaded in which we are sending data as input in a JSON file)
d)Expected data output file-(Meaning-Expected output data file of max 10 records has to be uploaded in json format)
e)schema file-(schema file has to be uploaded in this option,(meaning-Expected output data's schema has to be uploaded)
f)input data type-JSON
g)comparision logic-(meaning-while testing the component what and all has to be compared & tested ,like-comparing no. of columns,rows,data)
 
3)save the test case after configuring the above steps

4)Run the test case to know the results, we can check the status reports once it completes the test...
Reply


Messages In This Thread
How to test Components in Data pipeline? - by mohd.gulam - 12-21-2022, 07:46 AM

Forum Jump:


Users browsing this thread: 1 Guest(s)