Pipeline

Add Data Pipeline

Data pipelines help you to push the device data coming to cloud to be sent to various other platforms like mongo db, mysql, kafka,sftp for further analysis.

1. Click on Data Pipeline from the main menu
   
2. Select on the add button to create a new data pipeline
3. A new pipeline creation form is displayed . Fill up a unique name to identify the pipeline across the project
4. Select the device template which you want the data pipeline to be used for. All devices in this template will be sent to this data pipeline
5. One can filter events by selecting a data pipeline rule if created. Only device data matching that rule will be sent to the data pipeline
6. One can filter specific devices and not allow all devices of the same template to be reported to the data pipeline
7. User can make the data pipeline active/inactive any point of time
8. User then need to proceed to create the actions of the data pipeline
9. One can select any of data target like Mongo, kafka topic or sftp destination
   1. Mongo selection would need to fill up the mongo uri to create a successfull entry
   2. For kafka one needs to fill all required fields along with securiy type and sasl mechanism
   3. For sftp one needs to add the correct credentials for the sftp server
10. Once action or multiple actions are added one needs to click on the submit button to create the data pipeline