QuickConnect
Our second section of Routing is QuickConnect. True to its name, QuickConnect helps administrators connect Sources and Destinations quickly. The trade-off here is that there are no filters, meaning if your use case calls for filtering particular events into certain Pipelines, Data Routes are going to be your answer.
Sources can only be sent to either Data Routes or QuickConnect, not both. Take this into consideration when building your Stream configuration.
QuickConnect follows much of the same ideas as Data Routes, minus the filter. QuickConnect utilizes:
Sourcesof all available typesPipelinesorPacksto process the data coming from the sourcesDestinationswhere the data ends up
Let's get set up so we can see QuickConnect in action.
Meet QuickConnect
- With
Manageactive in the top nav, selectRoutingand clickQuickConnect. - On the left-hand side, click
Add SourceunderSources. - In the resulting pane, select
Datagenand clickAdd New.- For
Input IDenterqc_apache_common. - In the Datagen table, under
Data Generator File, chooseapache_common.logfrom the drop-down.
- For
- Click
Save.
Using QuickConnect, we can rapidly link together our new qc_apache_common source with our pre-existing local Filesystem destination. We can also apply the apache_common_lookup pipeline that we created earlier. All we have to do is click and drag from the + on our source to our destination. Then we select our pipeline and we're done!
-
Click the
+on the right side ofDatagen: qc_apache_common. -
While still holding down the left mouse button drag the cursor onto
Filesystem: local. -
While your cursor is over the destination release your left mouse button.
-
In the resulting pop-up, select
Pipeline. -
Click the dot to the let of
access_common_lookup.Note: if you click ON the name of the pipeline, it opens a new tab in your browser to this Stream instance. You can continue there, or simply navigate back to the sandbox tab and continue the course.
-
Click
Save
View QuickConnect Events
Now, to check your additional work, let's view the events as they're being saved to your local filesystem.
- If the terminal is not already open, toggle it open on the bottom right.
- At the command prompt, type or paste:
You should see a new directory,
ls -l /tmp/staging/localdatagen:qc_apache_common. - At the prompt, now type or paste:
You should not only see the output from our foray into
tree /tmp/staging/Data Routes, but also the new files insidedatagen:qc_apache_commonthat are being generated from ourQuickConnectrouting.