Page tree

Contents

ETL filtering removes the matches from the input file and generates the output file. Depending on your business needs, you can configure ETL (Extract, Transform, Load) filters to exclude specific information, and the unfiltered data will be transferred to the configured destinations. You can set up ETL configurations using Regex (Regular Expressions) for Grid member names as well as IP/Network, FQDN, DNS Record Type, OPHID, and ON-PREM HOST, and then apply the ETL configurations to your traffic flow configurations. 

Note

The supported ETL data filters are processed in the following order: client_ip, member, and query FQDN.

The following table provides the details of ETL filters supported for source data log types.  

ETL filters supported for source data log types

Source

Log Type

FQDN

Client IP/Network 

Member

DNS Record Type

Ophid

Hostname

BloxOne Source




Threat Defense Query/Response Log

Yes

Yes

Yes

Yes

Yes

Threat Defense Threat Feeds Hits Log

Yes

Yes

Yes

Yes

Yes

DDI Query/Response Log

Yes

Yes

Yes

Yes

Yes

DDI DHCP Lease Log

Yes

Yes

NIOS Source



Query/Response Log

Yes

Yes

Yes

Yes

IPAM Metadata/DHCP Lease Information

Yes


RPZ Logs

Yes

Yes

Yes

Yes


Viewing ETL Configurations

To view all the ETL configurations, complete the following:

  1. Log in to the Cloud Services Portal.
  2. Click Manage > Data Connector.
  3. Select the ETL Configuration tab, and the Cloud Services Portal displays the following for all the ETL configurations:
    • NAME: The name of the ETL configuration.
    • DATA TYPE: The filter criterion for the ETL process.
    • DESCRIPTION: The information about the ETL configuration.
    • STATE: Describes whether the configuration is Enabled or Disabled.


For more information on ETL configurations, see the following:



  • No labels

This page has no comments.