Socket Source

The Vector socket source receives logs from socket client.

Configuration

[sources.my_source_id]
type = "socket" # required
address = "0.0.0.0:9000" # required, required when mode = `tcp` or `udp`
max_length = 102400 # optional, default, bytes
mode = "tcp" # required
path = "/path/to/socket" # required, required when mode = `unix`
  • commonrequired*string

    address

    The address to listen for connections on, or systemd#N to use the Nth socket passed by systemd socket activation. If an address is used it must include a port.

    • Syntax: literal
    • Only required when: mode = `tcp` or `udp`
  • optionalstring

    host_key

    The key name added to each event representing the current host. This can also be globally set via the global [host_key](#host_key) option.

    • Syntax: literal
    • Default: "host"
  • optionaltable

    keepalive

    Configures the TCP keepalive behavior for the connection to the source.

    • optionaluint

      time_secs

      The time a connection needs to be idle before sending TCP keepalive probes.

    • commonoptionaluint

      max_length

      The maximum bytes size of incoming messages before they are discarded.

      • Default: 102400 (bytes)
    • enumcommonrequiredstring

      mode

      The type of socket to use.

      • Syntax: literal
      • Enum, must be one of: "tcp" "udp" "unix_datagram" "unix_stream"
    • commonrequired*string

      path

      The unix socket path. This should be an absolute path.

      • Syntax: literal
      • Only required when: mode = `unix`
    • optionaluint

      shutdown_timeout_secs

      The timeout before a connection is forcefully closed during shutdown.

      • Only relevant when: mode = `tcp``
      • Default: 30 (seconds)
    • optionaltable

      tls

      Configures the TLS options for incoming connections.

      • optionalstring

        ca_file

        Absolute path to an additional CA certificate file, in DER or PEM format (X.509), or an in-line CA certificate in PEM format.

        • Syntax: literal
      • optionalstring

        crt_file

        Absolute path to a certificate file used to identify this server, in DER or PEM format (X.509) or PKCS#12, or an in-line certificate in PEM format. If this is set, and is not a PKCS#12 archive, key_file must also be set. This is required if enabled is set to true.

        • Syntax: literal
      • optionalbool

        enabled

        Require TLS for incoming connections. If this is set, an identity certificate is also required.

        • Default: false
      • optionalstring

        key_file

        Absolute path to a private key file used to identify this server, in DER or PEM format (PKCS#8), or an in-line private key in PEM format.

        • Syntax: literal
      • optionalstring

        key_pass

        Pass phrase used to unlock the encrypted key file. This has no effect unless key_file is set.

        • Syntax: literal
      • optionalbool

        verify_certificate

        If true, Vector will require a TLS certificate from the connecting host and terminate the connection if the certificate is not valid. If false (the default), Vector will not request a certificate from the client.

        • Default: false

    Output

    This component outputs log events with the following fields:

    {
    "host" : "my-host.local",
    "message" : "2019-02-13T19:48:34+00:00 [info] Started GET \"/\" for 127.0.0.1",
    "timestamp" : "2020-10-10T17:07:36+00:00"
    }
    • commonrequiredstring

      host

      The local hostname, equivalent to the gethostname command.

      • Syntax: literal
    • commonrequiredstring

      message

      The raw line, unparsed.

      • Syntax: literal
    • commonrequiredtimestamp

      timestamp

      The exact time the event was ingested into Vector.

    Telemetry

    This component provides the following metrics that can be retrieved through the internal_metrics source. See the metrics section in the monitoring page for more info.

    • counter

      events_in_total

      The number of events accepted by this component either from tagged origin like file and uri, or cumulatively from other origins. This metric includes the following tags:

      • component_kind - The Vector component kind.

      • component_name - The Vector component ID.

      • component_type - The Vector component type.

      • container_name - The name of the container from which the event originates.

      • file - The file from which the event originates.

      • instance - The Vector instance identified by host and port.

      • job - The name of the job producing Vector metrics.

      • mode - The connection mode used by the component.

      • peer_addr - The IP from which the event originates.

      • peer_path - The pathname from which the event originates.

      • pod_name - The name of the pod from which the event originates.

      • uri - The sanitized uri from which the event originates.

    • counter

      connection_errors_total

      The total number of connection errors for this Vector instance. This metric includes the following tags:

      • instance - The Vector instance identified by host and port.

      • job - The name of the job producing Vector metrics.

    • counter

      events_out_total

      The total number of events emitted by this component. This metric includes the following tags:

      • component_kind - The Vector component kind.

      • component_name - The Vector component ID.

      • component_type - The Vector component type.

      • instance - The Vector instance identified by host and port.

      • job - The name of the job producing Vector metrics.

    • counter

      connection_failed_total

      The total number of times a connection has failed. This metric includes the following tags:

      • instance - The Vector instance identified by host and port.

      • job - The name of the job producing Vector metrics.

    • counter

      connection_established_total

      The total number of times a connection has been established. This metric includes the following tags:

      • instance - The Vector instance identified by host and port.

      • job - The name of the job producing Vector metrics.

    • counter

      connection_send_errors_total

      The total number of errors sending data via the connection. This metric includes the following tags:

      • instance - The Vector instance identified by host and port.

      • job - The name of the job producing Vector metrics.

    • counter

      connection_shutdown_total

      The total number of times the connection has been shut down. This metric includes the following tags:

      • instance - The Vector instance identified by host and port.

      • job - The name of the job producing Vector metrics.

    Examples

    Given the following input:

    2019-02-13T19:48:34+00:00 [info] Started GET "/" for 127.0.0.1

    And the following configuration:

    vector.toml
    [sources.socket]
    type = "socket"

    The following Vector log event will be output:

    {
    "timestamp": "2020-10-10T17:07:36.452332Z",
    "message": "2019-02-13T19:48:34+00:00 [info] Started GET \"/\" for 127.0.0.1",
    "host": "my-host.local"
    }

    How It Works

    Context

    By default, the socket source will augment events with helpful context keys as shown in the "Output" section.

    State

    This component is stateless, meaning its behavior is consistent across each input.

    Transport Layer Security (TLS)

    Vector uses Openssl for TLS protocols. You can adjust TLS behavior via the tls.* options.