Configuration Options ReferenceΒΆ

Every 3LC configuration option, grouped by category. Each option lists every surface through which it can be set or read: the YAML config-file key, the environment variable, the CLI argument (where applicable), and the Python attribute on Configuration.

Internal options (those flagged cli_visible=False and serializable=False) are omitted β€” they are framework-internal flags set automatically at process startup.

Top-level optionsΒΆ

Top-level options accessible directly on Configuration.

config.aliasesΒΆ

URL alias definitions for path shortcuts.

Dictionary mapping alias names to target paths/URLs. Aliases are used with angle brackets in URLs: <ALIAS_NAME>/path/to/file.

Example: aliases: DATASETS: /data/datasets MODELS: s3://bucket/models

  • Config key: aliases

  • Environment variable: TLC_ALIAS_([A-Z][A-Z0-9_]*)

  • Python attribute: config.aliases

  • Default: {}

config.api_keyΒΆ

API key for cloud/SaaS authentication.

  • Config key: api-key

  • Environment variable: TLC_API_KEY

  • CLI argument: --api-key

  • Python attribute: config.api_key

  • Default: ''

  • Serialized to config file: no (credentials / runtime-only state)

config.display_progressΒΆ

Whether to display progress bars.

  • Config key: display-progress

  • Environment variable: TLC_DISPLAY_PROGRESS

  • CLI argument: --display-progress

  • Python attribute: config.display_progress

  • Default: True

config.licenseΒΆ

Specify license or license file.

The option can either be the license key or point to a local file containing the license key. Required for on-prem deployments.

  • Config key: license

  • Environment variable: TLC_LICENSE

  • CLI argument: --license

  • Python attribute: config.license

  • Default: ''

  • Serialized to config file: no (credentials / runtime-only state)

config.project_root_urlΒΆ

Location for reading and writing 3LC project data.

This option is mandatory and must point to a location with write access. Supports local paths and remote URLs (s3://, gs://, az://). Environment variables and ~ are expanded. The location will be created if needed.

  • Config key: project-root-url

  • Environment variable: TLC_PROJECT_ROOT_URL

    • Legacy aliases (honored with a deprecation warning): TLC_CONFIG_PROJECT_ROOT_URL

  • CLI argument: --project-root-url

  • Python attribute: config.project_root_url

  • Default: computed at runtime

  • Required: yes

config.scan_urlsΒΆ

Locations to scan for 3LC objects.

Each entry can be a plain URL string (defaults to layout: project) or a dict with explicit attributes:

scan-urls: # Plain string β€” scanned as a project tree - s3://bucket/projects - /local/projects

# Dict with explicit layout
- url: /local/loose-objects
  layout: flat

# Full control
- url: /data/tables-only
  layout: flat
  object_type: table

Supported layout values: β€œproject” (recursive project scan), β€œflat” (single directory). Supported object_type values: β€œtable”, β€œrun” (omit to scan for all types).

The TLC_SCAN_URLS environment variable accepts a comma-separated list of URL strings.

Live propagation. Mutations to scan-urls (via Configuration.append / Configuration.remove / file reload / env reload) write through to ConfigStore under its RLock. IndexingTable instances constructed with share_configuration=True (the default for the three subclass instance() factories) run reconcile_with_configuration() at the top of every scan cycle; when nothing has changed the reconcile is a cheap pair of dict comprehensions with two no-op diff loops. Callers wanting synchronous propagation can call indexer.reconcile_with_configuration() directly. Mutations are safe from any thread under ConfigStore’s RLock.

  • Config key: scan-urls

  • Environment variable: TLC_SCAN_URLS

    • Legacy aliases (honored with a deprecation warning): TLC_CONFIG_PROJECT_SCAN_URLS

  • Python attribute: config.scan_urls

  • Default: []

Logging (config.logging.*)ΒΆ

Options governing the 3LC logger.

config.logging.fileΒΆ

Log file path for the 3LC logger.

The directory will be created if it does not exist. Environment variables and ~ are expanded. Must be a local filesystem path (remote URLs not allowed).

  • Config key: logging.file

  • Environment variable: TLC_LOG_FILE

    • Legacy aliases (honored with a deprecation warning): TLC_LOGFILE

  • CLI argument: --log-file

  • Python attribute: config.logging.file

  • Default: computed at runtime

config.logging.levelΒΆ

Log level for the 3LC logger.

Standard Python logging levels:

  • DEBUG: Detailed diagnostic information

  • INFO: Confirmation that things are working

  • WARNING: Unexpected events (default)

  • ERROR: Serious problems

  • CRITICAL: Program may not continue

  • Config key: logging.level

  • Environment variable: TLC_LOG_LEVEL

    • Legacy aliases (honored with a deprecation warning): TLC_LOGLEVEL

  • CLI argument: --log-level

  • Python attribute: config.logging.level

  • Default: 'WARNING'

  • Choices: 'DEBUG', 'INFO', 'WARNING', 'ERROR', 'CRITICAL'

Indexing (config.indexing.*)ΒΆ

Options governing the indexer scan cadence and timestamp debouncing.

config.indexing.debounce_backoff_max_levelΒΆ

Maximum backoff level for timestamp debouncing.

Controls the upper limit of the exponential backoff for timestamp writes. Zero means no backoff for debouncing.

  • Config key: indexing.debounce-backoff-max-level

  • Environment variable: TLC_INDEXING_DEBOUNCE_BACKOFF_MAX_LEVEL

    • Legacy aliases (honored with a deprecation warning): TLC_INDEXING_TIMESTAMP_DEBOUNCE_BACKOFF_MAX_LEVEL

  • Python attribute: config.indexing.debounce_backoff_max_level

  • Default: 0

config.indexing.debounce_backoff_multiplierΒΆ

Multiplier for timestamp debounce backoff.

Controls how aggressively the debounce interval increases when multiple writes occur within the current interval.

  • Config key: indexing.debounce-backoff-multiplier

  • Environment variable: TLC_INDEXING_DEBOUNCE_BACKOFF_MULTIPLIER

    • Legacy aliases (honored with a deprecation warning): TLC_INDEXING_TIMESTAMP_DEBOUNCE_BACKOFF_MULTIPLIER

  • Python attribute: config.indexing.debounce_backoff_multiplier

  • Default: 1.2

config.indexing.debounce_backoff_thresholdΒΆ

Threshold for timestamp debouncing.

Controls the threshold for the exponential backoff for timestamp writes. The threshold is the number of writes that must occur within the debounce interval before the backoff is applied.

  • Config key: indexing.debounce-backoff-threshold

  • Environment variable: TLC_INDEXING_DEBOUNCE_BACKOFF_THRESHOLD

    • Legacy aliases (honored with a deprecation warning): TLC_INDEXING_TIMESTAMP_DEBOUNCE_BACKOFF_THRESHOLD

  • Python attribute: config.indexing.debounce_backoff_threshold

  • Default: 2

config.indexing.debounce_intervalΒΆ

Initial debounce interval for timestamp-file writing.

Controls the initial delay (in seconds) before writing timestamp files. This is part of a dynamic debounce system that adapts to write frequency.

  • Config key: indexing.debounce-interval

  • Environment variable: TLC_INDEXING_DEBOUNCE_INTERVAL

    • Legacy aliases (honored with a deprecation warning): TLC_INDEXING_TIMESTAMP_DEBOUNCE_INTERVAL

  • Python attribute: config.indexing.debounce_interval

  • Default: 2.0

config.indexing.scan_intervalΒΆ

The interval between indexer scans for new objects.

This option governs the overall responsiveness of the indexing system. The setting specifies how frequently (in seconds) the indexer will check for new or modified objects in the configured scan locations.

  • Config key: indexing.scan-interval

  • Environment variable: TLC_INDEXING_SCAN_INTERVAL

  • Python attribute: config.indexing.scan_interval

  • Default: 10.0

Extensions (config.extensions.*)ΒΆ

Lists of external classes loaded at service startup (URL adapters, sample types, exporters).

config.extensions.exportersΒΆ

Custom exporters to load on startup.

A list of dictionaries specifying custom exporter classes to load. Each dictionary should contain:

  • module: The fully qualified module name

  • class: The exporter class name

  • kwargs (optional): Constructor arguments

  • force (optional): If true, override an existing format

  • Config key: extensions.exporters

  • Python attribute: config.extensions.exporters

  • Default: []

config.extensions.sample_typesΒΆ

Custom sample types to load on startup.

A list of dictionaries specifying custom sample type classes to load. Each dictionary should contain:

  • module: The fully qualified module name

  • class: The sample type class name

  • name (optional): Registration name (defaults to the class name)

  • force (optional): If true, override an existing sample type with the same name

  • Config key: extensions.sample-types

  • Python attribute: config.extensions.sample_types

  • Default: []

config.extensions.url_adaptersΒΆ

Custom URL adapters to load on startup.

A list of dictionaries specifying custom URL adapter classes to load. Each dictionary should contain:

  • module: The fully qualified module name

  • class: The adapter class name

  • kwargs (optional): Constructor arguments

Example:

extensions: url-adapters: - module: my.custom.adapters class: MyAdapter kwargs: some_arg: value

  • Config key: extensions.url-adapters

  • Python attribute: config.extensions.url_adapters

  • Default: []

Object Service (config.service.*)ΒΆ

Options for the Object Service server.

config.service.auth_secretΒΆ

Shared secret for Dashboard/Object Service HMAC authentication.

Used by an on-prem Object Service to verify HMAC-signed requests from the Dashboard.

Not required when using an API key (which uses JWT authentication instead).

  • Config key: service.auth-secret

  • Environment variable: TLC_OBJECT_SERVICE_AUTH_SECRET

  • CLI argument: --auth-secret

  • Python attribute: config.service.auth_secret

  • Default: ''

  • Serialized to config file: no (credentials / runtime-only state)

config.service.cache.sizeΒΆ

Maximum size in bytes for the in-memory object cache.

Setting the value to 0 will disable in-memory caching. Default: 1073741824 (1 GB)

  • Config key: service.cache.size

  • CLI argument: --cache-size

  • Python attribute: config.service.cache.size

  • Default: 1073741824

config.service.cache.timeoutΒΆ

Cache item time-to-live in seconds.

Setting the value to 0 will disable cache eviction based on time. Default: 3600 (1 hour)

  • Config key: service.cache.timeout

  • CLI argument: --cache-timeout

  • Python attribute: config.service.cache.timeout

  • Default: 3600

config.service.disable_external_media_urlsΒΆ

Disable external self-authenticated media URLs.

By default the service may resolve media URLs (images, videos, audio) used by the dashboard into external self-authenticated URLs (e.g. S3 presigned, GCS signed, Azure SAS) so the browser can fetch directly from cloud storage. When this option is set, all such media URLs are instead served through this service via a token-authenticated proxy endpoint.

This is useful when the machine running the service can access the cloud storage but the machine(s) used to run the dashboard webapp cannot or should not do so.

  • Config key: service.disable-external-media-urls

  • Environment variable: TLC_SERVICE_DISABLE_EXTERNAL_MEDIA_URLS

  • CLI argument: --disable-external-media-urls

  • Python attribute: config.service.disable_external_media_urls

  • Default: False

config.service.hostΒΆ

Host address for the Object Service server.

  • Config key: service.host

  • Environment variable: TLC_SERVICE_HOST

  • CLI argument: --host

  • Python attribute: config.service.host

  • Default: '127.0.0.1'

config.service.portΒΆ

Port for the Object Service server.

  • Config key: service.port

  • Environment variable: TLC_SERVICE_PORT

  • CLI argument: --port

  • Python attribute: config.service.port

  • Default: 5015

config.service.watch_foldersΒΆ

Enable the watch service to monitor folders for external changes.

When enabled, the watch service monitors configured local folders and automatically updates timestamp files when changes are detected. Useful for monitoring changes made by processes outside of 3LC.

WARNING: Avoid monitoring mounted folders (FUSE mounts, cloud storage mounts) as they may cause performance issues or unexpected behavior.

  • Config key: service.watch-folders

  • CLI argument: --watch-local-folders

  • Python attribute: config.service.watch_folders

  • Default: False