TabNetHyperparameters

Properties

batch_size

integer | object≥ 1

Batch size.

penalty

number | object≥ 0

Sparsity regularization penalty.

clip_value

number | object | null

Gradient clip value.

loss

string | object

Loss function. auto = set from outcome type.

epochs

integer | object≥ 1

Number of training epochs.

drop_last

boolean | object

Drop the last incomplete batch.

decision_width

integer | object | null≥ 1

Decision prediction layer width.

attention_width

integer | object | null≥ 1

Attention embedding width.

num_steps

integer | object≥ 1

Number of decision steps.

feature_reusage

number | object≥ 0

Feature reusage coefficient.

mask_type

string | object

Masking function.

one of"sparsemax""entmax"

virtual_batch_size

integer | object≥ 1

Virtual batch size (ghost batch normalization).

valid_split

number | object≥ 0< 1

Fraction of data used for (tabnet-internal) validation.

learn_rate

number | object> 0

Learning rate.

optimizer

string

Optimizer name, resolved by the tabnet backend.

lr_scheduler

string | null

Learning-rate scheduler. NULL = none.

one of"step""reduce_on_plateau"null

lr_decay

number | object≥ 0≤ 1

Learning rate decay.

step_size

integer | object≥ 1

Learning rate scheduler step size.

checkpoint_epochs

integer | object≥ 1

Checkpoint interval in epochs.

cat_emb_dim

integer | object≥ 1

Categorical embedding dimension.

num_independent

integer | object≥ 1

Number of independent GLU layers at each encoder step.

num_shared

integer | object≥ 1

Number of shared GLU layers at each encoder step.

num_independent_decoder

integer | object≥ 1

Number of independent GLU layers for pretraining.

num_shared_decoder

integer | object≥ 1

Number of shared GLU layers for pretraining.

momentum

number | object≥ 0

Momentum for batch normalization.

pretraining_ratio

number | object≥ 0≤ 1

Ratio of features to mask during pretraining.

device

string

Compute device.

one of"auto""cpu""cuda"

importance_sample_size

integer | object | null≥ 1

Sample size for importance calculation.

early_stopping_monitor

string | object

Metric monitored for early stopping.

one of"auto""valid_loss""train_loss"

early_stopping_tolerance

number | object≥ 0

Minimum relative improvement to reset the patience counter.

early_stopping_patience

integer | object≥ 0

Number of epochs without improvement before stopping.

num_workers

integer≥ 0

Number of subprocesses for data loading.

skip_importance

boolean

Skip importance calculation.

ifw

boolean | object

Inverse Frequency Weighting in classification.

Relationships