peal.architectures.interfaces.TransformerConfig

class peal.architectures.interfaces.TransformerConfig[source]

Bases: BaseModel

The config template for a transformer layer.

Methods

Attributes

config_name

The type of config.

num_blocks

Number of blocks per layer.

num_neurons

The number of neurons in the layer.
config_name: str = 'TransformerConfig'

The type of config. This is necessary to find config class from yaml config

num_neurons: pydantic.PositiveInt = 512

The number of neurons in the layer.

num_blocks: pydantic.PositiveInt = 2

Number of blocks per layer.