original_docstring: NesT tiny version with sequence length 16 for 32x32 inputs.
docstring: NesT tiny version with sequence length 16 for 32x32 inputs.
docstring_tokens: NesT tiny version with sequence length 16 for 32x32 inputs .
code: def nest_tiny_s16_32(config):
    """NesT tiny version with sequence length 16 for 32x32 inputs."""
    nest = default_config()
    # Encode one pixel as a word vector.
    nest.init_patch_embed_size = 1
    # Default max sequencee length is 4x4=16, so it has 4 layers.
    nest.patch_size = 4
    nest.num_layers_per_block = [3, 3, 3, 3]
    nest.embedding_dim = 192
    nest.num_heads = 3
    nest.attn_type = "local_multi_query"
  
    if config.get("nest"):
      nest.update(config.nest)
    return functools.partial(NestNet, config=nest)
code_tokens: def nest_tiny_s16_32 ( config ) : nest = default_config ( ) nest . init_patch_embed_size = 1 nest . patch_size = 4 nest . num_layers_per_block = [ 3 , 3 , 3 , 3 ] nest . embedding_dim = 192 nest . num_heads = 3 nest . attn_type = "local_multi_query" if config . get ( "nest" ) : nest . update ( config . nest ) return functools . partial ( NestNet , config = nest )
short_docstring: NesT tiny version with sequence length 16 for 32x32 inputs.
short_docstring_tokens: NesT tiny version with sequence length 16 for 32x32 inputs .
comment: """NesT tiny version with sequence length 16 for 32x32 inputs."""$SEP$# Encode one pixel as a word vector.$SEP$# Default max sequencee length is 4x4=16, so it has 4 layers.