original_docstring: NesT base version with sequence length 16 for 32x32 inputs.
docstring: NesT base version with sequence length 16 for 32x32 inputs.
docstring_tokens: NesT base version with sequence length 16 for 32x32 inputs .
code: def nest_base_s16_32(config):
    """NesT base version with sequence length 16 for 32x32 inputs."""
    nest = default_config()
    nest.init_patch_embed_size = 1
    nest.patch_size = 4
    nest.num_layers_per_block = [3, 3, 3, 3]
    nest.embedding_dim = 768
    nest.num_heads = 12
    nest.attn_type = "local_multi_query"
  
    if config.get("nest"):
      nest.update(config.nest)
    return functools.partial(NestNet, config=nest)
code_tokens: def nest_base_s16_32 ( config ) : nest = default_config ( ) nest . init_patch_embed_size = 1 nest . patch_size = 4 nest . num_layers_per_block = [ 3 , 3 , 3 , 3 ] nest . embedding_dim = 768 nest . num_heads = 12 nest . attn_type = "local_multi_query" if config . get ( "nest" ) : nest . update ( config . nest ) return functools . partial ( NestNet , config = nest )
short_docstring: NesT base version with sequence length 16 for 32x32 inputs.
short_docstring_tokens: NesT base version with sequence length 16 for 32x32 inputs .
comment: """NesT base version with sequence length 16 for 32x32 inputs."""