bigscience

/

bloom-megatron-deepspeed

like 1

Follow

BigScience Workshop 1.14k

• "typing.OrderedDict",
• "collections.OrderedDict",
• "torch._utils._rebuild_tensor_v2",
• "torch.FloatStorage",
• "deepspeed.runtime.bf16_optimizer.fragment_address"

How to fix it?

• "torch._utils._rebuild_tensor_v2",
• "torch.FloatStorage",
• "collections.OrderedDict",
• "typing.OrderedDict",
• "deepspeed.runtime.bf16_optimizer.fragment_address"

How to fix it?

• "torch._utils._rebuild_tensor_v2",
• "deepspeed.runtime.bf16_optimizer.fragment_address",
• "torch.FloatStorage",
• "collections.OrderedDict",
• "typing.OrderedDict"

How to fix it?

• "deepspeed.runtime.bf16_optimizer.fragment_address",
• "collections.OrderedDict",
• "torch._utils._rebuild_tensor_v2",
• "typing.OrderedDict",
• "torch.FloatStorage"

How to fix it?

• "collections.OrderedDict",
• "torch.FloatStorage",
• "deepspeed.runtime.bf16_optimizer.fragment_address",
• "typing.OrderedDict",
• "torch._utils._rebuild_tensor_v2"

How to fix it?

• "torch._utils._rebuild_tensor_v2",
• "collections.OrderedDict",
• "typing.OrderedDict",
• "deepspeed.runtime.bf16_optimizer.fragment_address",
• "torch.FloatStorage"

How to fix it?

• "torch.FloatStorage",
• "collections.OrderedDict",
• "typing.OrderedDict",
• "torch._utils._rebuild_tensor_v2",
• "deepspeed.runtime.bf16_optimizer.fragment_address"

How to fix it?

• "torch.FloatStorage",
• "collections.OrderedDict",
• "typing.OrderedDict",
• "torch._utils._rebuild_tensor_v2",
• "deepspeed.runtime.bf16_optimizer.fragment_address"

How to fix it?

• "deepspeed.runtime.bf16_optimizer.fragment_address",
• "typing.OrderedDict",
• "collections.OrderedDict",
• "torch._utils._rebuild_tensor_v2",
• "torch.FloatStorage"

How to fix it?

• "torch.FloatStorage",
• "collections.OrderedDict",
• "typing.OrderedDict",
• "torch._utils._rebuild_tensor_v2",
• "deepspeed.runtime.bf16_optimizer.fragment_address"

How to fix it?

• "torch.FloatStorage",
• "collections.OrderedDict",
• "typing.OrderedDict",
• "torch._utils._rebuild_tensor_v2",
• "deepspeed.runtime.bf16_optimizer.fragment_address"

How to fix it?

• "torch.FloatStorage",
• "collections.OrderedDict",
• "typing.OrderedDict",
• "torch._utils._rebuild_tensor_v2",
• "deepspeed.runtime.bf16_optimizer.fragment_address"

How to fix it?

• "torch.FloatStorage",
• "collections.OrderedDict",
• "typing.OrderedDict",
• "torch._utils._rebuild_tensor_v2",
• "deepspeed.runtime.bf16_optimizer.fragment_address"

How to fix it?

• "deepspeed.runtime.bf16_optimizer.fragment_address",
• "torch.FloatStorage",
• "typing.OrderedDict",
• "torch._utils._rebuild_tensor_v2",
• "collections.OrderedDict"

How to fix it?

• "collections.OrderedDict",
• "torch._utils._rebuild_tensor_v2",
• "deepspeed.runtime.bf16_optimizer.fragment_address",
• "torch.FloatStorage",
• "typing.OrderedDict"

How to fix it?

• "typing.OrderedDict",
• "deepspeed.runtime.bf16_optimizer.fragment_address",
• "torch.FloatStorage",
• "collections.OrderedDict",
• "torch._utils._rebuild_tensor_v2"

How to fix it?

• "torch.FloatStorage",
• "typing.OrderedDict",
• "torch._utils._rebuild_tensor_v2",
• "collections.OrderedDict",
• "deepspeed.runtime.bf16_optimizer.fragment_address"

How to fix it?

• "typing.OrderedDict",
• "deepspeed.runtime.bf16_optimizer.fragment_address",
• "collections.OrderedDict",
• "torch._utils._rebuild_tensor_v2",
• "torch.FloatStorage"

How to fix it?

• "torch._utils._rebuild_tensor_v2",
• "deepspeed.runtime.bf16_optimizer.fragment_address",
• "torch.FloatStorage",
• "collections.OrderedDict",
• "typing.OrderedDict"

How to fix it?

• "collections.OrderedDict",
• "torch._utils._rebuild_tensor_v2",
• "deepspeed.runtime.bf16_optimizer.fragment_address",
• "torch.FloatStorage",
• "typing.OrderedDict"

How to fix it?

• "collections.OrderedDict",
• "torch._utils._rebuild_tensor_v2",
• "typing.OrderedDict",
• "deepspeed.runtime.bf16_optimizer.fragment_address",
• "torch.FloatStorage"

How to fix it?

• "torch._utils._rebuild_tensor_v2",
• "deepspeed.runtime.bf16_optimizer.fragment_address",
• "collections.OrderedDict",
• "torch.FloatStorage",
• "typing.OrderedDict"

How to fix it?

• "deepspeed.runtime.bf16_optimizer.fragment_address",
• "typing.OrderedDict",
• "torch._utils._rebuild_tensor_v2",
• "collections.OrderedDict",
• "torch.FloatStorage"

How to fix it?

• "collections.OrderedDict",
• "deepspeed.runtime.bf16_optimizer.fragment_address",
• "torch._utils._rebuild_tensor_v2",
• "typing.OrderedDict",
• "torch.FloatStorage"

How to fix it?

• "collections.OrderedDict",
• "torch._utils._rebuild_tensor_v2",
• "deepspeed.runtime.bf16_optimizer.fragment_address",
• "torch.FloatStorage",
• "typing.OrderedDict"

How to fix it?

• "typing.OrderedDict",
• "deepspeed.runtime.bf16_optimizer.fragment_address",
• "torch.FloatStorage",
• "collections.OrderedDict",
• "torch._utils._rebuild_tensor_v2"

How to fix it?

• "typing.OrderedDict",
• "collections.OrderedDict",
• "torch._utils._rebuild_tensor_v2",
• "torch.FloatStorage",
• "deepspeed.runtime.bf16_optimizer.fragment_address"

How to fix it?

• "torch.FloatStorage",
• "typing.OrderedDict",
• "collections.OrderedDict",
• "deepspeed.runtime.bf16_optimizer.fragment_address",
• "torch._utils._rebuild_tensor_v2"

How to fix it?

• "deepspeed.runtime.bf16_optimizer.fragment_address",
• "torch.FloatStorage",
• "collections.OrderedDict",
• "typing.OrderedDict",
• "torch._utils._rebuild_tensor_v2"

How to fix it?

• "typing.OrderedDict",
• "deepspeed.runtime.bf16_optimizer.fragment_address",
• "collections.OrderedDict",
• "torch.FloatStorage",
• "torch._utils._rebuild_tensor_v2"

How to fix it?

• "torch.FloatStorage",
• "typing.OrderedDict",
• "torch._utils._rebuild_tensor_v2",
• "collections.OrderedDict",
• "deepspeed.runtime.bf16_optimizer.fragment_address"

How to fix it?

• "torch.FloatStorage",
• "torch._utils._rebuild_tensor_v2",
• "deepspeed.runtime.bf16_optimizer.fragment_address",
• "collections.OrderedDict",
• "typing.OrderedDict"

How to fix it?

• "torch._utils._rebuild_tensor_v2",
• "deepspeed.runtime.bf16_optimizer.fragment_address",
• "collections.OrderedDict",
• "torch.FloatStorage",
• "typing.OrderedDict"

How to fix it?

• "torch._utils._rebuild_tensor_v2",
• "deepspeed.runtime.bf16_optimizer.fragment_address",
• "collections.OrderedDict",
• "typing.OrderedDict",
• "torch.FloatStorage"

How to fix it?

• "torch._utils._rebuild_tensor_v2",
• "collections.OrderedDict",
• "typing.OrderedDict",
• "deepspeed.runtime.bf16_optimizer.fragment_address",
• "torch.FloatStorage"

How to fix it?

• "torch.FloatStorage",
• "collections.OrderedDict",
• "typing.OrderedDict",
• "deepspeed.runtime.bf16_optimizer.fragment_address",
• "torch._utils._rebuild_tensor_v2"

How to fix it?

• "typing.OrderedDict",
• "deepspeed.runtime.bf16_optimizer.fragment_address",
• "collections.OrderedDict",
• "torch.FloatStorage",
• "torch._utils._rebuild_tensor_v2"

How to fix it?

• "torch.FloatStorage",
• "torch._utils._rebuild_tensor_v2",
• "deepspeed.runtime.bf16_optimizer.fragment_address",
• "collections.OrderedDict",
• "typing.OrderedDict"

How to fix it?

• "deepspeed.runtime.bf16_optimizer.fragment_address",
• "typing.OrderedDict",
• "collections.OrderedDict",
• "torch._utils._rebuild_tensor_v2",
• "torch.FloatStorage"

How to fix it?

• "torch._utils._rebuild_tensor_v2",
• "collections.OrderedDict",
• "typing.OrderedDict",
• "deepspeed.runtime.bf16_optimizer.fragment_address",
• "torch.FloatStorage"

How to fix it?

• "deepspeed.runtime.bf16_optimizer.fragment_address",
• "collections.OrderedDict",
• "torch.FloatStorage",
• "torch._utils._rebuild_tensor_v2",
• "typing.OrderedDict"

How to fix it?

• "torch.FloatStorage",
• "collections.OrderedDict",
• "typing.OrderedDict",
• "deepspeed.runtime.bf16_optimizer.fragment_address",
• "torch._utils._rebuild_tensor_v2"

How to fix it?

• "typing.OrderedDict",
• "deepspeed.runtime.bf16_optimizer.fragment_address",
• "torch._utils._rebuild_tensor_v2",
• "collections.OrderedDict",
• "torch.FloatStorage"

How to fix it?

• "collections.OrderedDict",
• "deepspeed.runtime.bf16_optimizer.fragment_address",
• "typing.OrderedDict",
• "torch.FloatStorage",
• "torch._utils._rebuild_tensor_v2"

How to fix it?

• "torch.FloatStorage",
• "torch._utils._rebuild_tensor_v2",
• "deepspeed.runtime.bf16_optimizer.fragment_address",
• "collections.OrderedDict",
• "typing.OrderedDict"

How to fix it?

• "typing.OrderedDict",
• "deepspeed.runtime.bf16_optimizer.fragment_address",
• "torch._utils._rebuild_tensor_v2",
• "collections.OrderedDict",
• "torch.FloatStorage"

How to fix it?

• "deepspeed.runtime.bf16_optimizer.fragment_address",
• "torch._utils._rebuild_tensor_v2",
• "collections.OrderedDict",
• "typing.OrderedDict",
• "torch.FloatStorage"

How to fix it?

• "torch._utils._rebuild_tensor_v2",
• "deepspeed.runtime.bf16_optimizer.fragment_address",
• "collections.OrderedDict",
• "typing.OrderedDict",
• "torch.FloatStorage"

How to fix it?

• "torch.FloatStorage",
• "deepspeed.runtime.bf16_optimizer.fragment_address",
• "typing.OrderedDict",
• "collections.OrderedDict",
• "torch._utils._rebuild_tensor_v2"

How to fix it?