索引

A

activation (deepspeed.inference.config.QuantizationConfig 属性) add_config_arguments() (在模块 deepspeed 中) allgather_bucket_size (deepspeed.runtime.zero.config.DeepSpeedZeroConfig 属性)

allgather_partitions (deepspeed.runtime.zero.config.DeepSpeedZeroConfig 属性) allreduce_tied_weight_gradients() (deepspeed.pipe.PipelineModule 方法) api_key (deepspeed.monitor.config.CometConfig 属性) autotuner (在模块 deepspeed.autotuning 中)

B

backward() (deepspeed.runtime.pipe.engine.PipelineEngine 方法) (在模块 deepspeed.DeepSpeedEngine 中) BackwardPass (deepspeed.runtime.pipe.schedule 中的类) base_dir (deepspeed.inference.config.DeepSpeedInferenceConfig 属性) (deepspeed.inference.config.InferenceCheckpointConfig 属性)

buffer_count (deepspeed.runtime.zero.config.DeepSpeedZeroOffloadOptimizerConfig 属性) (deepspeed.runtime.zero.config.DeepSpeedZeroOffloadParamConfig 属性) buffer_size (deepspeed.runtime.zero.config.DeepSpeedZeroOffloadParamConfig 属性) BufferOpInstruction (deepspeed.runtime.pipe.schedule 中的类) build() (deepspeed.pipe.LayerSpec 方法)

C

checkpoint (deepspeed.inference.config.DeepSpeedInferenceConfig 属性) checkpoint() (在模块 deepspeed.checkpointing 中) checkpoint_config (deepspeed.inference.config.DeepSpeedInferenceConfig 属性) checkpoint_dir (deepspeed.inference.config.InferenceCheckpointConfig 属性) CheckpointFunction (deepspeed.checkpointing 中的类) ckpt_layer_path() (deepspeed.pipe.PipelineModule 方法) ckpt_layer_path_list() (deepspeed.pipe.PipelineModule 方法) ckpt_prefix() (deepspeed.pipe.PipelineModule 方法) clone_tensors_for_torch_save() (在模块 deepspeed.checkpoint.utils 中)

config (deepspeed.inference.config.DeepSpeedInferenceConfig 属性) configure() (在模块 deepspeed.checkpointing 中) contiguous_gradients (deepspeed.runtime.zero.config.DeepSpeedZeroConfig 属性) convert_zero_checkpoint_to_fp32_state_dict() (在模块 deepspeed.utils.zero_to_fp32 中) copy_params_from() (deepspeed.zero.TiledLinear 方法) cpu_offload (deepspeed.runtime.zero.config.DeepSpeedZeroConfig 属性) cpu_offload_param (deepspeed.runtime.zero.config.DeepSpeedZeroConfig 属性) cpu_offload_use_pin_memory (deepspeed.runtime.zero.config.DeepSpeedZeroConfig 属性) CudaRNGStatesTracker (deepspeed.checkpointing 中的类)

D

DataParallelSchedule (deepspeed.runtime.pipe.schedule 中的类) deepspeed.profiling.flops_profiler.profiler 模块 deepspeed.runtime.pipe.engine 模块 deepspeed.runtime.pipe.schedule 模块

DeepSpeedCPUAdam (deepspeed.ops.adam 中的类) DeepSpeedTransformerConfig (deepspeed 中的类) DeepSpeedTransformerLayer (deepspeed 中的类) device (deepspeed.runtime.zero.config.DeepSpeedZeroOffloadOptimizerConfig 属性) (deepspeed.runtime.zero.config.DeepSpeedZeroOffloadParamConfig 属性) dtype (deepspeed.inference.config.DeepSpeedInferenceConfig 属性)

E

elastic_checkpoint (deepspeed.runtime.zero.config.DeepSpeedZeroConfig 属性) enable_cuda_graph (deepspeed.inference.config.DeepSpeedInferenceConfig 属性) enabled (deepspeed.inference.config.DeepSpeedMoEConfig 属性) (deepspeed.inference.config.DeepSpeedTPConfig 属性) (deepspeed.inference.config.QuantizationConfig 属性) (deepspeed.monitor.config.CometConfig 属性) (deepspeed.monitor.config.CSVConfig 属性) (deepspeed.monitor.config.TensorBoardConfig 属性) (deepspeed.monitor.config.WandbConfig 属性) end_profile() (deepspeed.profiling.flops_profiler.profiler.FlopsProfiler 方法) ep_group (deepspeed.inference.config.DeepSpeedInferenceConfig 属性) (deepspeed.inference.config.DeepSpeedMoEConfig 属性)

ep_mp_group (deepspeed.inference.config.DeepSpeedInferenceConfig 属性) (deepspeed.inference.config.DeepSpeedMoEConfig 属性) ep_size (deepspeed.inference.config.DeepSpeedInferenceConfig 属性) (deepspeed.inference.config.DeepSpeedMoEConfig 属性) estimate_zero2_model_states_mem_needs_all_cold() (在模块 deepspeed.runtime.zero.stage_1_and_2 中) estimate_zero2_model_states_mem_needs_all_live() (在模块 deepspeed.runtime.zero.stage_1_and_2 中) estimate_zero3_model_states_mem_needs_all_cold() (在模块 deepspeed.runtime.zero.stage3 中) estimate_zero3_model_states_mem_needs_all_live() (在模块 deepspeed.runtime.zero.stage3 中) eval_batch() (deepspeed.runtime.pipe.engine.PipelineEngine 方法) experiment_key (deepspeed.monitor.config.CometConfig 属性) experiment_name (deepspeed.monitor.config.CometConfig 属性)

F

fast_init (deepspeed.runtime.zero.config.DeepSpeedZeroOffloadOptimizerConfig 属性) filter_match() (deepspeed.runtime.pipe.ProcessTopology 方法) FlopsProfiler (deepspeed.profiling.flops_profiler.profiler 中的类) forward() (deepspeed.moe.layer.MoE 方法) (deepspeed.pipe.PipelineModule 方法) (deepspeed.runtime.pipe.engine.PipelineEngine 方法) (deepspeed.zero.TiledLinear 方法) (在模块 deepspeed.DeepSpeedEngine 中) (在模块 deepspeed.InferenceEngine 中)

ForwardPass (deepspeed.runtime.pipe.schedule 中的类) FusedAdam (deepspeed.ops.adam 中的类) FusedLamb (deepspeed.ops.lamb 中的类)

G

gather_16bit_weights_on_model_save (deepspeed.runtime.zero.config.DeepSpeedZeroConfig 属性) GatheredParameters (deepspeed.zero 中的类) get_additional_losses() (deepspeed.pipe.PipelineModule 方法) get_axis_comm_lists() (deepspeed.runtime.pipe.ProcessTopology 方法) get_axis_list() (deepspeed.runtime.pipe.ProcessTopology 方法) get_axis_names() (deepspeed.runtime.pipe.ProcessTopology 方法) get_coord() (deepspeed.runtime.pipe.ProcessTopology 方法) get_cuda_rng_tracker() (在模块 deepspeed.checkpointing 中) get_dim() (deepspeed.runtime.pipe.ProcessTopology 方法) get_dp_process_group() (deepspeed.zero.Init 方法)

get_fp32_state_dict_from_zero_checkpoint() (在模块 deepspeed.utils.zero_to_fp32 中) get_model_profile() (在模块 deepspeed.profiling.flops_profiler.profiler 中) get_partition_rank() (deepspeed.zero.Init 方法) get_rank() (deepspeed.runtime.pipe.ProcessTopology 方法) get_rank_repr() (deepspeed.runtime.pipe.ProcessTopology 方法) get_total_duration() (deepspeed.profiling.flops_profiler.profiler.FlopsProfiler 方法) get_total_flops() (deepspeed.profiling.flops_profiler.profiler.FlopsProfiler 方法) get_total_macs() (deepspeed.profiling.flops_profiler.profiler.FlopsProfiler 方法) get_total_params() (deepspeed.profiling.flops_profiler.profiler.FlopsProfiler 方法) group (deepspeed.monitor.config.WandbConfig 属性)

I

ignore_unused_parameters (deepspeed.runtime.zero.config.DeepSpeedZeroConfig 属性) InferenceSchedule (deepspeed.runtime.pipe.schedule 中的类) Init (deepspeed.zero 中的类) init_distributed() (在模块 deepspeed 中) init_inference() (在模块 deepspeed 中) initialize() (在模块 deepspeed 中) injection_policy (deepspeed.inference.config.DeepSpeedInferenceConfig 属性)

injection_policy_tuple (deepspeed.inference.config.DeepSpeedInferenceConfig 属性) is_configured() (在模块 deepspeed.checkpointing 中) is_first_stage (deepspeed.runtime.pipe.schedule.PipeSchedule 属性) is_first_stage() (deepspeed.runtime.pipe.engine.PipelineEngine 方法) is_gradient_accumulation_boundary() (deepspeed.runtime.pipe.engine.PipelineEngine 方法) (在模块 deepspeed.DeepSpeedEngine 中) is_last_stage (deepspeed.runtime.pipe.schedule.PipeSchedule 属性) is_last_stage() (deepspeed.runtime.pipe.engine.PipelineEngine 方法)

J

job_name (deepspeed.monitor.config.CSVConfig 属性) (deepspeed.monitor.config.TensorBoardConfig 属性)

L

LayerSpec (deepspeed.pipe 中的类) legacy_stage1 (deepspeed.runtime.zero.config.DeepSpeedZeroConfig 属性) load_checkpoint() (在模块 deepspeed.DeepSpeedEngine 中) load_from_fp32_weights (deepspeed.runtime.zero.config.DeepSpeedZeroConfig 属性)

load_module_state_dict() (deepspeed.runtime.pipe.engine.PipelineEngine 方法) load_state_dict_from_zero_checkpoint() (在模块 deepspeed.utils.zero_to_fp32 中) LoadMicroBatch (deepspeed.runtime.pipe.schedule 中的类) LRRangeTest (deepspeed.runtime.lr_schedules 中的类)

M

max_in_cpu (deepspeed.runtime.zero.config.DeepSpeedZeroOffloadParamConfig 属性) max_live_parameters (deepspeed.runtime.zero.config.DeepSpeedZeroConfig 属性) max_out_tokens (deepspeed.inference.config.DeepSpeedInferenceConfig 属性) max_reuse_distance (deepspeed.runtime.zero.config.DeepSpeedZeroConfig 属性) memory_efficient_linear (deepspeed.runtime.zero.config.DeepSpeedZeroConfig 属性) mics_hierarchical_params_gather (deepspeed.runtime.zero.config.DeepSpeedZeroConfig 属性) mics_shard_size (deepspeed.runtime.zero.config.DeepSpeedZeroConfig 属性) min_out_tokens (deepspeed.inference.config.DeepSpeedInferenceConfig 属性) mode (deepspeed.monitor.config.CometConfig 属性) model_parallel_cuda_manual_seed() (在模块 deepspeed.checkpointing 中) model_persistence_threshold (deepspeed.runtime.zero.config.DeepSpeedZeroConfig 属性) 模块 deepspeed.profiling.flops_profiler.profiler deepspeed.runtime.pipe.engine deepspeed.runtime.pipe.schedule

module_state_dict() (deepspeed.runtime.pipe.engine.PipelineEngine 方法) MoE (deepspeed.moe.layer 中的类) moe (deepspeed.inference.config.DeepSpeedInferenceConfig 属性) moe_experts (deepspeed.inference.config.DeepSpeedInferenceConfig 属性) (deepspeed.inference.config.DeepSpeedMoEConfig 属性) moe_type (deepspeed.inference.config.DeepSpeedInferenceConfig 属性) mp_size (deepspeed.inference.config.DeepSpeedInferenceConfig 属性) mpu (deepspeed.inference.config.DeepSpeedInferenceConfig 属性) (deepspeed.inference.config.DeepSpeedTPConfig 属性)

N

num_micro_batches (deepspeed.runtime.pipe.schedule.PipeSchedule 属性) num_pipe_buffers() (deepspeed.runtime.pipe.schedule.DataParallelSchedule 方法) (deepspeed.runtime.pipe.schedule.InferenceSchedule 方法) (deepspeed.runtime.pipe.schedule.PipeSchedule 方法) (deepspeed.runtime.pipe.schedule.TrainSchedule 方法)

num_stages (deepspeed.runtime.pipe.schedule.PipeSchedule 属性) nvme_path (deepspeed.runtime.zero.config.DeepSpeedZeroOffloadOptimizerConfig 属性) (deepspeed.runtime.zero.config.DeepSpeedZeroOffloadParamConfig 属性)

O

offload_optimizer (deepspeed.runtime.zero.config.DeepSpeedZeroConfig 属性) offload_param (deepspeed.runtime.zero.config.DeepSpeedZeroConfig 属性) OnebitAdam (deepspeed.runtime.fp16.onebit.adam 中的类) OnebitLamb (deepspeed.runtime.fp16.onebit.lamb 中的类) OneCycle (deepspeed.runtime.lr_schedules 中的类)

online (deepspeed.monitor.config.CometConfig 属性) OptimizerStep (deepspeed.runtime.pipe.schedule 中的类) output_path (deepspeed.monitor.config.CSVConfig 属性) (deepspeed.monitor.config.TensorBoardConfig 属性) overlap_comm (deepspeed.runtime.zero.config.DeepSpeedZeroConfig 属性) override_module_apply (deepspeed.runtime.zero.config.DeepSpeedZeroConfig 属性)

P

param_persistence_threshold (deepspeed.runtime.zero.config.DeepSpeedZeroConfig 属性) pin_memory (deepspeed.runtime.zero.config.DeepSpeedZeroOffloadOptimizerConfig 属性) (deepspeed.runtime.zero.config.DeepSpeedZeroOffloadParamConfig 属性) PipeInstruction (deepspeed.runtime.pipe.schedule 中的类) pipeline_loading_checkpoint (deepspeed.runtime.zero.config.DeepSpeedZeroConfig 属性) pipeline_read (deepspeed.runtime.zero.config.DeepSpeedZeroOffloadOptimizerConfig 属性) pipeline_write (deepspeed.runtime.zero.config.DeepSpeedZeroOffloadOptimizerConfig 属性) PipelineEngine (deepspeed.runtime.pipe.engine 中的类)

PipelineModule (deepspeed.pipe 中的类) PipeSchedule (deepspeed.runtime.pipe.schedule 中的类) prefetch_bucket_size (deepspeed.runtime.zero.config.DeepSpeedZeroConfig 属性) print_model_aggregated_profile() (deepspeed.profiling.flops_profiler.profiler.FlopsProfiler 方法) print_model_profile() (deepspeed.profiling.flops_profiler.profiler.FlopsProfiler 方法) ProcessTopology (deepspeed.runtime.pipe 中的类) project (deepspeed.monitor.config.CometConfig 属性) (deepspeed.monitor.config.WandbConfig 属性)

Q

qkv (deepspeed.inference.config.QuantizationConfig 属性)

quant (deepspeed.inference.config.DeepSpeedInferenceConfig 属性)

R

ratio (deepspeed.runtime.zero.config.DeepSpeedZeroOffloadOptimizerConfig 属性) RecvActivation (deepspeed.runtime.pipe.schedule 中的类) RecvGrad (deepspeed.runtime.pipe.schedule 中的类) reduce_bucket_size (deepspeed.runtime.zero.config.DeepSpeedZeroConfig 属性) reduce_scatter (deepspeed.runtime.zero.config.DeepSpeedZeroConfig 属性) ReduceGrads (deepspeed.runtime.pipe.schedule 中的类) ReduceTiedGrads (deepspeed.runtime.pipe.schedule 中的类)

register_external_parameter() (在模块 deepspeed.zero 中) replace_method (deepspeed.inference.config.DeepSpeedInferenceConfig 属性) replace_with_kernel_inject (deepspeed.inference.config.DeepSpeedInferenceConfig 属性) reset() (在模块 deepspeed.checkpointing 中) reset_activation_shape() (deepspeed.runtime.pipe.engine.PipelineEngine 方法) reset_profile() (deepspeed.profiling.flops_profiler.profiler.FlopsProfiler 方法) return_tuple (deepspeed.inference.config.DeepSpeedInferenceConfig 属性) round_robin_gradients (deepspeed.runtime.zero.config.DeepSpeedZeroConfig 属性)

S

safe_get_full_fp32_param() (在模块 deepspeed.utils 中) safe_get_full_grad() (在模块 deepspeed.utils 中) safe_get_full_optimizer_state() (在模块 deepspeed.utils 中) safe_get_local_fp32_param() (在模块 deepspeed.utils 中) safe_get_local_grad() (在模块 deepspeed.utils 中) safe_get_local_optimizer_state() (在模块 deepspeed.utils 中) safe_set_full_fp32_param() (在模块 deepspeed.utils 中) safe_set_full_optimizer_state() (在模块 deepspeed.utils 中) safe_set_local_fp32_param() (在模块 deepspeed.utils 中) safe_set_local_optimizer_state() (在模块 deepspeed.utils 中) samples_log_interval (deepspeed.monitor.config.CometConfig 属性) save_16bit_model() (在模块 deepspeed.DeepSpeedEngine 中) save_checkpoint() (在模块 deepspeed.DeepSpeedEngine 中) save_mp_checkpoint_path (deepspeed.inference.config.DeepSpeedInferenceConfig 属性) (deepspeed.inference.config.InferenceCheckpointConfig 属性)

SendActivation (deepspeed.runtime.pipe.schedule 中的类) SendGrad (deepspeed.runtime.pipe.schedule 中的类) set_batch_fn() (deepspeed.runtime.pipe.engine.PipelineEngine 方法) set_dataiterator() (deepspeed.runtime.pipe.engine.PipelineEngine 方法) set_empty_params (deepspeed.inference.config.DeepSpeedInferenceConfig 属性) set_train_batch_size() (deepspeed.runtime.pipe.engine.PipelineEngine 方法) stage (deepspeed.runtime.pipe.schedule.PipeSchedule 属性) (deepspeed.runtime.zero.config.DeepSpeedZeroConfig 属性) stage3_gather_fp16_weights_on_model_save (deepspeed.runtime.zero.config.DeepSpeedZeroConfig 属性) start_profile() (deepspeed.profiling.flops_profiler.profiler.FlopsProfiler 方法) step() (deepspeed.runtime.pipe.engine.PipelineEngine 方法) (在模块 deepspeed.DeepSpeedEngine 中) steps() (deepspeed.runtime.pipe.schedule.PipeSchedule 方法) stop_profile() (deepspeed.profiling.flops_profiler.profiler.FlopsProfiler 方法) sub_group_size (deepspeed.runtime.zero.config.DeepSpeedZeroConfig 属性)

T

team (deepspeed.monitor.config.WandbConfig 属性) tensor_parallel (deepspeed.inference.config.DeepSpeedInferenceConfig 属性) TiedLayerSpec (deepspeed.pipe 中的类) TiledLinear (deepspeed.zero 中的类) topology() (deepspeed.pipe.PipelineModule 方法) tp_group (deepspeed.inference.config.DeepSpeedTPConfig 属性) tp_size (deepspeed.inference.config.DeepSpeedTPConfig 属性)

train_batch() (deepspeed.runtime.pipe.engine.PipelineEngine 方法) training_mp_size (deepspeed.inference.config.DeepSpeedInferenceConfig 属性) TrainSchedule (deepspeed.runtime.pipe.schedule 中的类) transposed_mode (deepspeed.inference.config.DeepSpeedInferenceConfig 属性) triangular_masking (deepspeed.inference.config.DeepSpeedInferenceConfig 属性) triton_autotune (deepspeed.inference.config.DeepSpeedInferenceConfig 属性) type (deepspeed.inference.config.DeepSpeedMoEConfig 属性)

U

use_all_reduce_for_fetch_params (deepspeed.runtime.zero.config.DeepSpeedZeroConfig 属性)

use_multi_rank_bucket_allreduce (deepspeed.runtime.zero.config.DeepSpeedZeroConfig 属性) use_triton (deepspeed.inference.config.DeepSpeedInferenceConfig 属性)

W

WarmupCosineLR (deepspeed.runtime.lr_schedules 中的类) WarmupDecayLR (deepspeed.runtime.lr_schedules 中的类)

WarmupLR (deepspeed.runtime.lr_schedules 中的类) weight (deepspeed.inference.config.QuantizationConfig 属性) workspace (deepspeed.monitor.config.CometConfig 属性)

Z

zero (deepspeed.inference.config.DeepSpeedInferenceConfig 属性) zero_hpz_partition_size (deepspeed.runtime.zero.config.DeepSpeedZeroConfig 属性) zero_quantized_gradients (deepspeed.runtime.zero.config.DeepSpeedZeroConfig 属性)

zero_quantized_nontrainable_weights (deepspeed.runtime.zero.config.DeepSpeedZeroConfig 属性) zero_quantized_weights (deepspeed.runtime.zero.config.DeepSpeedZeroConfig 属性) ZeroOneAdam (deepspeed.runtime.fp16.onebit.zoadam 中的类)