pytorch 反向求导
PyTorch 反向 求导
2023-09-14 09:15:52 时间
import torch
import math
dtype = torch.float
device = torch.device("cpu")
# device = torch.device("cuda:0") # Uncomment this to run on GPU
# Create random input and output data
x = torch.linspace(-math.pi, math.pi, 2000, device=device, dtype=dtype)
y = torch.sin(x)
# Randomly initialize weights
a = torch.randn((), device=device, dtype=dtype)
b = torch.randn((), device=device, dtype=dtype)
c = torch.randn((), device=device, dtype=dtype)
d = torch.randn((), device=device, dtype=dtype)
learning_rate = 1e-6
for t in range(2000):
# Forward pass: compute predicted y
y_pred = a + b * x + c * x ** 2 + d * x ** 3
# Compute and print loss
loss = (y_pred - y).pow(2).sum().item()
if t % 100 == 99:
print(t, loss)
# Backprop to compute gradients of a, b, c, d with respect to loss
grad_y_pred = 2.0 * (y_pred - y)
grad_a = grad_y_pred.sum()
grad_b = (grad_y_pred * x).sum()
grad_c = (grad_y_pred * x ** 2).sum()
grad_d = (grad_y_pred * x ** 3).sum()
# Update weights using gradient descent
a -= learning_rate * grad_a
b -= learning_rate * grad_b
c -= learning_rate * grad_c
d -= learning_rate * grad_d
print(f'Result: y = {a.item()} + {b.item()} x + {c.item()} x^2 + {d.item()} x^3')
相关文章
- 【PyTorch】教程:torch.nn.Tanh
- 【PyTorch】教程:torch.nn.Softshrink
- DL之IDE:深度学习环境安装之pytorch/torchvision版本和CUDA版本匹配(对应版本安装)、利用Pytorch查看自己电脑上CUDA版本及其相关信息之详细攻略
- pytorch和jittor 程序对比
- 【pytorch】.detach() .detach_() 和 .data==>用于切断反向传播
- pytorch矩阵乘法总结
- 【youcans的深度学习 D02】PyTorch例程:创建 LeNet 模型进行图像分类
- NLP自然语言处理-Pytorch情感分析简介
- 【PyTorch】 多进程队列中传入pytorch处理后的tensor张量
- 如何将pytorch模型部署到安卓
- Pytorch总结七之 深度学习的正向、反向传播原理+参数初始化+实战房价预测
- 【Pytorch】第 3 章 :进行数值估计的蒙特卡洛方法
- Pytorch房价预测
- Pytorch复现YoLo v-1
- pytorch 16 迁移学习核心技巧·从模型加载到按需初始化模块权重,再到各layer分组设置学习率