🚀 TorchData 101: Master Data Loading in PyTorch Like a Pro!

Опубликовано: 27 Апрель 2022
на канале: Bitswired
2,278
60

👎🏽 Stop using Dataset + DataLoader.
✅ Load data like a pro using TorchData DataPipes!

Since PyTorch v1.11, TorchData is now in beta.
It's a module containing modular and composable data loading primitives.
In this video I will show you why the DataLoader "sucks" and how to use TorchData.

👉🏽 Link to the demo Notebook: https://github.com/bitswired/bitsof-a...

Hope you'll enjoy it!

🌐 Visit my blog at: https://www.bitswired.com

🔗 Socials:
LinkedIn:   / jimi-vaubien  
Twitter:   / bitswired  
Instagram:   / bitswired_  

00:00 Intro
00:21 What Is Data Loading?
00:55 The Problem With DataLoader
01:48 Intro To TorchData
03:38 Code Demo Setup
05:13 Load Data With DataLoader
06:52 Load Data Like A Pro With TorchData
08:55 Outro

Resources:
TorchData documentation: https://pytorch.org/data/beta/index.html
TorchData on GitHub: https://github.com/pytorch/data
[RFC] DataLoader architecture updates: https://github.com/pytorch/pytorch/is...