ETL: Transform Data with Node.js

Опубликовано: 25 Январь 2021
на канале: Hey Node
1,573
20

See the written version of this tutorial for links to prerequisites and related tutorials: https://heynode.com/tutorial/etl-tran...

The goal of the transform step in a Node ETL (Extract, Transform, Load) pipeline is to take the data from the data source and make it fit into the format we want it to be in for the destination. We can rename fields, add new fields, and filter out unnecessary data. Transforming the data in Node is simple once it’s been extracted.

In this example, we’ll be transforming planet records from the NASA Exoplanet API into a different, easier-to-use format. We can do this by renaming keys, removing data points we aren't interested in, and computing new values from existing values.

In this tutorial we'll:

Understand the benefits of transforming the service payload
List ways we can transform a payload in Node

Heynode.com: The best online Node.js courses and tutorials to help you solve hard problems fast.