Learn how to create your first pipeline in Azure Data Factory in this Data Factory Tutorial. I explain how to copy data from Data Lake Storage into an SQL Database. In the video I talk through how to setup Data Factory, configure linked services and datasets and finally the pipeline.
If you would like to follow along with the video you can copy and paste the below in to a file and save as CSV:
Firstname,Lastname,DOB
Tony,Fellows,19/07/1984
Christine,Burt,25/02/1967
Patricia,Martins,07/12/1979
Scripts to grant Data Factory access to SQL Database:
-- create login in master database
CREATE LOGIN [datafactory] WITH PASSWORD = 'd4t4f4ctory123!';
GO
-- create user in database
CREATE USER [datafactory];
GO
-- add user to role in database
ALTER ROLE db_owner ADD MEMBER [datafactory];
GO
-- create target table
CREATE TABLE dbo.Customers
(
FirstName VARCHAR(50) NULL,
LastName VARCHAR(50) NULL,
DOB VARCHAR(50) NULL
);
-- query table
SELECT
*
FROM dbo.Customers;