
Already know some of this? A 2-minute test skips the lessons you know.
Take the placement testA free 16-lesson course built from Ansh Lamba's 3h 33m of YouTube video. 3 days at 90 minutes a day, with study notes and a quiz in every lesson. A 2-minute placement test skips what you already know.
Taught by Ansh Lamba on YouTube. Videos play in YouTube's own player, so the creator keeps every view.
Understand the course scope, target audience, and how Microsoft Fabric unifies data engineering, analytics, and science into a single platform replacing the fragmented Azure stack.
Learn the minimal prerequisites (basic SQL, Python, ETL concepts) and step-by-step creation of a free Azure account, Entra ID user, and Microsoft Fabric trial capacity (F64).
Navigate the Fabric portal, understand the OneLake abstraction layer, create workspaces and lakehouses, and distinguish between managed tables and external files.
Build a pipeline using the Copy Data activity with an HTTP connector (GitHub CSV), configure anonymous authentication, relative URL, CSV format, and upsert into a lakehouse table using a primary key.
Interpret common pipeline errors (missing file extension, upsert key column type), enable retry policies, and verify successful data load in the lakehouse.
Replace hard-coded values with pipeline parameters (array of dictionaries containing file name and primary key), use For Each activity, and access dictionary values via dot notation in dynamic content.
Create an Azure Storage Account (ADLS Gen2) with hierarchical namespace, upload a JSON config file, and use the Lookup activity to read configuration from the data lake into a pipeline.
Use Get Metadata (child items) to list files in a lakehouse folder, then apply For Each loop with If condition and String.Split/EndsWith functions to process only CSV files.
Create a Data Flow Gen2, connect to Lakehouse source, perform type conversions, add custom columns (DateTime.LocalNow), group by aggregation, and understand M script recording for repeatable transformations.
Distinguish Copy Data (full control, complex workflows) from Copy Job (lift-and-shift, incremental loading, CDC automation) and when to use each in production pipelines.
Build an orchestration pipeline that invokes child pipelines (EL and TL) in parallel, adds failure notifications via email on fail/skip, and validates end-to-end data integrity.
Configure daily schedule triggers with time zones, monitor pipeline runs, debug failures, and apply the 50% rerun rule for transient errors in production data engineering.