The tools nobody teaches

Pro lesson All levels

Docker for data engineers

Package a pipeline so it runs the same on your laptop, a server and the cloud. Build images, run containers, and make rebuilds fast.

15 min8 hands-on steps

In this lesson you will

  • Tell an image from a container
  • Build an image and run your pipeline in a container
  • Share a folder with a container, and order a Dockerfile so rebuilds are fast

Words you'll meet

Image
A packaged, read-only copy of a program and everything it needs. Built once, run anywhere.
Container
A running copy of an image. Throwaway: what it writes disappears when it stops.
Dockerfile
The recipe for an image: one instruction per line.
Volume
A folder shared between your machine and a container, so results survive.

The steps

Each step teaches one idea, then has you try it hands-on in your browser, and checks your work.

  1. 1The recipe
  2. 2Build an image
  3. 3Run a container
  4. 4Share a folder
  5. 5Throwaway by design
  6. 6Layers and the cache
  7. 7Slow things first
  8. 8Challenge

This lesson is part of LearnDE Pro

$12 a month or $100 a year: every lesson, spaced-repetition flashcards, and Learn by teaching. Refund on request within 14 days.