roadmap.sh: Data Engineer

What it is

roadmap.sh is a community-driven, open source site of visual learning paths. Its Data Engineer roadmap lays the field out as one map: programming (usually Python), SQL and databases, data modelling, data warehouses and data lakes, batch and streaming processing, workflow orchestration, infrastructure and cloud platforms, data quality and governance. Each node opens a short explanation with links to further reading, and signed-in users can mark nodes as done.

Who it is for

Students and early-career engineers who want to see the whole field before committing months to it, software engineers and analysts moving into data engineering who want to spot their gaps, and working data engineers checking what they have skipped. It suits anyone who likes to see the big picture first.

How to use it well

Do not try to learn every node in order. The map lists several tools for most jobs (several warehouses, several orchestrators, several streaming systems) because the industry uses all of them, but a junior role expects depth in one of each:

• Mark what you honestly know, meaning you could use it on a real dataset without notes.
• Pick one path: Python, strong SQL, one cloud, one warehouse, one orchestrator such as Airflow, dbt for transformation, and the basics of Spark and Kafka.
• Come back every few weeks to see what your next gap is, and compare it with real job descriptions in your market.

Is it worth your time?

As a map, yes. It shows the shape of the subject in one view and stops you from over-investing in one area, such as a third Python course, while never learning data modelling. It is not a course: the explanations are short, and real skill comes from building pipelines on real data. Some nodes cover tools that few entry-level roles ask for, so treat breadth on the map as a menu rather than a list of requirements.

Time needed

Skimming the map takes under an hour. Working through the core (Python, SQL, modelling, one cloud, orchestration, transformation, a portfolio pipeline) is usually several months of steady part-time study, longer if you are new to programming.

Common questions

Is it free? Yes. roadmap.sh offers some paid extras such as an AI tutor, but the roadmaps themselves are free to read.

Should I learn every tool on it? No. Learn the concepts behind each group (why an orchestrator exists, why columnar formats are fast) and one tool per group well. The concepts transfer when a new employer uses a different tool.

Where does the star count come from? The GitHub star figure above is the one roadmap.sh shows on its own pages for the whole project, as of 2026-09.