$
Lernen Linux-Handbuch
de
XP:0
Quest 114Data Munging Boss
+500 XP

Boss Challenge 13: Data Pipeline Normalization

Interaktives Terminal für diese Quest starten→Keine Installation erforderlich • Läuft im Browser

Konzept & Übersicht

ETL DATA INCIDENT: A legacy mainframe exported /home/learner/messy_data.csv using unconventional formatting: fields are separated by colons and rows end with semicolons (alice:dev:engineering;).

The analytics ingestion engine rejects this format. Transform the file into clean CSV format at /home/learner/clean_users.csv, containing only the user and department (fields 1 and 3) separated by commas (alice,engineering), with semicolons stripped.

Process /home/learner/messy_data.csv and write clean records into /home/learner/clean_users.csv formatted as name,dept without semicolons.

Befehlssyntax-Referenz

Command / SyntaxDescription
cat messy_data.csvView raw delimited data
awk / sed / cut / trFilter, translate delimiters, and cut fields
> clean_users.csvWrite normalized data to output file

Prüfungsziele

  • ○
    Generate /home/learner/clean_users.csv with clean comma-separated name,dept records

Bereit für Quest 114?