diff --git a/docs/sql-data-sources-csv.md b/docs/sql-data-sources-csv.md index 9dfe9739b7ac..03a2eac0cb43 100644 --- a/docs/sql-data-sources-csv.md +++ b/docs/sql-data-sources-csv.md @@ -231,7 +231,8 @@ Data source options of CSV can be set via: multiLine false - Allows a row to span multiple lines, by parsing line breaks within quoted values as part of the value itself. CSV built-in functions ignore this option. + Allows a row to span multiple lines, by parsing line breaks within quoted values as part of the value itself. CSV built-in functions ignore this option.
+ When this option is disabled, a line break inside a quoted value terminates the record at that break: the value is truncated, the remaining fields of the schema are set to null, and the rest of the value begins a new record. Both halves are malformed records, so what happens next follows mode: FAILFAST raises an error, DROPMALFORMED discards both halves and therefore loses the whole source record, and PERMISSIVE retains both, without any signal unless the schema declares columnNameOfCorruptRecord. Note also that the split increases the number of records, and that an action requiring no columns (a bare count(), for instance) may surface none of this, because of parser column pruning. read