5 Best Ways to Convert CSV to TSV in Python

by

💡 Problem Formulation: This article addresses the challenge of converting data in Comma-Separated Values (CSV) format to Tab-Separated Values (TSV) using Python. CSV files, which delimit data with commas, need to be converted to TSV files where data fields are separated by tabs for compatibility with certain applications or systems. Let’s say you have an input CSV file “data.csv” with the contents “name,age\nAlice,30” and desire an output TSV file “data.tsv” with the contents “name age\nAlice 30”.

Method 1: Using the csv and csv.writer Libraries

This method involves using the Python csv library to read the CSV file and then write it to a TSV format with the help of the csv.writer class by specifying the delimiter as a tab. This method provides a clean and straightforward approach to handling CSV data and writing to a new TSV file, complete with error handling.

Here’s an example:

import csv

with open('data.csv', 'r') as csv_file, open('data.tsv', 'w', newline='') as tsv_file:
    csv_reader = csv.reader(csv_file)
    tsv_writer = csv.writer(tsv_file, delimiter='\t')
    
    for row in csv_reader:
        tsv_writer.writerow(row)

Output “data.tsv”:

name	age
Alice	30

This code snippet reads each row from the source CSV file and writes it to the destination TSV file using tabs as the delimiter. This ensures that each comma in the CSV is replaced by a tab in the TSV.

Method 2: Using the pandas Library

The pandas library in Python is a powerful tool for data manipulation and analysis. It allows for the easy conversion of CSV files to TSV by loading the data into a DataFrame and then saving that DataFrame to a TSV file. This method is especially useful for larger or more complex datasets.

Here’s an example:

import pandas as pd

data = pd.read_csv('data.csv')
data.to_csv('data.tsv', sep='\t', index=False)

Output “data.tsv”:

name	age
Alice	30

The code uses pandas to read the CSV file into a DataFrame and then saves the DataFrame to a TSV file, specifying a tab character as the separator and excluding the row indices from the output.

Method 3: Custom Python Function

A custom Python function can be written to manually replace the commas with tabs. This can be useful if you want to process the data or include additional logic during the conversion. It’s a more hands-on approach that does not rely on external libraries.

Here’s an example:

def csv_to_tsv(input_file_path, output_file_path):
    with open(input_file_path, 'r') as infile, open(output_file_path, 'w') as outfile:
        for line in infile:
            outfile.write(line.replace(',', '\t'))
                    
csv_to_tsv('data.csv', 'data.tsv')

Output “data.tsv”:

name	age
Alice	30

The function reads the input CSV file line by line, replaces commas with tabs, and writes the result to the output TSV file. This approach gives developers full control over the conversion process.

Method 4: Using the csv Module with a Dictionary Reader

The csv.DictReader and csv.DictWriter classes can be utilized for CSV to TSV conversion to work directly with dictionaries. This is particularly beneficial when the CSV file includes a header row, as it allows you to reference data by field names.

Here’s an example:

import csv

with open('data.csv', mode='r') as infile, open('data.tsv', mode='w', newline='') as outfile:
    reader = csv.DictReader(infile)
    writer = csv.DictWriter(outfile, fieldnames=reader.fieldnames, delimiter='\t')
    
    writer.writeheader()
    for row in reader:
        writer.writerow(row)

Output “data.tsv”:

name	age
Alice	30

In this snippet, the csv.DictReader reads the CSV into dictionaries, and the csv.DictWriter writes each dictionary to a TSV using tab delimiters. This method facilitates data manipulation by columns.

Bonus One-Liner Method 5: Using Command Line

For those comfortable using the command line, converting a CSV file to a TSV file can be done with a simple one-liner using Python commands directly in the terminal. This method is ideal for quick conversions without writing a script.

Here’s an example:

python -c "import csv, sys; csv.writer(sys.stdout, delimiter='\t').writerows(csv.reader(sys.stdin))" < data.csv > data.tsv

Output “data.tsv”: (command line output directly to the file)

This one-liner runs a Python command that reads from standard input (stdin), which is the CSV file, using csv.reader, and writes to standard output (stdout) with csv.writer, while setting the delimiter to a tab.

Summary/Discussion

  • Method 1: csv.reader and csv.writer. Simple and straightforward. May not handle complex data transformations well.
  • Method 2: pandas Library. Convenient for large datasets and data analysis. Requires pandas to be installed, which may be overkill for simple tasks.
  • Method 3: Custom Python Function. Fully customizable. May require additional error handling and is less efficient for large files.
  • Method 4: csv with a Dictionary Reader. Great for header-based operations. Similar to Method 1, but offers easier data manipulation by field names.
  • Method 5: Command Line One-Liner. Quick and does not require a Python script. Not as readable, and less practical for complex transformations or error handling.