Skip to content

Repository files navigation

Simple Data Preparation Notebooks

This is a collection of simple browser based computational notebooks for performing some common data transformation and preparation tasks. These are primarily aimed at addressing some common data challenges, where the tools you might want to use require a different format to the data/materials you currently have.

These tools aim to have a simple user interface and basic configuration options to handle the most common problems, but certainly won't be able to address every need. They all run entirely in your browser: your data is never transferred outside your own computer. The complete source code for each tool is included and published under an open source licence, so you are welcome to inspect, modify, customise, or learn from as you so desire (however we do hope that the basic options covered are enough for most people).

The specific tools included are:

  • the Word Transcript Tabulator notebook. Takes a set of interview transcripts in Microsoft Word format (docx format only), and converts them into a structured Excel spreadsheet (xlsx format).
  • the Spreadsheet to Plaintext notebook. Upload a structured Excel spreadsheet (xlsx format), and choose which columns to pull out into separate text files.
  • the Document Text Extractor notebook. Takes a set of PDF and Word documents (docx format), and pulls out the text into either a set of plaintext files, or a structured format like a spreadsheet. This tool does not perform optical character recognition (OCR), but can work with the outputs of tools like Scribe OCR (also runs in your browser).

Please Cite

These tools have been built by Sam Hames as part of the Language Data Commons of Australia (LDaCA) research infrastructure project. If you use these tools, please cite them, and even better let us know how useful they were!

Acknowledgment

About

A collection of small tools for preparing language data for computational (text) analysis.

Resources

Contributing

Stars

0 stars

Watchers

0 watching

Forks

Releases

Packages

Contributors

Languages