ctrl+shift+p filters: :st2 :st3 :win :osx :linux
Browse

Data Wizard

by nickklaskala ALL

ST3/ST4 package for advanced data manipulation in delimited flat files (.csv, .psv, .tsv, .txt, .dat .etc). Supports auto detection of delimiters, Justification of delimited file, collapsing delimited files, pivoting delimited files, pop columns to end (cycling first column to end in pivoted data sets, see example), data masking(shuffle list, shuffle characters), data sampling, and converting datagrid to sql insert statements. This Package is especially helpful for ETL or any task that interfaces with delimited flat files in which you are constantly opening files and inspecting them. Allows for instant human readability and analysis.

Details

Installs

  • Total 600
  • Win 322
  • Mac 204
  • Linux 74
Nov 21 Nov 20 Nov 19 Nov 18 Nov 17 Nov 16 Nov 15 Nov 14 Nov 13 Nov 12 Nov 11 Nov 10 Nov 9 Nov 8 Nov 7 Nov 6 Nov 5 Nov 4 Nov 3 Nov 2 Nov 1 Oct 31 Oct 30 Oct 29 Oct 28 Oct 27 Oct 26 Oct 25 Oct 24 Oct 23 Oct 22 Oct 21 Oct 20 Oct 19 Oct 18 Oct 17 Oct 16 Oct 15 Oct 14 Oct 13 Oct 12 Oct 11 Oct 10 Oct 9 Oct 8
Windows 1 0 0 1 1 0 0 0 0 0 0 0 0 0 0 1 0 1 0 0 0 0 1 0 0 0 0 0 0 0 1 1 0 0 0 0 0 0 0 0 0 0 0 0 0
Mac 0 0 0 1 0 0 0 0 0 0 0 1 0 1 0 0 0 0 2 0 0 0 0 0 0 0 0 0 0 0 0 0 0 1 0 1 0 0 0 0 0 0 0 0 0
Linux 0 0 0 0 0 0 0 0 0 1 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0

Readme

Source
raw.​githubusercontent.​com

DataWizard

ST3/ST4 package for advanced data manipulation in delimited flat files (.csv, .psv, .tsv, .txt, .dat .etc). Supports auto detection of delimiters, Justification of delimited file, collapsing delimited files, pivoting delimited files, pop columns to end (cycling first column to end in pivoted data sets, see example), data masking(shuffle list, shuffle characters), data sampling, and converting datagrid to sql insert statements. This Package is especially helpful for ETL or any task that interfaces with delimited flat files in which you are constantly opening files and inspecting them. Allows for instant human readability and analysis. Notes: it's strongly recommended to key bind the justify, collapse, pivot, and pop commands. Recommended Key Bindings

//recommended bindings
// { "keys": ["alt+\\"],           "command": "datawizardjustifycolumns"},
// { "keys": ["alt+shift+\\"],     "command": "datawizardcollapsecolumns"},
// { "keys": ["alt+p"],            "command": "datawizardpivot"},
// { "keys": ["alt+shift+p"],      "command": "datawizardpivotjustify"},
// { "keys": ["alt+l"],            "command": "datawizardpop"},
// { "keys": ["alt+s"],            "command": "datawizarddistinctcolumns"},
// { "keys": ["alt+shift+s"],      "command": "datawizarddistinctcolumnformats"},
// { "keys": ["alt+j"],            "command": "datawizarddistinctcolumnstojson"},
// { "keys": ["alt+shift+j"],      "command": "datawizarddistinctcolumnformatstojson"},
// { "keys": ["alt+i"],            "command": "datawizardstatisticssampledelimiteddiffs"},
// { "keys": ["alt+q"],            "command": "datawizardconverttosqlinsertpostgres"},


//not neccessary to map these but you can if wanted.
//sense these are less common i really just use the context menu for these actions by right clicking in the canvas

// {"keys":["alt+?"],"command":"datawizarddistinctchars"},
// {"keys":["alt+?"],"command":"datawizardkeepdelimiters"},
// {"keys":["alt+?"],"command":"datawizardleadingzerosadd"},
// {"keys":["alt+?"],"command":"datawizardleadingzerosremove"},
// {"keys":["alt+?"],"command":"datawizardsqltolowercaser"},
// {"keys":["alt+?"],"command":"datawizardpyvartotext"},
// {"keys":["alt+?"],"command":"datawizardrandomshufflecolumnvertically"},
// {"keys":["alt+?"],"command":"datawizardrandomshufflecharvertically"},
// {"keys":["alt+?"],"command":"datawizardconverttosqlinsert"},
// {"keys":["alt+?"],"command":"datawizardopenchrometab"},
// {"keys":["alt+?"],"command":"datawizardformatjson"},

Justify Collapse Columns (auto detects delimiters) Justify_Collapse

Pivot and Justify Pivot_Justify

Pop pop

Distinct Columns Distinct_Columns

Distinct Columns into Json Distinct_Columns_JSON

SQL Inserts(batched in groups of 1000) now supporting sql server and postgres syntax SQLInserts

LeadingZerosAddRemove LeadingZerosAddRemove

Shuffle Columns ShuffleColumnVertically

Shuffle Characters vertically within equal length strings ShuffleCharsVertically

Distinct Characters Sample

Other misc function Read Py Variables PyVarToText