Data Wizard
ST3/ST4 package for advanced data manipulation in delimited flat files (.csv, .psv, .tsv, .txt, .dat .etc). Supports auto detection of delimiters, Justification of delimited file, collapsing delimited files, pivoting delimited files, pop columns to end (cycling first column to end in pivoted data sets, see example), data masking(shuffle list, shuffle characters), data sampling, and converting datagrid to sql insert statements. This Package is especially helpful for ETL or any task that interfaces with delimited flat files in which you are constantly opening files and inspecting them. Allows for instant human readability and analysis.
Details
Installs
- Total 623
- Win 337
- Mac 212
- Linux 74
Feb 5 | Feb 4 | Feb 3 | Feb 2 | Feb 1 | Jan 31 | Jan 30 | Jan 29 | Jan 28 | Jan 27 | Jan 26 | Jan 25 | Jan 24 | Jan 23 | Jan 22 | Jan 21 | Jan 20 | Jan 19 | Jan 18 | Jan 17 | Jan 16 | Jan 15 | Jan 14 | Jan 13 | Jan 12 | Jan 11 | Jan 10 | Jan 9 | Jan 8 | Jan 7 | Jan 6 | Jan 5 | Jan 4 | Jan 3 | Jan 2 | Jan 1 | Dec 31 | Dec 30 | Dec 29 | Dec 28 | Dec 27 | Dec 26 | Dec 25 | Dec 24 | Dec 23 | |
---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
Windows | 0 | 0 | 0 | 0 | 0 | 1 | 1 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 1 | 0 | 0 | 0 | 0 | 0 | 1 | 0 | 0 | 0 | 0 | 0 | 0 | 1 | 0 | 1 | 0 | 0 | 2 | 1 | 0 | 0 | 3 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 |
Mac | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 1 | 1 |
Linux | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 1 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 |
Readme
- Source
- raw.githubusercontent.com
DataWizard
ST3/ST4 package for advanced data manipulation in delimited flat files (.csv, .psv, .tsv, .txt, .dat .etc). Supports auto detection of delimiters, Justification of delimited file, collapsing delimited files, pivoting delimited files, pop columns to end (cycling first column to end in pivoted data sets, see example), data masking(shuffle list, shuffle characters), data sampling, and converting datagrid to sql insert statements. This Package is especially helpful for ETL or any task that interfaces with delimited flat files in which you are constantly opening files and inspecting them. Allows for instant human readability and analysis. Notes: it's strongly recommended to key bind the justify, collapse, pivot, and pop commands. Recommended Key Bindings
//recommended bindings
// { "keys": ["alt+\\"], "command": "datawizardjustifycolumns"},
// { "keys": ["alt+shift+\\"], "command": "datawizardcollapsecolumns"},
// { "keys": ["alt+p"], "command": "datawizardpivot"},
// { "keys": ["alt+shift+p"], "command": "datawizardpivotjustify"},
// { "keys": ["alt+l"], "command": "datawizardpop"},
// { "keys": ["alt+s"], "command": "datawizarddistinctcolumns"},
// { "keys": ["alt+shift+s"], "command": "datawizarddistinctcolumnformats"},
// { "keys": ["alt+j"], "command": "datawizarddistinctcolumnstojson"},
// { "keys": ["alt+shift+j"], "command": "datawizarddistinctcolumnformatstojson"},
// { "keys": ["alt+i"], "command": "datawizardstatisticssampledelimiteddiffs"},
// { "keys": ["alt+q"], "command": "datawizardconverttosqlinsertpostgres"},
//not neccessary to map these but you can if wanted.
//sense these are less common i really just use the context menu for these actions by right clicking in the canvas
// {"keys":["alt+?"],"command":"datawizarddistinctchars"},
// {"keys":["alt+?"],"command":"datawizardkeepdelimiters"},
// {"keys":["alt+?"],"command":"datawizardleadingzerosadd"},
// {"keys":["alt+?"],"command":"datawizardleadingzerosremove"},
// {"keys":["alt+?"],"command":"datawizardsqltolowercaser"},
// {"keys":["alt+?"],"command":"datawizardpyvartotext"},
// {"keys":["alt+?"],"command":"datawizardrandomshufflecolumnvertically"},
// {"keys":["alt+?"],"command":"datawizardrandomshufflecharvertically"},
// {"keys":["alt+?"],"command":"datawizardconverttosqlinsert"},
// {"keys":["alt+?"],"command":"datawizardopenchrometab"},
// {"keys":["alt+?"],"command":"datawizardformatjson"},
Justify Collapse Columns (auto detects delimiters)
Pivot and Justify
Pop
Distinct Columns
Distinct Columns into Json
SQL Inserts(batched in groups of 1000) now supporting sql server and postgres syntax
LeadingZerosAddRemove
Shuffle Columns
Shuffle Characters vertically within equal length strings
Distinct Characters
Other misc function Read Py Variables