Data Wizard
ST3/ST4 package for advanced data manipulation in delimited flat files (.csv, .psv, .tsv, .txt, .dat .etc). Supports auto detection of delimiters, Justification of delimited file, collapsing delimited files, pivoting delimited files, pop columns to end (cycling first column to end in pivoted data sets, see example), data masking(shuffle list, shuffle characters), data sampling, and converting datagrid to sql insert statements. This Package is especially helpful for ETL or any task that interfaces with delimited flat files in which you are constantly opening files and inspecting them. Allows for instant human readability and analysis.
Details
Installs
- Total 696
- Win 374
- Mac 234
- Linux 88
Oct 14 | Oct 13 | Oct 12 | Oct 11 | Oct 10 | Oct 9 | Oct 8 | Oct 7 | Oct 6 | Oct 5 | Oct 4 | Oct 3 | Oct 2 | Oct 1 | Sep 30 | Sep 29 | Sep 28 | Sep 27 | Sep 26 | Sep 25 | Sep 24 | Sep 23 | Sep 22 | Sep 21 | Sep 20 | Sep 19 | Sep 18 | Sep 17 | Sep 16 | Sep 15 | Sep 14 | Sep 13 | Sep 12 | Sep 11 | Sep 10 | Sep 9 | Sep 8 | Sep 7 | Sep 6 | Sep 5 | Sep 4 | Sep 3 | Sep 2 | Sep 1 | Aug 31 | |
---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
Windows | 0 | 2 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 2 | 0 | 1 | 2 | 0 | 0 | 1 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 2 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 |
Mac | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 1 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 1 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 |
Linux | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 1 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 |
Readme
- Source
- raw.githubusercontent.com
DataWizard
ST3/ST4 package for advanced data manipulation in delimited flat files (.csv, .psv, .tsv, .txt, .dat .etc). Supports auto detection of delimiters, Justification of delimited file, collapsing delimited files, pivoting delimited files, pop columns to end (cycling first column to end in pivoted data sets, see example), data masking(shuffle list, shuffle characters), data sampling, and converting datagrid to sql insert statements. This Package is especially helpful for ETL or any task that interfaces with delimited flat files in which you are constantly opening files and inspecting them. Allows for instant human readability and analysis. Notes: it's strongly recommended to key bind the justify, collapse, pivot, and pop commands. Recommended Key Bindings
//recommended bindings
// { "keys": ["alt+\\"], "command": "datawizardjustifycolumns"},
// { "keys": ["alt+shift+\\"], "command": "datawizardcollapsecolumns"},
// { "keys": ["alt+p"], "command": "datawizardpivot"},
// { "keys": ["alt+shift+p"], "command": "datawizardpivotjustify"},
// { "keys": ["alt+l"], "command": "datawizardpop"},
// { "keys": ["alt+s"], "command": "datawizarddistinctcolumns"},
// { "keys": ["alt+shift+s"], "command": "datawizarddistinctcolumnformats"},
// { "keys": ["alt+j"], "command": "datawizarddistinctcolumnstojson"},
// { "keys": ["alt+shift+j"], "command": "datawizarddistinctcolumnformatstojson"},
// { "keys": ["alt+i"], "command": "datawizardstatisticssampledelimiteddiffs"},
// { "keys": ["alt+q"], "command": "datawizardconverttosqlinsertpostgres"},
//not neccessary to map these but you can if wanted.
//sense these are less common i really just use the context menu for these actions by right clicking in the canvas
// {"keys":["alt+?"],"command":"datawizarddistinctchars"},
// {"keys":["alt+?"],"command":"datawizardkeepdelimiters"},
// {"keys":["alt+?"],"command":"datawizardleadingzerosadd"},
// {"keys":["alt+?"],"command":"datawizardleadingzerosremove"},
// {"keys":["alt+?"],"command":"datawizardsqltolowercaser"},
// {"keys":["alt+?"],"command":"datawizardpyvartotext"},
// {"keys":["alt+?"],"command":"datawizardrandomshufflecolumnvertically"},
// {"keys":["alt+?"],"command":"datawizardrandomshufflecharvertically"},
// {"keys":["alt+?"],"command":"datawizardconverttosqlinsert"},
// {"keys":["alt+?"],"command":"datawizardopenchrometab"},
// {"keys":["alt+?"],"command":"datawizardformatjson"},
Justify Collapse Columns (auto detects delimiters)
Pivot and Justify
Pop
Distinct Columns
Distinct Columns into Json
SQL Inserts(batched in groups of 1000) now supporting sql server and postgres syntax
LeadingZerosAddRemove
Shuffle Columns
Shuffle Characters vertically within equal length strings
Distinct Characters
Other misc function
Read Py Variables