Releases: dataform-co/dataform
Releases · dataform-co/dataform
Release list
3.0.64
What's Changed
- Bump protobufjs from 7.6.3 to 7.6.5 by @dependabot[bot] in #2228
- feat(core): add lineage.enabled to WorkflowSettings and ProjectConfig by @rafal-hawrylak in #2235
- Integrate JiT compilation into CLI runtime by @rafal-hawrylak in #2211
- Bump DF_VERSION from 3.0.63 to 3.0.64 by @rafal-hawrylak in #2240
Full Changelog: 3.0.63...3.0.64
3.0.63
What's Changed
- feat(cli): node selection for dataform compile by @alandrebraga in #2212
- Publishing Dataform security patches by @dataform-team in #2237
New Contributors
- @alandrebraga made their first contribution in #2212
Full Changelog: 3.0.62...3.0.63
3.0.62
What's Changed
- Proto field additions for JiT flow by @rafal-hawrylak in #2182
- Update OSS test credentials by @mfiglus in #2216
- Move DefaultIcebergConfig message to avoid circular dependencies by @apilaskowski in #2104
- Support incremental_strategy parameter and new insert_overwrite strategy by @SuchodolskiEdvin in #2195
- Refactor Runner parameter overloads and resolve review comments by @rafal-hawrylak in #2210
- ISSUE-2103 Handle trailing and trailing statement comments by @spatel11 in #2108
- Fix JiT assertion compilation to accept object result shape by @rafal-hawrylak in #2221
- Bump fast-uri from 3.1.2 to 3.1.4 by @dependabot[bot] in #2231
- Bump node-forge from 1.3.1 to 1.4.0 by @dependabot[bot] in #2232
- Bump js-yaml from 3.14.2 to 4.3.0 by @dependabot[bot] in #2217
- Add ESLint rule blocking Node built-in imports in core/ by @rafal-hawrylak in #2229
- Preserve Governance Controls in Dataform. by @mohamed-saad in #2220
- Bump fast-xml-builder from 1.1.4 to 1.2.0 by @dependabot[bot] in #2162
- Bump DF_VERSION from 3.0.61 to 3.0.62 by @mohamed-saad in #2233
New Contributors
- @spatel11 made their first contribution in #2108
- @mohamed-saad made their first contribution in #2220
Full Changelog: 3.0.61...3.0.62
3.0.61
What's Changed
- Ignore trailing positional arguments in the global flag parser by @aicayzer in #2199
- Bump protobufjs-cli from 1.0.0 to 1.3.3 by @dependabot[bot] in #2202
- Bump js-yaml from 4.1.1 to 4.2.0 by @dependabot[bot] in #2205
- feat: add getContents() for reading external markdown files into table descriptions pr fix by @AmmanuelT in #2164
- Bump protobufjs from 7.5.8 to 7.6.3 by @dependabot[bot] in #2204
- support client certificate environment in gcloud actions by @kolina in #2213
- Prevent .sqlx files in actions.yaml configs with a clear error by @aicayzer in #2189
- Bump tmp from 0.2.4 to 0.2.7 by @dependabot[bot] in #2183
- Bump @tootallnate/once from 2.0.0 to 2.0.1 by @dependabot[bot] in #2171
- Bump fast-uri from 3.0.6 to 3.1.2 by @dependabot[bot] in #2161
- Publishing Dataform security patches by @dataform-team in #2215
New Contributors
Full Changelog: 3.0.60...3.0.61
3.0.60
What's Changed
- Bump vm2 from 3.11.3 to 3.11.4 by @dependabot[bot] in #2188
- Extract BigQueryClientProvider for injectable BQ clients by @rafal-hawrylak in #2181
- Bump protobufjs from 7.5.5 to 7.5.8 by @dependabot[bot] in #2172
- Add go_package option to db_adapter.proto and jit.proto by @kolina in #2197
- Migrate to bazel 7.3.2 by @ikholopov-omni in #2187
- Upgrade gcloud to 572.0.0 by @ikholopov-omni in #2207
- Add metadata field to AssertionConfig by @rafal-hawrylak in #2208
- Bump DF_VERSION from 3.0.59 to 3.0.60 by @rafal-hawrylak in #2209
Full Changelog: 3.0.59...3.0.60
3.0.59
What's Changed
- Guard workflow_settings.yaml and dataform.json require with existence check by @rafal-hawrylak in #2178
- Refactor CompileChildProcess to use BaseWorker by @rafal-hawrylak in #2179
- Rename worker timeout error to "Compilation timed out" by @rafal-hawrylak in #2186
- Extract task creation into executionSql helpers by @rafal-hawrylak in #2180
- Add JiT compilation support for assertion actions by @rafal-hawrylak in #2193
- Fix caller-file error (#2177) and enforce Core/CLI version match by @rafal-hawrylak in #2191
- Raise default compile timeout to 60s and improve timeout error message by @rafal-hawrylak in #2192
- Bump DF_VERSION from 3.0.58 to 3.0.59 by @rafal-hawrylak in #2194
Fixes
- Addresses a compilation failure ("
Error: Unable to find valid caller file") that occurred when using@dataform/cli3.0.57 or 3.0.58 with@dataform/core3.0.56 or earlier (Issue #2177). This fix ensures@dataform/cli3.0.59 and later is now compatible with older@dataform/coreversions (3.0.56 and earlier), and also improves version mismatch handling. (Implemented in #2191)
Full Changelog: 3.0.58...3.0.59
3.0.58
What's Changed
- Support onSchemaChange for incremental tables by @SuchodolskiEdvin in #2101
- feat: implement .jitCode() support for Assertion actions by @rafal-hawrylak in #2170
- fix: Resolve presubmit failure introduced by PR #2101 by @SuchodolskiEdvin in #2175
- Bump DF_VERSION from 3.0.57 to 3.0.58 by @rafal-hawrylak in #2176
New Contributors
- @SuchodolskiEdvin made their first contribution in #2101
Full Changelog: 3.0.57...3.0.58
3.0.57
🚨 Compatibility Issue - Compilation Failure 🚨
- This release introduced a compatibility issue when using
@dataform/cliversion 3.0.57 or 3.0.58 with@dataform/coreversion 3.0.56 (or earlier). - Symptoms: Users with this version mismatch will see
dataform compilefail with the error: "Error: Unable to find valid caller file; please report this issue.", as reported in issue #2177. Compilation halts, reporting "Compiled 0 action(s)". - Cause: This is due to changes in how file paths are handled, related to the
vm2sandbox library update in the CLI, which requires a corresponding@dataform/coreupdate. - Workarounds:
- Recommended: Ensure your project's
dataformCoreVersioninworkflow_settings.yamlis aligned with the installed@dataform/cliversion (e.g., both are 3.0.57 or later). - Alternatively, downgrade the CLI to match your Core version:
npm install -g @dataform/cli@3.0.56
- Recommended: Ensure your project's
- Resolution: This compatibility requirement is more strictly enforced in version
3.0.59to prevent this issue. Upgrading both@dataform/cliand your project'sdataformCoreVersionto 3.0.59 or later is recommended. Also starting from version 3.0.59 you can safely use it with@dataform/core3.0.56 or earlier.
What's Changed
- Add compilation error when trying to add unit tests for unsupported actions by @fernst in #2154
- Upgrade the affected packages to the latest by @Tuseeq1 in #2115
- JiT Worker in CLI and RPC infrastructure by @rafal-hawrylak in #2109
- Bump vm2 from 3.10.2 to 3.11.3 by @dependabot[bot] in #2168
- Bump DF_VERSION from 3.0.56 to 3.0.57 by @rafal-hawrylak in #2173
Full Changelog: 3.0.56...3.0.57
3.0.56
What's Changed
- Bump @google-cloud/bigquery 8.2.0 -> 8.3.0 by @apilaskowski in #2152
- Bump DF_VERSION from 3.0.55 to 3.0.56 by @apilaskowski in #2159
Full Changelog: 3.0.55...3.0.56
3.0.55
What's Changed
- Populate new unit test properties and add flag to include unit tests in compiled graph by @fernst in #2063
- Revert "feat: add getContents() for reading external markdown files into table descriptions (#2138)" by @kolina in #2155
- release new Dataform core version with GCP compilation fix by @kolina in #2156
Full Changelog: 3.0.54...3.0.55