Commit Graph
1551 Commits
Author SHA1 Message Date
dependabot[bot] 16927afd7a Bump the github-actions group across 1 directory with 5 updates
Bumps the github-actions group with 5 updates in the / directory:

| Package | From | To |
| --- | --- | --- |
| [actions/checkout](https://github.com/actions/checkout) | `7` | `7` |
| [actions/setup-node](https://github.com/actions/setup-node) | `7` | `7` |
| [astral-sh/setup-uv](https://github.com/astral-sh/setup-uv) | `7` | `7` |
| [actions/upload-artifact](https://github.com/actions/upload-artifact) | `7` | `7` |
| [actions/download-artifact](https://github.com/actions/download-artifact) | `8` | `8` |



Updates `actions/checkout` from 7 to 7
- [Release notes](https://github.com/actions/checkout/releases)
- [Changelog](https://github.com/actions/checkout/blob/main/CHANGELOG.md)
- [Commits](https://github.com/actions/checkout/compare/v7...3d3c42e5aac5ba805825da76410c181273ba90b1)

Updates `actions/setup-node` from 7 to 7
- [Release notes](https://github.com/actions/setup-node/releases)
- [Commits](https://github.com/actions/setup-node/compare/v7...949feb2413d6458794dcd2491c4babbbce0c15c1)

Updates `astral-sh/setup-uv` from 7 to 7
- [Release notes](https://github.com/astral-sh/setup-uv/releases)
- [Commits](https://github.com/astral-sh/setup-uv/compare/v7...37802adc94f370d6bfd71619e3f0bf239e1f3b78)

Updates `actions/upload-artifact` from 7 to 7
- [Release notes](https://github.com/actions/upload-artifact/releases)
- [Commits](https://github.com/actions/upload-artifact/compare/v7...cf430e030ddbb5b0abf93d22962f4752f3646cd9)

Updates `actions/download-artifact` from 8 to 8
- [Release notes](https://github.com/actions/download-artifact/releases)
- [Commits](https://github.com/actions/download-artifact/compare/v8...9000827ccba6bdab643e8b6fd33ac0654aef8333)

---
updated-dependencies:
- dependency-name: actions/checkout
  dependency-version: '7'
  dependency-type: direct:production
  update-type: version-update:semver-patch
  dependency-group: github-actions
- dependency-name: actions/download-artifact
  dependency-version: '8'
  dependency-type: direct:production
  update-type: version-update:semver-patch
  dependency-group: github-actions
- dependency-name: actions/setup-node
  dependency-version: '7'
  dependency-type: direct:production
  update-type: version-update:semver-patch
  dependency-group: github-actions
- dependency-name: actions/upload-artifact
  dependency-version: '7'
  dependency-type: direct:production
  update-type: version-update:semver-patch
  dependency-group: github-actions
- dependency-name: astral-sh/setup-uv
  dependency-version: '7'
  dependency-type: direct:production
  update-type: version-update:semver-patch
  dependency-group: github-actions
...

Signed-off-by: dependabot[bot] <support@github.com>
2026-11-02 14:12:04 +00:00
Chenglong Wang af33eaad71 update Flint version and map 2026-10-30 15:56:35 -07:00
zhb-ai d8e0d80b56 fix(superset): honor exchange secret and allow reconnect after disconnect
- Send X-DF-Exchange-Secret from PLG_SUPERSET_EXCHANGE_SECRET in both
  token exchange paths (SupersetAuthBridge and TokenStore), so a shared
  secret configured on Superset no longer causes silent 403s
- Log SSO exchange failures at warning level with the underlying error
  instead of swallowing them at debug level
- Lift the SSO reconnect block when a user explicitly connects a
  connector, so reconnecting works without logging out of SSO
- Clarify CORS guidance in the Superset example config

Tests: tests/backend/auth/test_token_store.py,
tests/backend/data/test_data_connector_framework.py (83 passed)
2026-10-29 19:33:35 +08:00
Chenglong Wang 5c99a2d0a9 ok 2026-10-29 00:27:57 -07:00
Chenglong Wang 1ce19da6bd fixes and improvements 2026-10-28 15:34:32 -07:00
Chenglong Wang 56026049f6 new demo sets 2026-10-27 17:30:33 -07:00
Chenglong WangandCopilot 7b24fcb1fd Single-user mode and plugins follow the real listening address
Single-user localhost mode was decided at import from HOST (default
127.0.0.1), before the CLI parsed --host, so a server started with
--host 0.0.0.0 (as the Docker image is) treated every network client as
the machine owner (MSRC 168681, 156375).

- The CLI re-decides the mode once --host is known; under a WSGI server
  the address is unknown, so HOST must name a loopback address.
- DF_SINGLE_USER=1 keeps single-user mode where access is restricted
  another way; docker-compose sets it and publishes the port on 127.0.0.1.
- Data-loader plugins load only in single-user mode or with
  DF_ALLOW_PLUGINS=1, after the mode is final (MSRC 116889). Previously
  the gate read WORKSPACE_BACKEND, which DISABLE_DATABASE does not set.

Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com>
2026-10-27 11:00:00 -07:00
Chenglong WangandCopilot cfe35b9962 DISABLE_DATABASE turns the credential vault off by default
The demo preset keeps no credentials, so it no longer creates a vault key and
database on disk. CREDENTIAL_VAULT=local keeps the vault for configured
connections that store secrets.

Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com>
2026-10-27 08:31:36 -07:00
Chenglong WangandCopilot ac7c7fa24a Document DF_SANDBOX_IDLE_SECONDS
Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com>
2026-10-27 06:19:26 -07:00
Chenglong WangandCopilot a26c0c1512 Reap idle sandbox workers and log sandbox isolation under app:app
Each isolated worker is a separate ~200 MB interpreter. On multi-user servers
with many gunicorn processes, idle workers now expire (DF_SANDBOX_IDLE_SECONDS,
default 120 s; 600 s in local mode) and each process keeps at most two used
workers idle; prewarmed workers are not counted.

The startup sandbox isolation line uses the data_formulator.sandbox logger so
it is emitted when gunicorn loads the module as top-level 'app'.

Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com>
2026-10-27 04:03:22 -07:00
Chenglong WangandCopilot 9960fc964c sandbox: find bundled bwrap when DF_SANDBOX_BWRAP is stale; keep the server's import path in workers
App Service builds with Oryx run the app from an extracted copy under /tmp/<id>,
so a DF_SANDBOX_BWRAP pointing at /home/site/wwwroot no longer exists. Expand
$VARS in the setting and fall through to PATH and the bundled binary when the
configured path is missing.

Workers now start with -s -P instead of -I and receive the server's import
directories as PYTHONPATH (allowlisted environment), which the audit hook also
treats as library roots, so PYTHONPATH-based virtualenvs keep working.

Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com>
2026-10-27 02:21:24 -07:00
Chenglong Wang 05e5d527c6 fixes 2026-10-26 23:41:00 -07:00
Chenglong Wang 54957ec67c Merge pull request #501 from MohammedAlkindi/docs/path-safety-drop-cached-azure-blob
docs(dev-guides): drop the row for the removed cached_azure_blob_workspace.py
2026-10-26 19:52:34 -07:00
Chenglong Wang ef1b4168a1 background process stuff 2026-10-26 18:19:52 -07:00
Chenglong Wang 0e68c0e2c5 update tools for efficiency 2026-10-22 22:01:08 -07:00
Mohammed Alkindi 36734e46fc docs(dev-guides): drop the row for the removed cached_azure_blob_workspace.py
The migration list in 8-path-safety.md still names
cached_azure_blob_workspace.py and its _cache_path method. Neither
exists in the tree: only azure_blob_workspace.py and
azure_blob_workspace_manager.py are present, and nothing defines
_cache_path.
2026-10-22 20:27:41 -07:00
Chenglong Wang 0a70b4de7d some setups 2026-10-21 17:33:39 -07:00
Chenglong Wang 3a81aa6e62 demonstration 2026-10-21 16:47:00 -07:00
y-agent-aiandClaude Sonnet 4.6 78c84a3a51 fix: avoid secure-context-only APIs breaking HTTP deployments
Replace direct crypto.randomUUID() calls in the conversation-root and workflow reply/send paths with the existing generateUUID() helper, and guard navigator.clipboard with optional chaining. Both APIs are unavailable in non-secure contexts (HTTP + IP), where they throw and abort message sending before the request is issued.

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>
2026-10-22 00:06:18 +08:00
Chenglong Wang fd1e233b31 tabs, plan, auto running 2026-10-16 18:22:28 -07:00
Chenglong Wang 92edd620c0 Merge pull request #453 from MohammedAlkindi/fix/local-folder-loader-jail-guard
fix(local-folder-loader): lazily build _jail in ls and get_metadata
2026-10-13 16:44:00 -07:00
Chenglong WangandCopilot c947297332 Merge dev; build the local folder jail through one helper
Merge dev (the test conflict was a neighbouring test dev removed). Instead
of repeating the lazy `_jail` guard in ls and get_metadata, every method now
gets the jail from `_root_jail()`, which builds it on first use; this also
replaces the four copies of the guard dev already had.

Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com>
2026-10-13 16:43:27 -07:00
Chenglong Wang fce6fee0ef Merge pull request #482 from mastartm/docs/remove-catalog-annotations
docs: remove stale catalog annotations from catalog-metadata-sync guide
2026-10-13 16:23:44 -07:00
Chenglong WangandCopilot 9a055c0f54 docs: name find_catalog_cache in the catalog search section
Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com>
2026-10-13 16:23:28 -07:00
Chenglong Wang 241d74afb6 Merge pull request #481 from MohammedAlkindi/fix/workflows-read-utf8
fix(workflows): read checkpoints and inbox as utf-8
2026-10-13 16:20:20 -07:00
Chenglong Wang 8150c88a13 Merge pull request #479 from MohammedAlkindi/docs/agent-knowledge-guide-workflows-rename
docs(dev-guides): update knowledge guide for the workflows rename
2026-10-13 16:20:16 -07:00
Chenglong Wang 3437401e86 Merge pull request #478 from MohammedAlkindi/docs/drop-stale-path-safety-rows
docs(dev-guides): drop path-safety rows for the removed agent_data_loading_chat.py
2026-10-13 16:20:11 -07:00
Chenglong Wang 25fd45d19f Merge pull request #477 from MohammedAlkindi/fix/connectors-yaml-utf8
fix(data-connector): open connectors.yaml as utf-8
2026-10-13 16:20:06 -07:00
Chenglong Wang 335a4d049d Merge pull request #475 from fazelllyyy/feat/locale-de-fr-ko
Add German (de), French (fr) and Korean (ko) locales; refine Japanese (ja)
2026-10-13 16:11:57 -07:00
Chenglong WangandCopilot 162761a88d Merge dev into feat/locale-de-fr-ko; sync locales with dev
Resolve the ja conflicts (keep the PR's wording, take dev's added and removed
keys), translate the 38 keys dev added since this branch for de/fr/ko, drop
the keys dev removed, update deviceCodeInstructions to dev's new text, and add
the two new htmlApp keys to ja/zh/hi/id so every locale matches en.

Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com>
2026-10-13 16:11:23 -07:00
Chenglong Wang cba502e556 major refactor on agent runtime 2026-10-13 15:57:36 -07:00
Burak Kaan Gök 5aad05eb8c docs: remove stale catalog annotations from catalog-metadata-sync guide
The annotations feature was removed (data_connector.py: "User annotations
were removed in favor of source-system metadata only"), but the dev guide
still documented its files, endpoints, error codes and storage format.

Prune the annotation/merge material and keep the sync, cache and table_key
content, which is still accurate.

Fixes #480
2026-10-13 19:21:51 +03:00
Mohammed Alkindi 2136ffa9d0 docs(dev-guides): update knowledge guide for the workflows rename
The guide still described the removed experiences feature: ExperienceDistillAgent, /distill-experience, SaveExperienceButton and knowledge/experiences/. Point it at WorkflowDistillAgent, /distill-workflow, the session-scoped SessionDistill flow and knowledge/workflows/.
2026-10-12 16:13:44 -07:00
Mohammed Alkindi 6de757d4f9 docs(dev-guides): drop path-safety rows for the removed agent_data_loading_chat.py
agent_data_loading_chat.py and tests/backend/agents/test_tool_path_safety.py
no longer exist, so the six ConfinedDir migration rows and the reference
test bullet in 8-path-safety.md pointed at nothing.
2026-10-12 16:12:46 -07:00
Mohammed Alkindi 40f9c96888 fix(workflows): read checkpoints and inbox as utf-8
Checkpoints and the message inbox are written as UTF-8, but several readers used the locale encoding, so non-ASCII text raised UnicodeDecodeError or came back as mojibake on Windows.
2026-10-12 15:47:31 -07:00
Mohammed Alkindi 4b561ceccc fix(data-connector): open connectors.yaml as utf-8
open() without an encoding uses the locale codec, so on a cp1252 machine a connectors.yaml with non-ASCII names was mis-decoded or, for bytes cp1252 leaves undefined, failed to parse and the whole file was dropped.
2026-10-12 10:58:32 -07:00
Chenglong Wang 0786ec9fa8 add fixes 2026-10-12 09:10:41 -07:00
Chenglong Wang 06d956dc62 fixes to threads 2026-10-11 23:26:26 -07:00
Chenglong Wang f3abc8aad2 app in app 2026-10-07 17:53:06 -07:00
Zulfazli 989e0ab82b Add German (de), French (fr) and Korean (ko) locales; refine Japanese (ja)
Add three new frontend locale bundles (de, fr, ko), each with all 10 domains at full 2217-key parity with en. Register them in locales/index.ts and i18n/index.ts and cover key parity with unit tests. Also refine existing Japanese translations, including restoring the dropped {{name}} placeholder in setupForm.sessionName.
2026-10-07 12:17:37 +07:00
Chenglong WangandCopilot 9a9a429191 Add sandboxed interactive HTML apps; remove Chartifact
Add an html_app analyst skill whose write_html_app action saves an
agent-managed .html workspace file with a manifest of the tables it may
read. Revisions go through edit_file.

The canvas renders .html files in a double iframe: a same-origin
container with frame-src 'none' (blocks navigation exfiltration) holding
an opaque-origin sandbox="allow-scripts" app frame with a CSP that
blocks network access. An inlined DF runtime provides DF.query/DF.table
(validated bridge to sample-table, manifest tables only), DF.chart
(Vega-Lite), and theme variables.

Remove the unused Chartifact dialog and its i18n keys.

Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com>
2026-10-06 13:40:13 -07:00
Chenglong Wang e507e74f87 fix 2026-10-05 15:10:23 -07:00
Chenglong Wang 7287ecc574 ok 2026-10-03 15:00:46 -07:00
Chenglong Wang c22af56b0f minor 2026-10-03 10:06:30 -07:00
Chenglong Wang eb4796526e Merge pull request #467 from WinnieSmasher/fix/table-key-tree-search
fix(data-loader): backfill table_key in tree and search responses
2026-10-03 10:04:10 -07:00
Chenglong Wang 3a94444f96 language issues 2026-10-03 09:57:00 -07:00
Chenglong Wang 5ca0ce7e06 fix 2026-10-02 23:38:43 -07:00
Chenglong Wang 94c5d60ee7 minor 2026-10-02 08:59:12 -07:00
Chenglong Wang 83f0a2f511 improvements 2026-10-02 08:57:09 -07:00
Chenglong Wang 29541b4089 Data Formulator skill 2026-10-01 09:09:17 -07:00