### What problem does this PR solve?
Issue Number: None
Related PR: None
Problem Summary:
`fe_plugins/auditloader` is the old standalone audit loader plugin,
which had to be built with `build-plugin.sh` and installed with `INSTALL
PLUGIN`. FE now ships a built-in audit loader
(`org.apache.doris.plugin.audit.AuditLoader`), registered by `PluginMgr`
at startup, which writes audit events into `__internal_schema.audit_log`
and is switched by the global variable `enable_audit_plugin`. Nothing in
FE or the build depends on the standalone copy any more, and it has
drifted from the built-in one. This PR removes the module and its entry
in `fe_plugins/pom.xml`.
The legacy `pytest/deploy` scripts had an optional path that installed
this plugin. When `output/audit_loader/auditloader.zip` existed, they
rendered `plugin_auditload.conf`, unpacked the zip into the FE
directory, created `doris_audit_db__.doris_audit_tbl__` and ran `INSTALL
PLUGIN`. No build produces that zip, so the path never ran. This PR
removes that path, `plugin_auditload.conf`, and the `deploy_audit`
parameter it threaded through `prepare_palo_package()` and
`start_palo()`.
Problem Summary:
`pytest/requirements.txt` currently pins several dependencies to
vulnerable versions flagged by Dependabot. This PR updates the pinned
versions for `certifi`, `idna`, `PyMySQL`, `requests`, and `urllib3` to
patched releases so the pytest tooling dependencies are no longer on
known vulnerable ranges.
Signed-off-by: Arpit Jain <arpitjain099@gmail.com>
Remove the obsolete bitmap runtime filter planning and execution path
while preserving thrift compatibility entries as Deprecated.
Root cause:
BITMAP_FILTER still had a dedicated FE planning branch for
bitmap-containing nested-loop join predicates and matching BE
runtime/filter predicate implementations. Even though the path is no
longer intended to be planned, helper objects and runtime mappings kept
it reachable.
Fix:
- Keep existing thrift ids and fields for BITMAP_PRED,
TRuntimeFilterType.BITMAP, bitmap_target_expr, bitmap_filter_not_in, and
is_output_left_side_only, but mark them Deprecated.
- Remove FE bitmap runtime-filter generation, pushdown, translation,
session-variable acceptance, and nested-loop join probe-only special
handling.
- Delete VBitmapPredicate, BitmapFilterFunc, and bitmap column predicate
execution objects.
- Adjust runtime-filter tests and regressions to verify bitmap runtime
filters are not planned.
do not change column nullable on ColumnDef
1. bitmap/hll/quantile_state will directly change nullable to false
1. Currently, complex types do not support nullable in the storage
layer. If it is set to null, it should be coredump.
2. It is meaningless to set complex types to null. For example, bitmap
can use bitmap_empty to represent null to avoid nullable overhead.
3. Users reported that if it is a not null bitmap. When inserting into,
it is necessary to explicitly declare bitmap_empty, which is
troublesome. However, the work of supporting the default value of
bitmap_empty for complex columns has been claimed by the community.
https://github.com/apache/doris/issues/34228
4. Consider changing it here so that if null is explicitly specified
when creating a table, an error will be reported. If it is not
explicitly specified (the default will be null), it is not null.
2. The aggregate type REPLACE_IF_NOT_NULL will directly change nullable
to true
1. If it is a not null column, using REPLACE_IF_NOT_NULL is meaningless,
which is equivalent to REPLACE.
2. Consider changing it here so that if not nullable is encountered, an
error will be reported, and a prompt to use REPLACE will be given.
Calvin Kirs
Arpit Jain
zclllyybb
Refrain
Gabriel
Pxl
zhiqiang
zhangy5
Yulei-Yang