nprasad2077/doris
1
0 Fork 0
mirror of https://github.com/apache/doris.git synced 2026-11-04 18:29:59 +00:00
Code Issues Packages Projects Releases Wiki Activity
Files
699680e6f8d0decd07f1c49cc0fe3aeb34775d87
doris/be/test/exprs/function/function_varbinary_test.cpp
T
Gabriel 388a540d00 [fix](types) Fix binary value ownership and timestamp primitives (#68297) 
### What problem does this PR solve?

This is the first of five planned extractions from #67784, targeting
`branch-4.1`.

Binary `Field` values can retain references to released source storage,
and Hive binary text needs its own Base64 contract. TIMESTAMPTZ output
can lose historical offset seconds, format invalid NULL payloads, or
fail again while reporting a boundary cast error.

- Own long binary Field values while keeping short values inline.
Preserve execution type lengths and decoder bytes, fix binary literal
encoding, and add Hive Base64 and hexadecimal decoding support.
- Explicitly reject unsupported binary hash keys, IN, aggregates,
predicates and computed partition transforms. Keep the existing FE
comparison/group/join restrictions and existing binary scalar functions.
Reject unsupported collection kernels before coercion.
- Normalize fixed timezone offsets and preserve historical second
offsets in both TIMESTAMPTZ formatting and parsing. Skip masked NULL
payloads, reject unrepresentable local years, and preserve cast
error/NULL behavior at boundaries.

Arrow convertor migration, Parquet/ORC semantics, external writer
changes and catalog mapping migration belong to the subsequent
extractions. This PR does not enable native VARBINARY storage.

### Testing
- TIMESTAMPTZ regression follow-up: reproduced both binary-output and
stream-load failures using the master PR CI artifact, regenerated the
two snapshots through `run-regression-test.sh`, and passed both suites
in comparison mode from each branch checkout. Explicit `Asia/Shanghai`
session settings were verified with the server default session zone set
to UTC. Only historical offset seconds changed in the generated results.
- Function-local validation update: 17 FE tests passed after a clean
build with Checkstyle enabled. Coverage includes direct legality checks,
nested/mixed/variadic VARBINARY arguments, both `collect_set` arities,
supported ordinary types, SQL analysis, and existing array rewrites.
Collection restrictions now live in each function's legality check
before coercion; existing branch-specific argument rules are preserved.

- Rebuilt the BE ASAN test target from this extraction: **184 tests
passed**, zero failures. Coverage includes binary
lifetime/SerDe/rejection paths, timestamp parsing/casts, hash and
partition guards, and existing Arrow/Variant serialization tests.
- `VarBinaryUnsupportedCollectionTest`: **passed** (13 unsupported
collection expressions, plus existing byte-preserving array/collection
analysis).
- FE reactor `validate` with repository Checkstyle: **passed**.
- clang-format 16 check on all 34 changed C++ source/header files:
**passed**.
- Groovy compilation of the three new regression suites: **passed**.
Live SQL regression execution is pending CI.

The local BE test source list was narrowed for the focused build and
restored before committing. No build configuration changes are included.

### Release note

Fix binary value lifetime and serialization, reject unsupported binary
computation paths, and preserve TIMESTAMPTZ historical offsets and
boundary error behavior.

### Check List (For Author)

- Test
- [x] Regression test (three self-checking suites added; execution
pending CI)
  - [x] Unit Test
- Behavior changed:
- [x] Yes. Binary rejection and timestamp boundary behavior are
described above.
- Does this need documentation?
- [x] No. This fixes existing type behavior without introducing a
configuration option.

### Check List (For Reviewer who merge this PR)

- [ ] Confirm the release note
- [ ] Confirm test cases
- [ ] Confirm document
- [ ] Add branch pick label

### Scoped review follow-up

This follow-up only fixes correctness/stability defects introduced by
this PR. Compatibility preservation, pre-existing limitations,
additional VARBINARY computation/validation, and unrelated refactors are
excluded.

- Separate historical TIMESTAMPTZ wire-offset parsing from session
fixed-zone limits in both parser paths.
- Validate the complete UTC/GMT fixed offset and exclude rejected
endpoint values from the timezone cache.
- Decline FE string folding when the session-local year is outside the
new BE display range. Preserve the CAST for BE evaluation in both cast
modes instead of folding non-strict casts to NULL.
- Validation: 29 focused ASAN BE tests and 15 FE tests passed. Four BE
tests and the new FE boundary test failed before the fixes. clang-format
16 and FE Checkstyle passed.
- The corresponding master follow-up is in #68301. Master already has
different timezone normalization and FE folding behavior; its additional
TIMESTAMP_NS error-reporting fix does not apply to branch-4.1.

### CI test follow-up

- Keep the binary literal test's owning Field alive while reading its
StringView. Branch-4.1 now has the corresponding short/long embedded-NUL
coverage using its execution API.
- Replace the obsolete +15:00 rejection input with +24:00. Add generated
historical-offset checks in both cast modes; all prior snapshot results
are unchanged.
- Validation: 34 focused ASAN BE tests passed on each branch. The
lifetime error and the original SQL mismatch were reproduced. The
complete cast regression suite passed in comparison mode from both
branch checkouts against the reported master CI artifact. clang-format
16 passed; full clang-tidy remains blocked by pre-existing diagnostics.

This follow-up changes tests only and retains the agreed scope: no
compatibility work or additional binary computation support. Existing
muted failures are outside this fix.
2026-09-23 08:58:37 +08:00

442 lines
29 KiB
C++
Raw Blame History

// Licensed to the Apache Software Foundation (ASF) under one
// or more contributor license agreements. See the NOTICE file
// distributed with this work for additional information
// regarding copyright ownership. The ASF licenses this file
// to you under the Apache License, Version 2.0 (the
// "License"); you may not use this file except in compliance
// with the License. You may obtain a copy of the License at
//
// http://www.apache.org/licenses/LICENSE-2.0
//
// Unless required by applicable law or agreed to in writing,
// software distributed under the License is distributed on an
// "AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY
// KIND, either express or implied. See the License for the
// specific language governing permissions and limitations
// under the License.
#include "exprs/function/function_varbinary.h"
#include "core/data_type/data_type_varbinary.h"
#include "exprs/function/function_test_util.h"
#include "exprs/function/in.h"
namespace doris {
using namespace ut_type;
TEST(function_binary_test, in_and_not_in_are_not_supported) {
RuntimeState state;
for (const auto& type : DataTypes {std::make_shared<DataTypeVarbinary>(),
make_nullable(std::make_shared<DataTypeVarbinary>())}) {
const DataTypes arguments {type, type};
auto context = FunctionContext::create_context(
&state, make_nullable(std::make_shared<DataTypeUInt8>()), arguments);
EXPECT_EQ(FunctionIn<false>().open(context.get(), FunctionContext::FRAGMENT_LOCAL).code(),
ErrorCode::NOT_IMPLEMENTED_ERROR);
EXPECT_EQ(FunctionIn<true>().open(context.get(), FunctionContext::FRAGMENT_LOCAL).code(),
ErrorCode::NOT_IMPLEMENTED_ERROR);
}
}
TEST(function_binary_test, function_binary_length_test) {
std::string func_name = "length";
InputTypeSet input_types = {PrimitiveType::TYPE_VARBINARY};
DataSet data_set = {
{{VARBINARY("YXNk5L2g5aW9")}, std::int32_t(12)},
{{VARBINARY("aGVsbG8gd29ybGQ")}, std::int32_t(15)},
{{VARBINARY("SEVMTE8sIV4l")}, std::int32_t(12)},
{{VARBINARY("__123hehe1")}, std::int32_t(10)},
{{VARBINARY("")}, std::int32_t(0)},
{{VARBINARY("5ZWK5ZOI5ZOI5ZOI8J+YhCDjgILigJTigJQh")}, std::int32_t(36)},
{{VARBINARY("ò&ø")}, std::int32_t(5)},
{{VARBINARY("TVl0ZXN0U1RS")}, std::int32_t(12)},
{{VARBINARY("123321!@#@$!@%!@#!@$!@")}, std::int32_t(22)},
{{VARBINARY("123")}, std::int32_t(3)},
{{VARBINARY("Hello, World!")}, std::int32_t(13)},
{{VARBINARY("Привет, мир!")}, std::int32_t(21)},
{{VARBINARY("こんにちは世界")}, std::int32_t(21)},
{{VARBINARY("안녕하세요세계")}, std::int32_t(21)},
{{VARBINARY("你好，世界！")}, std::int32_t(18)},
{{VARBINARY("مرحبا بالعالم!")}, std::int32_t(26)},
{{VARBINARY("1234567890")}, std::int32_t(10)},
{{VARBINARY("👨‍👨‍👧‍👦")}, std::int32_t(25)},
{{VARBINARY("🇺🇸🇨🇳🇯🇵🇰🇷")}, std::int32_t(32)},
{{VARBINARY("\u00F1")}, std::int32_t(2)},
{{VARBINARY("\u65E5\u672C\u8A9E")}, std::int32_t(9)},
{{VARBINARY("Hello, 世界！")}, std::int32_t(16)},
{{VARBINARY("😀😃😄😁")}, std::int32_t(16)},
{{VARBINARY("Quick brown 狐 jumps over a lazy 狗.")}, std::int32_t(38)},
{{VARBINARY("Löwe 老虎 Léopard")}, std::int32_t(21)},
{{VARBINARY("Café 美丽")}, std::int32_t(12)},
{{VARBINARY("Björk")}, std::int32_t(6)},
{{VARBINARY("¿Dónde está la biblioteca?")}, std::int32_t(29)},
{{VARBINARY("Zażółć gęślą jaźń")}, std::int32_t(26)},
{{Null()}, Null()},
{{VARBINARY(" ")}, std::int32_t(1)},
{{VARBINARY(" ")}, std::int32_t(2)},
};
check_function_all_arg_comb<DataTypeInt32, true>(func_name, input_types, data_set);
}
TEST(function_binary_test, function_to_base64_binary_test) {
std::string func_name = "to_base64_binary";
InputTypeSet input_types = {PrimitiveType::TYPE_VARBINARY};
DataSet data_set = {
{{VARBINARY("ABC")}, std::string("QUJD")},
{{VARBINARY("ABB")}, std::string("QUJC")},
{{VARBINARY("HEHE")}, std::string("SEVIRQ==")},
{{VARBINARY("__123hehe1")}, std::string("X18xMjNoZWhlMQ==")},
{{VARBINARY("5ZWK5ZOI5ZOI5ZOI8J+YhCDjgILigJTigJQh")},
std::string("NVpXSzVaT0k1Wk9JNVpPSThKK1loQ0RqZ0lMaWdKVGlnSlFo")},
{{VARBINARY("ò&ø")}, std::string("w7Imw7g=")},
{{VARBINARY("hehe")}, std::string("aGVoZQ==")},
{{VARBINARY("`~!@#$%^&*()-_=+")}, std::string("YH4hQCMkJV4mKigpLV89Kw==")},
{{VARBINARY("test ")}, std::string("dGVzdCA=")},
{{VARBINARY("")}, std::string("")},
{{Null()}, Null()},
};
check_function_all_arg_comb<DataTypeString, true>(func_name, input_types, data_set);
}
TEST(function_binary_test, function_from_base64_binary_test) {
std::string func_name = "from_base64_binary";
InputTypeSet input_types = {PrimitiveType::TYPE_VARCHAR};
DataSet data_set = {
{{std::string("YXNk5L2g5aW9")}, VARBINARY("asd你好")},
{{std::string("aGVsbG8gd29ybGQ")}, Null()},
{{std::string("SEVMTE8sIV4l")}, VARBINARY("HELLO,!^%")},
{{std::string("__123hehe1")}, Null()},
{{std::string("")}, VARBINARY("")},
{{std::string("5ZWK5ZOI5ZOI5ZOI8J+YhCDjgILigJTigJQh")}, VARBINARY("啊哈哈哈😄 。——!")},
{{std::string("ò&ø")}, Null()},
{{std::string("TVl0ZXN0U1RS")}, VARBINARY("MYtestSTR")},
{{std::string("YWFhYWFhYWFhYWE=")}, VARBINARY("aaaaaaaaaaa")},
{{std::string("TVl0ZXN0U1RSTVl0ZXN0U1RSTVl0ZXN0U1RS")},
VARBINARY("MYtestSTRMYtestSTRMYtestSTR")},
{{std::string("SEVMTE8sIV4lSEVMTE8sIV4lSEVMTE8sIV4lSEVMTE8sIV4l")},
VARBINARY("HELLO,!^%HELLO,!^%HELLO,!^%HELLO,!^%")},
{{Null()}, Null()},
};
check_function_all_arg_comb<DataTypeVarbinary, true>(func_name, input_types, data_set);
}
TEST(function_binary_test, function_subbinary_test) {
std::string func_name = "sub_binary";
{
InputTypeSet input_types = {PrimitiveType::TYPE_VARBINARY, PrimitiveType::TYPE_INT,
PrimitiveType::TYPE_INT};
DataSet data_set = {
{{VARBINARY("AbCdEfg"), std::int32_t(1), std::int32_t(1)}, VARBINARY("A")},
{{VARBINARY("AbCdEfg"), std::int32_t(1), std::int32_t(5)}, VARBINARY("AbCdE")},
{{VARBINARY("AbCdEfg"), std::int32_t(1), std::int32_t(-1)}, VARBINARY("")},
{{VARBINARY("AbCdEfg"), std::int32_t(1), std::int32_t(100)}, VARBINARY("AbCdEfg")},
{{VARBINARY("AbCdEfg"), std::int32_t(1), Null()}, Null()},
{{VARBINARY("AbCdEfg"), std::int32_t(5), std::int32_t(1)}, VARBINARY("E")},
{{VARBINARY("AbCdEfg"), std::int32_t(5), std::int32_t(5)}, VARBINARY("Efg")},
{{VARBINARY("AbCdEfg"), std::int32_t(5), std::int32_t(-1)}, VARBINARY("")},
{{VARBINARY("AbCdEfg"), std::int32_t(5), std::int32_t(100)}, VARBINARY("Efg")},
{{VARBINARY("AbCdEfg"), std::int32_t(5), Null()}, Null()},
{{VARBINARY("AbCdEfg"), std::int32_t(-1), std::int32_t(1)}, VARBINARY("g")},
{{VARBINARY("AbCdEfg"), std::int32_t(-1), std::int32_t(5)}, VARBINARY("g")},
{{VARBINARY("AbCdEfg"), std::int32_t(-1), std::int32_t(-1)}, VARBINARY("")},
{{VARBINARY("AbCdEfg"), std::int32_t(-1), std::int32_t(100)}, VARBINARY("g")},
{{VARBINARY("AbCdEfg"), std::int32_t(-1), Null()}, Null()},
{{VARBINARY("AbCdEfg"), std::int32_t(100), std::int32_t(1)}, VARBINARY("")},
{{VARBINARY("AbCdEfg"), std::int32_t(100), std::int32_t(5)}, VARBINARY("")},
{{VARBINARY("AbCdEfg"), std::int32_t(100), std::int32_t(-1)}, VARBINARY("")},
{{VARBINARY("AbCdEfg"), std::int32_t(100), std::int32_t(100)}, VARBINARY("")},
{{VARBINARY("AbCdEfg"), std::int32_t(100), Null()}, Null()},
{{VARBINARY("AbCdEfg"), Null(), std::int32_t(1)}, Null()},
{{VARBINARY("AbCdEfg"), Null(), std::int32_t(5)}, Null()},
{{VARBINARY("AbCdEfg"), Null(), std::int32_t(-1)}, Null()},
{{VARBINARY("AbCdEfg"), Null(), std::int32_t(100)}, Null()},
{{VARBINARY("AbCdEfg"), Null(), Null()}, Null()},
{{VARBINARY("HELLO123"), std::int32_t(1), std::int32_t(1)}, VARBINARY("H")},
{{VARBINARY("HELLO123"), std::int32_t(1), std::int32_t(5)}, VARBINARY("HELLO")},
{{VARBINARY("HELLO123"), std::int32_t(1), std::int32_t(-1)}, VARBINARY("")},
{{VARBINARY("HELLO123"), std::int32_t(1), std::int32_t(100)},
VARBINARY("HELLO123")},
{{VARBINARY("HELLO123"), std::int32_t(1), Null()}, Null()},
{{VARBINARY("HELLO123"), std::int32_t(5), std::int32_t(1)}, VARBINARY("O")},
{{VARBINARY("HELLO123"), std::int32_t(5), std::int32_t(5)}, VARBINARY("O123")},
{{VARBINARY("HELLO123"), std::int32_t(5), std::int32_t(-1)}, VARBINARY("")},
{{VARBINARY("HELLO123"), std::int32_t(5), std::int32_t(100)}, VARBINARY("O123")},
{{VARBINARY("HELLO123"), std::int32_t(5), Null()}, Null()},
{{VARBINARY("HELLO123"), std::int32_t(-1), std::int32_t(1)}, VARBINARY("3")},
{{VARBINARY("HELLO123"), std::int32_t(-1), std::int32_t(5)}, VARBINARY("3")},
{{VARBINARY("HELLO123"), std::int32_t(-1), std::int32_t(-1)}, VARBINARY("")},
{{VARBINARY("HELLO123"), std::int32_t(-1), std::int32_t(100)}, VARBINARY("3")},
{{VARBINARY("HELLO123"), std::int32_t(-1), Null()}, Null()},
{{VARBINARY("HELLO123"), std::int32_t(100), std::int32_t(1)}, VARBINARY("")},
{{VARBINARY("HELLO123"), std::int32_t(100), std::int32_t(5)}, VARBINARY("")},
{{VARBINARY("HELLO123"), std::int32_t(100), std::int32_t(-1)}, VARBINARY("")},
{{VARBINARY("HELLO123"), std::int32_t(100), std::int32_t(100)}, VARBINARY("")},
{{VARBINARY("HELLO123"), std::int32_t(100), Null()}, Null()},
{{VARBINARY("HELLO123"), Null(), std::int32_t(1)}, Null()},
{{VARBINARY("HELLO123"), Null(), std::int32_t(5)}, Null()},
{{VARBINARY("HELLO123"), Null(), std::int32_t(-1)}, Null()},
{{VARBINARY("HELLO123"), Null(), std::int32_t(100)}, Null()},
{{VARBINARY("HELLO123"), Null(), Null()}, Null()},
// VARBINARY("\xE4\xBD\xA0\xE5\xA5\xBD\x48\x45\x4C\x4C\x4F") == VARBINARY("你好HELLO")
{{VARBINARY("你好HELLO"), std::int32_t(1), std::int32_t(1)}, VARBINARY("\xE4")},
{{VARBINARY("你好HELLO"), std::int32_t(1), std::int32_t(5)},
VARBINARY("\xE4\xBD\xA0\xE5\xA5")},
{{VARBINARY("你好HELLO"), std::int32_t(1), std::int32_t(-1)}, VARBINARY("")},
{{VARBINARY("你好HELLO"), std::int32_t(1), std::int32_t(100)},
VARBINARY("你好HELLO")},
{{VARBINARY("你好HELLO"), std::int32_t(1), Null()}, Null()},
{{VARBINARY("你好HELLO"), std::int32_t(5), std::int32_t(1)}, VARBINARY("\xA5")},
{{VARBINARY("你好HELLO"), std::int32_t(5), std::int32_t(5)},
VARBINARY("\xA5\xBD\x48\x45\x4C")},
{{VARBINARY("你好HELLO"), std::int32_t(5), std::int32_t(-1)}, VARBINARY("")},
{{VARBINARY("你好HELLO"), std::int32_t(5), std::int32_t(100)},
VARBINARY("\xA5\xBDHELLO")},
{{VARBINARY("你好HELLO"), std::int32_t(5), Null()}, Null()},
{{VARBINARY("你好HELLO"), std::int32_t(-1), std::int32_t(1)}, VARBINARY("O")},
{{VARBINARY("你好HELLO"), std::int32_t(-1), std::int32_t(5)}, VARBINARY("O")},
{{VARBINARY("你好HELLO"), std::int32_t(-1), std::int32_t(-1)}, VARBINARY("")},
{{VARBINARY("你好HELLO"), std::int32_t(-1), std::int32_t(100)}, VARBINARY("O")},
{{VARBINARY("你好HELLO"), std::int32_t(-1), Null()}, Null()},
{{VARBINARY("你好HELLO"), std::int32_t(100), std::int32_t(1)}, VARBINARY("")},
{{VARBINARY("你好HELLO"), std::int32_t(100), std::int32_t(5)}, VARBINARY("")},
{{VARBINARY("你好HELLO"), std::int32_t(100), std::int32_t(-1)}, VARBINARY("")},
{{VARBINARY("你好HELLO"), std::int32_t(100), std::int32_t(100)}, VARBINARY("")},
{{VARBINARY("你好HELLO"), std::int32_t(100), Null()}, Null()},
{{VARBINARY("你好HELLO"), Null(), std::int32_t(1)}, Null()},
{{VARBINARY("你好HELLO"), Null(), std::int32_t(5)}, Null()},
{{VARBINARY("你好HELLO"), Null(), std::int32_t(-1)}, Null()},
{{VARBINARY("你好HELLO"), Null(), std::int32_t(100)}, Null()},
{{VARBINARY("你好HELLO"), Null(), Null()}, Null()},
{{VARBINARY("123ABC_"), std::int32_t(1), std::int32_t(1)}, VARBINARY("1")},
{{VARBINARY("123ABC_"), std::int32_t(1), std::int32_t(5)}, VARBINARY("123AB")},
{{VARBINARY("123ABC_"), std::int32_t(1), std::int32_t(-1)}, VARBINARY("")},
{{VARBINARY("123ABC_"), std::int32_t(1), std::int32_t(100)}, VARBINARY("123ABC_")},
{{VARBINARY("123ABC_"), std::int32_t(1), Null()}, Null()},
{{VARBINARY("123ABC_"), std::int32_t(5), std::int32_t(1)}, VARBINARY("B")},
{{VARBINARY("123ABC_"), std::int32_t(5), std::int32_t(5)}, VARBINARY("BC_")},
{{VARBINARY("123ABC_"), std::int32_t(5), std::int32_t(-1)}, VARBINARY("")},
{{VARBINARY("123ABC_"), std::int32_t(5), std::int32_t(100)}, VARBINARY("BC_")},
{{VARBINARY("123ABC_"), std::int32_t(5), Null()}, Null()},
{{VARBINARY("123ABC_"), std::int32_t(-1), std::int32_t(1)}, VARBINARY("_")},
{{VARBINARY("123ABC_"), std::int32_t(-1), std::int32_t(5)}, VARBINARY("_")},
{{VARBINARY("123ABC_"), std::int32_t(-1), std::int32_t(-1)}, VARBINARY("")},
{{VARBINARY("123ABC_"), std::int32_t(-1), std::int32_t(100)}, VARBINARY("_")},
{{VARBINARY("123ABC_"), std::int32_t(-1), Null()}, Null()},
{{VARBINARY("123ABC_"), std::int32_t(100), std::int32_t(1)}, VARBINARY("")},
{{VARBINARY("123ABC_"), std::int32_t(100), std::int32_t(5)}, VARBINARY("")},
{{VARBINARY("123ABC_"), std::int32_t(100), std::int32_t(-1)}, VARBINARY("")},
{{VARBINARY("123ABC_"), std::int32_t(100), std::int32_t(100)}, VARBINARY("")},
{{VARBINARY("123ABC_"), std::int32_t(100), Null()}, Null()},
{{VARBINARY("123ABC_"), Null(), std::int32_t(1)}, Null()},
{{VARBINARY("123ABC_"), Null(), std::int32_t(5)}, Null()},
{{VARBINARY("123ABC_"), Null(), std::int32_t(-1)}, Null()},
{{VARBINARY("123ABC_"), Null(), std::int32_t(100)}, Null()},
{{VARBINARY("123ABC_"), Null(), Null()}, Null()},
{{VARBINARY("MYtestSTR"), std::int32_t(1), std::int32_t(1)}, VARBINARY("M")},
{{VARBINARY("MYtestSTR"), std::int32_t(1), std::int32_t(5)}, VARBINARY("MYtes")},
{{VARBINARY("MYtestSTR"), std::int32_t(1), std::int32_t(-1)}, VARBINARY("")},
{{VARBINARY("MYtestSTR"), std::int32_t(1), std::int32_t(100)},
VARBINARY("MYtestSTR")},
{{VARBINARY("MYtestSTR"), std::int32_t(1), Null()}, Null()},
{{VARBINARY("MYtestSTR"), std::int32_t(5), std::int32_t(1)}, VARBINARY("s")},
{{VARBINARY("MYtestSTR"), std::int32_t(5), std::int32_t(5)}, VARBINARY("stSTR")},
{{VARBINARY("MYtestSTR"), std::int32_t(5), std::int32_t(-1)}, VARBINARY("")},
{{VARBINARY("MYtestSTR"), std::int32_t(5), std::int32_t(100)}, VARBINARY("stSTR")},
{{VARBINARY("MYtestSTR"), std::int32_t(5), Null()}, Null()},
{{VARBINARY("MYtestSTR"), std::int32_t(-1), std::int32_t(1)}, VARBINARY("R")},
{{VARBINARY("MYtestSTR"), std::int32_t(-1), std::int32_t(5)}, VARBINARY("R")},
{{VARBINARY("MYtestSTR"), std::int32_t(-1), std::int32_t(-1)}, VARBINARY("")},
{{VARBINARY("MYtestSTR"), std::int32_t(-1), std::int32_t(100)}, VARBINARY("R")},
{{VARBINARY("MYtestSTR"), std::int32_t(-1), Null()}, Null()},
{{VARBINARY("MYtestSTR"), std::int32_t(100), std::int32_t(1)}, VARBINARY("")},
{{VARBINARY("MYtestSTR"), std::int32_t(100), std::int32_t(5)}, VARBINARY("")},
{{VARBINARY("MYtestSTR"), std::int32_t(100), std::int32_t(-1)}, VARBINARY("")},
{{VARBINARY("MYtestSTR"), std::int32_t(100), std::int32_t(100)}, VARBINARY("")},
{{VARBINARY("MYtestSTR"), std::int32_t(100), Null()}, Null()},
{{VARBINARY("MYtestSTR"), Null(), std::int32_t(1)}, Null()},
{{VARBINARY("MYtestSTR"), Null(), std::int32_t(5)}, Null()},
{{VARBINARY("MYtestSTR"), Null(), std::int32_t(-1)}, Null()},
{{VARBINARY("MYtestSTR"), Null(), std::int32_t(100)}, Null()},
{{VARBINARY("MYtestSTR"), Null(), Null()}, Null()},
{{VARBINARY(""), std::int32_t(1), std::int32_t(1)}, VARBINARY("")},
{{VARBINARY(""), std::int32_t(1), std::int32_t(5)}, VARBINARY("")},
{{VARBINARY(""), std::int32_t(1), std::int32_t(-1)}, VARBINARY("")},
{{VARBINARY(""), std::int32_t(1), std::int32_t(100)}, VARBINARY("")},
{{VARBINARY(""), std::int32_t(1), Null()}, Null()},
{{VARBINARY(""), std::int32_t(5), std::int32_t(1)}, VARBINARY("")},
{{VARBINARY(""), std::int32_t(5), std::int32_t(5)}, VARBINARY("")},
{{VARBINARY(""), std::int32_t(5), std::int32_t(-1)}, VARBINARY("")},
{{VARBINARY(""), std::int32_t(5), std::int32_t(100)}, VARBINARY("")},
{{VARBINARY(""), std::int32_t(5), Null()}, Null()},
{{VARBINARY(""), std::int32_t(-1), std::int32_t(1)}, VARBINARY("")},
{{VARBINARY(""), std::int32_t(-1), std::int32_t(5)}, VARBINARY("")},
{{VARBINARY(""), std::int32_t(-1), std::int32_t(-1)}, VARBINARY("")},
{{VARBINARY(""), std::int32_t(-1), std::int32_t(100)}, VARBINARY("")},
{{VARBINARY(""), std::int32_t(-1), Null()}, Null()},
{{VARBINARY(""), std::int32_t(100), std::int32_t(1)}, VARBINARY("")},
{{VARBINARY(""), std::int32_t(100), std::int32_t(5)}, VARBINARY("")},
{{VARBINARY(""), std::int32_t(100), std::int32_t(-1)}, VARBINARY("")},
{{VARBINARY(""), std::int32_t(100), std::int32_t(100)}, VARBINARY("")},
{{VARBINARY(""), std::int32_t(100), Null()}, Null()},
{{VARBINARY(""), Null(), std::int32_t(1)}, Null()},
{{VARBINARY(""), Null(), std::int32_t(5)}, Null()},
{{VARBINARY(""), Null(), std::int32_t(-1)}, Null()},
{{VARBINARY(""), Null(), std::int32_t(100)}, Null()},
{{VARBINARY(""), Null(), Null()}, Null()},
{{Null(), std::int32_t(1), std::int32_t(1)}, Null()},
{{Null(), std::int32_t(1), std::int32_t(5)}, Null()},
{{Null(), std::int32_t(1), std::int32_t(-1)}, Null()},
{{Null(), std::int32_t(1), std::int32_t(100)}, Null()},
{{Null(), std::int32_t(1), Null()}, Null()},
{{Null(), std::int32_t(5), std::int32_t(1)}, Null()},
{{Null(), std::int32_t(5), std::int32_t(5)}, Null()},
{{Null(), std::int32_t(5), std::int32_t(-1)}, Null()},
{{Null(), std::int32_t(5), std::int32_t(100)}, Null()},
{{Null(), std::int32_t(5), Null()}, Null()},
{{Null(), std::int32_t(-1), std::int32_t(1)}, Null()},
{{Null(), std::int32_t(-1), std::int32_t(5)}, Null()},
{{Null(), std::int32_t(-1), std::int32_t(-1)}, Null()},
{{Null(), std::int32_t(-1), std::int32_t(100)}, Null()},
{{Null(), std::int32_t(-1), Null()}, Null()},
{{Null(), std::int32_t(100), std::int32_t(1)}, Null()},
{{Null(), std::int32_t(100), std::int32_t(5)}, Null()},
{{Null(), std::int32_t(100), std::int32_t(-1)}, Null()},
{{Null(), std::int32_t(100), std::int32_t(100)}, Null()},
{{Null(), std::int32_t(100), Null()}, Null()},
{{Null(), Null(), std::int32_t(1)}, Null()},
{{Null(), Null(), std::int32_t(5)}, Null()},
{{Null(), Null(), std::int32_t(-1)}, Null()},
{{Null(), Null(), std::int32_t(100)}, Null()},
{{Null(), Null(), Null()}, Null()},
{{VARBINARY("A,b,C,D,_E"), std::int32_t(1), std::int32_t(1)}, VARBINARY("A")},
{{VARBINARY("A,b,C,D,_E"), std::int32_t(1), std::int32_t(5)}, VARBINARY("A,b,C")},
{{VARBINARY("A,b,C,D,_E"), std::int32_t(1), std::int32_t(-1)}, VARBINARY("")},
{{VARBINARY("A,b,C,D,_E"), std::int32_t(1), std::int32_t(100)},
VARBINARY("A,b,C,D,_E")},
{{VARBINARY("A,b,C,D,_E"), std::int32_t(1), Null()}, Null()},
{{VARBINARY("A,b,C,D,_E"), std::int32_t(5), std::int32_t(1)}, VARBINARY("C")},
{{VARBINARY("A,b,C,D,_E"), std::int32_t(5), std::int32_t(5)}, VARBINARY("C,D,_")},
{{VARBINARY("A,b,C,D,_E"), std::int32_t(5), std::int32_t(-1)}, VARBINARY("")},
{{VARBINARY("A,b,C,D,_E"), std::int32_t(5), std::int32_t(100)},
VARBINARY("C,D,_E")},
{{VARBINARY("A,b,C,D,_E"), std::int32_t(5), Null()}, Null()},
{{VARBINARY("A,b,C,D,_E"), std::int32_t(-1), std::int32_t(1)}, VARBINARY("E")},
{{VARBINARY("A,b,C,D,_E"), std::int32_t(-1), std::int32_t(5)}, VARBINARY("E")},
{{VARBINARY("A,b,C,D,_E"), std::int32_t(-1), std::int32_t(-1)}, VARBINARY("")},
{{VARBINARY("A,b,C,D,_E"), std::int32_t(-1), std::int32_t(100)}, VARBINARY("E")},
{{VARBINARY("A,b,C,D,_E"), std::int32_t(-1), Null()}, Null()},
{{VARBINARY("A,b,C,D,_E"), std::int32_t(100), std::int32_t(1)}, VARBINARY("")},
{{VARBINARY("A,b,C,D,_E"), std::int32_t(100), std::int32_t(5)}, VARBINARY("")},
{{VARBINARY("A,b,C,D,_E"), std::int32_t(100), std::int32_t(-1)}, VARBINARY("")},
{{VARBINARY("A,b,C,D,_E"), std::int32_t(100), std::int32_t(100)}, VARBINARY("")},
{{VARBINARY("A,b,C,D,_E"), std::int32_t(100), Null()}, Null()},
{{VARBINARY("A,b,C,D,_E"), Null(), std::int32_t(1)}, Null()},
{{VARBINARY("A,b,C,D,_E"), Null(), std::int32_t(5)}, Null()},
{{VARBINARY("A,b,C,D,_E"), Null(), std::int32_t(-1)}, Null()},
{{VARBINARY("A,b,C,D,_E"), Null(), std::int32_t(100)}, Null()},
{{VARBINARY("A,b,C,D,_E"), Null(), Null()}, Null()},
{{VARBINARY("1234321312312"), std::int32_t(1), std::int32_t(1)}, VARBINARY("1")},
{{VARBINARY("1234321312312"), std::int32_t(1), std::int32_t(5)},
VARBINARY("12343")},
{{VARBINARY("1234321312312"), std::int32_t(1), std::int32_t(-1)}, VARBINARY("")},
{{VARBINARY("1234321312312"), std::int32_t(1), std::int32_t(100)},
VARBINARY("1234321312312")},
{{VARBINARY("1234321312312"), std::int32_t(1), Null()}, Null()},
{{VARBINARY("1234321312312"), std::int32_t(5), std::int32_t(1)}, VARBINARY("3")},
{{VARBINARY("1234321312312"), std::int32_t(5), std::int32_t(5)},
VARBINARY("32131")},
{{VARBINARY("1234321312312"), std::int32_t(5), std::int32_t(-1)}, VARBINARY("")},
{{VARBINARY("1234321312312"), std::int32_t(5), std::int32_t(100)},
VARBINARY("321312312")},
{{VARBINARY("1234321312312"), std::int32_t(5), Null()}, Null()},
{{VARBINARY("1234321312312"), std::int32_t(-1), std::int32_t(1)}, VARBINARY("2")},
{{VARBINARY("1234321312312"), std::int32_t(-1), std::int32_t(5)}, VARBINARY("2")},
{{VARBINARY("1234321312312"), std::int32_t(-1), std::int32_t(-1)}, VARBINARY("")},
{{VARBINARY("1234321312312"), std::int32_t(-1), std::int32_t(100)}, VARBINARY("2")},
{{VARBINARY("1234321312312"), std::int32_t(-1), Null()}, Null()},
{{VARBINARY("1234321312312"), std::int32_t(100), std::int32_t(1)}, VARBINARY("")},
{{VARBINARY("1234321312312"), std::int32_t(100), std::int32_t(5)}, VARBINARY("")},
{{VARBINARY("1234321312312"), std::int32_t(100), std::int32_t(-1)}, VARBINARY("")},
{{VARBINARY("1234321312312"), std::int32_t(100), std::int32_t(100)}, VARBINARY("")},
{{VARBINARY("1234321312312"), std::int32_t(100), Null()}, Null()},
{{VARBINARY("1234321312312"), Null(), std::int32_t(1)}, Null()},
{{VARBINARY("1234321312312"), Null(), std::int32_t(5)}, Null()},
{{VARBINARY("1234321312312"), Null(), std::int32_t(-1)}, Null()},
{{VARBINARY("1234321312312"), Null(), std::int32_t(100)}, Null()},
{{VARBINARY("1234321312312"), Null(), Null()}, Null()},
{{VARBINARY("heh1h2_!u@_u@i$o%ll_"), std::int32_t(1), std::int32_t(1)},
VARBINARY("h")},
{{VARBINARY("heh1h2_!u@_u@i$o%ll_"), std::int32_t(1), std::int32_t(5)},
VARBINARY("heh1h")},
{{VARBINARY("heh1h2_!u@_u@i$o%ll_"), std::int32_t(1), std::int32_t(-1)},
VARBINARY("")},
{{VARBINARY("heh1h2_!u@_u@i$o%ll_"), std::int32_t(1), std::int32_t(100)},
VARBINARY("heh1h2_!u@_u@i$o%ll_")},
{{VARBINARY("heh1h2_!u@_u@i$o%ll_"), std::int32_t(1), Null()}, Null()},
{{VARBINARY("heh1h2_!u@_u@i$o%ll_"), std::int32_t(5), std::int32_t(1)},
VARBINARY("h")},
{{VARBINARY("heh1h2_!u@_u@i$o%ll_"), std::int32_t(5), std::int32_t(5)},
VARBINARY("h2_!u")},
{{VARBINARY("heh1h2_!u@_u@i$o%ll_"), std::int32_t(5), std::int32_t(-1)},
VARBINARY("")},
{{VARBINARY("heh1h2_!u@_u@i$o%ll_"), std::int32_t(5), std::int32_t(100)},
VARBINARY("h2_!u@_u@i$o%ll_")},
{{VARBINARY("heh1h2_!u@_u@i$o%ll_"), std::int32_t(5), Null()}, Null()},
{{VARBINARY("heh1h2_!u@_u@i$o%ll_"), std::int32_t(-1), std::int32_t(1)},
VARBINARY("_")},
{{VARBINARY("heh1h2_!u@_u@i$o%ll_"), std::int32_t(-1), std::int32_t(5)},
VARBINARY("_")},
{{VARBINARY("heh1h2_!u@_u@i$o%ll_"), std::int32_t(-1), std::int32_t(-1)},
VARBINARY("")},
{{VARBINARY("heh1h2_!u@_u@i$o%ll_"), std::int32_t(-1), std::int32_t(100)},
VARBINARY("_")},
{{VARBINARY("heh1h2_!u@_u@i$o%ll_"), std::int32_t(-1), Null()}, Null()},
{{VARBINARY("heh1h2_!u@_u@i$o%ll_"), std::int32_t(100), std::int32_t(1)},
VARBINARY("")},
{{VARBINARY("heh1h2_!u@_u@i$o%ll_"), std::int32_t(100), std::int32_t(5)},
VARBINARY("")},
{{VARBINARY("heh1h2_!u@_u@i$o%ll_"), std::int32_t(100), std::int32_t(-1)},
VARBINARY("")},
{{VARBINARY("heh1h2_!u@_u@i$o%ll_"), std::int32_t(100), std::int32_t(100)},
VARBINARY("")},
{{VARBINARY("heh1h2_!u@_u@i$o%ll_"), std::int32_t(100), Null()}, Null()},
{{VARBINARY("heh1h2_!u@_u@i$o%ll_"), Null(), std::int32_t(1)}, Null()},
{{VARBINARY("heh1h2_!u@_u@i$o%ll_"), Null(), std::int32_t(5)}, Null()},
{{VARBINARY("heh1h2_!u@_u@i$o%ll_"), Null(), std::int32_t(-1)}, Null()},
{{VARBINARY("heh1h2_!u@_u@i$o%ll_"), Null(), std::int32_t(100)}, Null()},
{{VARBINARY("heh1h2_!u@_u@i$o%ll_"), Null(), Null()}, Null()},
};
check_function_all_arg_comb<DataTypeVarbinary, true>(func_name, input_types, data_set);
}
}
TEST(function_binary_test, function_to_binary_test) {
std::string func_name = "to_binary";
InputTypeSet input_types = {PrimitiveType::TYPE_VARCHAR};
DataSet data_set = {
{{std::string("48656c6c6f")}, VARBINARY("Hello")},
{{std::string("0001")}, VARBINARY(std::string_view("\x00\x01", 2))},
{{std::string("aaff")}, VARBINARY("\xAA\xFF")},
{{std::string("aGVsbG8gd29ybGQ")}, Null()},
{{std::string("a")}, Null()},
{{std::string("__123hehe1")}, Null()},
{{std::string("")}, Null()},
{{Null()}, Null()},
};
check_function_all_arg_comb<DataTypeVarbinary, true>(func_name, input_types, data_set);
}
} // namespace doris
Reference in new issue View Git Blame Copy Permalink