ページの先頭行へ戻る
Big Data Integration ServerV1.3.0 リリース情報
FUJITSU Software

2.1.5 Apache Hiveに関する非互換

Apache Hiveに関する非互換を以下に示します。

内容

詳細

JIRA

Summary

外部仕様の変更

コマンド仕様の変更(注1)

HIVE-22622

Hive allows to create a struct with duplicate attribute names

HIVE-23671

MSCK repair should handle transactional tables in certain usecases

HIVE-23685

Removing user's extra resources while executing File Merge Task

HIVE-23723

Limit operator pushdown through LOJ

HIVE-23797

Throw exception when no metastore found in zookeeper

HIVE-23868

Windowing function spec: support 0 preceeding/following

HIVE-23973

Use SQL constraints to improve join reordering algorithm (III)

HIVE-24031

Infinite planning time on syntactically big queries

HIVE-24041

Extend semijoin conversion rules

HIVE-24063

SqlFunctionConverter#getHiveUDF handles cast before geting FunctionInfo

HIVE-24069

HiveHistory should log the task that ends abnormally

HIVE-24084

Push Aggregates thru joins in case it re-groups previously unique columns

HIVE-24106

Abort polling on the operation state when the current thread is interrupted

HIVE-24160

Scheduled executions must allow state transition EXECUTING->TIMED_OUT

HIVE-24213

Incorrect exception in the Merge MapJoinTask into its child MapRedTask optimizer

HIVE-24282

Show columns shouldn't sort output columns unless explicitly mentioned

HIVE-24336

Turn off the direct insert for EXPLAIN ANALYZE queries

HIVE-24357

Exchange SWO table/algorithm strategy

HIVE-24360

SharedWorkOptimizer may create incorrect plans with DPPUnion

HIVE-24365

SWO should not create complex and redundant filter expressions

オプションの内容/値の変更/省略値の変更(注2)

HIVE-23836

Make 'cols' dependent so that it cascade deletes

HIVE-23959

Provide an option to wipe out column stats for partitioned tables in case of column removal

チェック強化(注3)

HIVE-23339

SBA does not check permissions for DB location specified in Create or Alter database query

HIVE-23406

SharedWorkOptimizer should check nullSortOrders when comparing ReduceSink operators

HIVE-23509

MapJoin AssertionError: Capacity must be power of 2

HIVE-23937

Take null ordering into consideration when pushing TNK through inner joins (amagyar)

HIVE-24479

Introduce setting to set lower bound of hash aggregation reduction.

公開しているファイルの内容/形式(注4)

HIVE-22290

ObjectStore.cleanWriteNotificationEvents and ObjectStore.cleanupEvents OutOfMemory on large number of pending events

HIVE-22869

Add locking benchmark to metastore-tools/metastore-benchmarks

HIVE-23324

Parallelise compaction directory cleaning process

HIVE-23727

Improve SQLOperation log handling when canceling background

HIVE-23750

Rewrite plan to join back tables: support function calls in project

HIVE-23813

Fix MetricsMaintTask run frequency

HIVE-23817

Pushing TopN Key operator PKFK inner joins

HIVE-23874

Added debug line for fetchRequest in the HiveQueryResultSet

HIVE-23953

Use task counter information to compute keycount during hashtable loading

HIVE-24015

Disable query-based compaction on MR execution engine

HIVE-24024

Improve logging around CompactionTxnHandler

HIVE-24125

Incorrect transaction snapshot invalidation with unnecessary writeset check for exclusive operations

HIVE-24143

Include convention in JDBC converter operator in Calcite plan

HIVE-24146

Cleanup TaskExecutionException in GenericUDTFExplode

HIVE-24168

Disable hdfsEncryptionShims cache during query-based compaction

HIVE-24202

Clean up local HS2 HMS cache code (II)

HIVE-24210

PartitionManagementTask fails if one of tables dropped after fetching TableMeta

HIVE-24325

Cardinality preserving join optimization fails when column is backtracked to a constant

HIVE-24329

Add HMS notification for compaction commit

HIVE-24403

change min_history_level schema change to be compatible with previous version

HIVE-24423

Improve DbNotificationListener Thread

メッセージ内容の変更(注5)

HIVE-23790

The error message length of 2000 is exceeded for scheduled query

HIVE-23997

Some logs in ConstantPropagateProcFactory are not straightforward

HIVE-24096

Abort failed compaction's txn on TException or IOException

HIVE-24234

Improve checkHashModeEfficiency in VectorGroupByOperator

HIVE-24401

COMPACTOR_CRUD_QUERY_BASED description in HiveConf is outdated

メッセージの追加・削除(注6)

HIVE-23789

Merge ValidTxnManager into DriverTxnHandler

HIVE-23908

Rewrite plan to join back tables: handle root input is an Aggregate

HIVE-24012

Support for rewriting with materialized views containing grouping sets

HIVE-24231

Enhance shared work optimizer to merge scans with filters on both sides

ファイルのパーミッションの変更(注8)

HIVE-24089

Run QB compaction as table directory user with impersonation

実行結果の変更

誤った実装の修正(注7)

HIVE-19703

GenericUDTFGetSplits never uses num splits argument

HIVE-23763

Query based minor compaction produces wrong files when rows with different buckets Ids are processed by the same FileSinkOperator

HIVE-24144

getIdentifierQuoteString in HiveDatabaseMetaData returns incorrect value

HIVE-24178

managedlocation is missing in SHOW CREATE DATABASE

HIVE-24199

Incorrect result when subquey in exists contains limit

HIVE-24232

Incorrect translation of rollup expression from Calcite

HIVE-24255

StorageHandler with select-limit query is returning 0 rows

HIVE-24373

Wrong predicate is pushed down for view with constant value projection.

HIVE-24378

Leading and trailing spaces are not removed before decimal conversion

HIVE-24381

Compressed text input returns 0 rows if skip header/footer is mentioned

HIVE-24389

Trailing zeros of constant decimal numbers are removed

HIVE-24435

Vectorized unix_timestamp is inconsistent with non-vectorized counterpart

注1)実行結果、実行権限、実行多重度の変更など

注2)設定画面、操作画面など、画面情報含む

注3)指定可能範囲の変更、定義間の整合チェック、チェックの厳密化による有効範囲の拡大/縮小

注4)ログファイルの出力項目や形式の変更など

注5)ポップアップメッセージなどの変更により従前の操作が変わるものを含む。メッセージ内容、メッセージレベルの変更、メッセージ改善

注6)既存機能を使用する範囲で障害修正、改善などによるメッセージ新規追加・削除。

注7)外部仕様に反した外部動作を正規の動作に修正する場合、または誤った解釈の基で実装した標準的な技術の動作を正規の動作に修正する場合

参照

詳細は、下記のサイトを参照してください。

https://issues.apache.org/jira/secure/Dashboard.jspa