misc: Sync upstream Velox main - #65
Draft
firestarman wants to merge 289 commits into
Draft
Conversation
Differential Revision: D115607344 Pull Request resolved: facebookincubator#18470
Differential Revision: D115654162 Pull Request resolved: facebookincubator#18469
Differential Revision: D112929824 Pull Request resolved: facebookincubator#18075
…ns (facebookincubator#18378) Differential Revision: D114433657 Pull Request resolved: facebookincubator#18378
Differential Revision: D115767319 Pull Request resolved: facebookincubator#18285
Differential Revision: D115766716 Pull Request resolved: facebookincubator#18480
Differential Revision: D115604323 Pull Request resolved: facebookincubator#18479
Differential Revision: D115655249 Pull Request resolved: facebookincubator#18415
Differential Revision: D114913439 Pull Request resolved: facebookincubator#18416
…8419) Differential Revision: D113979882 Pull Request resolved: facebookincubator#18419
Differential Revision: D115255896 Pull Request resolved: facebookincubator#13907
…contract) (facebookincubator#18270) Differential Revision: D113578837 Pull Request resolved: facebookincubator#18270
Differential Revision: D115817317 Pull Request resolved: facebookincubator#18497
Differential Revision: D115766742 Pull Request resolved: facebookincubator#18458
Differential Revision: D115767508 Pull Request resolved: facebookincubator#18074
…acebookincubator#18475) Differential Revision: D115530427 Pull Request resolved: facebookincubator#18475
…or#18496) Differential Revision: D115659926 Pull Request resolved: facebookincubator#18496
Differential Revision: D115807551 Pull Request resolved: facebookincubator#18438
Differential Revision: D115766774 Pull Request resolved: facebookincubator#18455
Differential Revision: D115768477 Pull Request resolved: facebookincubator#18141
… check Differential Revision: D115891195 Pull Request resolved: facebookincubator#18498
Differential Revision: D113550897 Pull Request resolved: facebookincubator#17391
…kincubator#18511) Differential Revision: D115979786 Pull Request resolved: facebookincubator#18511
…cubator#18429) Differential Revision: D114919966 Pull Request resolved: facebookincubator#18429
Differential Revision: D115932280 Pull Request resolved: facebookincubator#18489
…spec Differential Revision: D115933127 Pull Request resolved: facebookincubator#18477
Differential Revision: D115939177 Pull Request resolved: facebookincubator#18382
Differential Revision: D115933828 Pull Request resolved: facebookincubator#17219
Differential Revision: D115932182 Pull Request resolved: facebookincubator#18130
…eader Differential Revision: D115933709 Pull Request resolved: facebookincubator#18383
Differential Revision: D118496590 Pull Request resolved: facebookincubator#18779
…tor#18828) Differential Revision: D118263069 Pull Request resolved: facebookincubator#18828
Differential Revision: D118242040 Pull Request resolved: facebookincubator#18805
Differential Revision: D118628694 Pull Request resolved: facebookincubator#18830
Differential Revision: D118563902 Pull Request resolved: facebookincubator#18823
Differential Revision: D118371081 Pull Request resolved: facebookincubator#11886
Differential Revision: D118338069 Pull Request resolved: facebookincubator#17931
Differential Revision: D118526897 Pull Request resolved: facebookincubator#18806
…d() by mode (facebookincubator#18743) Differential Revision: D117820911 Pull Request resolved: facebookincubator#18743
Differential Revision: D118212503 Pull Request resolved: facebookincubator#18561
Differential Revision: D118593412 Pull Request resolved: facebookincubator#18835
…tor#18842) Differential Revision: D118747030 Pull Request resolved: facebookincubator#18842
…bator#18847) Differential Revision: D118800738 Pull Request resolved: facebookincubator#18847
Differential Revision: D118750417 Pull Request resolved: facebookincubator#18843
…acebookincubator#18795) Differential Revision: D118298348 Pull Request resolved: facebookincubator#18795
…ad of repacking Differential Revision: D117309777 Pull Request resolved: facebookincubator#18785
Differential Revision: D118543707 Pull Request resolved: facebookincubator#18567
Differential Revision: D117810561 Pull Request resolved: facebookincubator#18839
…ested Differential Revision: D118061297 Pull Request resolved: facebookincubator#18857
…ts test (facebookincubator#18860) Differential Revision: D114379433 Pull Request resolved: facebookincubator#18860
Differential Revision: D118949931 Pull Request resolved: facebookincubator#18858
Differential Revision: D111315788 Pull Request resolved: facebookincubator#18861
…rnel wrote (facebookincubator#18862) Differential Revision: D118061298 Pull Request resolved: facebookincubator#18862
Differential Revision: D118983416 Pull Request resolved: facebookincubator#18870
Differential Revision: D118978729 Pull Request resolved: facebookincubator#18869
Differential Revision: D118984752 Pull Request resolved: facebookincubator#18808
…acebookincubator#18864) Differential Revision: D116667979 Pull Request resolved: facebookincubator#18864
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Merge summary
796c6214c89a78ef86df29a64d4351129f62cb86..d13ef1e303af6a12cfb770f8144fad49594bd5baf95611c3ee9d3556e2a600aaf1faef20d487aba92cb8ace70220dc8a151816ab1412ea472b6a1202dev: freshly fetchedcf619d90eca1b83ad31f446b96482df096d24923was already contained; no second merge commit was required.2cb8ace70220dc8a151816ab1412ea472b6a1202.github: retained exactly from the recorded latestdownstream/dev; upstream.githubchanges were ignored.Notable changes
masked_select_jagged, and.pt2flat-input loading.AverageAggregate::toIntermediateandbtrim; vector decoding exposes whether buffers are borrowed or owned.Invokewrappers were removed. This range has no netexperimental/cudfchanges.Conflict resolutions
.githubwas restored and verified against the recorded baseline after the upstream merge, per downstream-ownership policy.Validation
BLOCKED_ON_SPARK_GLUTEN_FIX— smoke and full Colt validation pass against the unmerged fix below; this Velox PR remains Draft until that fix lands in Spark-Glutendevand validation is rerun from scratch againstdev.dev:9f732196834cb3d1f67488dd1d2f93823802dc7adf462d247c8f5193d578ee8f8242d1a8c909748e(Ready).73f99f12c9f0fe067f48a667a68e0c52e4dbd832ebb16dcd6fcb238b34d39cd00a2eb46a9525d5ec; generated manifest9b45526e6ac686c3fb1a95fdb2f94f1ae48e90b7113de4dcfe80d58f5835e338; provenance at/home/liangcail/velox-upstream-sync-20260814/results/20260907T041509Z/verify-config/provenance.json(SHA-256e28bcbb0f83e7c716050f5468e377e3ddc8878276d763ca0b78ba5f139a0732d).devfailure:build-libs, return code 2.InsertTableHandlerequirednotNullColumns, andUnnestNoderequired optional output names. Evidence:/home/liangcail/velox-upstream-sync-20260814/results/20260907T033307Z/smoke/verify/workflow/logs/10-build-libs/spark-gluten-build-libs.log.df462d247c8f5193d578ee8f8242d1a8c909748esupplies an emptynotNullColumnsset to preserve existing behavior and usesvector<optional<string>>for Unnest names.git diff --check, both independent clean consumer builds, and all downstream tests passed./home/liangcail/velox-upstream-sync-20260814/results/20260907T041509Z/smoke/verify./home/liangcail/velox-upstream-sync-20260814/results/20260907T041509Z/full/verify./home/liangcail/velox-upstream-sync-20260814/results/20260907T041509Z/sync-validation.json.native, detected SM89 on GPU 0 (NVIDIA L4); driver modeautoresolved to host; cuDF5beaa5954688fcb12236ffb434e192ea2c77db30; sealed dependency carriersha256:b52df2b7521e0fb00e0ec14a3cf7428c7bbd8dba0caba037c5d308c9c19b3094; smoke/full build execution imagessha256:b13917dd0d88e30d94aab058e18e754e419348c3f679c26cf05f8583f71a3782andsha256:e2724244a0268243dfc11747b45c29d6c45ddfac5f5f30ea99769328e3c8828a; smoke/full runtime imagesha256:1b42a229c8357223f5c3bdc06dceee2ddddf6c3d0e692db1b5a8b8b074ffaaa3.