Video Encode/Decode - #226

Merged

dzhdanNV merged 139 commits into

NVIDIA-RTX:mainfrom

Daedie-git:video-queues

Aug 25, 2026

Commits on Apr 27, 2026

Add video queue support
BjornSAIM
committed
f2d5cfa
Add video encode/decode extension
BjornSAIM
committed
c9a1145

Commits on Apr 28, 2026

processed review
BjornSAIM
committed
1fd07d7

Commits on Apr 30, 2026

Merge branch 'main' of https://github.com/NVIDIA-RTX/NRI into video-queues
BjornSAIM
committed
c24ea91
Split video wrapper payloads from NRIVideo
BjornSAIM
committed
44202e5
Mark optional video references idiomatically
BjornSAIM
committed
f6d0505
Implement neutral video session coverage
BjornSAIM
committed
9aa2bc6
Add neutral video picture abstraction
BjornSAIM
committed
feecc1c
Add neutral video encode decode support
BjornSAIM
committed
4a2960d

Commits on May 1, 2026

Commits on May 3, 2026

Commits on May 5, 2026

Add backend-neutral video encode/decode helpers
BjornSAIM
committed
c36df23
Merge remote-tracking branch 'upstream/main' into video-queues
BjornSAIM
committed
f2483c2
Format video queue changes
BjornSAIM
committed
11797b9
Format layout enum comments
BjornSAIM
committed
e424565
Restore public header alignment
BjornSAIM
committed
e075e1c
Restore wrapper header alignment
BjornSAIM
committed
aea7122
Restore Vulkan header alignment
BjornSAIM
committed
e2e5192

Commits on May 6, 2026

Simplify video resource and queue API
BjornSAIM
committed
ddd1876
Probe D3D12 video codec features
BjornSAIM
committed
62cd9bd
Clean up D3D12 readable reconpic flag shim
BjornSAIM
committed
f6f7fc7
Refine video support integration
BjornSAIM
committed
62be2a3
Restore Vulkan queue selection shape
BjornSAIM
committed
844528a
Remove unused video version macro
BjornSAIM
committed
f95db9f

Commits on May 7, 2026

Add AV1 inter-frame decode info parsing
BjornSAIM
committed
7cf9655
Remove NRI-hosted AV1 tests
BjornSAIM
committed
f4de675
Address video review cleanup
BjornSAIM
committed
4200f06
Complete D3D12 video capability checks
BjornSAIM
committed
8cef8b0
Rename compatible video memory index
BjornSAIM
committed
78eb5b5
Prefer D3D12 AV1 metadata decode info
BjornSAIM
committed
01a7ece
Store Vulkan AV1 encode headers in metadata
BjornSAIM
committed
0bc7866

Commits on May 8, 2026

Address video review feedback
BjornSAIM
committed
435d014
Restore existing file copyright years
BjornSAIM
committed
6863e3b
Preserve NRIDescs header encoding
BjornSAIM
committed
de861b7
Restore existing file BOMs
BjornSAIM
committed
4a1cd4c
Preserve VK header EOF style
BjornSAIM
committed
c5de904

Commits on May 21, 2026

addressed review partially
BjornSAIM
committed
08b7b1a
Fix Vulkan video capability queries
BjornSAIM
committed
330f93d
Fix video encode feedback handling
BjornSAIM
committed
b2469b2
Move video object implementations to headers
BjornSAIM
committed
54700a6
Clarify video encode end-of-stream flag
BjornSAIM
committed
35fea29
Merge remote-tracking branch 'upstream/main' into video-queues
BjornSAIM
committed
d5bf596

Commits on May 26, 2026

refactor(video): polish backend integration
BjornSAIM
committed
59ec044

Commits on May 27, 2026

fix: tighten video resolve and timestamp support
BjornSAIM
committed
81dfce6

Commits on May 28, 2026

Proper implementation of "best" interfaces
dzhdanNV
committed
1acd35a
Polishing
dzhdanNV
committed
3532661
Refactoring (no functional changes)
dzhdanNV
committed
6be8b6d
Fix
dzhdanNV
committed
dbba522
Merge pull request #2 from NVIDIA-RTX/fixes
Daedie-git
authored
281599b

Commits on May 29, 2026

Merge branch 'main' into video-queues
dzhdanNV
authored
c294b92
Polishing
dzhdanNV
committed
9a6c7aa
Refactoring (no functional changes)
dzhdanNV
committed
cd4070e
Merge branch 'main' of https://github.com/NVIDIA-RTX/NRI into video-queues
dzhdanNV
committed
6015877
Removed unnecessary functions: ResourceBarrier and Barrier
dzhdanNV
committed
a8aeace
Refactored "ID3D12XxxCommandListBest" functions
dzhdanNV
committed
cc1c31c
Polishing
dzhdanNV
committed
6c20d0c

Commits on Jun 4, 2026

Merge branch 'main' of https://github.com/NVIDIA-RTX/NRI into video-queues
dzhdanNV
committed
2dd4d3a
Removed "subresource" from "VideoPictureDesc", which doesn't exist in NRI as a logical entity
dzhdanNV
committed
a4ae5b0
Fixed formatting
dzhdanNV
committed
7643c05
Fixed formatting
dzhdanNV
committed
f894967
Removed "format" from "VideoPictureDesc" to reach D3D12/VK parity
dzhdanNV
committed
1375838
Formatting
dzhdanNV
committed
fab99ac
Moved "CmdVideoX" functions to "CommandBuffer" implementations. Moved some (not all) error checks to "Val" (they were different in D3D12/VK for some reason)
dzhdanNV
committed
b267a63
Cleanup
dzhdanNV
committed
8b3ac08

Commits on Jun 5, 2026

"NRI_D3D12_HAS_VIDEO_ENCODE_AV1" replaced with "NRI_ENABLE_AGILITY_SDK_SUPPORT" (it's all or nothing, NRI requires latest known AgilitySDK if it's enabled)
dzhdanNV
committed
8dbb018
Reverted changes in wrappers (see TODOs):
dzhdanNV
committed
d13e171
"VideoSessionD3D12" cleanup:
dzhdanNV
committed
dd10917
Renamed "VideoUsage" to "VideoSessionType"
dzhdanNV
committed
7478cab
Added TODOs
dzhdanNV
committed
c968003
Updated to the latest + resolved some TODOs
dzhdanNV
committed
0ba9927
Merge branch 'main' of https://github.com/NVIDIA-RTX/NRI into video-queues
dzhdanNV
committed
25ae58b
Merge branch 'main' of https://github.com/NVIDIA-RTX/NRI into video-queues
dzhdanNV
committed
1334639
fix(vk): avoid deprecated aligned storage
BjornSAIM
committed
d1c4660

Commits on Jun 6, 2026

cmake: Pin fetched dependency hashes
BjornSAIM
committed
9a4ed0b

Commits on Jun 7, 2026

Commits on Jun 8, 2026

Massaged "videoFeatures" to reflect recent changes in NRI API
dzhdanNV
committed
35bdb55
Polishing
dzhdanNV
committed
d7bc69e
Ensure that "D3D12 encoder" stuff is used only if Agility SDK is enabled (WIP) + refactoring
dzhdanNV
committed
f7f9db8
Merge branch 'main' of https://github.com/NVIDIA-RTX/NRI into video-queues
dzhdanNV
committed
0815eb8
Fixed regression
dzhdanNV
committed
4f9761f
Ensure that "D3D12 encoder" stuff is used only if Agility SDK is enabled (now compiles for min spec, i.e. Win SDK 10.0.20348)
dzhdanNV
committed
2c33a6a
Merge branch 'main' of https://github.com/NVIDIA-RTX/NRI into video-queues
dzhdanNV
committed
8b01c81
initial agent support
BjornSAIM
committed
e526b4b
Remove video encode EOS flag
BjornSAIM
committed
178a5a4

Commits on Jun 12, 2026

Finalize NRI video support
BjornSAIM
committed
2741780
Add AV1 OBU header helper
BjornSAIM
committed
923e609

Commits on Jun 13, 2026

Fix generated AV1 decode metadata
BjornSAIM
committed
2a0c180

Commits on Jun 15, 2026

Merge branch 'main' of https://github.com/NVIDIA-RTX/NRI into video-queues
dzhdanNV
committed
b9e5e08

Commits on Jun 16, 2026

Updated to the latest:
dzhdanNV
committed
7a3b84c
Fixed a regression
dzhdanNV
committed
b096c4b

Commits on Jun 17, 2026

Merge branch 'main' of https://github.com/NVIDIA-RTX/NRI into video-queues
dzhdanNV
committed
667cd50

Commits on Jun 19, 2026

D3D12: Fix video buffer barriers
BjornSAIM
committed
7c930cb

Commits on Jun 21, 2026

Update video TODOs
BjornSAIM
committed
bbb9f3c
Support H26 B-frame video encode
BjornSAIM
committed
93fa63c
Fix video B-frame encode handling
BjornSAIM
committed
0a3c8d5
Document video backend discrepancies
BjornSAIM
committed
94fe752
Fix video B-frame validation
BjornSAIM
committed
3b9fe2d
Clean up Vulkan video smoke findings
BjornSAIM
committed
4068e5c
Clean up Vulkan video session API
BjornSAIM
committed
5e03509
Validate video B-frame references
BjornSAIM
committed
eca7c5e
Fix video encode TODO bugs
BjornSAIM
committed
cf76352

Commits on Jun 22, 2026

Merge branch 'main' of https://github.com/NVIDIA-RTX/NRI into video-queues
dzhdanNV
committed
c566ff5

Commits on Jun 23, 2026

Fix Vulkan AV1 enum fallbacks
BjornSAIM
committed
55198d7

Commits on Jul 29, 2026

Fix video metadata and validation
BjornSAIM
committed
5192556

Commits on Aug 24, 2026

Merge branch 'main' into video-queues
dzhdanNV
authored
528b706
Fixed compilation after update to the latest
dzhdanNV
committed
f2a0719
Fixes
dzhdanNV
committed
6d55a8b
Review: allow WIP ABI changes
dzhdanNV
committed
ada8e18
VK: fix decode output and DPB handling
dzhdanNV
committed
a2ee002
D3D12: restore encode metadata state after resolve
dzhdanNV
committed
07550a3
VK: require video maintenance for bitstream buffers
dzhdanNV
committed
2b73748
Validation: check video decode slice offsets
dzhdanNV
committed
19ec459
VK: fix video picture array layer
dzhdanNV
committed
c808ddb
Video: add role-specific picture states
dzhdanNV
committed
110e781
Shared: generalize array validation
dzhdanNV
committed
79fd711
D3D12: report decode DPB output modes accurately
dzhdanNV
committed
1ae72f1
Validation: enforce video command queue types
dzhdanNV
committed
bc666bc
VK: report wrapped video codec support accurately
dzhdanNV
committed
9988655
VK: fix encode feedback bitstream offset
dzhdanNV
committed
09041d1
Video: use scratch storage for AV1 parameters
dzhdanNV
committed
0bb070f
Video: address non-blocking audit findings
dzhdanNV
committed
39ce136
Video: fix remaining merge blockers
dzhdanNV
committed
7bbd168
Video: polish API and Vulkan implementation
dzhdanNV
committed
80d63c8

Commits on Aug 25, 2026

Video: finalize API and backend correctness
dzhdanNV
committed
cdbe40b
Refactor file-local helper placement
dzhdanNV
committed
0674c1c
Refine file-local inline qualifiers
dzhdanNV
committed
f2d3c15
Consolidate shared video helpers
dzhdanNV
committed
db6a473
Rename shared video header
dzhdanNV
committed
b4a283f
Simplify file-local backend helper names
dzhdanNV
committed
e8c6720
Fix D3D12 decode setup mapping and polish video paths
dzhdanNV
committed
d25c3b3
Clarify native decode slots and Vulkan diagnostics
dzhdanNV
committed
8fadf05
Clarify neutral H264 decode setup slot
dzhdanNV
committed
b892aea