Skip to content

[Feat] Asu: integrate submit flow with transport runtime #999

Merged
Infinite666 merged 4 commits into
ModelEngine-Group:feature_26h1from
yuanzhg078:dev_asu_trans_pr_3
Jun 6, 2026
Merged

[Feat] Asu: integrate submit flow with transport runtime #999
Infinite666 merged 4 commits into
ModelEngine-Group:feature_26h1from
yuanzhg078:dev_asu_trans_pr_3

Conversation

@yuanzhg078

Copy link
Copy Markdown
Contributor

Purpose

Integrate the ASU submit flow into AsuTransportImpl so async transport APIs can build SQEs, send sub-batches, poll completions, and return final task/query results.

Modifications

Initialize send buffer manager, flag buffer manager, and ProtocolManager during transport initialization.
Validate SQE/send attrs before starting transport worker threads.
Add request CID allocation for ASU SQE submissions.
Add completion polling thread to detect completed response CIDs, unpack CQEs, map response status, and finalize sub-batches.
Replace placeholder CompleteTask logic with real request submission, connection assignment, send-buffer construction, send execution, cancellation cleanup, and completion finalization.
Treat vector LoadAsync and StoreAsync as BATCH_LOAD and BATCH_STORE so they use ASU batch SQE flow.
Build TaskResult entryStatus from completed sub-batches and derive QueryResult from ASU query entry status.
Parse transport.* config attrs and propagate them into each TransportConfig for SQE/send configuration.

Test

Runtime integration was not fully executed locally because ASU transport execution depends on the Ascend/ACL runtime environment. Covered paths are validated through ASU transport unit tests for request submission, send-buffer construction, completion handling, response status mapping, and config attr parsing.

Comment thread ucm/transport/kv/asu/trans/src/asu_transport_impl.cpp
Comment thread ucm/transport/kv/asu/trans/src/asu_transport_impl.cpp Outdated
Comment thread ucm/transport/kv/asu/trans/src/asu_transport_impl.cpp Outdated
@yuanzhg078 yuanzhg078 force-pushed the dev_asu_trans_pr_3 branch from b87238a to fe013a6 Compare June 5, 2026 15:16
Comment thread ucm/transport/kv/asu/trans/src/asu_transport_impl.cpp
Comment thread ucm/transport/kv/asu/trans/src/asu_transport_impl.cpp
@yuanzhg078 yuanzhg078 force-pushed the dev_asu_trans_pr_3 branch from 50555f9 to 55695b1 Compare June 6, 2026 06:20
Comment thread ucm/transport/kv/asu/trans/src/asu_response_status.cpp Outdated
@yuanzhg078 yuanzhg078 force-pushed the dev_asu_trans_pr_3 branch from 55695b1 to 3b41646 Compare June 6, 2026 06:31
Comment thread ucm/transport/kv/asu/common/config_parser_common.cpp
@yuanzhg078 yuanzhg078 force-pushed the dev_asu_trans_pr_3 branch 3 times, most recently from fc14996 to 80b3e15 Compare June 6, 2026 07:30
yuanzhg078 and others added 4 commits June 6, 2026 16:13
Initialize request buffers and protocol state in AsuTransportImpl, then drive sub-batch send and completion polling through the worker threads.

Parse transport.* config attrs so SQE and send parameters flow from client config into transport initialization.
…nfig parser. Merge common part of ClientConfigParser and TransportConfigParser into common/.

# Conflicts:
#	ucm/transport/kv/asu/trans/src/asu_transport_impl.cpp
@yuanzhg078 yuanzhg078 force-pushed the dev_asu_trans_pr_3 branch from 80b3e15 to f1a8bbf Compare June 6, 2026 08:14
@Infinite666 Infinite666 merged commit c38d458 into ModelEngine-Group:feature_26h1 Jun 6, 2026
8 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

5 participants