OpenVINO backend: enable cohere2 for arch test#176

Closed

zhaixuejun1993 wants to merge 76 commits into

ravi9:dev_backend_openvinofrom

zhaixuejun1993:xuejun/arch-test-cohere

Commits on Apr 22, 2026

Add interface is_model_splitted() to check the c-graph is splited or not

zhaixuejun1993
authored and
wine99
committed
Infer and propagate dynamic-dimension indices for all tensors in the GGML graph in api compute_model_outputs()

zhaixuejun1993
authored and
wine99
committed
Only do this for fallback sub graph

zhaixuejun1993
authored and
wine99
committed
Move dynamic dims compute in graph missmatch

zhaixuejun1993
authored and
wine99
committed
ggml-openvino: fix tensor data handling for PERMUTE/VIEW ops in split models

zhaixuejun1993
authored and
wine99
committed
ggml-openvino:add comments

zhaixuejun1993
authored and
wine99
committed
ggml-openvino: override VIEW op_case to 0 for split model inputs

zhaixuejun1993
authored and
wine99
committed
openvino backend: Handle unsupported VIEW shape-mismatch in OpenVINO backend

zhaixuejun1993
authored and
wine99
committed
Enable additional mul_mat tests and add tensor data saving function (#81)

zhaixuejun1993
authored and
wine99
committed
ggml-openvino: fix CONT/TRANSPOSE mapping and improve dynamic-dimension handling

zhaixuejun1993
authored and
wine99
committed
OpenVINO: add NORM/TANH support and rework SOFT_MAX translation

zhaixuejun1993
authored and
wine99
committed
ggml-openvino: extend VIEW handling

zhaixuejun1993
authored and
wine99
committed
Enable -fa off (#118)
wine99
committed
Enable --context-shift
wine99
committed
Fix llm param compute error for normal softmax not the softmax in attention

zhaixuejun1993
authored and
wine99
committed
OpenVINO backend: fix error for attention size compute in llm param

zhaixuejun1993
authored and
wine99
committed

Commits on Apr 29, 2026

use tensor->extra in infer_request i/o
wine99
committed
OpenVINO backend: refacter the compute_llm_params() func add get_attention_pattern_case to easy extand

zhaixuejun1993
authored and
wine99
committed
OpenVINO backend: clean unused code

zhaixuejun1993
authored and
wine99
committed

Commits on May 4, 2026

Commits on May 6, 2026

1to1 match op update (#146)

cavusmustafa
and
Mustafa Cavus
authored
initial gemma4 support

Mustafa Cavus
authored and
wine99
committed
removed hardcoded names for kv cache slicing

cavusmustafa
authored and
wine99
committed
OpenVINO backend: Add new attention pattern for llm parameters compute

zhaixuejun1993
authored and
wine99
committed
Merge pull request #144 from cavusmustafa/stateless_perf_opt
cavusmustafa
authored

Commits on May 7, 2026

Commits on May 9, 2026

OpenVINO backend: enable get_rows with view

zhaixuejun1993
authored and
yangwang201911
committed
OpenVINO backend: enable view + norm/rms_norm

zhaixuejun1993
authored and
yangwang201911
committed
OpenVINO backend: concat op

zhaixuejun1993
authored and
yangwang201911
committed
OpenVINO backend: argsort op

zhaixuejun1993
authored and
yangwang201911
committed

Commits on May 11, 2026

OpenVINO backend: enable unary + view & GGML_UNARY_OP_SOFTPLUS

zhaixuejun1993
authored and
yangwang201911
committed
Fix issue for test-backend-ops in TOPK_MOE, which compare VIEW ops result, VIEW node in OpenVINO no need compare, the whole graph result is correct

zhaixuejun1993
authored and
yangwang201911
committed
OpenVINO backend: remove hardcode name inp_tokens, which ignore some leaf case

zhaixuejun1993
authored and
wine99
committed
OpenVINO backend: enable sum_rows

zhaixuejun1993
authored and
yangwang201911
committed
OpenVINO backend: enable clamp

zhaixuejun1993
authored and
yangwang201911
committed
OpenVINO backend: enable DIV

zhaixuejun1993
authored and
yangwang201911
committed
OpenVINO backend: enable GGML_OP_MUL_MAT_ID

zhaixuejun1993
authored and
yangwang201911
committed
OpenVINO backend: disable MUL_MAT_ID_FUSION case with large mem needed

zhaixuejun1993
authored and
yangwang201911
committed

Commits on May 12, 2026

Commits on May 13, 2026

Commits on May 14, 2026

OpenVINO backend: fix issue in mul_mat_id

zhaixuejun1993
authored and
yangwang201911
committed
OpenVINO backend: Disable DIV with broadcast on GPU

zhaixuejun1993
authored and
yangwang201911
committed

Commits on May 15, 2026

Commits on May 19, 2026

Commits on May 20, 2026

Commits on May 22, 2026

Merge branch 'dev_backend_openvino' into xuejun/arch-test-cohere
wine99
authored