Multiple model selection with remote service - #2

Open

sgurunat wants to merge 105 commits into

mainfrom

multiple-model-with-remote-service

Commits on Oct 28, 2024

update codetrans default model (#1015)

XinyaoWa
and
pre-commit-ci[bot]
authored
a2afce1
[Codegen] Replace codegen default Model to Qwen/Qwen2.5-Coder-7B-Instruct. (#1013)

yao531441
and
pre-commit-ci[bot]
authored
2332d22
manifest CI: repopulate the failure from inner test script (#1032)
lianhao
authored
bc47930

Commits on Oct 29, 2024

fix FaqGen accuracy scripts bug (#1039)
XinyaoWa
authored
fde5996
Add chatqna_wrapper.py along with updated Dockerfile.wrapper. To support multiple models chatqna with wrapper is required
sgurunat
committed
a3ef260
ProductivitySuite: Add docker compose files for Intel Gaudi server along with remote tgi/tei service with instructions
sgurunat
committed
1d30bff
ProductivitySuite UI: Update names of ChatQnA, CodeGen, DocSum to Digital Assistant, Code Generator, Content Summarizer respectively
sgurunat
committed
8ec0f6a
ProductivitySuite UI: Update Docsum to have vertical scroll bar if content exceeds the window height
sgurunat
committed
6216b5a
ProductivitySuite UI: Remove <|eot_id|> string from the Chat, Docsum and Faqgen response
sgurunat
committed
a6e4a7d
ProductivitySuite UI: Update contextWrapper and contextTitle width to adjust to different screen sizes
sgurunat
committed
b999077
ProductivitySuite UI: Show system prompt input field always to edit in the chatqna prompt section
sgurunat
committed
cf96dcc
ProductivitySuite UI: Update max_new_tokens into max_tokens in ConversationSlice
sgurunat
committed
debdd0f
ProductivitySuite UI: Add multiple models support in ChatQnA. Choose different models from dropdown
sgurunat
committed
0a5584a

Commits on Oct 30, 2024

Commits on Oct 31, 2024

Fix ChatQnA manifest test issue on Xeon (#1044)

chensuyue
and
pre-commit-ci[bot]
authored
0f5a9c4
update action for CI (#1050)
chensuyue
authored
9d12416

Commits on Nov 1, 2024

fix vllm output in chatqna (#1038)
XinyaoWa
authored
c65d7d4
Add Workflow Executor Example (#892)

JoshuaL3000
and
pre-commit-ci[bot]
authored
bf5c391

Commits on Nov 3, 2024

Add performance benchmark scripts for 4 use cases. (#1052)

joshuayao
and
pre-commit-ci[bot]
authored
ced68e1

Commits on Nov 4, 2024

Update AgentQnA example for v1.1 release (#885)

minmin-intel
and
pre-commit-ci[bot]
authored
5eb3d28
update accuracy embedding endpoint for no wrapper (#1056)

lkk12014402
and
pre-commit-ci[bot]
authored
3372b9d
Update TGI CPU image to latest official release 2.4.0 (#1035)

lvliang-intel
and
pre-commit-ci[bot]
authored
0306c62
Inject commit for the release docker image (#1060)
ZePan110
authored
7f7ad0e
Add nightly image build and publish action (#1067)

chensuyue
and
pre-commit-ci[bot]
authored
78331ee
Use docker stop instead of docker compose stop to avoid container clean up issue (#1068)

chensuyue
and
pre-commit-ci[bot]
authored
c2b7bd2

Commits on Nov 5, 2024

Update nightly image build jobs (#1070)
chensuyue
authored
cf86ace
[Doc] Fix broken build instruction (#1063)
xiguiw
authored
a0921f1
fix wrong format which break online doc build (#1073)

NeoZhangJianyu
and
arthw
authored
2d9aeb3

Commits on Nov 6, 2024

[ChatQnA] Fix the service connection issue on GPU and modify the emb backend (#1059)
wangkl2
authored
944ae47

Commits on Nov 7, 2024

Enhance CI hardware list detect (#1077)
chensuyue
authored
2de7c0b
Merge branch 'main' into multiple-model-with-remote-service
jaswanth8888
authored
0d3ec68
[Doc] Add steps to deploy opea services using minikube (#1058)

authored
6263b51
align vllm hpu version to latest vllm-fork (#1061)
XinyaoWa
authored
e9b1645
Remove debug outputs (#1085)
ZePan110
authored
1da44d9
Make embedding run on CPU for aligning with Gaudi performance benchmark (#1057)

lvliang-intel
and
chensuyue
authored
4635a92

Commits on Nov 8, 2024

ProductivitySuite: Update TGI CPU image version to 2.4.0 (#1062)
hteeyeoh
authored
11d8b24
Add CI case to check online doc building, not update online doc (#1087)

NeoZhangJianyu
and
arthw
authored
fe97e88
remove vllm-on-ray (#1084)
XinyaoWa
authored
40386d9
Align faqgen to form input (#1089)

XinyaoWa
and
pre-commit-ci[bot]
authored
4c27a3d
Add new image repo clone. (#1093)
ZePan110
authored
dd9623d
MultimodalQnA Image and Audio Support Phase 1 (#1071)

authored
bbc95bb
Fix faq ut bug (#1097)
XinyaoWa
authored
9c3023a
Add EdgeCraftRag as a GenAIExample (#1072)

authored
c9088eb
update faqGen ui response (#1091)

authored
e2bdd19
opt CI to skip none MD and RST files (#1098)
NeoZhangJianyu
authored
ee83a6d
Improve the robustness of links check workflow (#1096)
ZePan110
authored
049517f
Bump gradio from 5.0.0 to 5.5.0 in /MultimodalQnA/ui/gradio (#1080)
dependabot[bot]
authored
dfed2ae
ProductivitySuite: Fix typo in README (#1083)
hteeyeoh
authored
edc09ec
[ChatQnA] Fix the no_proxy setting for gpu example (#1078)
wangkl2
authored
f702677
image build bug fix (#1105)
chensuyue
authored
82801d0

Commits on Nov 11, 2024

Commits on Nov 12, 2024

Commits on Nov 13, 2024

Pinecone update to Readme and docker compose for ChatQnA (#540)

authored
0d52c2f
Enable vLLM Profiling for ChatQnA (#1124)
louie-tsai
authored
7adbba6
Merge branch 'main' into multiple-model-with-remote-service
sgurunat
authored
d7414b9
[pre-commit.ci] auto fixes from pre-commit.com hooks
pre-commit-ci[bot]
committed
502f2d5
Fix left issue of tgi version update (#1121)

chensuyue
and
pre-commit-ci[bot]
authored
393367e
Merge branch 'main' into multiple-model-with-remote-service
sgurunat
authored
de76c7a
Fix missing end of file chars (#1106)

ashahba
and
pre-commit-ci[bot]
authored
b5f95f7
Use fixed version of TEI Gaudi for stability (#1101)

lvliang-intel
and
Malini Bhandaru
authored
9ff7df9
ChatQnA - Add Terraform and Ansible Modules information (#970)

authored
7c9ed04

Commits on Nov 14, 2024

fix faq ui bug (#1118)

XinyaoWa
and
pre-commit-ci[bot]
authored
73879d3
Merge branch 'main' into multiple-model-with-remote-service
sgurunat
authored
4df84e5
Add benchmark launcher for AudioQnA (#981)

joshuayao
and
pre-commit-ci[bot]
authored
5720cd4
added test_compose_on_gaudi.sh file
sgurunat
committed
bdc873f
Merge branch 'multiple-model-with-remote-service' of https://github.com/sgurunat/GenAIExamples into multiple-model-with-remote-service
sgurunat
committed
159b58b
DBQnA: Include workflow in README (#956)
hteeyeoh
authored
6b9a27d
Merge branch 'main' into multiple-model-with-remote-service
sgurunat
authored
d023af8
upgrade setuptools version to fix CVE-2024-6345 (#999)
chensuyue
authored
2b2c7ee
Merge branch 'main' into multiple-model-with-remote-service
sgurunat
authored
0bc52a5
Modified test_compose_on_gaudi compose to use build.yaml file
sgurunat
committed
d961b30
Updated compose.yaml file in gaudi folder related to codegen
sgurunat
committed
bd97160