Search results

Add grpc and graphql endpoints

Status: Open.

#17 In geniusrise/text;

· ixaxaar opened on Mar 26, 2024

Integrate TorchDistributor based fine-tuning and inference on spark

enhancementNew feature or requestNew feature or request

Status: Open.

#14 In geniusrise/text;

· ixaxaar opened on Mar 1, 2024

Support OAUTH token introspection in APIs

enhancementNew feature or requestNew feature or request

good first issueGood for newcomersGood for newcomers

Status: Open.

#13 In geniusrise/text;

· ixaxaar opened on Mar 1, 2024

Add K-V cache, more options for compilation

enhancementNew feature or requestNew feature or request

good first issueGood for newcomersGood for newcomers

Status: Open.

#12 In geniusrise/text;

· ixaxaar opened on Mar 1, 2024

Think about supporting triton - as triton server client or triton as lib + FFI

questionFurther information is requestedFurther information is requested

Status: Open.

#9 In geniusrise/text;

· ixaxaar opened on Feb 27, 2024

Add support for local models for llama.cpp in text

enhancementNew feature or requestNew feature or request

good first issueGood for newcomersGood for newcomers

Status: Open.

#8 In geniusrise/text;

· ixaxaar opened on Feb 27, 2024

Abstract out inference and batch inference - text

good first issueGood for newcomersGood for newcomers

Status: Open.

#7 In geniusrise/text;

· ixaxaar opened on Feb 27, 2024

Implement batching for APIs - text

enhancementNew feature or requestNew feature or request

Status: Open.

#6 In geniusrise/text;

· ixaxaar opened on Feb 27, 2024

Implement streaming inference - text

enhancementNew feature or requestNew feature or request

Status: Open.

#5 In geniusrise/text;

· ixaxaar opened on Feb 27, 2024