Get started with kubectl-ai with open LLMs using AIKit easily

If you don't have OpenAI API access, you can set up a local OpenAI API-compatible endpoint using AIKit on your local machine without any GPUs! For more information, see the AIKit documentaton.

docker run -d --rm -p 8080:8080 ghcr.io/sozercan/llama3.1:8b
export OPENAI_ENDPOINT="http://localhost:8080/v1"
export OPENAI_DEPLOYMENT_NAME="llama-3.1-8b-instruct"
export OPENAI_API_KEY="n/a"

After setting up the environment like above, you can use kubectl-ai as usual.

Changelog

• 645159f update readme with local instructions (#172)
• 694bd72 chore: use system prompt (#136)
• 1b62f83 chore: bump the actions-all group across 1 directory with 5 updates (#170)
• 611003e chore: bump the k8s group across 1 directory with 3 updates (#167)
• d61dc7f chore: bump github.com/sashabaranov/go-openai from 1.26.2 to 1.27.1 (#169)
• acbd25c chore: bump github.com/spf13/cobra from 1.8.0 to 1.8.1 (#157)
• 4736ab3 chore: bump the k8s group across 1 directory with 3 updates (#152)
• 48c3ea8 chore: bump the actions-all group across 1 directory with 6 updates (#163)
• a5d5ac8 chore: bump github.com/sashabaranov/go-openai from 1.24.0 to 1.26.2 (#162)
• 9248c3d chore: bump the actions-all group across 1 directory with 8 updates (#151)
• 645fde0 chore: bump github.com/sashabaranov/go-openai from 1.21.0 to 1.24.0 (#150)
• adb09b3 chore: bump golang.org/x/net from 0.21.0 to 0.23.0 in the go_modules group (#142)
• bc15913 chore: bump github.com/sashabaranov/go-openai from 1.20.5 to 1.21.0 (#140)
• 6c0e85d chore: bump github/codeql-action from 3.24.10 to 3.25.0 in the actions-all group (#141)
• 523e8c2 chore: bump github/codeql-action from 3.24.9 to 3.24.10 in the actions-all group (#138)
• 7a48d9a chore: bump github.com/sashabaranov/go-openai from 1.20.4 to 1.20.5 (#137)
• 0f97f46 chore: bump github.com/charmbracelet/glamour from 0.6.0 to 0.7.0 (#134)
• a6ad689 chore: bump the actions-all group with 1 update (#135)
• 0052302 chore: bump the actions-all group with 2 updates (#133)
• 61dd51c chore: bump the actions-all group with 2 updates (#132)
• aeb9421 chore: bump the k8s group with 3 updates (#131)
• 5ba3940 build(deps): bump github.com/sashabaranov/go-openai from 1.20.3 to 1.20.4 (#126)
• f230ab4 ci: dependabot group stuff (#130)
• 259e2d7 build(deps): bump github.com/sashabaranov/go-openai from 1.20.2 to 1.20.3 (#118)
• 7063175 build(deps): bump ossf/scorecard-action from 2.0.6 to 2.3.1 (#119)
• 828eb5b build(deps): bump actions/dependency-review-action from 2.5.1 to 4.1.3 (#120)
• bc03dae build(deps): bump actions/upload-artifact from 3.1.3 to 4.3.1 (#121)
• 706f9b7 build(deps): bump github/codeql-action from 2.24.6 to 3.24.6 (#122)
• 18d0993 chore: improve ui and prompt (#117)
• a6f47c3 chore: use toolcalls (#116)
• 0043908 Krew manifest update for kubectl-ai version v0.0.12 (#115)
• e42b24b Brew formula update for kubectl-ai version v0.0.12 (#114)

v0.0.13 Latest

Latest

Compare

Choose a tag to compare

Changelog

• 972ea9c feat: support for stdin (#110)
• 2695058 build(deps): bump github.com/sashabaranov/go-openai from 1.16.1 to 1.20.2 (#108)
• 3e70b18 build(deps): bump actions/checkout from 3.6.0 to 4.1.1 (#109)
• ab0ddb3 [StepSecurity] Apply security best practices (#107)
• b4e10af chore: remove deprecated apis (#105)
• 8c15493 test: add test (#106)
• f09825e docs: add aikit (#104)
• 808b008 Added current context view (#79)
• dfe4b8c Brew formula update for kubectl-ai version v0.0.11 (#76)
• fda25ed Krew manifest update for kubectl-ai version v0.0.11 (#77)

New Contributors

• @eyal-solomon1 made their first contribution in #79
• @step-security-bot made their first contribution in #107

Full Changelog: v0.0.11...v0.0.12

v0.0.12

Compare

Choose a tag to compare

Notable Changes

• 🤖 Local AI support (#67)
  • Allows integration with self-hosted, community-driven, local OpenAI-compatible API.
  • See https://localai.io/basics/getting_started/index.html for getting started.
• ☎️ Kubernetes API support with function calling (#69)
  • This will result in very accurate completions including CRDs (if present in configured cluster).
  • See --use-k8s-api flag or USE_K8S_API environment variable in the readme for more details.
  • This setting will use more OpenAI API calls and it requires function calling which is available in 0613 and later models. Defaults to false. However, this is recommended for accuracy and completeness.

Changelog

• 8ae3528 update goreleaser (#75)
• afd1e40 update goreleaser (#73)
• 90d00d9 update goreleaser (#72)
• a8cd2b2 update deprecated fields in goreleaser (#71)
• 3af5ab9 fix windows build (#70)
• 0e47b2d feat: function calling (#69)
• b64b73c feat: localai support (#67)
• 3684351 [update] Support for custom OpenAI API Base (#41)
• 44e3584 build(deps): bump k8s.io/cli-runtime from 0.27.2 to 0.27.4 (#63)
• c0b1c5b build(deps): bump github.com/sashabaranov/go-openai from 1.9.5 to 1.14.1 (#66)
• 48e1b96 build(deps): bump github.com/sashabaranov/go-openai from 1.9.4 to 1.9.5 (#50)
• b0294c9 retry for 429 (#49)
• 509ffcf update openai library (#48)
• 013cf88 docs: editor usage (#47)
• 8de4335 build(deps): bump k8s.io/cli-runtime from 0.27.1 to 0.27.2 (#42)
• 9dcfaff build(deps): bump github.com/stretchr/testify from 1.8.2 to 1.8.3 (#44)
• 736954c build(deps): bump golang.org/x/net from 0.9.0 to 0.10.0 (#40)
• 4aeeaf9 Updated kubectl-ai to 0.0.10 (#39)

New Contributors

• @Anoyer made their first contribution in #41

Full Changelog: v0.0.10...v0.0.11

v0.0.11

Compare

Choose a tag to compare

Changelog

• d6b6249 Add Windows build into release (#38)
• 1437680 Enabling raw flag. (#34)
• f3539b7 build(deps): bump k8s.io/cli-runtime from 0.26.3 to 0.27.1 (#33)
• 7a700c4 fix: fix gha paths ignore (#35)
• 238f7ea docs: add demo (#30)
• c8960a0 docs: update readme (#29)
• 3bf47b2 docs: add krew and brew to readme (#28)
• 42fba98 Updated kubectl-ai to 0.0.9 (#27)

New Contributors

• @Tatsinnit made their first contribution in #34
• @peterbom made their first contribution in #38

Full Changelog: v0.0.9...v0.0.10

v0.0.10

Compare

Choose a tag to compare

Changelog

• ec9af71 release: publish krew and brew (#25)

v0.0.9

Compare

Choose a tag to compare

Changelog

• 685b67d fix: handle kubeconfig (#24)
• 9dadc9f fix: double errors (#23)

v0.0.8

Compare

Choose a tag to compare

Changelog

• 4df7767 feat: reprompt support (#22)
• a117045 Bump golang.org/x/net from 0.8.0 to 0.9.0 (#21)
• 5d439cc Bump github.com/spf13/cobra from 1.6.1 to 1.7.0 (#20)
• e9ede3a add gpt-4 support (#19)
• 1c11180 Bump github.com/PullRequestInc/go-gpt3 from 1.1.14 to 1.1.15 (#17)
• 6cd22fd add max token specify flag (#14)

v0.0.7

Compare

Choose a tag to compare

Changelog

• 5efdcf3 add chatgpt model support (#13)

v0.0.6

Compare

Choose a tag to compare

Changelog

• 2de181b use completionWithEngine (#10)
• 3df2727 fix readme (#6)

v0.0.5

Compare

Choose a tag to compare

Changelog

• 4830f7c confirmation ux changes (#5)

v0.0.4

Compare

Choose a tag to compare