cyber-security-resources/ai_research/LLM-frameworks/README.md
2023-10-23 22:21:19 -04:00

6.6 KiB
Raw Blame History

LLM Frameworks

The following is a collection of different LLM frameworks in alphabetical order:

  • Agent-LLM: An Artificial Intelligence Automation Platform.
  • AgentFlow: About Complex LLM Workflows from Simple JSON.
  • AgentVerse Provides a flexible framework that simplifies the process of building custom multi-agent environments for LLMs
  • AI Utils: TypeScript-first library for building AI apps, chatbots, and agents.
  • AI.JSX: The AI Application Framework for Javascript
  • Autochain: Build lightweight, extensible, and testable LLM Agents with AutoChain.
  • Autogen: Enable Next-Gen Large Language Model Applications.
  • Ax: A comprehensive AI framework for TypeScript
  • Botpress: The building blocks for building chatbots
  • Dust: Design and Deploy Large Language Model Apps
  • e2b: Open-source platform for building & deploying virtual developers agents
  • Embedbase: The native Software 3.0 stack for building AI-powered applications.
  • FlagAI: FlagAI (Fast LArge-scale General AI models) is a fast, easy-to-use and extensible toolkit for large-scale model.
  • Flappy: Production-Ready LLM Agent SDK for Every Developer
  • Griptape: Python framework for AI workflows and pipelines with chain of thought reasoning, external tools, and memory.
  • Haystack: NLP framework to interact with your data using Transformer models and LLMs
  • Hyv: Probably the easiest way to use any AI Model in Node.js and create complex interactions with ease.
  • Lagent: A lightweight framework for building LLM-based agents
  • LangStream: Framework for building and running event-driven LLM applications using no-code and Python (including LangChain-based) agents.
  • LlamaIndex: provides a central interface to connect your LLM's with external data.
  • LLFn: A light-weight framework for creating applications using LLMs
  • LLM Agents: Build agents which are controlled by LLMs
  • llm-chain: is a powerful rust crate for building chains in LLMs allowing you to summarise text and complete complex tasks.
  • LLMFlow: Simple, Explicit and Transparent LLM Apps
  • LLMStack: No code platform for building LLM-powered applications with custom data.
  • LMQL: A programming language for large language models.
  • Magentic: Seamlessly integrate LLMs as Python functions
  • Marvin: Build AI interfaces that spark joy
  • MemGPT: Teaching LLMs memory management for unbounded context
  • MetaGPT: The Multi-Agent Meta Programming Framework: Given one line Requirement, return PRD, Design, Tasks, Repo and CI
  • MiniChain: A tiny library for coding with large language models.
  • OpenDAN: open source Personal AI OS , which consolidates various AI modules in one place for your personal use.
  • OpenLLM: An open platform for operating large language models (LLMs) in production. Fine-tune, serve, deploy, and monitor any LLMs with ease using OpenLLM.
  • OpenLM: a drop-in OpenAI-compatible library that can call LLMs from any other hosted inference API. Also Typescript
  • Outlines: Fast and reliable neural text generation.
  • Outlines: Generative Model Programming (Python)
  • PromptFlow: Create executable flowcharts that link LLMs (Large Language Models), Prompts, Python functions, and conditional logic together.
  • Promptfoo: Test your prompts. Evaluate and compare LLM outputs, catch regressions, and improve prompt quality.
  • Promptify: Prompt Engineering | Use GPT or other prompt based models to get structured output.
  • PromptSource: About Toolkit for creating, sharing and using natural language prompts.
  • ReLLM: Regular Expressions for Language Model Completions.
  • RestGPT: An LLM-based autonomous agent controlling real-world applications via RESTful APIs
  • Rivet: An IDE for creating complex AI agents and prompt chaining, and embedding it in your application.
  • Semantic Kernel: Microsoft C# SDK to integrate cutting-edge LLM technology quickly and easily into your apps
  • SimpleAIChat: Python package for easily interfacing with chat apps, with robust features and minimal code complexity.
  • SmartGPT: A program that provides LLMs with the ability to complete complex tasks using plugins.
  • SuperAGI: A dev-first open source autonomous AI agent framework.
  • TermGPT: Giving LLMs like GPT-4 the ability to plan and execute terminal commands
  • TextAI: 💡 All-in-one open-source embeddings database for semantic search, LLM orchestration and language model workflows.
  • Transformers Agents: Provides a natural language API on top of transformers
  • TypeChat: TypeChat is a library that makes it easy to build natural language interfaces using types.