cyber-security-resources/ai_research/LLM-frameworks

LLM Frameworks

The following is a collection of different LLM frameworks in alphabetical order:

• Agent-LLM: An Artificial Intelligence Automation Platform.
• AgentFlow: About Complex LLM Workflows from Simple JSON.
• AgentVerse Provides a flexible framework that simplifies the process of building custom multi-agent environments for LLMs
• AI Utils: TypeScript-first library for building AI apps, chatbots, and agents.
• AI.JSX: The AI Application Framework for Javascript
• Autochain: Build lightweight, extensible, and testable LLM Agents with AutoChain.
• Autogen: Enable Next-Gen Large Language Model Applications.
• Ax: A comprehensive AI framework for TypeScript
• Botpress: The building blocks for building chatbots
• Dust: Design and Deploy Large Language Model Apps
• e2b: Open-source platform for building & deploying virtual developers’ agents
• Embedbase: The native Software 3.0 stack for building AI-powered applications.
• FlagAI: FlagAI (Fast LArge-scale General AI models) is a fast, easy-to-use and extensible toolkit for large-scale model.
• Flappy: Production-Ready LLM Agent SDK for Every Developer
• Griptape: Python framework for AI workflows and pipelines with chain of thought reasoning, external tools, and memory.
• Haystack: NLP framework to interact with your data using Transformer models and LLMs
• Hyv: Probably the easiest way to use any AI Model in Node.js and create complex interactions with ease.
• Lagent: A lightweight framework for building LLM-based agents
• LangStream: Framework for building and running event-driven LLM applications using no-code and Python (including LangChain-based) agents.
• LlamaIndex: provides a central interface to connect your LLM's with external data.
• LLFn: A light-weight framework for creating applications using LLMs
• LLM Agents: Build agents which are controlled by LLMs
• llm-chain: is a powerful rust crate for building chains in LLMs allowing you to summarise text and complete complex tasks.
• LLMFlow: Simple, Explicit and Transparent LLM Apps
• LLMStack: No code platform for building LLM-powered applications with custom data.
• LMQL: A programming language for large language models.
• Magentic: Seamlessly integrate LLMs as Python functions
• Marvin: ✨ Build AI interfaces that spark joy
• MemGPT: Teaching LLMs memory management for unbounded context
• MetaGPT: The Multi-Agent Meta Programming Framework: Given one line Requirement, return PRD, Design, Tasks, Repo and CI
• MiniChain: A tiny library for coding with large language models.
• OpenDAN: open source Personal AI OS , which consolidates various AI modules in one place for your personal use.
• OpenLLM: An open platform for operating large language models (LLMs) in production. Fine-tune, serve, deploy, and monitor any LLMs with ease using OpenLLM.
• OpenLM: a drop-in OpenAI-compatible library that can call LLMs from any other hosted inference API. Also Typescript
• Outlines: Fast and reliable neural text generation.
• Outlines: Generative Model Programming (Python)
• PromptFlow: Create executable flowcharts that link LLMs (Large Language Models), Prompts, Python functions, and conditional logic together.
• Promptfoo: Test your prompts. Evaluate and compare LLM outputs, catch regressions, and improve prompt quality.
• Promptify: Prompt Engineering | Use GPT or other prompt based models to get structured output.
• PromptSource: About Toolkit for creating, sharing and using natural language prompts.
• ReLLM: Regular Expressions for Language Model Completions.
• RestGPT: An LLM-based autonomous agent controlling real-world applications via RESTful APIs
• Rivet: An IDE for creating complex AI agents and prompt chaining, and embedding it in your application.
• Semantic Kernel: Microsoft C# SDK to integrate cutting-edge LLM technology quickly and easily into your apps
• SimpleAIChat: Python package for easily interfacing with chat apps, with robust features and minimal code complexity.
• SmartGPT: A program that provides LLMs with the ability to complete complex tasks using plugins.
• SuperAGI: A dev-first open source autonomous AI agent framework.
• TermGPT: Giving LLMs like GPT-4 the ability to plan and execute terminal commands
• TextAI: 💡 All-in-one open-source embeddings database for semantic search, LLM orchestration and language model workflows.
• Transformers Agents: Provides a natural language API on top of transformers
• TypeChat: TypeChat is a library that makes it easy to build natural language interfaces using types.