cyber-security-resources/ai_research/prompt_engineering/README.md

6.5 KiB

Prompt Engineering Resources

Prompting Guide

This is a great resource for prompting LLMs:

Tools and Sample Prompt Repositories

Resource Description Link
LlamaIndex LlamaIndex is a project consisting of a set of data structures designed to make it easier to use large external knowledge bases with LLMs. [Github]
Promptify Solve NLP Problems with LLM's & Easily generate different NLP Task prompts for popular generative models like GPT, PaLM, and more with Promptify [Github]
Arize-Phoenix Open-source tool for ML observability that runs in your notebook environment. Monitor and fine tune LLM, CV and Tabular Models. [Github]
Better Prompt Test suite for LLM prompts before pushing them to PROD [Github]
CometLLM Log, visualize, and evaluate your LLM prompts, prompt templates, prompt variables, metadata, and more. [Github]
Embedchain Framework to create ChatGPT like bots over your dataset [Github]
Interactive Composition Explorerx ICE is a Python library and trace visualizer for language model programs. [Github]
Haystack Open source NLP framework to interact with your data using LLMs and Transformers. [Github]
LangChainx Building applications with LLMs through composability [Github]
OpenPrompt An Open-Source Framework for Prompt-learning [Github]
Prompt Engine This repo contains an NPM utility library for creating and maintaining prompts for Large Language Models (LLMs). [Github]
PromptInject PromptInject is a framework that assembles prompts in a modular fashion to provide a quantitative analysis of the robustness of LLMs to adversarial prompt attacks. [Github]
Prompts AI Advanced playground for GPT-3 [Github]
Prompt Source PromptSource is a toolkit for creating, sharing and using natural language prompts. [Github]
ThoughtSource A framework for the science of machine thinking [Github]
PROMPTMETHEUS One-shot Prompt Engineering Toolkit [Tool]
AI Config An Open-Source configuration based framework for building applications with LLMs [Github]
LastMile AI Notebook-like playground for interacting with LLMs across different modalities (text, speech, audio, image) [Tool]
XpulsAI Effortlessly build scalable AI Apps. AutoOps platform for AI & ML [Tool]
Agenta Agenta is an open-source LLM developer platform with the tools for prompt management, evaluation, human feedback, and deployment all in one place. [Github]
Promptotype Develop, test, and monitor your LLM { structured } tasks [Tool]

Tutorials and Videos

Introduction to Prompt Engineering

Beginner's Guide to Generative Language Models

Best Practices for Prompt Engineering

Complete Guide to Prompt Engineering

Technical Aspects of Prompt Engineering

Resources for Prompt Engineering

YouTube Videos