awesome-devops/README.md

344 lines
21 KiB
Markdown
Raw Normal View History

2019-11-20 16:41:35 +00:00
# Awesome DevOps
2019-11-19 14:16:52 +00:00
2019-11-20 16:41:35 +00:00
[![Awesome](https://awesome.re/badge.svg)](https://awesome.re)
A curated list of awesome DevOps tools, platforms and resources.
- [Awesome DevOps](#awesome-devops)
- [Cloud Platforms](#cloud-platforms)
- [Open Source Cloud Platforms](#open-source-cloud-platforms)
- [Operating Systems](#operating-systems)
- [Distributed Filesystems](#distributed-filesystems)
- [Applications Platforms](#applications-platforms)
- [Container Image Registry](#container-image-registry)
- [Automation & Orchestration](#automation-&-orchestration)
- [Continuous Integration & Delivery](#continuous-integration-&-delivery)
- [Source Code Management](#source-code-management)
- [Web Servers](#web-servers)
- [Databases](#databases)
- [Observability and Monitoring](#observability-&-monitoring)
- [Service Discovery & Service Mesh](#service-discovery-&-service-mesh)
- [API Gateway](#api-gateway)
- [Code review](#code-review)
- [Distributed messaging](#distributed-messaging)
- [Programming Languages](#programming-languages)
- [Chat and ChatOps](#chat-and-chatops)
- [Secret Management](#secret-management)
- [Sharing](#sharing)
- [Resources](#resources)
- [Books](#books)
- [Conferences](#conferences)
- [Contributing](#contributing)
- [Authors](#authors)
---
## Cloud Platforms
*Public and Private Cloud Platforms.*
- [Amazon Web Services (AWS)](https://aws.amazon.com/) - Cloud Computing Services.
- [Google Cloud Platform (GCP)](https://cloud.google.com/) - Cloud Computing Services.
- [Azure](https://azure.microsoft.com/) - Cloud Computing Platform & Services.
- [Alibaba Cloud](https://us.alibabacloud.com/) - integrated suite of cloud products and services.
- [Oracle Cloud](https://www.oracle.com/cloud/) - comprehensive and fully integrated stack of cloud applications and platform services.
- [DigitalOcean](https://www.digitalocean.com/) - helping developers easily build, test, manage, and scale applications of any size.
- [Scaleway](https://www.scaleway.com/) - single way to create, deploy and scale your infrastructure in the cloud.
- [Vultr](https://www.vultr.com/) - easily deploy cloud servers, bare metal, and storage worldwide.
- [VMware Cloud](https://cloud.vmware.com/) - run, manage, connect and protect all of your apps on any cloud.
## Open Source Cloud Platforms
*Private, Public and Hybrid open source Cloud Platforms.*
- [Openstack](https://www.openstack.org/) - open source software for creating private and public clouds.
- [Apache CloudStack](https://cloudstack.apache.org/) - designed to deploy and manage large networks of virtual machines.
- [OpenNebula](https://opennebula.org/) - build Private Clouds and manage Data Center virtualization based on KVM, LXD and VMware.
- [Eucalyptus](https://www.eucalyptus.cloud/) - building AWS-compatible private and hybrid clouds.
- [DC/OS](https://dcos.io/) - distributed operating system based on the Apache Mesos distributed systems kernel.
- [Apache Mesos](http://mesos.apache.org/) - program against your datacenter like its a single pool of resources.
## Operating Systems
*Operating Systems - Server Platform.*
- [Ubuntu](https://ubuntu.com/)
- [CentOS](https://www.centos.org/)
- [CoreOS](http://coreos.com/)
- [OSv](http://osv.io/) - versatile modular unikernel designed to run unmodified Linux applications securely on micro-VMs in the cloud.
- [Rancher OS](https://rancher.com/rancher-os) - a lightweight, secure Linux distribution, built from containers to run containers well.
- [Atomic](http://www.projectatomic.io/) - use immutable infrastructure to deploy and scale your containerized applications.
## Distributed Filesystems
*Network distributed filesystems.*
- [Chep](https://ceph.io/) - highly scalable object, block and file-based storage under one whole system.
- [Gluster](https://www.gluster.org/) - free and open source software scalable network filesystem.
- [LINBIT](https://www.linbit.com/en/) - create, remove, and replicate block storage devices for datacenter scale environments.
- [XtreemFS](http://www.xtreemfs.org/) - fault-tolerant distributed file system for all storage needs.
## Applications Platforms
*Applications management platforms, Containers management.*
- [Openshift](https://www.openshift.com/) - the Kubernetes platform for big ideas.
- [Dokku](http://dokku.viewdocs.io/dokku/) - helps you build and manage the lifecycle of applications.
- [Flynn](https://flynn.io/) - open source platform (PaaS) for running applications in production.
- [Docker](https://www.docker.com/) - create, deploy, and run applications by using containers.
- [Docker Compose](https://github.com/docker/compose) - define and run multi-container applications with Docker.
- [Docker Swarm](https://github.com/docker/swarm) - Docker-native clustering system.
- [Kubernetes](https://kubernetes.io/) - automating deployment, scaling, and management of containerized applications.
- [LXC](https://linuxcontainers.org/) - lets Linux users easily create and manage system or application containers.
- [Rancher](https://rancher.com/) - lets you deliver Kubernetes-as-a-Service.
- [OpenVz](https://openvz.org/) - container-based virtualization for Linux.
- [Singularity](https://sylabs.io/singularity/) - run the application from the local environment to the cloud.
- [AppScale](https://github.com/AppScale/appscale) - easy-to-manage serverless platform for building and running scalable web and mobile applications.
- [Kata Containers](https://katacontainers.io/) - building lightweight virtual machines that seamlessly plug into the containers ecosystem.
## Container Image Registry
*Container Image registry.*
- [Quay](https://www.projectquay.io/) - container image registry that enables you to build, organize, distribute, and deploy containers.
- [Dockyard](https://github.com/Huawei/dockyard) - Container & Artifact Repository.
## Automation & Orchestration
*Tools for automation, orchestration, deployment, provisioning and configuration management.*
- [Ansible](https://www.ansible.com/) - simple IT automation platform that makes your applications and systems easier to deploy.
- [Salt](https://www.saltstack.com/) - automate the management and configuration of any infrastructure or application at scale.
- [Puppet](https://puppet.com/) - unparalleled infrastructure automation and delivery.
- [Chef](https://www.chef.io/) - automate infrastructure and applications.
- [Juju](https://jaas.ai/) - simplifies how you configure, scale and operate todays complex software.
- [Rundeck](https://www.rundeck.com/) - Runbook Automation For Modernizing Your Operations.
- [StackStorm](https://stackstorm.com/) - connects all your apps, services, and workflows. Automate DevOps your way.
- [Bosh](https://www.cloudfoundry.org/bosh/) - release engineering, deployment, and lifecycle management of complex distributed systems.
- [Cloudify](https://cloudify.co/) - Connect, Control, & Automate from core to edge: unlimited locations, clouds and devices.
- [Tsuru](https://tsuru.io/) - an extensible and open source Platform as a Service software.
- [Fabric](http://www.fabfile.org/) - high level Python library designed to execute shell commands remotely over SSH.
- [Capistrano](https://capistranorb.com/) - A remote server automation and deployment tool.
- [Mina](http://nadarei.co/mina/) - really fast deployer and server automation tool.
- [Terraform](https://www.terraform.io/) - use Infrastructure as Code to provision and manage any cloud, infrastructure, or service.
- [Packer](https://www.packer.io/) - build Automated Machine Images.
- [Vagrant](https://www.vagrantup.com/) - Development Environments Made Easy.
- [Foreman](https://theforeman.org/) - complete lifecycle management tool for physical and virtual servers.
- [Nomad](https://learn.hashicorp.com/nomad) - deploy and Manage Any Containerized, Legacy, or Batch Application.
- [Marathon](https://mesosphere.github.io/marathon/) - a production-grade container orchestration platform for DC/OS and Apache Mesos.
2019-11-20 21:45:14 +00:00
- [Atlantis](https://github.com/runatlantis/atlantis) - Terraform Pull Request Automation.
2019-11-20 16:41:35 +00:00
## Continuous Integration & Delivery
*Continuous Integration, Continuous Delivery and Continuous Delivery.*
- On premises
- [Buildbot](http://buildbot.net/) - automate all aspects of the software development cycle.
- [Gitlab CI](https://about.gitlab.com/product/continuous-integration/) - pipelines build, test, deploy, and monitor your code as part of a single, integrated workflow.
- [Jenkins](http://jenkins-ci.org/) - automation server for building, deploying and automating any project.
- [Drone](https://github.com/drone/drone) - a Container-Native, Continuous Delivery Platform.
- [Concourse](https://concourse-ci.org/) - pipeline-based continuous thing-doer.
2019-11-20 21:45:14 +00:00
- [Spinnaker](https://www.spinnaker.io/) - fast, safe, repeatable deployments for every Enterprise.
2019-11-20 16:41:35 +00:00
- [goCD](https://www.gocd.org/) - Delivery and Release Automation server.
- [Teamcity](https://www.jetbrains.com/teamcity/) - enterprise-level CI and CD.
2019-11-20 21:45:14 +00:00
- [Bamboo](https://www.atlassian.com/software/bamboo) - tie automated builds, tests, and releases together in a single workflow.
2019-11-20 16:41:35 +00:00
- [Integrity](http://integrity.github.io/) - Continuous Integration server.
- [Zuul](https://zuul-ci.org/) - drives continuous integration, delivery, and deployment systems with a focus on project gating.
- [Argo](https://argoproj.github.io/) - open source Kubernetes native workflows, events, CI and CD.
- [Strider](https://strider-cd.github.io/) - Continuous Deployment/Continuous Integration platform.
- Web service
- [Travis CI](https://travis-ci.org/) - easily sync your projects, youll be testing your code in minutes.
- [Circle CI](https://circleci.com/) - powerful CI/CD pipelines that keep code moving.
- [Bitrise](https://www.bitrise.io/) - CI/CD for mobile applications.
- [Buildkite](https://buildkite.com/) - run fast, secure, and scalable continuous integration pipelines on your own infrastructure.
- [Cirrus CI](https://cirrus-ci.org/) - cycle fast, efficient, and secure with modern cloud technologies.
## Source Code Management
*Source Code management, Git-repository manager, Version Control. Some of them include Code review.*
- [Github](https://github.com/) - helps developers store and manage their code, as well as track and control changes to their code.
- [Gitlab](https://gitlab.com/) - entire DevOps lifecycle in one application.
- [Bitbucket](https://bitbucket.org/product/) - gives teams one place to plan projects, collaborate on code, test, and deploy
- [Phabricator](https://github.com/phacility/phabricator/) - a collection of web applications which help software companies build better software.
- [Gogs](https://gogs.io/) - a painless self-hosted Git service.
- [Gitea](https://gitea.io/) - a painless self-hosted Git service.
## Web Servers
*Web servers and reverse proxy.*
2019-11-20 21:45:14 +00:00
- [Nginx](http://nginx.org/) - high performant load balancer, web server and reverse proxy.
- [Apache](http://httpd.apache.org/) - web server and reverse proxy.
- [Caddy](https://caddyserver.com/) - web server with automatic HTTPS.
- [Cherokee](http://cherokee-project.com/) - highly concurrent secured web applications.
- [Lighttpd](http://www.lighttpd.net/) - optimized for speed-critical environments while remaining standards-compliant, secure and flexible.
- [Uwsgi](https://github.com/unbit/uwsgi/) - application server container.
2019-11-20 16:41:35 +00:00
## Databases
*Rational (SQL) and non-rational (NO-SQL) databases.*
- Rational (SQL)
2019-11-20 21:45:14 +00:00
- [PostgreSQL](https://www.postgresql.org/) - powerful, open source object-relational database system.
- [MySQL](https://www.mysql.com/) - open-source relational database management system.
- [MariaDB](https://mariadb.org/) - fast, scalable and robust, with a rich ecosystem of storage engines, plugins and many other tools.
- [SQLite](https://sqlite.org/) - small, fast, self-contained, high-reliability, full-featured, SQL database engine.
2019-11-20 16:41:35 +00:00
- Non-relational (No-SQL)
2019-11-20 21:45:14 +00:00
- [Casandra](http://cassandra.apache.org/) - manage massive amounts of data, fast, without losing sleep.
- [Apache HBase](http://hbase.apache.org/) - distributed, versioned, non-relational database.
- [Couchdb](https://couchdb.apache.org/) - database that completely embraces the web.
- [Elasticsearch](https://www.elastic.co/products/elasticsearch) - distributed, RESTful search and analytics engine capable of addressing a growing number of use cases.
- [MongoDB](https://www.mongodb.com/) - general purpose, document-based, distributed database built for modern application.
- [Rethinkdb](https://github.com/rethinkdb/rethinkdb) - open-source database for the realtime web.
2019-11-20 16:41:35 +00:00
- Key-Value
2019-11-20 21:45:14 +00:00
- [Couchbase](https://www.couchbase.com/) - distributed (shared-nothing architecture) multi-model NoSQL document-oriented database that is optimized for interactive applications.
- [Leveldb](https://github.com/google/leveldb) - fast key-value storage library.
- [Redis](https://redis.io/) - in-memory data structure store, used as a database, cache and message broker.
- [RocksDB](https://rocksdb.org/) - a library that provides an embeddable, persistent key-value store for fast storage.
- [Etcd](https://github.com/etcd-io/etcd) - distributed reliable key-value store for the most critical data of a distributed system.
2019-11-20 16:41:35 +00:00
## Observability & Monitoring
*Observability, Monitoring, Metrics/Metrics collection and Alerting tools.*
2019-11-20 21:45:14 +00:00
- [Sensu](https://sensu.io/) - Simple. Scalable. Multi-cloud monitoring.
- [Alerta](https://github.com/alerta/alerta) - scalable, minimal configuration and visualization monitoring system.
- [Cabot](https://github.com/arachnys/cabot) - self-hosted, easily-deployable monitoring and alerts service.
- [Amon](https://github.com/amonapp/amon) - modern server monitoring platform.
- [Flapjack](https://flapjack.io/) - monitoring notification routing + event processing system.
- [Icinga](https://icinga.com/) - monitors availability and performance, gives you simple access to relevant data and raises alerts.
- [Monit](https://mmonit.com/monit/#home) - managing and monitoring Unix systems.
- [Naemon](http://www.naemon.org/) - fast, stable and innovative while giving you a clear view of the state of your network and applications.
- [Nagios](https://www.nagios.org/) - computer-software application that monitors systems, networks and infrastructure.
- [Sentry](https://sentry.io/welcome/) - error monitoring that helps all software teams discover, triage, and prioritize errors in real-time.
- [Shinken](http://www.shinken-monitoring.org/) - monitoring framework.
2019-11-20 21:59:43 +00:00
- [Zabbix](https://www.zabbix.com/) - mature and effortless monitoring solution for network monitoring and application monitoring.
- [Glances](https://github.com/nicolargo/glances) - monitoring information through a curses or Web based interface.
2019-11-20 16:41:35 +00:00
- Metrics/Metrics collection
2019-11-20 21:45:14 +00:00
- [Prometheus](https://prometheus.io/) - power your metrics and alerting with a leading open-source monitoring solution.
- [Collectd](https://github.com/collectd/collectd) - the system statistics collection daemon.
- [Facette](https://github.com/facette/facette) - time series data visualization software.
- [Grafana](https://grafana.com/) - analytics & monitoring solution for every database.
- [Graphite](https://graphite.readthedocs.io/en/latest/) - store numeric time-series data and render graphs of this data on demand.
- [Influxdata](https://www.influxdata.com/) - time series database.
- [Netdata](https://www.netdata.cloud/) - instantly diagnose slowdowns and anomalies in your infrastructure.
2019-11-20 16:41:35 +00:00
- Logs Management
2019-11-20 21:45:14 +00:00
- [Anthracite](https://github.com/Dieterbe/anthracite) - an event/change logging/managament app.
2019-11-20 21:59:43 +00:00
- [Graylog](https://github.com/Graylog2/graylog2-server) - free and open source log management.
2019-11-20 21:45:14 +00:00
- [Logstash](https://www.elastic.co/products/logstash#) - collect, parse, transform logs.
- [Fluentd](https://www.fluentd.org/) - data collector for unified logging layer.
- [Flume](https://flume.apache.org/) - distributed, reliable, and available service for efficiently collecting, aggregating, and moving large amounts of log data.
- [Heka](https://hekad.readthedocs.io/en/latest/#) - stream processing software system.
- [Kibana](https://www.elastic.co/products/kibana) - explore, visualize, discover data.
2019-11-20 16:41:35 +00:00
## Service Discovery & Service Mesh
*Service Discovery, Service Mesh and Failure detection tools.*
2019-11-20 21:59:43 +00:00
- [Consul](https://www.hashicorp.com/products/consul/) - connect and secure any service.
- [Serf](https://www.serf.io/) - decentralized cluster membership, failure detection, and orchestration.
- [Doozerd](https://github.com/ha/doozerd) - a consistent distributed data store.
- [Zookeeper](http://zookeeper.apache.org/) - centralized service for maintaining configuration information, naming, providing distributed synchronization, and providing group services.
- [Etcd](https://etcd.io/) - distributed, reliable key-value store for the most critical data of a distributed system.
- [Istio](https://istio.io/) -cConnect, secure, control, and observe services.
- [Kong](https://konghq.com/products/kong-gateway/kong-proxy) - deliver performance needed for microservices, service mesh, and cloud native deployments.
2019-11-20 16:41:35 +00:00
## API Gateway
*API Gateway, Service Proxy and Service Management tools.*
- [API Umbrella](https://apiumbrella.io/#)
- [Ambassador](https://www.getambassador.io/)
- [Kong](https://konghq.com/)
- [Tyk](https://tyk.io/)
- [Cilium](https://github.com/cilium/cilium)
- [Gloo](https://github.com/solo-io/gloo)
- [Envoy](https://www.envoyproxy.io/)
- [Traefik](https://traefik.io/)
- [Nginx](https://nginx.org/)
- [Linkerd](https://github.com/linkerd/linkerd2)
## Code review
*Code review. In [Source Code Management](#source-code-management) section you can find few of them with Code review already as feature.*
- [Gerrit](https://www.gerritcodereview.com/)
- [Review Board](https://www.reviewboard.org/)
## Distributed messaging
*Distributed messaging platforms and Queues software.*
- [Rabbitmq](https://www.rabbitmq.com/)
- [Kafka](http://kafka.apache.org/)
- [Activemq](http://activemq.apache.org/)
- [Beanstalkd](https://beanstalkd.github.io/)
- [NSQ](https://nsq.io/)
- [Celery](http://www.celeryproject.org/)
- [Faktory](https://github.com/contribsys/faktory)
- [Nats](https://nats.io/)
- [RestMQ](http://restmq.com/)
## Programming Languages
*Programming languages.*
- [Pyhon](https://www.python.org/) - programming language that lets you work quickly and integrate systems more effectively.
- [Ruby](https://www.ruby-lang.org/) - a dynamic, open source programming language with a focus on simplicity and productivity.
- [Go](https://golang.org/) - is an open source programming language that makes it easy to build simple, reliable, and efficient software.
## Chat and ChatOps
*Chat and ChatOps.*
2019-11-20 21:59:43 +00:00
- [Rocket](https://rocket.chat/) - open source team communication.
- [Mattermost](https://mattermost.com/) - messaging platform that enables secure team collaboration.
- [Zulip](https://zulipchat.com/) - real-time chat with an email threading model.
- [Riot](https://about.riot.im/) - a universal secure chat app entirely under your control.
2019-11-20 16:41:35 +00:00
- ChatOps:
2019-11-20 21:59:43 +00:00
- [CloudBot](https://github.com/CloudBotIRC/CloudBot) - simple, fast, expandable, open-source Python IRC Bot.
- [Hubot](https://hubot.github.com/) - a customizable life embetterment robot.
- [Lita](https://www.lita.io/) - a robot companion for your company's chat room.
2019-11-20 16:41:35 +00:00
## Secret Management
*Security as code, sensitive credentials and secrets need to be managed, security, maintained and rotated using automation.*
2019-11-20 21:45:14 +00:00
- [Sops](https://github.com/mozilla/sops) - simple and flexible tool for managing secrets.
- [Vault](https://www.hashicorp.com/products/vault/) - manage secrets and protect sensitive data.
- [Keybase](https://keybase.io/) - end-to-end encrypted chat and cloud storage system.
2019-11-20 16:41:35 +00:00
## Sharing
*A collection of tools to help with sharing knowledge and telling the story.*
2019-11-20 21:45:14 +00:00
- [Gitbook](https://github.com/GitbookIO/gitbook) - modern documentation format and toolchain using Git and Markdown.
- [Docusaurus](https://github.com/facebook/docusaurus) - easy to maintain open source documentation websites.
- [Docsify](https://github.com/docsifyjs/docsify/) - a magical documentation site generator.
- [MkDocs](https://github.com/mkdocs/mkdocs/) - project documentation with Markdown.
2019-11-20 16:41:35 +00:00
## Resources
### Books
*Books focused on DevOps and DevSecOps.*
- [Hands-On Security in DevOpss](https://www.packtpub.com/networking-and-servers/hands-security-devops)
### Conferences
- [DevOpsCon](https://devopscon.io/)
2019-11-20 21:45:14 +00:00
- [AWS re:Invent](https://reinvent.awsevents.com/)
2019-11-20 16:41:35 +00:00
- [DevSecOps](https://www.devseccon.com/)
- [ADDO](https://www.alldaydevops.com/)
- [DevOpsConnect](https://www.devopsconnect.com/)
## Contributing
Your contributions are always welcome! Please take a look at the [Contribution Guidelines](CONTRIBUTING.md).
## Authors
Created by *DevOps* for *DevOps*.