Awesome-Mirrors
/
awesome-devops
mirror of https://github.com/wmariuss/awesome-devops.git
1
0
Fork 0
Code Issues Packages Projects Releases Wiki Activity
A curated list of awesome DevOps platforms, tools, practices and resources
40 Commits 2 Branches 0 Tags 2.4 MiB
Python 100%
Go to file
Marius Stanca c625eb11a1
Add new distributed storage 		2020-07-13 17:16:38 +03:00
docs Move cname file to docs 2019-11-26 22:18:35 +02:00
.gitignore Add new distributed storage 2020-07-13 17:16:38 +03:00
.travis.yml Bump version for py and libs 2020-04-09 02:15:24 +03:00
CODEOWNERS Add few basic tools and software 2019-11-20 18:41:35 +02:00
CONTRIBUTING.md Few minor changes 2019-11-21 15:52:31 +02:00
LICENSE Add few basic tools and software 2019-11-20 18:41:35 +02:00
README.md Add new distributed storage 2020-07-13 17:16:38 +03:00
mkdocs.yml Fix icon issue 2020-04-09 09:09:53 +03:00
requirements.txt Bump version for py and libs 2020-04-09 02:15:24 +03:00
tasks.py Add tasks flow 2019-11-26 23:54:52 +02:00

README.md

Awesome DevOps

Awesome Build Status

A curated list of awesome DevOps tools, technologies, platforms and resources. Things to help/grow you in DevOps or SRE area.

Cloud Platforms

Public and Private Cloud Platforms.

  • Amazon Web Services (AWS) - Cloud Computing Services.
  • Google Cloud Platform (GCP) - Cloud Computing Services.
  • Azure - Cloud Computing Platform & Services.
  • Alibaba Cloud - integrated suite of cloud products and services.
  • Oracle Cloud - comprehensive and fully integrated stack of cloud applications and platform services.
  • DigitalOcean - helping developers easily build, test, manage, and scale applications of any size.
  • Scaleway - single way to create, deploy and scale your infrastructure in the cloud.
  • Vultr - easily deploy cloud servers, bare metal, and storage worldwide.
  • VMware Cloud - run, manage, connect and protect all of your apps on any cloud.
  • IBM Cloud - tools, data & APIs to make AI real now.
  • Stackpath - platform of computing infrastructure and services built at the edge of the cloud.
  • Linode - accelerate innovation in the cloud, virtual computing must be more accessible, affordable, and simple.

Open Source Cloud Platforms

Private, Public and Hybrid open source Cloud Platforms.

  • Openstack - open source software for creating private and public clouds.
  • Apache CloudStack - designed to deploy and manage large networks of virtual machines.
  • OpenNebula - build Private Clouds and manage Data Center virtualization based on KVM, LXD and VMware.
  • Eucalyptus - building AWS-compatible private and hybrid clouds.
  • DC/OS - distributed operating system based on the Apache Mesos distributed systems kernel.
  • Apache Mesos - program against your datacenter like it’s a single pool of resources.
  • Localstack - fully functional local AWS cloud stack. Develop and test your cloud & Serverless apps offline.

Operating Systems

Operating Systems - Server Platform.

  • Ubuntu
  • CentOS
  • CoreOS - the pioneering lightweight container host.
  • OSv - versatile modular unikernel designed to run unmodified Linux applications securely on micro-VMs in the cloud.
  • Rancher OS - a lightweight, secure Linux distribution, built from containers to run containers well.
  • Atomic - use immutable infrastructure to deploy and scale your containerized applications.
  • Photon - Linux container host optimized for cloud-native applications, cloud platforms, and VMware infrastructure.

Distributed Filesystems

Network distributed filesystems.

  • Ceph - highly scalable object, block and file-based storage under one whole system.
  • Gluster - free and open source software scalable network filesystem.
  • LINBIT - create, remove, and replicate block storage devices for datacenter scale environments.
  • XtreemFS - fault-tolerant distributed file system for all storage needs.
  • min.io - high performance, distributed object storage system.

Applications Platforms

Applications management platforms, Containers platform and Containers management.

  • Openshift - the Kubernetes platform for big ideas.
  • Dokku - helps you build and manage the lifecycle of applications.
  • Flynn - open source platform (PaaS) for running applications in production.
  • Docker - create, deploy, and run applications by using containers.
  • Docker Compose - define and run multi-container applications with Docker.
  • Docker Swarm - Docker-native clustering system.
  • Kubernetes - automating deployment, scaling, and management of containerized applications.
  • LXC - lets Linux users easily create and manage system or application containers.
  • Rancher - lets you deliver Kubernetes-as-a-Service.
  • OpenVz - container-based virtualization for Linux.
  • Singularity - run the application from the local environment to the cloud.
  • AppScale - easy-to-manage serverless platform for building and running scalable web and mobile applications.
  • Kata Containers - building lightweight virtual machines that seamlessly plug into the containers ecosystem.
  • K3S - The certified Kubernetes distribution built for IoT and Edge computing.

Container Image Registry

Container Image registry.

  • Quay - container image registry that enables you to build, organize, distribute, and deploy containers.
  • Dockyard - Container & Artifact Repository.

Automation & Orchestration

Tools for automation, orchestration, deployment, provisioning and configuration management.

  • Ansible - simple IT automation platform that makes your applications and systems easier to deploy.
  • Salt - automate the management and configuration of any infrastructure or application at scale.
  • Puppet - unparalleled infrastructure automation and delivery.
  • Chef - automate infrastructure and applications.
  • Juju - simplifies how you configure, scale and operate todays complex software.
  • Rundeck - Runbook Automation For Modernizing Your Operations.
  • StackStorm - connects all your apps, services, and workflows. Automate DevOps your way.
  • Bosh - release engineering, deployment, and lifecycle management of complex distributed systems.
  • Cloudify - Connect, Control, & Automate from core to edge: unlimited locations, clouds and devices.
  • Tsuru - an extensible and open source Platform as a Service software.
  • Fabric - high level Python library designed to execute shell commands remotely over SSH.
  • Capistrano - A remote server automation and deployment tool.
  • Mina - really fast deployer and server automation tool.
  • Terraform - use Infrastructure as Code to provision and manage any cloud, infrastructure, or service.
  • Packer - build Automated Machine Images.
  • Vagrant - Development Environments Made Easy.
  • Foreman - complete lifecycle management tool for physical and virtual servers.
  • Nomad - deploy and Manage Any Containerized, Legacy, or Batch Application.
  • Marathon - a production-grade container orchestration platform for DC/OS and Apache Mesos.
  • Atlantis - Terraform Pull Request Automation.
  • OctoDNS - managing DNS across multiple providers. DNS as code.
  • ManageIQ - Manage containers, virtual machines, networks, and storage from a single platform.

Continuous Integration & Delivery

Continuous Integration, Continuous Delivery and Continuous Delivery.

  • On premises
    • Buildbot - automate all aspects of the software development cycle.
    • Gitlab CI - pipelines build, test, deploy, and monitor your code as part of a single, integrated workflow.
    • Jenkins - automation server for building, deploying and automating any project.
    • Drone - a Container-Native, Continuous Delivery Platform.
    • Concourse - pipeline-based continuous thing-doer.
    • Spinnaker - fast, safe, repeatable deployments for every Enterprise.
    • goCD - Delivery and Release Automation server.
    • Teamcity - enterprise-level CI and CD.
    • Bamboo - tie automated builds, tests, and releases together in a single workflow.
    • Integrity - Continuous Integration server.
    • Zuul - drives continuous integration, delivery, and deployment systems with a focus on project gating.
    • Argo - open source Kubernetes native workflows, events, CI and CD.
    • Strider - Continuous Deployment/Continuous Integration platform.
  • Web service
    • Travis CI - easily sync your projects, you’ll be testing your code in minutes.
    • Circle CI - powerful CI/CD pipelines that keep code moving.
    • Bitrise - CI/CD for mobile applications.
    • Buildkite - run fast, secure, and scalable continuous integration pipelines on your own infrastructure.
    • Cirrus CI - cycle fast, efficient, and secure with modern cloud technologies.

Source Code Management

Source Code management, Git-repository manager, Version Control. Some of them include Code review.

  • Github - helps developers store and manage their code, as well as track and control changes to their code.
  • Gitlab - entire DevOps lifecycle in one application.
  • Bitbucket - gives teams one place to plan projects, collaborate on code, test, and deploy
  • Phabricator - a collection of web applications which help software companies build better software.
  • Gogs - a painless self-hosted Git service.
  • Gitea - a painless self-hosted Git service.
  • Gitblit - pure Java Git solution for managing, viewing, and serving Git repositories.

Web Servers

Web servers and reverse proxy.

  • Nginx - high performant load balancer, web server and reverse proxy.
  • Apache - web server and reverse proxy.
  • Caddy - web server with automatic HTTPS.
  • Cherokee - highly concurrent secured web applications.
  • Lighttpd - optimized for speed-critical environments while remaining standards-compliant, secure and flexible.
  • Uwsgi - application server container.

SSL

Tools for automate the management of SSL certificates.

  • Certbot - automatically using Let’s Encrypt certificates on manually-administrated websites to enable HTTPS.
  • Let’s Encrypt - free, automated, and open Certificate Authority.
  • Cert Manager - K8S add-on to automate the management and issuance of TLS certificates from various issuing sources.

Databases

Rational (SQL) and non-rational (NO-SQL) databases.

  • Rational (SQL)
    • PostgreSQL - powerful, open source object-relational database system.
    • MySQL - open-source relational database management system.
    • MariaDB - fast, scalable and robust, with a rich ecosystem of storage engines, plugins and many other tools.
    • SQLite - small, fast, self-contained, high-reliability, full-featured, SQL database engine.
  • Non-relational (No-SQL)
    • Casandra - manage massive amounts of data, fast, without losing sleep.
    • Apache HBase - distributed, versioned, non-relational database.
    • Couchdb - database that completely embraces the web.
    • Elasticsearch - distributed, RESTful search and analytics engine capable of addressing a growing number of use cases.
    • MongoDB - general purpose, document-based, distributed database built for modern application.
    • Rethinkdb - open-source database for the realtime web.
    • Key-Value
      • Couchbase - distributed multi-model NoSQL document-oriented database that is optimized for interactive applications.
      • Leveldb - fast key-value storage library.
      • Redis - in-memory data structure store, used as a database, cache and message broker.
      • RocksDB - a library that provides an embeddable, persistent key-value store for fast storage.
      • Etcd - distributed reliable key-value store for the most critical data of a distributed system.

Observability & Monitoring

Observability, Monitoring, Metrics/Metrics collection and Alerting tools.

  • Sensu - Simple. Scalable. Multi-cloud monitoring.
  • Alerta - scalable, minimal configuration and visualization monitoring system.
  • Cabot - self-hosted, easily-deployable monitoring and alerts service.
  • Amon - modern server monitoring platform.
  • Flapjack - monitoring notification routing + event processing system.
  • Icinga - monitors availability and performance, gives you simple access to relevant data and raises alerts.
  • Monit - managing and monitoring Unix systems.
  • Naemon - fast, stable and innovative while giving you a clear view of the state of your network and applications.
  • Nagios - computer-software application that monitors systems, networks and infrastructure.
  • Sentry - error monitoring that helps all software teams discover, triage, and prioritize errors in real-time.
  • Shinken - monitoring framework.
  • Zabbix - mature and effortless monitoring solution for network monitoring and application monitoring.
  • Glances - monitoring information through a curses or Web based interface.
  • Healthchecks - cron monitoring tool.
  • Bolo - building distributed, scalable monitoring systems.
  • cAdvisor - analyzes resource usage and performance characteristics of running containers.
  • ElastiFlow - network flow monitoring (Netflow, sFlow and IPFIX) with the Elastic Stack.
  • Co-Pilot - system performance analysis toolkit.
  • Metrics/Metrics collection
    • Prometheus - power your metrics and alerting with a leading open-source monitoring solution.
    • Collectd - the system statistics collection daemon.
    • Facette - time series data visualization software.
    • Grafana - analytics & monitoring solution for every database.
    • Graphite - store numeric time-series data and render graphs of this data on demand.
    • Influxdata - time series database.
    • Netdata - instantly diagnose slowdowns and anomalies in your infrastructure.
    • Freeboard - real-time dashboard builder for IOT and other web mashups.
  • Logs Management
    • Anthracite - an event/change logging/managament app.
    • Graylog - free and open source log management.
    • Logstash - collect, parse, transform logs.
    • Fluentd - data collector for unified logging layer.
    • Flume - distributed, reliable, and available service for efficiently collecting, aggregating, and moving logs.
    • Heka - stream processing software system.
    • Kibana - explore, visualize, discover data.
  • Status
    • Cachet - beautiful and powerful open source status page system.

Service Discovery & Service Mesh

Service Discovery, Service Mesh and Failure detection tools.

  • Consul - connect and secure any service.
  • Serf - decentralized cluster membership, failure detection, and orchestration.
  • Doozerd - a consistent distributed data store.
  • Zookeeper - centralized service for configuration, naming, providing distributed synchronization, and more.
  • Etcd - distributed, reliable key-value store for the most critical data of a distributed system.
  • Istio - connect, secure, control, and observe services.
  • Kong - deliver performance needed for microservices, service mesh, and cloud native deployments.
  • Linkerd - service mesh for Kubernetes and beyond.

Chaos Engineering

The discipline of experimenting on a distributed system in order to build confidence in the system's capability to withstand turbulent conditions in production.

  • Chaos Toolkit - the Open Source Platform for Chaos Engineering.
  • Chaos Monkey - a resiliency tool that helps applications tolerate random instance failures.
  • Toxiproxy - simulate network and system conditions for chaos and resiliency testing.
  • Pumba - chaos testing, network emulation and stress testing tool for containers.

API Gateway

API Gateway, Service Proxy and Service Management tools.

  • API Umbrella - proxy that sits in front of your APIs.
  • Ambassador - Kubernetes-Native API Gateway built on the Envoy Proxy.
  • Kong - connect all your microservices and APIs with the industry’s most performant, scalable and flexible API platform.
  • Tyk - API and service management platform.
  • Cilium - API aware networking and security using BPF and XDP.
  • Gloo - feature-rich, Kubernetes-native ingress controller, and next-generation API gateway.
  • Envoy - cloud-native high-performance edge/middle/service proxy.
  • Traefik - reverse proxy and load balancer for HTTP and TCP-based applications.
  • Nginx - high performant reverse proxy.

Code review

Code review. In Source Code Management section you can find few of them with Code review already as feature.

  • Gerrit - web-based team code collaboration tool.
  • Review Board - web-based collaborative code review tool.

Distributed messaging

Distributed messaging platforms and Queues software.

  • Rabbitmq - message broker.
  • Kafka - building real-time data pipelines and streaming apps.
  • Activemq - Multi-Protocol messaging.
  • Beanstalkd - simple, fast work queue.
  • NSQ - realtime distributed messaging platform.
  • Celery - asynchronous task queue/job queue based on distributed message passing.
  • Faktory - repository for background jobs within your application.
  • Nats - simple, secure and high performance open source messaging system.
  • RestMQ - message queue which uses HTTP as transport.
  • Dkron - distributed, fault tolerant job scheduling system.

Programming Languages

Programming languages.

  • Pyhon - programming language that lets you work quickly and integrate systems more effectively.
  • Ruby - a dynamic, open source programming language with a focus on simplicity and productivity.
  • Go - an open source programming language that makes it easy to build simple, reliable, and efficient software.

Chat and ChatOps

Chat and ChatOps.

  • Rocket - open source team communication.
  • Mattermost - messaging platform that enables secure team collaboration.
  • Zulip - real-time chat with an email threading model.
  • Riot - a universal secure chat app entirely under your control.
  • ChatOps:
    • CloudBot - simple, fast, expandable, open-source Python IRC Bot.
    • Hubot - a customizable life embetterment robot.
    • Lita - a robot companion for your company's chat room.

Secret Management

Security as code, sensitive credentials and secrets need to be managed, security, maintained and rotated using automation.

  • Sops - simple and flexible tool for managing secrets.
  • Vault - manage secrets and protect sensitive data.
  • Keybase - end-to-end encrypted chat and cloud storage system.

Sharing

A collection of tools to help with sharing knowledge and telling the story.

  • Gitbook - modern documentation format and toolchain using Git and Markdown.
  • Docusaurus - easy to maintain open source documentation websites.
  • Docsify - a magical documentation site generator.
  • MkDocs - project documentation with Markdown.

VPN

VPN, routing and firewall.

  • OpenVPN - flexible VPN solutions to secure your data communications, whether it's for Internet privacy,
  • Pritunl - enterprise Distributed OpenVPN and IPsec Server.
  • VyOS - open source network OS that runs on a wide range of hardware, virtual machines, and cloud providers.
  • Algo - set up a personal VPN in the cloud.
  • Streisand - sets up a new VPN services nearly automatically.
  • Freelan - a peer-to-peer, secure, easy-to-setup, multi-platform, open-source, highly-configurable VPN software.
  • Sshuttle - transparent proxy server that works as a poor man's VPN.

Resources

Books

Books focused on DevOps, DevSecOps and Site Reliability Engineering.

Conferences

DevOps Roadmap

Basic understanding and what you should know to become a DevOps Engineer, check the roadmap here.

Contributing

Your contributions are always welcome! Please take a look at the Contribution Guidelines.

Authors

Created by DevOps for DevOps.

License

License: CC0 1.0 Universal