Assimilation System Management Suite

The Assimilation Suite discovers systems, services, network connections, configuration and dependencies, IP and MAC addresses. This all goes into a continually updated graph-based configuration management database (CMDB). This is then compared and scored against best practices, services and servers are monitored - all with near-zero configuration - in a way that scales to hundreds of thousands of servers. It also provides visualization tools, APIs for sending alerts to humans and other systems, and a variety of canned reports (queries) to aid in securing and managing systems, hooking into ChatOps, and creating plans for triaging your security issues

     

linux open-source commercial C shell python config CMDB service-discovery monitoring visualization security hardening

AWSBox

DIY Platform-as-a-Service tool specialized for NodeJS projects with AWS as the backend, and created by Mozilla

     

linux open-source cloud-paas nodejs

Basebox-Packer

A comprehensive set of Packer definitions. It has quite a collection of 64 bit and 32 bit images for Vagrant VirtualBox and VMWare. A good place to learn Packer definitions.

     

linux open-source virt shell

Bento

A modularized collection of Packer definitions for building machine images. A good place to start with Packer.

     

linux windows osx open-source virt ruby

Berkshelf

A cookbook source structure manager for Chef, similar to Bundler for Ruby. Each Chef cookbook can be structured as an individual entity and can be pulled into your main Chef workflows.

     

linux windows osx open-source scm ruby

Bolt

Bolt is an open source orchestration tool that automates the manual work it takes to maintain your infrastructure. Use Bolt to automate tasks that you perform on an as-needed basis or as part of a greater orchestration workflow. For example, you can use Bolt to patch and update systems, troubleshoot servers, deploy applications, or stop and restart services. Bolt can be installed on your local workstation and connects directly to remote targets with SSH or WinRM, so you are not required to install any agent software.

     

linux open-source provisioning config-mgmt orchestration ruby

Brood

A Deployment framework written in PHP. Can deploy to multiple servers using Gearman.

     

linux windows osx open-source provisioning php

Brooklyn

A Java based deployment tool, focused on both deployment as well as post-deploy lifecycle management. It is aware of network topologies, integrates with many cloud and PaaS APIs, and is designed to handle the entire roll-out

     

linux windows osx open-source provisioning orchestration java

bugsnag

Monitor everything you're building.

     

windows linux osx open-source ruby java python php nodejs errors

Buildstep

Buildstep uses Docker and small buildpack scripts to build applications like Heroku. It was used by Dokku to create a 100-line Heroku clone. There are many open source Buildpack scripts for various languages like Java, Ruby, Erlang, PHP, etc.

     

linux open-source cloud-paas ruby

Capistrano

The Ruby equivalent of Fabric, Capistrano is a Ruby framework to configure and run deployment or system administration tasks on local or remote machines. It extends the Rake DSL to define tasks, and can group tasks by Roles.

     

linux osx open-source provisioning orchestration ruby

Chef

Configuration management tool which uses a pure-Ruby, domain-specific language (DSL) for writing system configuration recipes. Supports Linux, UNIX, Windows, and AIX as first-class citizens for management.

     

linux windows open-source provisioning config-mgmt ruby

CloudRepo

Public and Private Maven and Python (PyPi) repositories. Fully managed and highly available repository hosting.

     

linux windows osx bsd solaris commercial packaging artifacts java clojure scala groovy python pypi cloud maven sbt leiningen gradle ivy

CMB (Cloud Message Bus)

A notification service (like Amazon SQS and SNS), allows notifications to be published across many channels like Email, VoIP, SMS, etc

     

linux open-source monitoring java

Concourse

Concourse is a CI system composed of simple tools and ideas. It can express entire pipelines, integrating with arbitrary resources, or it can be used to execute one-off tasks, either locally or in another CI system.

     

linux open-source go ci cd

ConfigCat

ConfigCat is a feature flags as a service. It gives you a web based dashboard to manage your feature flags + SDKs to integrate those feature flags into your applications. ConfigCat enables you to use the same feature flags in your mobile apps, websites and server-side applications. It offers all features for free. You get an enterprise-ready SLA with the pricing plans.

     

linux osx windows open-source free commercial ci cd config-management go java net nodejs php python ruby

Consul

Consul makes it simple for services to register themselves and to discover other services via a DNS or HTTP interface. Register external services such as SaaS providers as well

     

linux windows osx open-source service-discovery go monitoring

Deliver

A pure bash-based deployment tool with virtually no dependencies except the shell.

     

linux open-source provisioning ruby

Deployinator

A simple, rack-based deployment framework

     

linux open-source provisioning orchestration ruby

DeployKit

A generic integration tool built on a Message Queue, to make it easy to communicate events and triggers across various parts parts of the infrastructure. Created to ease the pain of configuring many disparate events in a CI

     

linux windows osx open-source ci ruby

Docker

Docker uses LXC to create and manage native, sandboxed virtual containers. LXC containers acts like a separate OSes, can install their own packages without affecting anything else, and overall have almost the same flexibility of VMs but without any of the virtualization overhead! Docker adds a ton of features, like an elegant configuration file that automates many things (like port forwarding, disk/directory mounting, networking, etc), a way to create and share readymade images that can be distributed as appliances, etc.

     

linux open-source virt cloud-paas provisioning go

Drone

Drone is a Continuous Integration platform built on Docker, written in Go

     

linux windows osx open-source ci go

Errbit

An open source, self-hosted error catching tool, which can collect and manage errors from other applications. It is compatible with the Airbrake API and can be used as a drop-in replacement.

     

linux windows osx open-source monitoring ruby

Fabric8

fabric8 is an end to end development platform spanning ideation to production for the creation of cloud native applications and microservices

     

linux windows osx open-source free cloud-paas virt go

FastForward

Flexible operating-system event and metric forwarding agent. Receives input and forwards output using plugins.

     

linux windows osx open-source metrics monitoring ruby

Fig

A package management tool, similar to Ivy/APT, but language agnostic, faster and works well with both executables and libraries.

     

linux windows osx open-source packaging ruby

Flynn

From the creator of Dokku, Flynn is a full fledged, open source PaaS platform built on top of Docker. You just push code with a Procfile, and that’s it, Flynn immediately picks it up, provisions a Docker container and deploys the latest code! Its tagged as “the product that ops gives to developers”

     

linux open-source virt cloud-paas go

FnordMetric

A HTML5/Javascript API for collecting and visualizing time series data

     

linux windows osx open-source monitoring ruby

Fog

The Ruby Cloud API library. Provides a Ruby API for interacting and managing many cloud providers, such as spinning up new instances, terminating old ones, attaching storage, etc. Currently supports more than 20 providers, including EC2, Rackspace, Brightbox, etc.

     

linux windows osx open-source cloud-paas ruby

Foreman

A complete lifecycle management tool for servers, both self-hosted and in the cloud. It allows you to create and manage instances, build and deploy images, view and audit hosts, and much more! It works with Puppet or Chef, and has multiple interaction facilities like a web frontend, CLI and a RESTful API.

     

linux open-source virt config-mgmt provisioning monitoring cloud-paas ruby

FPM

Effing Package Managers (FPM) is a single tool that can generate rpm, deb, solaris, osx (pkg) and many other packages. It supports multiple inputs (directory, gem, egg, deb, etc) and can produce multiple outputs (rpm, deb, solaris, etc). It relieves the pain out of creating various kinds of packages.

     

linux osx open-source packaging ruby

Gauntlt

Gauntlt provides hooks to a variety of security tools and puts them within reach of security, dev and ops teams to collaborate to build rugged software. It is built to facilitate testing and communication between groups and create actionable tests that can be hooked into your deploy and testing processes.

     

linux open-source security hardening ruby

Gerrit

A Web based code review and project management system for Git projects

     

linux windows osx open-source scm java

GitLab CI

GitLab CI integrates with GitLab and runs continuous integration builds whenever you check in code to any of your projects.

     

linux open-source ci ruby

GitLab

GitLab is an open-source, fully featured git web frontend developed using Ruby on Rails. You can host this in your own server, create projects, repositories and teams, manage fine grained access permissions, add wikis, collaborate, raise and merge pull requests, and do much more through the web! (Note: GitLab acquired Gitorious, another open source git management system, in March 2015)

     

linux open-source vcs ruby

GoCD

Go is a continuous delivery and release management tool, built from the ground up with pipelines in mind, and makes it easy to model complex build and deploy workflows

     

linux windows osx open-source ci java

Gogs

A self-hosted Git service written in Go. Gogs(Go Git Service) is a painless self-hosted Git Service written in Go. The goal of this project is to make the easiest, fastest and most painless way to set up a self-hosted Git service. With Go, this can be done in independent binary distribution across ALL platforms that Go supports, including Linux, Mac OS X, and Windows.

     

linux open-source git go scm

Graylog

An open source data analytics and reporting system, built on top of Java, Scala and ElasticSearch

     

linux open-source monitoring java

Honeybadger

Honeybadger is a hosted monitoring service that tracks errors happening in your applications, aggregates them, and notifies you about them based on rules you define. Honeybadger gives you the insight you need to diagnose and fix application errors, faster.

     

linux open-source free commercial monitoring ruby nodejs php java

Hubot

Hubot is a chat bot that can be configured to do a variety of tasks. Apart from usual CI stuff like deploying, it can be interestingly configured to do different workflows like posting images, translating languages and integrating with Google Maps, and being a bot, it can be configured to ask questions like what is the current deployed version, etc.

     

linux windows osx open-source ci nodejs

Hudson

The original lightweight CI tool written in Java. Initially part of Sun, then acquired by Oracle, and now maintained to the Eclipse Foundation

     

linux windows osx open-source ci java

InfluxDB

InfluxDB is a time series, metrics, and analytics database. It’s written in Go and has no external dependencies. InfluxDB is targeted at use cases for DevOps, metrics, sensor data, and real-time analytics.

     

linux open-source monitoring go metrics

Instrumental

Instrumental is a real-time, high-scale application and server monitoring tool with intelligent alerts, a powerful query language, and free development accounts.

     

linux windows oxs free metrics commercial metrics monitoring visualization php ruby python net java nodejs

jclouds

A Java Library for controlling cloud resources, with various plugins for many popular cloud providers.

     

linux windows osx open-source cloud-paas java

Jenkins

Jenkins is an open source, lightweight CI tool written in Java, with high extensibility and a fast release cycle. It was forked from Hudson after Oracle acquired it, and has since added significantly more features than the original

     

linux windows osx open-source ci java

jmxtrans

Plugs Java VM statistics via JMX to various backend monitoring tools

     

linux windows osx open-source monitoring java

KairosDB

KairosDB is a fast distributed scalable time series database written on top of Cassandra. RESTful JSON-based query/results. Includes flot-based visualization.

     

linux windows osx open-source metrics visualization java cassandra

Kibana

Kibana is a modern, beautiful visualization tool that works seamlessly with Logstash and ElasticSearch. It features a no-code setup, realtime analytics, and much more.

     

linux windows osx open-source monitoring nodejs visualization

Kubernetes

Kubernetes is a system for managing containerized applications across multiple hosts, providing basic mechanisms for deployment, maintenance, and scaling of applications

     

linux open-source virt orchestration go

Librarian-Puppet

Librarian-Puppet is a source structure and dependency manager for Puppet modules, similar to bundler for Ruby. Each Puppet module can be managed as a separate source repository with individual versioning, and can then be pulled into your Puppetfile.

     

linux windows osx open-source scm ruby

log.io

Realtime log monitoring directly in the browser, without any persistence layer in the middle!

     

linux windows osx open-source monitoring nodejs

Logstash

A modern tool for managing events and logs, with an ElasticSearch backend which allows a high degree of searching and filtering. It includes a shipper in remote systems, indexer in the aggregator machine, and a Web UI.

     

linux windows osx open-source monitoring java

LXD

LXD is a next generation system container manager. It offers a user experience similar to virtual machines but using Linux containers instead. It's image based with pre-made images available for a wide number of Linux distributions and is built around a very powerful, yet pretty simple, REST API.

     

linux open-source virt cloud-paas provisioning go

Metrics

Captures JVM and application-level metrics for Java

     

linux windows osx open-source monitoring java

Mina

A Ruby Rake-like DSL for fast deployment and automation, similar to Capistrano but faster and lesser overhead, since it creates only a single SSH connection for a deploy

     

linux osx open-source orchestration ruby

Monigusto

A collection of Chef recipes to install various monitoring tools (such as sensu, statsd, etc). Makes it a breeze to get a monitoring infrastructure up and running

     

linux windows osx open-source monitoring ruby

Nagios Log Server

Nagios Log Server greatly simplifies the process of searching your log data. Set up alerts to notify you when potential threats arise, or simply query your log data to quickly audit any system. With Nagios Log Server, you get all of your log data in one location, with high availability and fail-over built right in.

     

linux commercial monitoring metrics visualization java php ruby shell

Nagios Network Analyzer

Nagios Network Analyzer provides an in-depth look at all network traffic sources and potential security threats allowing system admins to quickly gather high-level information regarding the health of the network as well as highly granular data for complete and thorough network analysis using netflow, sflow, jflow, etc.

     

linux commercial monitoring metrics visualization c php python shell

Nagios XI

Nagios XI provides monitoring of all mission-critical infrastructure components including applications, services, operating systems, network protocols, systems metrics, and network infrastructure. Hundreds of third-party addons provide for monitoring of virtually all in-house and external applications, services, and systems.

     

linux commercial monitoring metrics visualization c php python perl shell

Nomad

Nomad is a lightweight workload orchestrator. It offers client instance scaling as well as workload scaling.

     

linux windows osx open-source virt orchestration go

Openshift

Openshift is a container management platform built around a core of Docker container packaging and Kubernetes cluster management. Origin is the upstream community project that powers OpenShift.

     

linux open-source cloud-paas go

Opskeleton

Bootstrap a DevOps infrastructure with some opinionated defaults (vagrant, puppet, librarian-puppet, git, etc), standard development guidelines, etc. Makes it very quick to get a DevOps team up and running

     

linux open-source scm virt config-mgmt provisioning orchestration ruby

Orc

A model driven orchestration tool for deployment of application clusters

     

linux windows osx open-source provisioning orchestration ruby

Packer

Packer is a tool for creating identical machine images for multiple platforms (like VirtualBox, VMWare, EC2, DigitalOcean, etc) from a single configuration file.

     

linux windows osx open-source virt cloud-paas go

Pallet

A tool to provision and maintain servers across various cloud platforms as well as virtual machine platforms, without any dependencies. Provides cloud and operating system independence.

     

linux windows osx open-source cloud-paas clojure

Phabricator

Phabricator is an open source collection of development and code management, including code reviews and audits, browsing repositories, tracking bugs, etc

     

linux osx open-source scm php

Prevoty Application Monitoring & Protection (AMP)

Prevoty enables DevOps to inject security into your web applications and web services. Protection is provided at runtime from within the application itself, and stays with the app regardless of deployment method (cloud, on-premises, etc). Applications are protected against threats including XSS, SQLi, CSRF, command injection, etc. Works with Puppet, Chef, Ansible, Docker, Splunk, QRadar, ELK, and many others.

     

linux windows osx bsd commercial go java net nodejs perl php python ruby monitoring security hardening chef puppet ansible metrics-visualization ci

Prometheus

Prometheus is an open-source systems monitoring and alerting toolkit built at SoundCloud.

     

linux open-source go metrics monitoring

PowerShell Desired State Configuration

DSC is a new management platform in Windows PowerShell that enables deploying and managing configuration data for software services and managing the environment in which these services run.

     

linux windows powershell open-source commercial config-mgmt

Pulumi

Create, deploy, and manage Cloud Native infrastructure, as real code. A single toolset for infrastructure, managed services, containers, and serverless environments on any cloud infrastructure. You get all the benefits of real programming languages; IDEs, abstractions and reuse thanks to functions, classes, and packages, debugging, testability, and more

     

linux windows osx open-source cloud-paas go javascript python

Puppet Dashboard

A web interface for Puppet. It can view and analyze Puppet reports, assign Puppet classes and parameters to nodes, view inventory data and backed-up file contents, etc.

     

linux windows osx open-source monitoring ruby

Puppet

Puppet is a tool designed to manage the configuration of Unix-like and Microsoft Windows systems declaratively.

     

linux windows osx open-source config-mgmt ruby

Raygun

Raygun keeps a watchful eye on your web and mobile applications and tells you when problems arise.

     

windows linux osx open-source python nodejs java ruby errors

Razor

Razor is next generation provisioning software that handles bare metal hardware and virtual server provisioning

     

linux open-source provisioning ruby

Riemann

Riemann aggregates events from servers and applications, notifies exceptions, tracks latency, collects system statistics and more, all with a powerful stream processing language

     

linux open-source monitoring clojure

Rollbar

Detect, diagnose and defeat errors.

     

linux windows osx nodejs open-source ruby php java python errors

Rundeck

Turns your operational procedures into self-service portal. Define common operational tasks in the Rundeck web portal, and safely hand it over to the rest of the team so that they can perform these tasks without you being around.

     

linux windows osx open-source orchestration java

Semaphore

Semaphore is a hosted continuous integration and deployment service for open source and private projects. Its cloud solution helps developers find bugs before they reach users and deliver new features faster.

     

linux open-source free commercial ci ruby php nodejs

Sensu

Sensu is a simple, malleable and scalable monitoring framework which is highly composable

     

linux open-source monitoring ruby

Sentry

Automate error tracking to find and fix issues before your users even experience a crash. Sentry is open-source, real-time, and loved by 100,000 developers around the world.

     

osx windows linux open-source errors nodejs ruby python php java monitoring

Serf

Serf is a service discovery and orchestration tool which is highly decentralized, highly available, fault tolerant, cross platform and extremely lightweight.

     

linux windows osx open-source orchestration go

SignalFx

SignalFx is an advanced monitoring and alerting solution for modern infrastructure. With SignalFx, development and operations teams monitor, analyze, and alert in real-time on any time series data.

     

linux windows oxs commercial go python c metrics monitoring visualization

Soloist

Soloist lets you quickly and easily converge Chef recipes using chef-solo.

     

linux windows osx open-source provisioning ruby

Spinnaker

Spinnaker is an open source, multi-cloud continuous delivery platform for releasing software changes with high velocity and confidence. It provides two core sets of features: cluster management and deployment management.

     

linux windows osx open-source cd java

SSH KeyBox

An open-source jump box solution with auditing capabilities

     

linux open-source cloud monitoring security java

Statsd

A network daemon that listens and collects statistics and sends aggregates to many pluggable backend services

     

linux windows osx open-source monitoring nodejs

Sunzi

A shell-based pure provisioning tool which doesn’t try to do anything else. Has no dependencies other than the shell

     

linux open-source provisioning shell

Supervisord Monitor

Supervisord Monitor is multi server monitoring tool for supervisor - watch, start and stop all your supervisord instances and servvices from one place.

     

linux windows osx open-source monitoring provisioning php process-mgmt

Terraform

Terraform provides a common configuration to launch infrastructure from different providers (AWS, Digital Ocean, Heroku, etc.). It provides dependency resolution to make sure that your infrastructure is created in the right order

     

linux windows osx open-source cloud-paas go

testssl.sh

A command-line tool which checks a server's service on any port for the support of TLS/SSL ciphers, protocols as well as some cryptographic flaws. It's designed to provide clear output for your "is this good or bad" decision.

     

linux osx open-source security shell

Travis-CI

Travis CI is a hosted CI service free for open source communities. It directly integrates with GitHub, BitBucket and many other version control systems, and offers deep support for a variety of languages. Travis also has an Enterprise version that can be installed on your own servers.

     

linux free commercial ci java

tsuru

tsuru is an extensible and open source Platform as a Service (PaaS) that makes application deployments faster and easier. Its built upon Docker and allows you easily manage and scale your applications.

     

linux open-source virt cloud-paas go

Uptime

An externally deployable application that keeps pinging and monitoring the uptime and availability of your real applications and services. It helps you track these metrics from the outside without affecting any of your servers.

     

linux windows osx open-source monitoring nodejs

Vagrant Cachier

A Vagrant plugin that helps you reduce the amount of coffee you drink while waiting for boxes to be provisioned by sharing a common package cache among similiar VM instances.

     

linux windows osx open-source virt artifacts ruby

Vagrant

Vagrant is a cross platform tool to create, boot, configure and destroy development environments. It provides a simple configuration-based approach to take a base image, boot it up, provision it (using any other provisioners), SSH, port forward, and much more. It automates the process of booting up and configuring virtual machines. It supports various providers like VirtualBox, VMWare, AWS, LXC, etc.

     

linux windows osx open-source virt provisioning ruby

Veewee

veewee is a great tool for building Virtual Machine images (aka base boxes). It automates most of the steps and allows you to easily create readymade images for VirtualBox/Vagrant, VMWare Fusion, KVM and Parallels. No longer need to shy away from building custom VM images!

     

linux osx windows open-source virt packaging ruby

Weave

Weave creates a virtual network that connects Docker containers deployed across multiple hosts. Services provided by application containers on the weave network can be made accessible to the outside world, regardless of where those containers are running. Similarly, existing internal systems can be exposed to application containers irrespective of their location.

     

linux open-source virt cloud-paas orchestration service-discovery go

werf

werf is CI/CD tool for building Docker images and delivering them to Kubernetes using a GitOps approach. It integrates with any existing CI systems including GitLab CI, GitHub Actions, etc.

     

linux windows osx open-source ci kubernetes virt go

Zipkin

A distributed request tracking system, useful for micro-service and distributed architectures written in Scala

     

linux windows osx open-source monitoring scala

Apache ZooKeeper

ZooKeeper is a centralized service for maintaining configuration information, naming, providing distributed synchronization, and providing group services. It is distributed and highly reliable, with Consensus, group management and presence protocols built-in.

     

linux open-source service-discovery java