Reading Logs Integrating Extensive Reading With Writing Tasks: Fill & Download for Free

I asked something among the lines of this question and I'm going to leave the best of what I got here:What are the most useful gems to use in Rails?Check out the Ruby Toolbox for better feedback:The Ruby Toolbox. But here is a rough list that is collected from Marc Anguera's Github repo and most of the ones I recall to be recommended.Also, to learn more about the following gem, I've made a list of Ruby podcasts that actually talk about some of the following gems in depth:Yad's answer to Are there good alternatives to Ryan Bates' RailsCasts?AbstractionActiveInteraction - Manage application specific business logic.Cells - View Components for RailsInteractor - Interactor provides a common interface for performing complex interactions in a single requestLight Service - Series of Actions with an emphasis on simplicity.Mutations - Compose your business logic into commands that sanitize and validate inputReform - Form objects decoupled from models.Admin Interfaceupmin/upmin-admin-ruby Upmin Admin is a framework for creating powerful Ruby on Rails admin backends with minimal effort.ActiveAdmin - a Ruby on Rails framework for creating elegant backends for website administrationRailsAdmin - A Rails engine that provides an easy-to-use interface for managing your dataAnalyticGabba - Simple way to send server-side notifications to Google Analyticsactivenetwork/gattica Gattica is a Ruby library for talking to the Google Analytics API.Ahoy - A solid foundation to track visits and events in Ruby, JavaScript, and native appsLegato - Model analytics reports and queries against the official Google Analytics Reporting APIAPI BuilderActiveModel::Serializers - JSON serialization of objectsCrêpe - The thin API stackGrape - An opinionated micro-framework for creating REST-like APIs in Rubyjbuilder - Create JSON structures via a Builder-style DSLJSONAPI::Resources - JSONAPI::Resources, or "JR", provides a framework for developing a server that complies with the JSON API specification.Jsonite - A tiny, HAL-compliant JSON presenter for your APIsPliny - Opinionated template Sinatra app for writing excellent APIs in Rubyrabl - General ruby templating with json, bson, xml, plist and msgpack supportRails::API - Rails for API only applicationsRoar - Resource-Oriented Architectures in RubyAssetsLess Rails - The dynamic stylesheet language for the Rails asset pipeline.Less - Leaner CSS, in your browser or Ruby.Sass - Sass makes CSS fun againManagement:Rails Assets - Bundler to Bower proxySprockets - Rack-based asset packaging systemAuthentication and OAuthAuthlogicClearance - Small and simple email & password based authenticaton for RailsDevise - A flexible authentication solution for Rails based on WardenOmniAuth - A library that standardizes multi-provider authentication utilizing Rack middlewareSorcery - Magical Authentication for Rails 3 and 4OAuth:Doorkeeper - An OAuth2 provider for RailsOAuth2 - A Ruby wrapper for the OAuth 2.0 protocolAuthorizationAuthority ORM-neutral way to authorize actions in your Rails app.CanCanCanPundit - Minimal authorization through OO design and pure Ruby classesCachingAction caching for Action Pack - Action caching for Action PackDalli - A high performance pure Ruby client for accessing memcached serversRecord Cache - Cache Active Model Records in Rails 3CLI BuilderCommander - The complete solution for Ruby command-line executablesGLI - Git-Like Interface Command Line ParserMain - A class factory and DSL for generating command line programs real quickRake - A make-like build utility for RubySlop - Simple Lightweight Option ParsingThor - A toolkit for building powerful command-line interfacesCMSAlchemy CMS - A powerful, userfriendly and flexible Open Source Rails CMSLocomotiveCMS - A simple but powerful CMS based on Liquid templates and Mongodb databasePublify - A self hosted Web publishing platform on RailsRadiant - A no-fluff, open source content management system designed for small teamsRefinery CMS - An open source Ruby on Rails content management system for Rails 3 and 4Code Analysis and MetricsBrakeman - A static analysis security vulnerability scanner for Ruby on Rails applications.Flay - Flay analyzes code for structural similarities. Differences in literal values, variable, class, method names, whitespace, programming style, braces vs do/end, etc are all ignored. Making this totally rad.Flog - Flog reports the most tortured code in an easy to read pain report. The higher the score, the more pain the code is in.fukuzatsu - Complexity analysis tool with a rich web front-end.MetricFu - A fist full of code metricsrails_best_practices - A code metric tool for rails projectsReek - Code smell detector for RubyRubocop - A static code analyzer, based on the community Ruby style guide.Rubycritic - A Ruby code quality reporter.SimpleCov - Code coverage for Ruby 1.9+ with a powerful configuration library and automatic merging of coverage across test suites.Coding Style GuidesRails style guide - Community-driven Rails best practices and style for Rails 3 and 4RSpec style guide - Better Specs { rspec guidelines with ruby }Ruby style guide - Community-driven Ruby coding styleConcurrencyCelluloid - Actor-based concurrent object framework for RubyConcurrent Ruby - Modern concurrency tools including agents, futures, promises, thread pools, supervisors, and more. Inspired by Erlang, Clojure, Scala, Go, Java, JavaScript, and classic concurrency patterns.EventMachine - An event-driven I/O and lightweight concurrency library for RubyConfigurationConfigatron - Simple and feature rich configuration system for Ruby appsConfigus - Helps you easily manage environment specific settingsdotenv - Loads environment variables from .envEconfig - Flexible configuration for Rails applicationsFigaro - Simple, Heroku-friendly Rails app configuration using ENV and a single YAML fileGlobal - Provides accessor methods for your configuration dataRailsConfig - Multi-environment yaml settings for Rails3Core ExtensionsActiveSupport - A collection of utility classes and standard library extensions.Ruby Facets - The premiere collection of general purpose method extensions and standard additions for Ruby.AttributesActiveAttr - What ActiveModel left outFastAttributes - FastAttributes adds attributes with their types to the classVirtus - Attributes on Steroids for Plain Old Ruby ObjectsHashHashie - A collection of tools that extend Hashes and make them more usefulCountry DataCarmen - A repository of geographic regionsCountries - All sorts of useful information about every country packaged as pretty little country objectsi18n_data - country/language names and 2-letter-code pairs, in 85 languages, for country/language i18nnormalize_country - Convert country names and codes to a standard, includes a conversion program for XMLs, CSVs and DBsDashboardsDashing-Rails - The exceptionally handsome dashboard framework for Rails.Data VisualizationRailRoady - Ruby on Rails 3/4 model and controller UML class diagram generator.Rails Erd - Generate Entity-Relationship Diagrams for Rails applications.Ruby/GraphViz - Ruby interface to the GraphViz graphing toolDatabase DriversCassandra Driver - A pure ruby driver for Apache Cassandra with asynchronous io and configurable load balancing, reconnection and retry policiesDataObjects - An attempt to rewrite existing Ruby database drivers to conform to one, standard interface.mongo-ruby-driver - MongoDB Ruby drivermoped - A MongoDB driver for Rubymysql2 - A modern, simple and very fast Mysql library for Ruby (binding to libmysql)Redic - Lightweight Redis Clientredis-rb - A Ruby client that tries to match Redis' API one-to-one, while still providing an idiomatic interfaceruby-pg - Ruby interface to PostgreSQL 8.3 and laterSQLite3Database ToolsDatabase Cleaner - Database Cleaner is a set of strategies for cleaning your database in Ruby.PgHero - Postgres insights made easySeed dump - Rails 4 task to dump (parts) of your database to db/seeds.rb.Seed Fu - Advanced seed data handling for Rails.Date and Time Processingbusiness_time - Support for doing time math in business hours and daysChronic - A natural language date/time parser written in pure Rubygroupdate - The simplest way to group temporal data in ActiveRecord, arrays and hashestime-lord - Adds extra functionality to the time classtime_diff - Calculates the difference between two timevalidates_timeliness - Date and time validation plugin for ActiveModel and Railsyymmdd - Tiny DSL for idiomatic date parsing and formattingDebugging ToolsByebug - A simple to use, feature rich debugger for Ruby 2.debugger - A port of ruby-debug that works on 1.9.2 and 1.9.3.DecoratorsDraper - Draper adds an object-oriented layer of presentation logic to your Rails applicationDevOps ToolsBackup - Provides an elegant DSL in Ruby for performing backups on UNIX-like systemsCapistrano - A remote server automation and deployment tool written in RubyChef - A systems integration framework, built to bring the benefits of configuration management to your entire infrastructureLogstash - Logs/event transport, processing, management, searchMina - Really fast deployer and server automation tool.Puppet - An automated administrative engine for your Linux, Unix, and Windows systems, performs administrative tasks (such as adding users, installing packages, and updating server configurations) based on a centralized specificationRubber - The rubber plugin enables relatively complex multi-instance deployments of RubyOnRails applications to Amazon's Elastic Compute Cloud (EC2).DocumentationAsciidoctor - A fast, Ruby-based text processor & publishing toolchain for converting AsciiDoc to HTML5, DocBook, EPUB3, PDF & more.grape-swagger - Add swagger compliant documentation to your Grape APIInch - Inch is a documentation measurement and evalutation tool for Ruby code, based on YARDRDoc - RDoc produces HTML and command-line documentation for Ruby projectsYARD - YARD enables the user to generate consistent, usable documentation that can be exported to a number of formats very easilyE-Commerce and PaymentsActive Merchant - A simple payment abstraction library extracted from ShopifyPaypal Merchant SDK - Official Paypal Merchant SDK for RubyPiggybak - Modular, Extensible open-source ecommerce solution for Ruby on RailsROR EcommerceShoppe - A Rails-based e-commerce platform which allows you to easily introduce a catalogue-based store into your Rails 4 applicationsSpreestripe-ruby - Stripe Ruby bindingsEbookBookshop - Bookshop is a an open-source agile book development and publishing framework for authors, editors.Eeepub - EeePub is a Ruby ePub generator.Gepub - A generic EPUB library for Ruby : supports EPUB 3Git Scribe - Basically the best way to write an ebook.Mobi - A Ruby way to read MOBI format metadataReview - Re:VIEW is flexible document format/conversion systemEmailIncoming - Incoming! helps you receive email in your Rack appsLetterOpener - Preview mail in the browser instead of sending.Mail - A Really Ruby Mail LibraryMailCatcher - Catches mail and serves it through a dreamMailman - An incoming mail processing microframework in RubyPony - The express way to send mail from RubyEnvironment Managementchgems - Chroot for RubyGemschruby - Change your current Ruby. No shims, no crazy options or features, ~90 LOCfry - Simple ruby version manager for fishgem_home - A tool for changing your $GEM_HOMErbenv - Use rbenv to pick a Ruby version for your application and guarantee that your development environment matches productionruby-build - Compile and install Rubyruby-install - Installs Ruby, JRuby, Rubinius, MagLev or MRubyRVM - RVM is a command-line tool which allows you to easily install, manage, and work with multiple ruby environments from interpreters to sets of gemsError HandlingAirbrake - The official Airbrake library for Ruby on Rails (and other Rack based frameworks)Better Errors - Better error page for Rack appsErrbit - The open source, self-hosted error catcherException Notification - A set of notifiers for sending notifications when errors occur in a Rack/Rails applicationNesty - Nested exceptions for RubyRaven Ruby - Raven is a Ruby client for Sentry.File UploadCarrierWave - Classier solution for file uploads for Rails, Sinatra and other Ruby web frameworksDragonFly - A Ruby gem for on-the-fly processing - suitable for image uploading in Rails, Sinatra and much more!PaperClip - Easy file attachment management for ActiveRecordrack-secure-upload - Upload files securelyForm BuilderAbracadabra - The gem that swaps out text with a fully-compliant Rails form in one clickFormtastic - A Rails form builder plugin with semantically rich and accessible markupRails Bootstrap Forms - Rails form builder that makes it super easy to create beautiful-looking forms with Twitter Bootstrap 3+Simple Form - Rails forms made easyGame DevelopmentGosu - A 2D game development library for the Ruby and C++ programming languagesYeah - Practical Ruby video game frameworkGeolocationGeocoder - A complete geocoding solution for Ruby. With Rails it adds geocoding (by street or IP address), reverse geocoding (find street address based on given coordinates), and distance queriesGeokit - Geokit gem provides geocoding and distance/heading calculationsHTTPexcon - Usable, fast, simple Ruby HTTP 1.1. It works great as a general HTTP(s) client and is particularly well suited to usage in API clients.FaradayHttp Client - Gives something like the functionality of libwww-perl (LWP) in Rubyhttp - The HTTP Gem: a simple Ruby DSL for making HTTP requests.httpartyPatron - Patron is a Ruby HTTP client library based on libcurl.RESTClient - Simple HTTP and REST client for Ruby, inspired by microframework syntax for specifying actionsSavon - Savon is a SOAP client for the Ruby programming language.Sawyer - Secret user agent of HTTP, built on top of FaradayTyphoeus - Typhoeus wraps libcurl in order to make fast and reliable requestsImageryMiniMagick - A ruby wrapper for ImageMagick or GraphicsMagick command linePSD.rb - Parse Photoshop files in Ruby with easeRMagick - RMagick is an interface between Ruby and ImageMagickSkeptick - Skeptick is an all-purpose DSL for building and running ImageMagick commands.Internationalizationi18n-tasks - Manage missing and unused translations with the awesome power of static analysisi18n - Ruby Internationalization and localization solutionr18n - Advanced i18n library for Rails, Sinatra, desktop apps, models, works well with complex languages like Russian.twitter-cldr-rb - Ruby implementation of the ICU (International Components for Unicode) that uses the Common Locale Data Repository to format dates, plurals, and moreLoggingCabin - Structured+contextual logging experiments in Ruby.Fluentd - Fluentd collects events from various data sources and writes them to files, database or other types of storagesHttpLog - Log outgoing HTTP requests.Log4r - Log4r is a comprehensive and flexible logging library for use in Ruby programsLogging - A flexible logging library for use in Ruby programs based on the design of Java's log4j library.Lograge - An attempt to tame Rails' default policy to log everything.MongoDB Logger - MongoDB logger for RailsScrolls - Simple loggingYell - Your Extensible Logging LibraryMachine LearningPredictionIO Ruby SDK - The PredictionIO Ruby SDK provides a convenient API to quickly record your users' behavior and retrieve personalized predictions for themRuby Datumbox Wrapper - It's a simple Ruby Datumbox Wrapper. At the moment the API currently allows you to build applications that make use of machine learning algorithms.Markdown Processorskramdown - Kramdown is yet-another-markdown-parser but fast, pure Ruby, using a strict syntax definition and supporting several common extensionsMaruku - A pure-Ruby Markdown-superset interpreterRedcarpet - A fast, safe and extensible Markdown to (X)HTML parserMiscAASM - A library for adding finite state machines to Ruby classesAXLSX - An excel xlsx generation libraryBetty - Friendly English-like interface for your command line. Don't remember a command? Ask BettyForeman - Manage Procfile-based applicationsGollum - A simple, Git-powered wiki with a sweet API and local frontend.Guard - A command line tool to easily handle events on file system modificationsJsonCompare - Returns the difference between two JSON filesplay ► - Your company's djPry Debugger - Pry navigation commands via debugger (formerly ruby-debug)Pry - A powerful alternative to the standard IRB shell for Rubypygments.rb - A Ruby wrapper for the Python pygments syntax highlighterRuby Operators - A webpage showing awesome names for different Ruby operators.Termit - Google Translate with speech synthesis in your terminalTreetop - PEG (Parsing Expression Grammar) parserYomu - Read text and metadata from files and documents (.doc, .docx, .pages, .odt, .rtf, .pdf)Mobile DevelopmentRuboto - A platform for developing full stand-alone apps for Android using the Ruby language and librariesRubyMotion - A revolutionary toolchain that lets you quickly develop and test native iOS and OS X applications for iPhone, iPad and MacMoneyeu_central_bank - A gem that calculates the exchange rate using published rates from European Central BankMoney - A Ruby Library for dealing with money and currency conversionNatural Language ProcessingTreat - Treat is a toolkit for natural language processing and computational linguistics in RubyORM/ODMActiveRecordDataMapper - ORM which works well with legacy databases. Last release (1.2.0) was on 13 October 2011.Guacamole - An ODM for ArangoDBMongoid - An ODM (Object-Document-Mapper) framework for MongoDB in RubyMongoMapperMongoModel - Ruby ODM for interfacing with MongoDB databasesohm - Object-hash mapping library for RedisSequel - Sequel is a simple, flexible, and powerful SQL database access toolkit for RubyORM/ODM ExtensionsMongoid Tree - A tree structure for Mongoid documents using the materialized path patternPackage ManagementGemsBundler - Manage your application's gem dependencies with less painRubyGems - Community's gem hosting servicePackages and ApplicationsBerkshelf - A Chef Cookbook managerCocoaPods - The Objective-C dependency managerfpm - Effing package management! Build packages for multiple platforms (deb, rpm, etc) with great ease and sanityHomebrew-cask - a CLI workflow for the administration of Mac applications distributed as binariesHomebrew - The missing package manager for OS XPaginationKaminari - A Scope & Engine based, clean, powerful, customizable and sophisticated paginator for modern web app frameworks and ORMswill_paginate - A pagination library that integrates with Ruby on Rails, Sinatra, Merb, DataMapper and SequelPDFGimli - Utility for converting markup files to pdf files.Kitabu - A framework for creating e-books from Markdown/Textile text markup using Ruby.Pdfkit - HTML+CSS to PDF using wkhtmltopdfPrawn - Fast, Nimble PDF Writer for RubyRGhost - RGhost is a document creation and conversion API.Shrimp - A phantomjs based pdf rendererWicked Pdf - PDF generator (from HTML) plugin for Ruby on RailsWisepdf - Wkhtmltopdf wrapper done rightProcess MonitoringBluepill - Simple process monitoring toolGod - An easy to configure, easy to extend monitoring framework written in RubyProcesses and ThreadsParallel - Run any code in parallel Processes (> use all CPUs) or Threads (> speedup blocking operations). Best suited for map-reduce or e.g. parallel downloads/uploadschildprocess - Cross-platform ruby library for managing child processes.forkoff - brain-dead simple parallel processing for rubyposix-spawn - Fast Process::spawn for Rubys >= 1.8.7 based on the posix_spawn() system interfacesProfilerbullet - Help to kill N+1 queries and unused eager loadingPeek - Visual status bar showing Rails performanceperftools.rb - gperftools (formerly known as google-perftools) for Ruby coderack-mini-profiler - Profiler for your development and production Ruby rack appsruby-prof - A code profiler for MRI rubiesQueueactive_job - Declare job classes that can be run by a variety of queueing backendsDelayed::Job - Database backed asynchronous priority queueResque - A Redis-backed Ruby library for creating background jobsSidekiq - A full-featured background processing framework for Ruby. It aims to be simple to integrate with any modern Rails application and much higher performance than other existing solutions.Sucker Punch - A single process background processing library using Celluloid. Aimed to be Sidekiq's little brother.RoboticsArtoo - Next generation robotics framework with support for different platforms: Arduino, Leap Motion, Pebble, Raspberry Pi, etc.RSSFeed normalizer - Extensible Ruby wrapper for Atom and RSS parsers.Feedjira - A feed fetching and parsing library.Ratom - A fast, libxml based, Ruby Atom library.Simple rss - A simple, flexible, extensible, and liberal RSS and Atom reader.SchedulingClockwork - Clockwork is a cron replacement. It runs as a lightweight, long-running Ruby process which sits alongside your web processes (Mongrel/Thin) and your worker processes (DJ/Resque/Minion/Stalker) to schedule recurring work at particular times or dates.resque-scheduler - A light-weight job scheduling system built on top of Resquerufus-scheduler - Job scheduler for Ruby (at, cron, in and every jobs)Whenever - A Ruby gem that provides a clear syntax for writing and deploying cron jobsSearchattr_searchable - Search engine like fulltext query support for ActiveRecordelasticsearch-rubyhas_scope - Has scope allows you to easily create controller filters based on your resources named scopes.pg_search - Builds ActiveRecord named scopes that take advantage of PostgreSQL's full text searchransack - Object-based searching.Rroonga - The Ruby bindings of GroongaSearchkick - Searchkick learns what your users are looking for. As more people search, it gets smarter and the results get better. It’s friendly for developers - and magical for your users.Searchlogic - Object based searching, common named scopes, and other useful named scope tools for ActiveRecordSunspot - A Ruby library for expressive, powerful interaction with the Solr search engineThinking Sphinx - A library for connecting ActiveRecord to the Sphinx full-text search toolSEOFriendlyId - The "Swiss Army bulldozer" of slugging and permalink plugins for Active RecordMetaTags - A gem to make your Rails application SEO-friendlySitemapGenerator - A framework-agnostic XML Sitemap generator written in RubySocial NetworkingCampo - Campo is a lightweight forum application, base on Ruby on Rails.diaspora* - A privacy aware, distributed, open source social networkDiscourse - A platform for community discussion. Free, open, simpleForem - Rails 3 and Rails 4 forum engineState MachinesAASM - State machines for Ruby classes (plain Ruby, Rails Active Record, Mongoid)simple_states - A super-slim statemachine-like support libraryStatesman - A statesmanlike state machine libraryWorkflow - A finite-state-machine-inspired API for modeling and interacting with what we tend to refer to as 'workflow'Static Site GenerationHigh Voltage - Easily include static pages in your Rails appJekyll - Transform your plain text into static websites and blogsMiddleman - A static site generator using all the shortcuts and tools in modern web developmentNanoc - A static site generator, fit for building anything from a small personal blog to a large corporate web siteTemplate EngineCurly - A template language that completely separates structure and logicHaml - HTML Abstraction Markup LanguageLiquid - Safe, customer facing template language for flexible web appsMustache - Logic-less Ruby templatesSlim - A template language whose goal is reduce the syntax to the essential parts without becoming crypticTilt - Generic interface to multiple Ruby template enginesTestingFrameworksRSpec - Behaviour Driven Development for RubyFormattersEmoji-RSpec - Custom Emoji Formatters for RSpecFuubar - The instafailing RSpec progress bar formatterNyan Cat - Nyan Cat inspired RSpec formatter!Bacon - A small RSpec cloneCapybara - Acceptance test framework for web applicationsCucumber - BDD that talks to domain experts first and code secondCutest - Isolated tests in RubyKonacha - Test your Rails application's JavaScript with the mocha test framework and chai assertion libraryminitest - minitest provides a complete suite of testing facilities supporting TDD, BDD, mocking, and benchmarkingRR - A test double framework that features a rich selection of double techniques and a terse syntaxshoulda-matchers - Provides Test::Unit- and RSpec-compatible one-liners that test common Rails functionality. These tests would otherwise be much longer, more complex, and error-prone.Spinach - Spinach is a high-level BDD framework that leverages the expressive Gherkin language (used by Cucumber) to help you define executable specifications of your application or library's acceptance criteria.Spork - A DRb server for testing frameworks (RSpec / Cucumber currently)Test::Unit - Test::Unit is a xUnit family unit testing framework for RubyFake DataFabrication - A simple and powerful object generation libraryfactory_girl - A library for setting up Ruby objects as test datafaker - A library for generating fake data such as names, addresses, and phone numbers.ffaker - A faster Faker, generates dummy data, rewrite of faker.Forgery - Easy and customizable generation of forged data.Machinist - Fixtures aren't fun. Machinist isMockActiveMocker - Generate mocks from ActiveRecord models for unit tests that run fast because they don’t need to load Rails or a database.TestXml - TestXml is a small extension for testing XML/HTML.WebMock - Library for stubbing and setting expectations on HTTP requestsWebDriversSelenium WebDriver - This gem provides Ruby bindings for WebDriver.Watir - Web application testing in RubyExtraAppraisal - Appraisal integrates with bundler and rake to test your library against different versions of dependenciesRuby-JMeter - A Ruby based DSL for building JMeter test plansSpring - Preloads your rails environment in the background for faster testing and Rake taskstimecop - Provides "time travel" and "time freezing" capabilities, making it dead simple to test time-dependent codevcr - Record your test suite's HTTP interactions and replay them during future test runs for fast, deterministic, accurate testsThird-party APIsdatabasedotcom - Ruby client for the Salesforce's Welcome to the world’s most trusted and secure cloud database, salesforce.com. - Salesforce.com and Chatter APIsDropbox - Dropbox API Ruby Client.facy - Command line power tool for facebookfb_graph - A full-stack Facebook Graph API wrapperflickr - A Ruby interface to the Flickr APIgitlab - Ruby wrapper and CLI for the GitLab APIgmail - A Rubyesque interface to Gmail, with all the tools you'll need.hipchat-rb - HipChat HTTP API Wrapper in Ruby with Capistrano hooksinstagram-ruby-gem - The official gem for the Instagram REST and Search APIsitunes_store_transporter - Ruby wrapper around Apple's iTMSTransporter programlinkedin - Provides an easy-to-use wrapper for LinkedIn's REST APIsOctokit - Ruby toolkit for the GitHub APIPusher - Ruby server library for the Pusher API.ruby-gmail - A Rubyesque interface to Gmailruby-trello - Implementation of the Trello API for Rubysoundcloud-ruby - Official SoundCloud API Wrapper for Rubyt - A command-line power tool for Twittertweetstream - A simple library for consuming Twitter's Streaming APItwitter - A Ruby interface to the Twitter APIwikipedia - Ruby client for the Wikipedia API.youtube_it - An object-oriented Ruby wrapper for the YouTube GData APIYt - An object-oriented Ruby client for YouTube API V3VideoStreamio FFMPEG - Simple yet powerful wrapper around the ffmpeg command for reading metadata and transcoding moviesWeb Crawlinganemone - Ruby library and CLI for crawling websites.LinkThumbnailer - Ruby gem that generates thumbnail images and videos from a given URL. Much like popular social website with link preview.Mechanize - Mechanize is a ruby library that makes automated web interaction easy.MetaInspector - Ruby gem for web scraping purposes. It scrapes a given URL, and returns you its title, meta description, meta keywords, an array with all the links, all the images in it, etc.Upton - A batteries-included framework for easy web-scraping. Just add CSS! (Or do more.)Wombat - Web scraper with an elegant DSL that parses structured data from web pagesWeb FrameworksCamping - A web microframework which consistently stays at less than 4kB of codeCuba - A microframework for web developmentLotus - It aims to bring back Object Oriented Programming to web development, leveraging on a stable API, a minimal DSL, and plain objects.Padrino - A full-stack ruby framework built upon SinatraPakyow - A framework for building modern, realtime web-apps in Ruby. It helps you build working software faster with a development process that's friendly to both designers and developersRamaze - A simple, light and modular open-source web application framework written in RubyRoda - A routing tree web frameworkRuby on Rails - A web-application framework that includes everything needed to create database-backed web applications according to the Model-View-Controller (MVC) patternSinatra - Classy web-development dressed in a DSLVolt - A Ruby web framework where your ruby code runs on both the server and the clientWeb ServersGoliath - A non-blocking Ruby web server frameworkPhusion Passenger - Fast and robust web server and application serverPuma - A modern, concurrent web server for RubyRack - A common Ruby web server interface. By itself, it's just a specification and utility library, but all Ruby web servers implement this interfaceThin - Tiny, fast & funny HTTP serverUnicorn - Rack HTTP server for fast clients and UnixWebSocketFaye - A set of tools for simple publish-subscribe messaging between web clients. It ships with easy-to-use message routing servers for Node.js and Rack applications, and clients that can be used on the server and in the browser.Firehose - Build realtime Ruby web applicationsRails Realtime - Adding Real-Time To Your RESTful Rails App.Sync - Real-time Rails PartialsWebsocket-Rails - Creates a built in WebSocket server inside a Rails application with ease. Also support streaming HTTP

Since Python has gained a lot of momentum in the field of data science in recent years, I would like to list some of the most useful libraries for data scientists and engineers based on recent experience. Moreover, since all libraries are open source, we have increased the number of submissions, contributors, and other metrics from Github, which can serve as a proxy indicator for library popularity.Core library1. NumPy (Submitted: 15980, Contributors: 522)When it comes to dealing with scientific tasks in Python, it will inevitably help Python's SciPy Stack, which is a collection of software designed for scientific computing in Python (not with the SciPy library that is part of the stack). Confuse the community around this stack). So we want to look at it first. However, this stack is very large and there are more than a dozen libraries. We hope to focus on the core packages (especially the most important ones).The most basic package created by the scientific computing stack is NumPy (for Numerical Python). It provides a wealth of useful features for n arrays and matrix operations in Python. This library provides vectorization of mathematical operations on NumPy array types, which improves performance and speeds up execution accordingly.2. SciPy (submitted: 17213, contributors: 489)SciPy is an engineering and science software library. Again, you need to understand the difference between SciPy Stack and SciPy Library. SciPy contains modules for linear algebra, optimization, integration, and statistics. The main function of the SciPy library is based on NumPy, so its array uses NumPy extensively. It provides valid numerical routines through its specific submodules, such as numerical integration, optimization, and so on. All of SciPy's sub-modules are well documented - another coin is in its pot.3. Panda (Promise: 15089, Contributors: 762)Pandas is a Python package designed to handle "tag" and "relationship" data simply and intuitively. Panda is the best tool for data scramble. It is designed for fast and easy data processing, aggregation and visualization.There are two main data structures in the library:"Series" - One-dimensional, "Data Framework" is two-dimensional. For example, when you want to receive a new Dataframe from these two types of structures, you will get a DF by passing a Series to add a row to the DataFrame:Here are just a few things you can do with pandas:Easily delete and add columns from DataFrameConvert data structures to DataFrame objectsDealing with missing data, expressed as NaNPowerful groupingVisualization4. Matplotlib (submitted: 21754, contributors: 588)Another SciPy Stack core package and another Python library generated for easy generation of simple and powerful visualizations is Matplotlib. This is a top-notch software that makes Python (with some help from NumPy, SciPy, and Pandas) a cognitive contender for scientific tools such as MatLab or Mathematica.However, this library is quite low-level, which means that you need to write more code to achieve advanced visualization, and if you use more advanced tools, you will usually put more effort, but the overall workload is worth Shooting.With a little effort, you can make any visualization:Line drawingScatter plots;Bar and histograms;pie chart;Stem plots;Contour map;TremblingSpectrogram.There are also tools for creating labels, grids, legends, and many other formatting entities using Matplotlib. Basically, everything is customizable.The library is supported by different platforms and uses different GUI toolkits to describe the visualization results. Different IDEs (such as IPython) support the functionality of Matplotlib.There are additional libraries that make visualizing easier.5. Seaborn (Promise: 1699, contributor: 71)Seaborn focuses on the visualization of statistical models; such visualizations include heat maps, heat maps that summarize data but still depict the overall distribution. Seaborn is based on Matplotlib and is highly dependent on it.6. Bokeh (Submission: 15724, Contributors: 223)Another great visual library is Bokeh, whose goal is interactive visualization. Compared to previous libraries, this library is independent of Matplotlib. As we have already mentioned, Bokeh's main focus is on interactivity, which is demonstrated in modern browsers in the form of "data-driven documentation" (d3.js).7. Plotly (Promise: 2486, contributors: 33)Finally, a word about Plotly. This is a web-based toolkit for building visualizations and exposing the API to some programming languages ​​(including Python). There are some powerful, out-of-the-box graphics on Modern Visualization for the Data Era. In order to use Plotly, you need to set your API key. The graphics will be processed on the server side and will be posted on the internet, but there is a way to avoid it.Machine learning8. SciKit-Learn (Submitted: 21793, Contributors: 842)Scikits is an add-on package for the SciPy Stack and is designed for specific functions such as image processing and machine learning. For the latter, the most prominent of these packages is scikit-learn. This package is built on top of SciPy and uses its mathematical operations extensively.Scikit-learn provides a simple and consistent interface to common machine learning algorithms, making it easy to bring ML into production systems. The library combines high-quality code and good documentation, ease of use and high performance, and is an industry standard for machine learning in fact using Python.Deep Learning - Keras / TensorFlow / TheanoIn deep learning, one of the most important and convenient Python libraries in this area is Keras, which can run on TensorFlow or Theano. Let us describe in detail all these details.9. Theano. (Commitment: 25870, Contributors: 300)First, let's talk about Theano.Theano is a Python package that defines a multidimensional array similar to NumPy, as well as mathematical operations and expressions. The library is compiled so that it runs efficiently on all architectures. Originally developed by the Montreal University Machine Learning Group, it is primarily used for machine learning needs.It is important to note that Theano and NumPy are tightly integrated in low-level operations. The library also optimizes the use of GPUs and CPUs to make data-intensive computations faster.The adjustment of efficiency and stability can get more accurate results, even very small values, for example, the calculation of log(1 + x) can give an understanding result even if it is the minimum value x.10. Tensor flow. (Commitment: 16785, Contributor: 795) Developer from Google, it is an open source data flow graph calculation library, this calculation is more acute for machine learning. It is designed to meet the high demand for neural networks in the Google environment and is the successor to DistBelief, a neural network based machine learning system. However, TensorFlow is not strictly used for scientific purposes in Google's borders - it is sufficient for a variety of real-world applications.The main feature of TensorFlow is their multi-tiered node system, which can quickly train artificial neural networks on large data sets. This makes Google's speech recognition and object recognition in pictures possible.11. Keras. (Commitment: 3519, Contributors: 428)Finally, let's take a look at Kailas. It is an open source library for building neural networks in advanced interfaces and is written in Python. It is simple and direct, with a high degree of scalability. It uses Theano or TensorFlow as its backend, but Microsoft is now working hard to make CNTK (Microsoft's cognitive toolkit) a new backend.The simple method in the design aims to make a quick and simple experiment by building a compact system.Kailas is really easy to get started and continues with rapid prototyping. It is written in pure Python and is essentially advanced. It is highly modular and extensible. Despite its simple, simple and high-level positioning, Keras is still profound and powerful enough to perform serious modeling.The basic idea of ​​Keras is based on the level, and everything else is built around them. The data preparation tensor, the first layer is responsible for the input of the tensor, the last layer is responsible for the output, and the model is placed between the two.Natural language processing12. NLTK (Promise: 12449, contributors: 196)The name of this set of libraries represents the natural language toolkit, as the name suggests, it is used for the common tasks of symbolic and statistical natural language processing. NLTK aims to promote the teaching and research of NLP and its related fields (linguistics, cognitive sciences, artificial intelligence, etc.) and it is now being used.NLTK's capabilities allow for many operations such as text tagging, classification and tagging, name entity identification, building a corpus tree that displays sentence-to-sentence and inter-sentence dependencies, stemming, and semantic reasoning. All of these building blocks allow the construction of complex research systems for different tasks, such as sentiment analysis and automatic summarization.13. Gensim (Promise: 2878, contributors: 179)It is a Python open source library that implements vector space modeling and theme modeling tools. The library is designed for efficient large text and can not only be processed in memory. Efficiency is achieved through extensive use of NumPy data structures and SciPy operations. It is both efficient and easy to use.Gensim is intended for use with raw and unstructured digital text. Gensim implements Hierarchical Dirichlet Process (HDP), Latent Semantic Analysis (LSA) and Potential Dirichlet Allocation (LDA) as well as tf-idf, Random Projection, word2vec, and document2vec algorithms to check a set of text files for repeating patterns in text ( Often referred to as a corpus. All algorithms are unsupervised - no parameters are required and the only input is a corpus.Data Mining / Statistics14. Scrapy (submitted: 6325, contributors: 243)Scrapy is a library for crawling programs, also known as spider robots, for retrieving structured data, such as contact information or URLs, from the web.It is open source and written in Python. As its name suggests, it was originally designed for crawling, but it has been developed in a complete framework that can collect data from APIs and act as a general crawler.The library follows the famous "Do not repeat yourself" interface design - it prompts users to write common code that will be reused to build and extend large crawlers.Scrapy's architecture is built around the Spider class, which encapsulates the set of instructions that the crawler follows.15. Statsmodels(Commits:8960,Contributors:119)As you might guess from the name, statsmodels is a Python library that enables users to perform data mining by using various statistical model estimation methods and statistical assertions and analysis.By using linear regression models, generalized linear models, discrete selection models, robust linear models, time series analysis models, various estimators, many useful features are descriptive and result statistics.He also provides a large number of drawing functions that are dedicated to statistical analysis and use performance statistics to adjust large data sets.in conclusion. These are considered by many data scientists and engineers to be the most important open source libraries, worth a look, and at least familiar with them.Here are the detailed statistics for the Github activities in these libraries:Source: Google SpreadsheetOf course, this is not an exhaustive list, and there are many other libraries and frameworks that are worthwhile and merit proper attention to specific tasks. A good example is the different packages of SciKit, focusing on specific areas, like SciKit-Image for processing images.So, if you have another useful library, please let our readers know in the comments section.My answer is a bit long. Thank you for reading. I hope I can help you.

What Is Jenkins? How & Why To Use It?Source - LambdaTestWhat Is Jenkins?Jenkins is an open-source server that is written entirely in Java. It lets you execute a series of actions to achieve the continuous integration process, that too in an automated fashion.This CI server runs in servlet containers such as Apache Tomcat. Jenkins facilitates continuous integration and continuous delivery in software projects by automating parts related to build, test, and deployment. This makes it easy for developers to continuously work on the betterment of the product by integrating changes to the project.Jenkins automates the software builds in a continuous manner and lets the developers know about the errors at an early stage. A strong Jenkins community is one of the prime reasons for its popularity. Jenkins is not only extensible but also has a thriving plugin ecosystem.Some of the possible steps that can be performed using Jenkins are:Software build using build systems such as Gradle, Maven, and more.Automation testing using test frameworks such as Nose2, PyTest, Robot, Selenium, and more.Execute test scripts (using Windows terminal, Linux shell, etc.Achieve test results and perform post actions such as printing test reports, and more.Execute test scenarios against different input combinations for obtaining improved test coverage.Continuous Integration (CI) where the artifacts are automatically created and tested. This aids in identification of issues in the product at an early stage of development.At the time of what is Jenkins blog, it had close to 1500+ plugins contributed by the community. Plugins help in customizing the experience with Jenkins, along with providing support for accelerating activities related to building, deploying, and automating a project.Salient Features Of JenkinsJenkins is more functionality-driven rather than UI-driven hence, there is a learning curve involved in getting to know what is Jenkins. Here are the powerful developer-centric features offered by Jenkins:1. Easy Installation & ConfigurationJenkins is a self-contained Java program that is agnostic of the platform on which it is installed. It is available for almost all the popular operating systems such as Windows, different flavors of Unix, and Mac OS.It is available as a normal installer, as well as a .war file. Once installed, it is easy to configure using its web interface.2. Open-SourceAs it is open-source, it is free for use. There is a strong involvement of the community which makes it a powerful CI/CD tool. You can take support from the Jenkins community, whether it is for extensibility, support, documentation, or any other feature related to Jenkins.3. Thriving Plugin EcosystemThe backbone of Jenkins is the community and the community members have been instrumental in the development (and testing) of close to 1500+ plugins available in the Update Center.4. Easy DistributionJenkins is designed in such a manner that makes it relatively easy to distribute work across multiple machines and platforms for accelerated build, testing, and deployment.How Does Jenkins Work?In this section of the What is Jenkins blog, we look at the internal functioning of Jenkins i.e. what happens once the developer commits changes to the repository and how CI/CD is realized in Jenkins. We also look at the Master-Slave architecture in Jenkins.Architecture Of JenkinsBefore we dive into how does Jenkins work, we must understand the architecture of Jenkins. These are the series of steps that outlines the interaction between different elements in Jenkins:Developers do the necessary modifications in the source code and commit the changes to the repository. A new version of that file will be created in the version control system that is used for maintaining the repository of source code.The repository is continuously checked by Jenkins CI server for any changes (either in the form of code or libraries) and changes are pulled by the server.In the next step, we ensure that the build with the ‘pulled changes’ is going through or not. The Build server performs a build with the code and an executable is generated if the build process is successful. In case of a build failure, an automated email with a link to build logs and other build artifacts is sent to the developer.In case of a successful build, the built application (or executable) is deployed to the test server. This step helps in realizing continuous testing where the newly built executable goes through a series of automated tests. Developers are alerted in case the changes have caused any breakage in functionality.If there are no build, integration, and testing issues with the checked-in code, the changes and tested application are automatically deployed to the Prod/Production server.Here is the diagrammatic representation of the Jenkins architecture:A single Jenkins server might not be sufficient to realize the following requirements:Testing needs to be performed on different environments (i.e. code written using different languages e.g. Java, Python, C, etc. are committed to the version control system), where a single server might not suffice the requirement.A single Jenkins server might not be sufficient to handle the load that comes with large-scale software projects.In such scenarios, the distributed (or Master-Slave) architecture of Jenkins is used for continuous integration and testing. Diving deeper into how does Jenkins works, we take a look at the architecture of Jenkins.What Is Jenkins Pipeline?Pipeline in Jenkins is a group of jobs (or events) that are interlinked in a particular sequence. Jenkins Pipeline is a set or suite of plugins that provides support for implementation and integration of Continuous Delivery pipelines into Jenkins.The Pipeline also provides a set of tools that are useful for modeling simple as well as complex delivery pipelines ‘as code’ through ‘Pipeline Domain-Specific Language (DSL)’ syntax.Every job in the Jenkins pipeline has some dependency on one or more events. Continuous delivery pipeline in Jenkins consists of four states – Build, Deploy, Test, and Release. Each of these states consist of events that execute in a sequence.What Is Jenkinsfile?Now that you understand what is Jenkins pipeline, we can dive deeper into the concept. The entire definition of a Jenkins Pipeline is written into a text file called Jenkinsfile. It contains the steps required for running a Jenkins Pipeline. ‘Pipeline as code’ can be implemented using Jenkinsfile and Domain Specific Language (DSL) is used for defining the same.Jenkinsfile can also be committed to the source control repository of the project. With Jenkinsfile, the CD Pipeline is also treated as a part of the application that is versioned, committed, and reviewed like any other piece of code.Some of the major benefits of Jenkinsfile are:Single Jenkinsfile can be used for creating a Pipeline build process for all the branches and executing pull requests.The implementation in a Pipeline can be reviewed like normal source code.Audit trail of the Pipeline.Singular source for the Pipeline can be viewed as well as edited by multiple members associated with the project.Though Pipeline can be defined either in web UI or with a Jenkinsfile, it is recommended to define the what is Jenkins Pipeline in a Jenkinsfile and maintain the same in a source control repository.Syntax For Defining A JenkinsfileTo define what is Jenkins pipeline, Jenkinsfile can be written using the following types of Syntax:a. DeclarativeDeclarative Pipeline is a recent feature of Jenkins Pipeline that makes reading and writing the Pipeline code a lot easier. Unlike Scripted Syntax with Pipelines, Declarative Syntax helps in controlling different aspects of the Pipeline in a simplistic manner.b. ScriptedScripted Pipeline is a more traditional way of writing a Jenkins Pipeline as code. It uses traditional Groovy-based syntax. The Web UI of Jenkins is normally used for writing the Scripted Pipeline in a Jenkinsfile.Important Concepts Of Jenkins PipelineMoving on with what is Jenkins pipeline, here are some basic concepts that need to be well-understood if you are planning to use the Jenkins Pipeline:a. PipelineThe Pipeline consists of a set of instructions written as code. It defines the entire build process, which ideally consists of different stages for building, testing, and delivering the application.b. NodeNode is a machine that is a part of the Jenkins environment. The Jenkins Pipeline executes on a node block that is usually a part of the Scripted Pipeline syntax.c. StageStage in a Jenkins Pipeline consists of a unique subset of tasks such as Build, Test, Deploy, etc. The Stage block is used by many plugins for providing the visualization of Jenkins status (and progress).d. StepStep is a single task that tells Jenkins what exactly needs to be done. For example, setting an environment variable can be done in a step, executing a build command can also be a step. On the whole, a Jenkins Pipeline constitutes a series of steps.Advantages Of Using Jenkins PipelineJenkins Pipeline is instrumental in adding a rich set of automation tools onto Jenkins. Hence, Jenkins can be used for simple continuous integration as well as for comprehensive CD pipelines.These are some of the primary reasons for using the Jenkins Pipeline:As the Jenkins Pipeline is implemented as code, it can be checked in the source control repository. Teams can view, edit, as well as iterate upon the delivery pipeline.Jenkins Pipelines are robust. A Pipeline is automatically resumed in case the server witnesses an unplanned restart.Pipeline process can pause and wait for input for any input from the user.Pipelines are versatile as they can be used for realizing complex CD requirements, including performing work in parallel.Jenkins Pipelines are extensible by plugin developers and users with Pipeline Shared Libraries.