1 - OpenAI universe
Universe is a software platform for measuring and training an AI's general intelligence across the world's supply of games, websites and other applications .
In Universe, AI agents interact with the virtual world by sending simulated mouse and keyboard strokes via what’s called Virtual Network Computing, or VNC. In this way, Universe facilitates reinforcement learning, an AI technique where agents learn tasks by trial and error, carefully keeping tabs on what works and what doesn’t, what brings the highest score or wins a game or grabs some other reward.
2 - TensorFlow
TensorFlow is an open source software library for numerical computation using data flow graphs. Nodes in the graph represent mathematical operations, while the graph edges represent the multidimensional data arrays (tensors) that flow between them. This flexible architecture lets you deploy computation to one or more CPUs or GPUs in a desktop, server, or mobile device without rewriting code. TensorFlow also includes TensorBoard, a data visualization toolkit.
3 - Scikit-learn
Scikit-learn provides a range of supervised and unsupervised machine learning or learning algorithms via a consistent interface in Python. it is licensed under a permissive simplified BSD license and is distributed under many Linux distributions, encouraging academic and commercial use.
The library is built upon the SciPy (Scientific Python) that must be installed before you can use scikit-learn. scikit-learn also uses CBLAS, the C interface to the Basic Linear Algebra Subprograms library. scikit-learn comes with a reference implementation, but the system CBLAS will be detected by the build system and used if present .
Yotubube-DL is a Command-line program to download videos from YouTube.com and other video sites . youtube-dl should work in your Unix box, in Windows or in Mac OS X . It requires the Python interpreter, version 2.6, 2.7, or 3.2+, and it is not platform specific .
youtube-dl supports DASH and separate audio and video streams: youtube-dl will automatically combine / merge / multiplex the audio and video formats offered by YouTube. Other sites for download include Vevo, 9gag, discovery.com, vk.com, southpark.de, myspace.com, vube.com, vesti.ru, stream.cz, ndr.de, onf.ca, Dropbox and so on . It is released to the public domain, which means you can modify it .
5 - Scrapy
Scrapy is a fast high-level web crawling and web scraping framework, used to crawl websites and extract structured data from their pages. It can be used for a wide range of purposes, from data mining to monitoring and automated testing.
Scrapy is one of the most popular and powerful Python scraping libraries; it takes a "batteries included" approach to scraping, meaning that it handles a lot of the common functionality that all scrapers need so developers don't have to reinvent the wheel each time. It makes scraping a quick and fun process!Scrapy, like most Python packages, is on PyPI (also known as pip). PyPI, the Python Package Index, is a community-owned repository of all published Python software.