Cargando…
Mastering Machine Learning with Spark 2.x.
Unlock the complexities of machine learning algorithms in Spark to generate useful data insights through this data analysis tutorial About This Book Process and analyze big data in a distributed and scalable way Write sophisticated Spark pipelines that incorporate elaborate extraction Build and use...
| Clasificación: | Libro Electrónico |
|---|---|
| Autor principal: | |
| Otros Autores: | , |
| Formato: | Electrónico eBook |
| Idioma: | Inglés |
| Publicado: |
Birmingham :
Packt Publishing,
2017.
|
| Temas: | |
| Acceso en línea: | Texto completo |
Tabla de Contenidos:
- Cover ; Copyright; Credits; About the Authors; About the Reviewer; www.PacktPub.com; Customer Feedback; Table of Contents; Preface; Chapter 1: Introduction to Large-Scale Machine Learning and Spark; Data science; The sexiest role of the 21st century
- data scientist?; A day in the life of a data scientist; Working with big data; The machine learning algorithm using a distributed environment; Splitting of data into multiple machines; From Hadoop MapReduce to Spark; What is Databricks?; Inside the box; Introducing H2O.ai; Design of Sparkling Water.
- What's the difference between H2O and Spark's MLlib?Data munging; Data science
- an iterative process; Summary; Chapter 2: Detecting Dark Matter
- The Higgs-Boson Particle; Type I versus type II error; Finding the Higgs-Boson particle; The LHC and data creation; The theory behind the Higgs-Boson; Measuring for the Higgs-Boson; The dataset; Spark start and data load; Labeled point vector; Data caching; Creating a training and testing set; What about cross-validation?; Our first model
- decision tree; Gini versus Entropy; Next model
- tree ensembles; Random forest model; Grid search.
- Gradient boosting machineLast model
- H2O deep learning; Build a 3-layer DNN; Adding more layers; Building models and inspecting results; Summary; Chapter 3: Ensemble Methods for Multi-Class Classification; Data; Modeling goal; Challenges; Machine learning workflow; Starting Spark shell; Exploring data; Missing data; Summary of missing value analysis; Data unification; Missing values; Categorical values; Final transformation; Modelling data with Random Forest; Building a classification model using Spark RandomForest; Classification model evaluation; Spark model metrics.
- Building a classification model using H2O RandomForestSummary; Chapter 4: Predicting Movie Reviews Using NLP and Spark Streaming; NLP
- a brief primer; The dataset; Dataset preparation; Feature extraction; Feature extraction method- bag-of-words model; Text tokenization; Declaring our stopwords list; Stemming and lemmatization; Featurization
- feature hashing; Term Frequency
- Inverse Document Frequency (TF-IDF) weighting scheme; Let's do some (model) training!; Spark decision tree model; Spark Naive Bayes model; Spark random forest model; Spark GBM model; Super-learner model; Super learner.
- Composing all transformations togetherUsing the super-learner model; Summary; Chapter 5: Word2vec for Prediction and Clustering; Motivation of word vectors; Word2vec explained; What is a word vector?; The CBOW model; The skip-gram model; Fun with word vectors; Cosine similarity; Doc2vec explained; The distributed-memory model; The distributed bag-of-words model; Applying word2vec and exploring our data with vectors; Creating document vectors; Supervised learning task; Summary; Chapter 6: Extracting Patterns from Clickstream Data; Frequent pattern mining; Pattern mining terminology.