Cargando…
Debugging Spark : how to spot and squash common Spark bugs /
"Apache Spark is an extremely powerful general purpose distributed system that also happens to be extremely difficult to debug. This video, designed for intermediate-level Spark developers and data scientists, looks at some of the most common (and baffling) ways Spark can explode (e.g., out of...
| Clasificación: | Libro Electrónico |
|---|---|
| Formato: | Electrónico Video |
| Idioma: | Inglés |
| Publicado: |
[Place of publication not identified] :
O'Reilly Media,
[2018]
|
| Temas: | |
| Acceso en línea: | Texto completo (Requiere registro previo con correo institucional) |
| Sumario: | "Apache Spark is an extremely powerful general purpose distributed system that also happens to be extremely difficult to debug. This video, designed for intermediate-level Spark developers and data scientists, looks at some of the most common (and baffling) ways Spark can explode (e.g., out of memory exceptions, unbalanced partitioning, strange serialization errors, debugging errors inside your own code, etc.) and then provides a set of remedies for keeping those blow-ups under control. You'll pick up techniques for improving your own logging (and reducing your dependence on Spark's verbose logs); learn how to deal with fuzzy data; discover how to connect and use a debugger in a distributed environment; and gain the ability to know which Spark error messages are actually relevant."--Resource description page |
|---|---|
| Notas: | Title from title screen (viewed January 30, 2019). |
| Descripción Física: | 1 online resource (1 streaming video file (2 hr., 26 min., 8 sec.)) |