Cargando…

Data engineering foundations. Part 2, Building data pipelines with Kafka and Nifi.

4+ Hours of Video Instruction The Perfect Way to Get Started with Data Pipelines, Kafka, and NiFi Data Engineering Foundations Part 2: Building Data Pipelines with Kafka and NiFi provides over four hours of video introducing you to creating data pipelines at scale with Kafka and NiFi. You learn to w...

Descripción completa

Detalles Bibliográficos
Clasificación:Libro Electrónico
Formato: Electrónico Video
Idioma:Inglés
Publicado: [Place of publication not identified] : Addison-Wesley Professional, [2022]
Edición:[First edition].
Colección:LiveLessons (Indianapolis, Ind.)
Temas:
Acceso en línea:Texto completo (Requiere registro previo con correo institucional)

MARC

LEADER 00000cgm a22000007i 4500
001 OR_on1354325933
003 OCoLC
005 20231017213018.0
006 m o c
007 vz czazuu
007 cr cnannnuuuuu
008 221212s2022 xx 269 o vleng d
040 |a ORMDA  |b eng  |e rda  |e pn  |c ORMDA  |d ORMDA  |d OCLCF 
020 |a 9780138087029  |q (electronic video) 
020 |a 0138087024  |q (electronic video) 
029 1 |a AU@  |b 000073179951 
035 |a (OCoLC)1354325933 
037 |a 9780138087029  |b O'Reilly Media 
050 4 |a QA76.76.A65 
082 0 4 |a 005.3  |2 23/eng/20221212 
049 |a UAMI 
245 0 0 |a Data engineering foundations.  |n Part 2,  |p Building data pipelines with Kafka and Nifi. 
246 3 0 |a Building data pipelines with Kafka and Nifi 
250 |a [First edition]. 
264 1 |a [Place of publication not identified] :  |b Addison-Wesley Professional,  |c [2022] 
300 |a 1 online resource (1 video file (4 hr., 29 min.)) :  |b sound, color. 
306 |a 042900 
336 |a two-dimensional moving image  |b tdi  |2 rdacontent 
337 |a computer  |b c  |2 rdamedia 
338 |a online resource  |b cr  |2 rdacarrier 
344 |a digital  |2 rdatr 
347 |a video file  |2 rdaft 
380 |a Instructional films  |2 lcgft 
490 1 |a Live lessons 
511 0 |a Doug Eadine, presenter. 
520 |a 4+ Hours of Video Instruction The Perfect Way to Get Started with Data Pipelines, Kafka, and NiFi Data Engineering Foundations Part 2: Building Data Pipelines with Kafka and NiFi provides over four hours of video introducing you to creating data pipelines at scale with Kafka and NiFi. You learn to work with the Kafka message broker and discover how to establish NiFi dataflow. You also learn about data movement and storage. All software used in videos is open source and freely available for your use and experimentation on the included virtual machine. About the Instructor Doug Eadline, PhD, began his career as a practitioner and a chronicler of the Linux Cluster HPC revolution and now documents big data analytics. Starting with the first Beowulf How To document, Dr. Eadline has written hundreds of articles, white papers, and instructional documents covering virtually all aspects of HPC computing. Prior to starting and editing the popular ClusterMonkey.net website in 2005, he served as editor-in-chief for ClusterWorld Magazine and was Senior HPC Editor for Linux Magazine. Currently, he is a consultant to the HPC industry and writes a monthly column in HPC Admin Magazine. He has practical hands-on experience in many aspects of HPC, including hardware and software design, benchmarking, storage, GPU, cloud, and parallel computing. He is the co-author of the Apache Hadoop YARN book and author of Hadoop Fundamentals LiveLessons and Apache Hadoop YARN LiveLessons. Skill Level: Beginner Intermediate Learn How To: Understand Kafka topics, brokers, and partitions Implement basic Kafka usage modes Use Kafka producers and consumers with Python Utilize the KafkaEsque graphical user interface Understand the core concepts of NiFi Understand NiFi flow and web UI components Understand direct data movement with HDFS Use HBase with Python Happybase Use Sqoop for database movement Who Should Take This Course: Users, developers, and administrators interested in learning the fundamental aspects and operations of date engineering and scalable systems Course Requirements: Basic understanding of programming and development A working knowledge of Linux systems and tools Familiarity with Python Lesson Descriptions: Lesson 7: Working with the Kafka Message Broker In Lesson 7, Doug introduces introduce the Kafka message broker concept and describes the producer-consumer model that enables input data to be reliably decoupled from output requests. Kafka producers and consumers are developed using Python, and internal broker operations are displayed using the Kafkaesque graphical user interface. Lesson 8: Working with NiFi Dataflow Lesson 8 begins with a description of NiFi flow-based programming and then provides several examples that include writing pipeline data to the local file system, then to the Hadoop Distributed File System, and finally to Hadoop Hive tables. The entire flow process is constructed using the NiFi web Graphical User Interface. The creation of portable flow templates for all examples is also presented. Lesson 9: Big Data Movement and Storage Lesson 9 provides you with several methods for moving data to and from the Hadoop Distributed File System. Hands-on examples include direct web downloads and using Python Pydoop to move data. Basic data movement between Apache HBase, Hive, and Spark using Python Happybase and Hive-SQL is also presented. Finally, movement of relational data to and from the Hadoop Distributed File System is demonstrated using Apache Sqoop. About Pearson Video Training: Pearson publishes expert-led video tutorials covering a wide selection of technology topics designed to teach you the skills you need to succeed. These professional and personal technology videos feature world-leading author instructors published by your trusted technology brands: Addison-Wesley, Cisco Press, Pearson IT Certification, Sams, and Que Topics include: IT Certification, Network Security, Cisco Technology, Programming, Web Development, Mobile Development, and more. Learn more about Pearson Video training at http://www.informit.com/video. 
588 |a Online resource; title from title details screen (O'Reilly, viewed December 12, 2022). 
590 |a O'Reilly  |b O'Reilly Online Learning: Academic/Public Library Edition 
630 0 0 |a Apache Kafka. 
650 0 |a Application software  |x Development. 
650 0 |a Electronic data processing. 
650 7 |a Application software  |x Development.  |2 fast  |0 (OCoLC)fst00811707 
650 7 |a Electronic data processing.  |2 fast  |0 (OCoLC)fst00906956 
655 7 |a Instructional films.  |2 fast  |0 (OCoLC)fst01726236 
655 7 |a Internet videos.  |2 fast  |0 (OCoLC)fst01750214 
655 7 |a Nonfiction films.  |2 fast  |0 (OCoLC)fst01710269 
655 7 |a Instructional films.  |2 lcgft 
655 7 |a Nonfiction films.  |2 lcgft 
655 7 |a Internet videos.  |2 lcgft 
700 1 |a Eadline, Doug,  |d 1956-  |e presenter. 
710 2 |a Addison-Wesley Professional (Firm),  |e publisher. 
830 0 |a LiveLessons (Indianapolis, Ind.) 
856 4 0 |u https://learning.oreilly.com/videos/~/9780138087029/?ar  |z Texto completo (Requiere registro previo con correo institucional) 
994 |a 92  |b IZTAP