Cargando…
Rust data engineering.
Rust Data Engineering: Course Description Are you a data engineer, software developer, or a tech enthusiast with a basic understanding of Rust, seeking to enhance your skills and dive deep into the realm of data engineering with Rust? Or are you a professional from another programming language backg...
| Clasificación: | Libro Electrónico |
|---|---|
| Formato: | Electrónico Video |
| Idioma: | Inglés |
| Publicado: |
[Place of publication not identified] :
Pragmatic AI Solutions,
[2023]
|
| Edición: | [First edition]. |
| Temas: | |
| Acceso en línea: | Texto completo (Requiere registro previo con correo institucional) |
| Sumario: | Rust Data Engineering: Course Description Are you a data engineer, software developer, or a tech enthusiast with a basic understanding of Rust, seeking to enhance your skills and dive deep into the realm of data engineering with Rust? Or are you a professional from another programming language background, aiming to explore the efficiency, safety, and concurrency features of Rust for data engineering tasks? If so, this course is designed for you. While a fundamental knowledge of Rust is expected, you should ideally be comfortable with the basics of data structures and algorithms, and have a working understanding of databases and data processing. Familiarity with SQL, the command line, and version control with git is advantageous. This four-week course focuses on leveraging Rust to create efficient, safe, and concurrent data processing systems. The journey begins with a deep dive into Rust's data structures and collections, followed by exploring Rust's safety and security features in the context of data engineering. In the subsequent week, you'll explore libraries and tools specific to data engineering like Diesel, async, Polars, and Apache Arrow, and learn to interface with data processing systems, REST, gRPC protocols, and AWS SDK for cloud-based data operations. The final week focuses on designing and implementing full-fledged data processing systems using Rust. By the end of this course, you will be well-equipped to use Rust for handling large-scale data engineering tasks, solving real-world problems with efficiency and speed. The hands-on labs and projects throughout this course will ensure you gain practical experience, putting your knowledge into action. This course is your gateway to mastering data engineering with Rust, preparing you for the next level in your data engineering journey. Learning Rust During Live Coding This video series covers live coding the Rust language iteratively, thus learning the language. Lessons Covered Include: Section 1: Rust Data Structures: Collections Lesson 1: Getting Started With The Modern Rust Development Ecosystem Meet the instructor & Course Overview: 1.0-meet-instructor-course-overview.mp4 Introduction to the AI Coding Paradigm Shift: 1.1-ai-pair-programming-paradigm-shift.mp4 Introduction to cloud-based development environments: 1.2-GitHub-Codespaces-Ecosystem-with-copilot-chat.mp4 Introduction to GitHub Copilot Ecosystem for Rust: 1.3-copilot-enabled-rust.mp4 Prompt Engineering with GCP BigQuery SQL: 1.4-big-query-prompt-engineering.mp4 Introduction to AWS CodeWhisperer for Rust: 1.5-aws-codewhisperer-for-rust.mp4 Using Google Bard to Enhance Productivity: 1.6-using-bard-to-enhance-productivity.mp4 Continuous Integration with Rust and GitHub Actions: 1.7-continuous-integration-rust-github-actions.mp4 Lesson 2: Rust Sequences and Maps Introducing Rust Sequences and Maps: 1.8-rust-sequences-maps.mp4 Print Rust data structures demo: 1.9-Print-Rust-data-structures-demo.mp4 Vector Fruit Salad demo: 1.10-Vector-Fruit-Salad-demo.mp4 VecDeque Fruit Salad demo: 1.11-VecDeque-Fruit-Salad-demo.mp4 Linkedin List Fruit Salad demo: 1.12-Linkedin-List-Fruit-Salad-demo.mp4 Fruit Salad CLI demo: 1.13-Fruit-Salad-CLI-demo.mp4 HashMap frequency counter demo: 1.14-HashMap-frequency-counter-demo.mp4 HashMap language comparison: 1.15-HashMap-language-comparison.mp4 Lesson 3: Rust Sets, Graphs and Miscellaneous Data Structures Analyzing UFC Fighter Network Using Graph Centrality in Rust: 1.16-ufc-graph-centrality.mp4 Storing Unique Fruits Using HashSet in Rust: 1.17-unique-fruits-with-hashset.mp4 Maintaining Sorted and Unique Fruits Using BTreeSet in Rust: 1.18-sorted-unique-fruits-with-btreeset.mp4 Creating a Fig Priority Fruit Salad Using Binary Heap in Rust: 1.19-fig-priority-fruit-salad-with-binary-heap.mp4 PageRank algorithm for sports data: 1.20-pagerank-sports.mp4 Showing shortest path with dijkstra: 1.21-shortest-path.mp4 Detecting Strongly Connected Components: A Deep Dive into Kosaraju's Algorithm: 1.22-strongly_connected_components_with_kosaraju.mp4 Simple Charting of Data Structures in Rust: 1.23-ascii-graphing.mp4 Section 2: Safety, Security and Concurrency with Rust Lesson 1: Rust Safety and Security Features Multi-Factor Authentication: 2.1_Multi-Factor_Authentication.mp4 Network Segmentation: 2.2_Network_Segmentation.mp4 Least Privilege Access: 2.3_Least_Privilege_Access.mp4 Encryption: 2.4_Encryption.mp4 Mutable fruit salad: 2.5-mutable-fruit-salad.mp4 Customize fruit salad with a CLI: 2.6-customize-csv-fruit-salad.mp4 Data Race example: 2.7-data-race.mp4 Lesson 2: Security Programming with Rust High Availability: 2.10-high-availability.mp4 Understanding the Homophonic Cipher: A Cryptographic Technique: 2.11-homphonic-cipher.mp4 Decoding the Secrets of the Caesar Cipher: 2.12-caesar-cipher.mp4 Building a Caesar Cipher Command Line Interface: 2.13-caesar-cipher-cli.mp4 Creating a Decoder Ring: A Practical Guide: 2.14-decoder-ring.mp4 Detecting Duplicates with SHA-3: A Data Integrity Tool: 2.15-sha3-dupe-detector.mp4 Incident Response: 2.16-incident-response.mp4 Compliance: 2.17-compliance.mp4 Lesson 3: Concurrency with Rust Core Concepts in Concurrency: 2.20-core-concepts-concurrency.mp4 Dining Philosophers: 2.21-dining-philosopher.mp4 Web Crawl Wikipedia with Rayon: 2.22-web-crawl-wikipedia-rayon.mp4 Intelligent Chatbot with Tokio: 2.23-tokio-chatbot.mp4 Multi-threaded deduplication with Rust: 2.24-data-eng-with-rust-dedupe.mp4 Energy Efficiency Python vs Rust: 2.25-energy-efficiency-python-rust.mp4 Concurrency Stress test with a GPU: 2.26-building-cuda-enabled-stress-test-with-rust-pytorch.mp4 Host Efficiency Serverless Optimization problem: 2.27-host-efficiency-optimization-problem.mp4 Section 3: Rust Data Engineering Libraries and Tools Lesson 1: Using Rust to Manage Data, Files and Network Storage Process CSV files in Rust: 2.31-process-csv-rust.mp4 Using Cargo Lambda with Rust: 2.33-cargo-lambda-rust.mp4 List files on AWS EFS with Rust: 2.34-rust-efs-lister.mp4 Use AWS S3 Storage: 2.35-use-s3-storage.mp4 Use AWS S3 Storage from Rust: 2.36-use-rust-for-s3-storage.mp4 Write encrypted data to tables or Parquet files: 2.37-Write-encrypted-data-to-tables-or-Parquet-files.mp4 Lesson 2: DataFrames with Rust, Python and Notebooks What is Colab?: 2.40-what-is-colab.mp4 Using Bard to enhance notebook development: 2.41-using-bard-to-enhance-productivity.mp4 Exploring Life Expectency in a Notebook: 2.42-life-expectancy-eda.mp4 Load a DataFrame with sensitive data: 2.43-Load-a-DataFrame-with-sensitive-information.mp4 Using MLFlow with Databricks Notebooks: 2.44-mlops-mlflow-tracking.mp4 End to End ML with MLFlow and Databricks: 2.45-end-to-end-ml-with-mlflow-and-databricks.mp4 Comparing DataFrame Libraries between Rust and Python: 2.46-comparing-dataframe-libs-rust-python.mp4 Lesson 3: Data Engineering Libraries and Tools with Rust Parquet file writing and reading with Rust: 2.50-parquet-read-write-rust.mp4 Arrow & Parquet in Rust: 2.51-arrow-parquet-rust.mp4 Serverless functions with Rust and AWS Lambda: 2.52-serverless-rust-aws-lambda.mp4 Polars library overview: 2.53-polars-library-overview.mp4 Building RESTful APIs with Rocket: 2.54-building-restful-apis-rocket.mp4 Utilizing Async Rust in Web Development: 2.55-utilizing-async-rust-web-development.mp4 Applying Data Cleaning Techniques with Rust: 2.56-applying-data-cleaning-rust.mp4 Deploying Rust Applications in a Kubernetes Environment: 2.57-deploying-rust-apps-kubernetes.mp4 Section 4: Designing Data Processing Systems in Rust Lesson 1: Getting Started with Rust Data Pipelines (Including ETL) Jack and the Beanstalk Data Pipelines: 4.1-jack-beanstalk-building-data-pipelines.mp4 Open Source Data Engineering - Pros and Cons: 4.2-open-source-de-pro-con.mp4 Core Components of Data Engineering Pipelines: 4.3-core-components-data-engineering-pipelines.mp4 Rust AWS Step Functions Pipeline: 4.4-rust-aws-step-functions.mp4 Rust AWS Lambda Async S3 Size Calculator: 4.5-rust-async-s3-size-calculator-lambda.mp4 What is Distroless: 4.6-what-is-distroless.mp4 Demo Deploying Rust Microservices on GCP: 4.7-demo-build-deploy-rust-microservice-cloud-run.mp4 Lesson 2: Using Rust and Python for LLMs, ONNX, Hugging Face, and PyTorch Pipelines Introduction to Hugging Face Hub: 4.10-intro-hugging-face-hub.mp4 Rust PyTorch Pre-trained Model Ecosystem: 4.11-rust-pytorch-pretrained-models-ecosystem.mp4 Rust GPU Hugging Face Translator: 4.12-rust-gpu-hugging-face-translator.mp4 Rust PyTorch High-Performance Options: 4.13-high-performance-pytorch-rust-demo.mp4 Rust CUDA PyTorch Stress Test: 4.14-building-cuda-enabled-stress-test-with-rust-pytorch.mp4 EFS ONNX Rust Inference with AWS Lambda: 4.15-efs-onnx-lambda-rust-inference-mlops.mp4 Theory behind model fine-tuning: 4.16-intro-fine-tuning-theory.mp4 Doing Fine Tuning: 4.17-doing-fine-tuning.mp4 Lesson 3: Building SQL Solutions with Rust, Generative AI and Cloud Selecting the correct database on GCP: 4.20-gcp-optimize-database-solution.mp4 Rust SQLite Hugging Face Zero Shot Classifier: 4.21-rust-sqlite-hugging-face-zero-shot-classifier-demo.mp4 Prompt Engineering for BigQuery: 4.22-big-query-prompt-engineering-v3.mp4 Big Query to Colab Pipeline: 4.23-bq-colab-pipeline-v2.mp4 Exploring Data with Big Query: 4.24-exploring-data-google-bigquery-v2.mp4 Using Public Datasets for Data Science: 4.25-using-public-datasets.mp4 Querying Log files with BigQuery: 4.26-demo-big-query-log-query.mp4 There is no one size database: 4.27-one-size-database.mp4 Course Conclusion: 4.28-conclusion.mp4 Learning Objectives By the end of this Course, you will be able to: Leverage Rust's robust data structures and collections for efficient data manipulation. Understand and utilize Rust's safety and security features to build relia... |
|---|---|
| Descripción Física: | 1 online resource (1 video file (7 hr., 51 min.)) : sound, color. |
| Tiempo de Juego: | 07:51:00 |