Background and course overview

• Join the GCP Study Hub Community
• Google's view of the Professional Data Engineer
• Exam Structure
• Old Exam vs New Exam
• A note on service name updates

Free preview practice questions

• Free practice questions intro
• Practice questions (free preview)

Foundational concepts

• On-Prem vs Cloud
• Cloud Services
• Data Lifecycle
• Structured, Unstructured, and Semi-structured Data
• Batch vs. Streaming
• Database Types
• Management Levels in GCP
• Types of Scaling
• Big Data Tools
• ML Development Lifecycle
• Regularization in Machine Learning
• ETL and ELT
• Throughput and Latency
• Availability
• Regions and Zones
• ACID Compliance
• Quiz: Foundational concepts

GCP Management and Access Control

• Google Cloud SDK Components
• gcloud CLI
• GCP Resource Hierarchy
• Project Name, ID, and Number
• Org Level Roles
• Org Policies (Governance and Compliance)
• Quiz: GCP Management and Governance
• Cloud IAM - Intro
• Cloud IAM - Types of Service Accounts
• Cloud IAM - Permissions and Roles
• Cloud IAM - Role Type Details
• Cloud IAM - Principle of Least Privilege
• Cloud IAM - Access Approval
• Cloud IAM - Groups
• Cloud IAM - gcloud commands
• Quiz: Cloud IAM

Cloud Observability Suite

• Cloud Logging
• Quiz: Cloud Logging
• Cloud Monitoring
• Quiz: Cloud Monitoring

Data Ingestion with Cloud Pub/Sub

• Intro to Cloud Pub/Sub
• Pub/Sub - Use cases with Kafka
• Pub/Sub - Publishers, Subscribers, Topics, Subscriptions
• Pub/Sub - Subscription Types
• Pub/Sub - Message Handling Techniques
• PubSub - Message Delivery and Acknowledgement
• Pub/Sub - Retries
• Pub/Sub - Monitoring
• Pub/Sub - Publish Timeout
• Pub/Sub - Common Ingestion Pattern
• Pub/Sub - IoT Gateway
• Quiz: Cloud Pub/Sub
• Pub/Sub Basics (Lab Instructions)
• Pub/Sub: Push Subscriptions and Webhooks (lab instructions)

Dataflow: Batch and Stream Data Pipelines

• Intro to Dataflow
• Dataflow - Core Concepts and Terminology
• Dataflow - Windows
• Dataflow - Watermarks and Triggers
• Dataflow - Common Challenges
• Dataflow - Networking
• Dataflow - Pipeline Setup
• Dataflow - Updating Pipelines
• Dataflow - Errors and Monitoring
• Dataflow - Connecting to Other Tools
• Dataflow - Cost Optimization
• Dataflow - IAM Roles
• Quiz: Dataflow

Dataproc: Managed Apache Spark and Hadoop

• Intro to Dataproc and Hadoop Architecture
• Dataproc - Migration Best Practices
• Dataproc - Data Storage and Access
• Dataproc - Cluster Setup and Management
• Dataproc - Performance Optimization
• Dataproc - IAM Roles
• Dataproc vs. Dataflow
• Quiz: Dataproc

Scalable Object Storage with Google Cloud Storage

• GCS - Overview and Basic Bucket Setup
• GCS - Lifecycle Rules, Versioning, and Retention
• GCS - Availability and Failover Strategies
• GCS - Managing Access
• GCS - Migrations, Uploads, and Transfers
• GCS - Integration with other GCP services
• Quiz: Cloud Storage
• Cloud Storage Basics (Lab Instructions)

BigQuery

• BigQuery - Intro
• BigQuery - Importing Data
• BigQuery - Spark-BigQuery Connector
• BigQuery - External Tables and Federated Queries
• BigQuery - Dataset Configuration
• BigQuery - Backing up Data
• Quiz: BigQuery knowledge check #1
• BigQuery - Referential Integrity
• BigQuery - Normalization and Denormalization
• BigQuery - Table Partitioning
• BigQuery - DDL Operations
• BigQuery - DML Operations
• BigQuery - Advanced Query Management
• Quiz: BigQuery knowledge check #2
• BigQuery - Storage Types
• BigQuery - Compute Cost Management
• BigQuery - Logs
• BigQuery - Admin Console
• BigQuery - Identity & Access Management
• BigQuery - Some Best Practices
• Looker Studio
• Quiz: BigQuery knowledge check #3
• BigQuery Basics (Lab Instructions)

Bigtable

• Bigtable - Intro
• Bigtable - Use Cases
• Bigtable - Instance Configuration
• Bigtable - Schema and Row Key Design
• Bigtable - Garbage Collection Policies
• Bigtable - Detailed Logging
• Quiz: Bigtable

Workflow Orchestration and Automation

• Cloud Composer - Introduction
• Composer - APIs
• Composer - Architecture
• Composer - Triggering Pipelines
• Composer - Orchestrating Other Services
• Composer - Airflow Task Management
• Composer - IAM
• Quiz: Cloud Composer
• Cloud Functions
• Quiz: Cloud Functions
• Cloud Workflows
• Quiz: Cloud Workflows

Data Integration and Transformation

• Data Fusion - Intro
• Data Fusion - Studio
• Data Fusion - Wrangler
• Data Fusion - Encryption
• Quiz: Data Fusion
• Datastream
• Quiz: Datastream
• Dataform
• Quiz: Dataform
• Dataprep
• Quiz: Dataprep

Data Management and Governance

• Intro to Dataplex and Data Meshes
• Dataplex - Roles and Access Management
• Quiz: Dataplex
• Data Catalog - Intro
• Data Catalog - Tagging
• Data Catalog - IAM Roles
• Data Catalog vs Dataplex
• Quiz: Data Catalog

Multi-Cloud Solutions

• BigQuery Omni: Cross-Cloud Analytics
• Quiz: BigQuery Omni
• Analytics Hub - Intro
• Analytics Hub - Private Exchange
• Analytics Hub - Exam Scenarios
• Quiz: Analytics Hub
• BigLake - Intro
• BigLake - Granular Security Policies
• BigLake Tables vs. BigQuery External Tables
• BigLake - Exam Scenarios
• Quiz: BigLake

Development and Operations

• Intro to CI/CD
• Cloud Build - Basics, YAMLs, Substitutions, Triggers
• Cloud Build - Cross-Project Deployment
• Cloud Build - Service Account Troubleshooting
• Quiz: Cloud Build

In-Memory Data Storage

• Cloud Memorystore - Intro
• Cloud Memorystore - Use Cases
• Cloud Memorystore - Memcached and Redis
• Cloud Memorystore - Monitoring Redis
• Quiz: Memorystore

Data Security and Encryption

• Data Loss Prevention (DLP) API - Intro
• DLP API - Data Protection Methods
• DLP API - Integration with GCP Services
• Quiz: DLP API
• Cloud Key Management Service (KMS) - Intro
• Cloud KMS - Encryption Keys
• Cloud KMS - Compromised CMEKs
• Quiz: Cloud KMS

Networking

• Cloud VPC - Introduction
• Cloud VPC - IP Addresses
• Cloud VPC - Subnets
• Cloud VPC - Private Google Access
• Cloud VPC - Private Service Connect
• Cloud VPC - Connecting to other networks
• Cloud VPC - Project Isolation Techniques
• Quiz: Cloud VPC
• Cloud NAT (Network Address Translation)
• Quiz: Cloud NAT
• Cloud Firewall
• Quiz: Cloud Firewall

Cloud SQL

• Cloud SQL - Intro
• Cloud SQL - Importing Data
• Cloud SQL - Availability and Recovery
• Cloud SQL Auth Proxy
• Quiz: Cloud SQL

Cloud Spanner

• Cloud Spanner - Intro
• Cloud Spanner - Monitoring Health and Performance
• Cloud Spanner - Secondary Indexes
• Quiz: Cloud Spanner

Firestore

• Firestore - Intro
• Firestore - Data Modeling and Index Optimization
• Firestore - Location
• Firestore - Datastore Mode
• Quiz: Firestore

Planned additions

• Additional concepts

Practice Exams

• Note about practice exams
• Practice Exam #1 (50 questions)
• Practice Exam #2 (50 questions)
• Practice Exam #3 (50 questions)
• Practice Exam #4 (50 questions)
• Practice Exam #5 (50 questions)

Exam Simulator

• Exam Simulator (2 hours, 50 random questions)

Leave a testimonial

• Leave a testimonial