Book TOC · Chapter 0 of 7 · Next: Chapter 1
Chapter 0: The PSOE Reference Stack & 10 Core Principles
Chapter Focus: A visual guide to the Google Cloud Certified Professional Security Operations Engineer (PSOE) architecture stack, how the core Google Cloud services fit together, and the 10 Core Architectural Principles that govern production design decisions.
1. The Master Architectural Map: The Google Cloud Security Operations Stack
The official Google Cloud Professional Security Operations Engineer Curriculum spans 6 Sections, 13 Subsections, and 69 Considerations. Rather than memorizing tools in isolation, organize the entire in-scope ecosystem across Six Integrated Architectural Planes:
Complete Reference Table of In-Scope PSOE Platforms, Services & Capabilities
# | Service / Capability | Architectural Plane | Primary Architectural Responsibility |
|---|---|---|---|
1 | Google Security Operations (SecOps) SIEM | Ingestion, Hunting & Detection | Cloud-native petabyte-scale SIEM storing telemetry in the Unified Data Model (UDM) with 12-month default hot retention, sub-second IOC matching, and YARA-L correlation. |
2 | Google Security Operations SOAR | Incident Response & Automation | Orchestrating automated playbooks, reusable Blocks, Marketplace third-party integrations, Case Management, alert grouping, and multi-tenant SOAR Environments. |
3 | Security Command Center (SCC) (Standard vs. Premium/Enterprise) | Posture & Cloud-Native Detection | Centralized Google Cloud risk platform: Security Health Analytics (SHA), Security Posture, Toxic Combinations / Attack Path Simulation, Event Threat Detection (ETD), VM Threat Detection (VMTD), and Container Threat Detection (CTD). |
4 | Google Threat Intelligence (GTI) | Threat Intelligence | Unified intelligence combining Mandiant frontline actor/campaign research, VirusTotal file/URL/domain reputation, Passive DNS, WHOIS, and IC-Score (Confidence Score) enrichment. |
5 | YARA-L 2.0 Detection Engine | Detection Engineering | Authoring single-event and multi-event correlation rules ( meta, events, match, outcome, condition), repeated-field quantifiers (any/all), net.ip_in_range_cidr(), and Composite Rules. |
6 | Unified Data Model (UDM) & Entity Graph | Normalization & Context | Normalizing raw logs into UDM Event records ( principal, target, src, observer, intermediary, security_result) and UDM Entity context records (USER, ASSET, GROUP, IOC) joined across time via Aliasing. |
7 | Parsers, Parser Extensions & Custom Parsers | Ingestion & Normalization | Converting raw logs ( log_type ingestion labels) into UDM via Google-managed Config-Based Normalization (CBN) parsers and augmenting them safely with Parser Extensions (no-code field mappings or CBN code snippets). |
8 | Google SecOps Forwarder & Bindplane Agent | Ingestion Pipeline | Lightweight software (Docker/Linux/Windows) deployed on-premises or in VPCs to collect Syslog, Windows Events, Packet Captures, and Splunk feeds, buffering locally and streaming over TLS to SecOps. |
9 | Reference Lists (String, Regex, CIDR) | Detection & Tuning | Externalized lists referenced inside YARA-L ( in %list_name, in regex %list_name, in cidr %list_name) and updated dynamically via API/SOAR playbooks without modifying rule code. |
10 | Retrohunt | Threat Hunting & Validation | Executing newly written or updated YARA-L rules asynchronously against historical UDM telemetry to uncover past compromises or validate false-positive rates before enabling live alerting. |
11 | Risk Analytics (UEBA) & Entity Risk Score | Behavioral Detection | Computing normalized entity risk scores over sliding windows (24h / 7d), baseline statistical metrics ( mean, stddev, first_seen), and triggering alerts when a host or user breaches a composite risk threshold. |
12 | Prevalence ( day_max / rolling_max) | Threat Hunting & Detection | Measuring how many distinct assets across the enterprise have accessed a domain, IP, or file hash over the past 10 days—exposing rare ( rolling_max <= 2) C2 infrastructure or novel malware. |
13 | Cloud IDS & VPC Packet Mirroring | Network Intrusion & Forensics | Cloud IDS provides managed Layer-7 signature/anomaly intrusion detection (powered by Palo Alto Networks Threat Prevention) via VPC Packet Mirroring, which clones full packets ( PCAP) for deep network forensics. |
14 | VPC Flow Logs & Firewall Rules Logging | Network Telemetry | Agentless network connection flow telemetry ( 5-tuple, bytes, packets, GKE pod annotations) sampled at the subnet level; tuned via sampling rates and filters to balance visibility and ingestion cost. |
15 | Cloud Audit Logs & Access Transparency | Identity & Control-Plane Telemetry | Admin Activity (always-on, free), System Event (always-on, free), Policy Denied (VPC-SC/IAM blocks), Data Access (opt-in, high-volume), and Access Transparency (Google support personnel access logs). |
16 | Workforce vs. Workload Identity Federation | Authentication & Access | Workforce Identity Federation authenticates external human analysts (Okta, Entra ID/Azure AD) via SAML/OIDC; Workload Identity Federation authenticates external/on-prem scripts, AWS/Azure workloads, and CI/CD pipelines without static Service Account keys. |
17 | Cloud Logging, Log Router, Exclusion Filters & Log Analytics | Log Management & Hunting | Routing logs via Organization Aggregated Sinks ( includeChildren=true) to SecOps/BigQuery/GCS, dropping noisy logs prior to billing with Exclusion Filters, and running SQL queries over log buckets via Log Analytics. |
18 | BigQuery & Looker Studio | Long-Term Analytics & Reporting | Petabyte-scale SQL warehouse linked to Google SecOps ( events, udm_events_aggregates, rule_detections, ioc_matches) and SCC exports to power multi-year compliance reports and Looker Studio executive KPI dashboards. |
19 | Cloud Monitoring, Log-Based Metrics & Silent Source Detection | Observability & Pipeline Health | Monitoring ingestion throughput ( ingestion_component_bytes), forwarder heartbeats, and metric-absence / Silent Source Detection conditions routed via Notification Channels (Pub/Sub, Slack, PagerDuty, Webhooks). |
20 | Cloud Compute Forensics & Containment Primitives | Incident Response | Isolating compromised VMs with priority- 0/100 deny-all ingress/egress VPC Firewall Rules (preserving IAP forensic SSH), capturing Persistent Disk Snapshots to an isolated forensic project, and disabling (never deleting) compromised Service Accounts. |
2. The 10 Core Architectural Principles of the Architecture Stack
Before you tackle your first challenge in Chapter 1, internalize these 10 Core Architectural Principles. Whenever you are torn between two plausible-sounding options In Google Cloud architectures, these laws will break the tie:
- Principle 1 — Always Use
Parser ExtensionsBefore Writing Custom Parsers from Scratch: Google-managed default parsers receive continuous upstream schema updates. If a vendor appliance adds custom fields or non-standard key-value pairs, never clone or overwrite the default parser if a Parser Extension (no-code field mapping or CBN code snippet) can extract the unmapped fields—doing so preserves automatic Google maintenance on the base parser. - Principle 2 — Never Use Static Service Account JSON Keys; Enforce Federation: Any option proposing downloadable
.jsonService Account keys stored in scripts, containers, or third-party servers is an immediate common pitfalls. Use Workforce Identity Federation for human analysts (Okta/Entra ID) and Workload Identity Federation (or attached Service Accounts with short-lived tokens) for external workloads, forwarders, and CI/CD pipelines. - Principle 3 — Filter Noise at the Earliest Possible Ingestion Stage to Optimize Cost: If debug/health-check logs are never needed in Google Cloud or SecOps, drop them at the Cloud Logging Log Router Sink (
Exclusion Filter) or SecOps Forwarder regex filter before ingestion billing occurs. If logs are needed for compliance archival but not real-time SIEM analysis, route them via a Log Router Sink to Cloud Storage (Archive/Coldline) while routing only security-critical logs (Admin Activity,Policy Denied, criticalData Access,Cloud IDS) to Google SecOps. - Principle 4 — Preserve Volatile Evidence First, Quarantine Second, Snapshot Third, and Never Delete Evidence: During live incident response on a Compute Engine VM:
- Capture volatile memory (RAM) and live network socket/process tables before rebooting or powering off the VM.
- Contain the VM at the network layer using high-priority VPC Firewall Rules (via a quarantine network tag or target service account) rather than deleting the VM.
- Take a Persistent Disk Snapshot and share/instantiate it inside a separate, isolated Forensic Google Cloud Project—never inspect malware on the live production host.
- Disable (do not delete!) a compromised Service Account or user identity so its unique principal ID and historical Cloud Audit Logs remain intact for Root Cause Analysis (RCA).
- Principle 5 — Master YARA-L Repeated Fields (
anyvs.all) and Sliding Windows (match): In UDM, fields likesecurity_result.action,principal.ip, andtarget.ipare repeated (array) fields. - Use
any $e.security_result.action = "BLOCK"when at least one element must match. - When excluding values on a repeated field, use
not any $e.principal.ip = "10.0.0.1"(orall $e.principal.ip != "10.0.0.1"), becauseany $e.principal.ip != "10.0.0.1"evaluates totrueas soon as a multi-IP array contains any other IP! - Multi-event correlation rules always require a
match:section specifying the grouping variable(s) and time window (e.g.,$user over 5m). - Principle 6 — Event Logs Are Point-in-Time Actions; Entity Context Logs Require Aliasing Across Time: Raw firewall or proxy logs only know an ephemeral DHCP IP (
10.12.4.55) at14:02 UTC. To attribute that connection toalice@corp.comonlaptop-fin-09, Google SecOps relies on continuous ingestion of Entity Context sources (DHCPイベント,Active Directoryusers/groups,Workday,CMDB/SCCassets) so the Entity Graph can perform time-aware asset and user aliasing at the exact event timestamp. - Principle 7 — Externalize Dynamic Indicators into
Reference ListsRather Than Hardcoding Rules: Never edit a YARA-L rule's code every time you add an allowed scanner IP, a VIP executive username, or a Watchlist CIDR block. Store those values in a Google SecOps Reference List (STRING,REGEX, orCIDRmode) and update the list programmatically via the Reference List API or a SOAR playbook action. - Principle 8 — Match the Threat Detection Engine to the Telemetry Layer:
- Hypervisor-level memory rootkits / kernel cryptominers without guest agents → SCC Virtual Machine Threat Detection (
VMTD). - GKE runtime container escapes / unexpected binary execution in pods → SCC Container Threat Detection (
CTD). - Near-real-time Cloud Audit Log / GKE / DNS log attack patterns inside GCP → SCC Event Threat Detection (
ETD) (and custom ETD JSON templates). - Cloud misconfigurations and compliance posture drift → SCC Security Health Analytics (
SHA) & Security Posture Service. - Multi-source, multi-cloud, on-premises, UEBA, and historical 12-month YARA-L correlation → Google SecOps SIEM.
- Deep Layer-7 payload signatures and full packet capture (
PCAP) → Cloud IDS + VPC Packet Mirroring. - Principle 9 — Gate High-Blast-Radius SOAR Playbook Actions Behind Conditional Enrichment and Manual Approval: In Google SecOps SOAR, fully automate read-only enrichment (GTI hash/IP reputation, WHOIS, AD group lookup, SIEM UDM pivot) and low-risk hygiene. However, before executing high-blast-radius containment on critical production infrastructure (e.g., isolating a shared database server, revoking an executive's credentials, bulk-deleting emails), enforce conditional risk-score checks and a deterministic Manual Analyst Approval Task with an expiration SLA.
- Principle 10 — Monitor the Monitors with
Silent Source Detection: A detection rule that emits zero alerts might mean your environment is secure—or it might mean the on-premises firewall forwarder crashed 6 hours ago. Always pair security detections with Silent Source Detection (using Cloud Monitoring metric-absence policies onchronicle.googleapis.com/ingestion/...or log-based heartbeat metrics) so the SOC is alerted the moment a critical telemetry pipeline goes dark.
Book TOC · Chapter 0 of 7 · Next: Chapter 1
AwesomeGCP.com Learning
The approach taken is a question-led learning approach: you explore realistic project scenarios where you need to make decisions or take actions to achieve business goals within specific constraints. Instead of passive learning, you are challenged to think and work through the options to master the Professional Security Operations Engineer (PSOE) certification!