Welcome to issue #274 December 27th, 2021

With 2021 recaps from various GCP teams and this year's last issue, I wish you as well all the best in 2022. 

 

News

Official Blog Serverless

A cloud built for developers — 2021 year in review - Driving 10X developer productivity with Google Cloud in 2022 and beyond.

Official Blog Security

Cloud CISO Perspectives: December 2021 - Google Cloud CISO Phil Venables shares his thoughts on the latest security updates from the Google Cybersecurity Action Team.

Data Analytics Official Blog

Google Cloud Data Analytics 2021: The year in review - How we’ve helped break down silos, unearth the value of data, and apply that data to solve big problems.

Networking Official Blog

A year in review: Advancements in infrastructure at Google Cloud - A recap of the year’s infrastructure progress, from impressive Tau VMs, to industry-leading storage capabilities, to major networking leaps.

AI Machine Learning Official Blog

Google Cloud’s top AI blog posts from 2021 - Google Cloud’s top artificial intelligence and machine learning posts from 2021.

Contact Center AI Official Blog

Reaching more customers with Contact Center AI: 2021 Wrap-up - Explore Google Cloud’s Contact Center AI (CCAI) and its momentum in 2021.

BigQuery Data Analytics Official Blog

The top three insights we learned from data analytics customers in 2021 - Google Cloud announces the top data analytics stories from 2021 including the top three trends and lessons they learned from customers this year.

Articles, Tutorials

Infrastructure, Networking, Security, Kubernetes

Google Kubernetes Engine Terraform

Setting up GKE with Terraform Cloud - Building up a GKE Kubernetes cluster in GCP using Terraform Cloud.

Beginner Google Kubernetes Engine Kubernetes

Exposing GKE applications leveraging the built-in ingress - Step by step deployment of web application on GKE.

IAM Security

Secure your Google service account keys by eliminating them - Ways to access Google Cloud products without service account keys.

Cloud Armor

Introduction to Google Cloud Armor part 1 - Policies and rules for WAF and DDoS protection.

Cloud Armor

Introduction to Google Cloud Armor - Part 2 - Cloud Armor with GKE and filtering the logs.

App Development, Serverless, Databases, DevOps

DevOps

Google DevOps — Agility with Cost-Optimization - DevOps series - Agility with Cost Optimization.

Cloud Functions

Working Around the 9 Minute Limit of Google Cloud Functions - Designing a robust system using time-limited compute.

Firebase Typescript

Running a Remix App on Firebase - A lot of Remix’s cool features run on the server. When you create a new Remix app, you will see that you have to choose a server as a….

Cloud Logging

Apache APISIX Integrates with Google Cloud Logging to Improve Log Processing - This article describes the detailed steps for interfacing Apache APISIX and Google Cloud Logging.

Big Data, Analytics, ML&AI

Apache Beam BigQuery Cloud Dataflow Python

Streaming Data to BigQuery with Dataflow and Updating the Schema in Real-Time - Updating BigQuery schema during Cloud Dataflow streaming.

Airflow Cloud Composer Cloud Pub/Sub

Composer invoking long running services - Running long-running services as Airflow tasks.

Cloud Data Fusion

The Wrangler User Interface of Cloud Data Fusion - An in-depth explanation of the Wrangler User Interface of Cloud Data Fusion.

BigQuery Data Analytics Official Blog

Leveraging BigQuery Audit Log pipelines for Usage Analytics - Use BigQuery Audit Logs for deep dive monitoring and analytics of BigQuery generated log events for various personas and use cases.

BigQuery Python

How to keep metadata of all tables in BigQuery? - This article explains how to keep metadata of all tables in BigQuery.

BigQuery Machine Learning

BigQuery Machine Learning Cheat Sheet - Using SQL directly in the BigQuery Console, it is possible to train and deploy machine learning models to be reused upon prediction ….

BigQuery dbt

How we build a Cloud Data lake using ELT instead of ETL - At Datamesh GmbH we build data products for our clients mainly on Germany. Our last client needed a data warehouse which integrate….

BigQuery Kubeflow Vertex AI

BigQuery ML models deployment with Vertex AI and Kubeflow - Building a Kubeflow Pipeline in Vertex AI that will pick the best existing BigQuery ML model, deploy it and create an endpoint for online prediction.

Releases

Anthos clusters on bare metal - 1.9. Release 1.9.3 Anthos clusters on bare metal 1.9.3 is now available for download. Fixes: Fixed an issue in which cluster creation fails if a cluster has more than one control plane node, and the HTTPS_PROXY environment variable has been defined on one or more of the control plane nodes. Known issues: For information about the latest known issues, see Anthos on bare metal known issues in the Troubleshooting section.

Anthos clusters on VMware 1.7 - When deploying Anthos clusters on VMware releases with a version number of 1.9.0 or higher, that have the Seesaw bundled load balancer in an environment that uses NSX-T stateful distributed firewall rules, stackdriver-operator might fail to create gke-metrics-agent-conf ConfigMap and cause gke-connect-agent Pods to be in a crash loop. Anthos clusters on VMware 1.10.0-gke.194 is now available. vCenter/ESXi host 6.7u2 and below is no longer supported. Cluster lifecycle Improvements: An admin cluster upgrade is resumable after a previous failed admin cluster upgrade attempt. Functionality changes: Replaced the SSH tunnel with Konnectivity service for communication between the user cluster control plane and the user cluster nodes. Fixed an issue that the Windows nodes were assigned with duplicated IP addresses. Because of the change to use an OpenTelemetry-based scalable monitoring pipeline for application metrics, Horizontal Pod Autoscaling with user-defined metrics does not work in 1.10.0 unless you explicitly set scalableMonitoring to false, while also ensuring that both enableStackdriverForApplications and enableCustomMetricsAdapter are set to true, in the Stackdriver object.

BigTable - System Event audit logs for Cloud Bigtable autoscaling are now generally available (GA).

Dataproc - Dataproc has released 1.3.95-debian10/-ubuntu18 images with a one-time patch that addresses the Apache Log4j 2 CVE-2021-44228 and CVE-2021-45046 vulnerabilities, but note that that all 1.3 images remain unsupported, and Dataproc will not provide upgrades to 1.3 images .

Deep Learning VM - M88 Release To help address the Apache Log4j 2 vulnerability, H2O has been updated to 3.34.0.6 in the R and Theia images. As previously announced in the M87 release and M71 release, the previous format of TensorFlow 2.x image names, tf2-xxx-2-y-zzz, is unavailable starting with this release. Starting with this release, the Python packages that are installed on each image are listed in files that are available on Cloud Storage. Images from the M88 release mistakenly have M87 metadata stored in the images.

Google Kubernetes Engine - For GKE versions 1.21 and later, newly created clusters will have the DenyServiceExternalIPs admission controller enabled by default, disabling the use of ExternalIPs Services. A bug was found in containerd where container root directories and some plugins had insufficiently restricted permissions, allowing otherwise unprivileged Linux users to traverse directory contents and execute programs.

Load Balancing - Internal TCP/UDP Load Balancing now allows you to configure a connection tracking policy for the load balancer's backend service.

Anthos Migrate - Security updates 1.10.1 Security updates available.

Notebooks - There are now three Vertex AI release note feeds.

Security Command Center - Event Threat Detection, a built-in service of Security Command Center, launched the Active Scan: Log4j Vulnerable to RCE rule to General Availability.

SAP Solutions - Backint agent for SAP HANA version 1.0.16 Version 1.0.16 of the Google Cloud Backint agent for SAP HANA is now available.

 

Latest Issues




Contact

Zdenko Hrček
Třebanická 183
Prague, Czech Republic
Phone: +420 777 283 075
Email: [email protected]