#425 Issue
Nov. 18, 2024
Tag: Python
Docker Python Nov. 18, 2024Authenticate Google Cloud In Docker Without Getting Your Creds Stolen - Avoid GCP 401 errors — and security concerns — by passing project credentials into your Docker image the right way.
API Python Nov. 18, 2024Customizing Retry Predicates in Google Cloud Python Libraries - This blog post explores how the Google Cloud's Python libraries interact with custom retry predicates, allowing you to customize the retry behavior to better meet your specific requirements.
DevOps Paywall Python SRE Nov. 18, 2024Building Resilient Systems on Google Cloud Platform: An Engineer’s Guide - This guide provides key strategies and coding practices for building resilient systems on GCP, covering topics such as regions and zones, platform availability, and infrastructure stack. Real-world scenarios illustrate the application of these principles in practice.
BigQuery Cloud Logging Paywall Python Nov. 4, 2024How to Save Google Cloud Logs in BigQuery - Learn to save live and history Google logs in BigQuery.
BigQuery Generative AI Python Nov. 4, 2024Using BigQuery as a Vector Store - This article shows how to use BigQuery as a vector store for a simple Python application that uses a Streamlit frontend, FastAPI backend, and Langchain and Google Cloud services to ask questions about the 2024 NFL rule book.
Python Serverless Sept. 30, 2024You’re Using Pip Wrong in the Cloud! - How python’s most used package manager could leave your serverless workloads open to dependency confusion attacks.
BigQuery Python Sept. 30, 2024Upcoming Changes in Python Version Support for the Google Cloud BigQuery Client Library and Connectors for Python - The Google Cloud BigQuery client library and connectors for Python will no longer support Python 3.7 and 3.8 after October 2024.
Cloud Run Python Sept. 16, 2024Cloud Run job with a Python Module - The article explains how to create a Cloud Run job with a Python module, including the project structure, code logic, CI/CD setup, and how to execute the job directly or via a Cloud Scheduler.
Artifact Registry Cloud Functions Paywall Python Sept. 16, 2024Managing Python Dependencies in Cloud Functions - Python Packaging to Google Artifact Registry.
BigQuery Python Sept. 9, 2024BigTesty: Integration testing library with BigQuery - BigTesty is an integration testing library for BigQuery that allows users to execute tests in the real infrastructure, ensuring that SQL queries work as expected and return the intended data. It can be installed as a Python package or used as a Docker image.
BigQuery Python Sept. 2, 2024Effective Tactics for End-to-End Pipeline Testing - Using self-made BigQuery emulator in tests.
AI Machine Learning Python Aug. 19, 2024Step-by-Step Guide: Deploying Streamlit Apps on Google Cloud Platform (GCP) - This article provides a step-by-step guide on testing and deploying Python web applications, specifically Streamlit apps, on Google Cloud Platform.
BigQuery IoT Paywall Python Aug. 12, 2024IoT Data Logging and Device Control with GCP: Setting Up Google Cloud Functions and BigQuery for Teracom TCG140–4 - Tutorial with step-by-step setup of Teracom TCG 140–4 with Google Cloud Function and BigQuery database for remote data logging.
Paywall Python Aug. 5, 2024Deploying dbt Projects at Scale on Google Cloud - Containerising and running dbt projects with Artifact Registry, Cloud Composer, GitHub Actions and dbt-airflow.
Cloud Tasks Python Aug. 5, 2024Automate or Stagnate: Master Salesforce Task Automation with Python and Google Cloud Platform - Salesforce task automation with Python and Google Cloud Platform streamlines operations, reduces manual effort, and ensures timely attention to at-risk partners.
App Engine Docker Python Aug. 5, 2024[SOLVED] Google App Engine deployment fails because of failing readiness check - A custom Google App Engine environment fails to start due to failing readiness checks. The issue was resolved by adding a CMD statement to the Dockerfile and reverting to default health check settings. The default nginx instance shipped by the Google base container handles health checks.
Cloud Security Command Center Python Aug. 5, 2024Bulk closing alerts with Python and the Google Security Operations API - This article presents a method for bulk closing alerts in Google Security Operations using Python and the Google Security Operations API.
AI Machine Learning Python July 29, 2024Package and deploy your machine learning models to Google Cloud with Cog - Cog is an open-source tool that lets you package machine learning models in a standard, production-ready container.
Cloud Logging Python July 29, 2024Enhance Your Django REST API with Google Cloud Logging - In this tutorial, you'll learn how to integrate Google Cloud Logging with your Django REST API project.
Artifact Registry GitHub Python July 22, 2024Create, version, and manage your library using Poetry and Google Artifact Registry - Using Poetry with.
Cloud Storage Python July 22, 2024Introducing gs-fastcopy - gs-factcopy is a Python library that optimizes file copying & compression for large files on Google Cloud Storage.
Python July 22, 2024Streamlit & Google Cloud Storage: Your Easy File Upload Guide - A Python tutorial to upload files to Google Cloud using Streamlit.
Cloud Functions GitHub Paywall Python July 15, 2024Deploy Your Google Cloud Functions The Right Way (Step-by-Step Guide) - Covering GitHub versioning, CI/CD pipeline development and scheduling jobs within Google Cloud Platform.
AI DevOps Python Speech to Text July 8, 2024Enhancing Video to Text Transcription with AI: An Asynchronous Solution on Google Cloud Platform - An asynchronous video-to-text transcription solution built with GCP using an event-driven and serverless architecture.
Gemini Machine Learning Python Vertex AI July 8, 2024Counting Gemini text tokens locally - The Vertex AI SDK for Python now offers local tokenization to calculate the number of tokens in your text input.
Data Analytics Python July 1, 2024Did Google Just Kill Streamlit? - Checking out Google’s Mesop Framework to see if it’s better than Streamlit.
Gemini LLM Python July 1, 2024How to prompt Gemini asynchronously using Python on Google Cloud - How to send all your prompts at the same time and collect the answers, rather than sending them one by one, using Python.
IAM Python June 17, 2024Obtain JWT OAuth tokens for Service Account - This article explains how to obtain JWT OAuth tokens for a service account in Python.
Cloud Run Python June 3, 2024Shipping Fast with FastAPI and Cloud Run - This article demonstrates how to quickly build and deploy a backend API server using FastAPI and deploy it to Google Cloud Run. The API interacts with Google's Firestore database using the Discovery API and Firestore Client libraries. The code is available on an open-source repository, and the deployment process involves creating a Docker image, pushing it to Artifact Registry, and deploying it to Cloud Run. Testing and verification steps are also provided.
Artifact Registry Eventarc Official Blog Python Serverless May 27, 2024Releasing Artifact Registry assets across Organizations and Projects with serverless - This article presents a serverless approach to automatically copy Artifact Registry or Container Registry images across different projects and organizations. It uses Cloud Pub/Sub, Cloud Run, and EventArc to trigger the image copy process when changes are made to the source Artifact Registry.
Cloud Datastore Cloud Firestore Python May 27, 2024Using Google Cloud Firestore with Django's ORM - Django Google Cloud Connectors provides database backends for both Datastore and Firestore.
BigQuery Python May 20, 2024BigQuery Hide and Seek: The Quest for Lost Tables and Elusive Datasets! - We compare approaches for getting insights in your BigQuery footprint and present you a custom Python script for full flexibility.
DevOps Python May 20, 2024Drawing cloud system architecture via Python code - Diagrams python package provides an interface to define architecture schemas.
Cloud Functions Python Serverless May 20, 2024Google Cloud Functions Guide — Deploying on Serverless Framework - Serverless Framework is an open-source command-line tool (CLI) that allows you to develop and deploy serverless applications on GCP.
Cloud Dataproc Python May 20, 2024Dataproc Serverless: Python Package Management through Conda - Use Conda to package up python dependencies for your Dataproc Serverless jobs.
Paywall Python April 22, 2024How to communicate to your cloud run instance in GCP using Python (Deploy in Production/Locally) - Deploy In Production:.
Looker Python April 22, 2024A step-by-step guide to maintaining a clean Looker instance - In this article, we will walk through the process of creating an automated clean-up script for Looker, using Python.
Cloud Functions Python April 8, 2024Working with GCP Cloud Functions and Box webhooks - Using Cloud Functions for Box webhooks.
AI Gemini LLM Python April 1, 2024Crafting Bespoke Output Formats with Gemini API - Propose a method using question phrasing and API calls to craft a bespoke output, enabling seamless integration with user applications.
AI Machine Learning Python April 1, 2024Secure Together — Federated Learning for Decentralized Security on GCP - Integrating security mechanisms to enhance organization posture with FL.
Cloud Build Cloud Run Data Science Machine Learning Python March 25, 2024Deploy A Production-Ready Streamlit App with Cloud Run and Cloud Build - How to ship containerized applications on a serverless architecture and over a CICD pipeline.
Cloud Run Python Security March 18, 2024Unlocking Secrets: Navigating Cloud Run’s Secret Access Methods - In Cloud Run, there are three distinct methods for accessing secrets. This article will delve into how these methods can be implemented using Python and deployed via YAML files, examining their respective advantages and limitations.
DevOps NodeJS Python March 11, 2024Extending your tools, adding matrices to Google Cloud build - Join my journey in overcoming copy-paste chaos and easily enhancing out-of-box tools!
API Gateway Python March 4, 2024Bridging the Gap: Converting FastAPI OpenAPI to Swagger 2.0 for GCP API Gateway compatibility - This guide helps convert FastAPI’s OpenAPI 3.0 to 2.0 for GCP API Gateway deployment, covering core concepts and step by step instructions.
LLM Python Feb. 26, 2024Using and Finetuning Google’s State-of-the-Art Open Source Model Gemma-2B - This article describes how to use and fine-tune Gemma model.
BigQuery Python Feb. 11, 2024BigQuery Methods For Re-Creating Pandas’ Top EDA Functions - In this guide, we’ll explore how to re-create key Pandas functions used for EDA such as describe and corr in BigQuery.
OpenTelemetry Python Feb. 11, 2024Telemetry at Greenbids - Using OpenTelemetry to gather business related metrics.
Cloud Run Python Serverless Terraform Feb. 11, 2024FastAPI CloudRun Starter: Serveless Backend Deployment - FastAPI CloudRun Starter repository for efficient and streamlined backend deployment.
DevOps Google Kubernetes Engine Kubernetes Python Feb. 11, 2024FastAPI on GKE with GPU: A Step-by-Step Guide - To run a FastAPI application that requires GPU support on Google Cloud Run, which itself does not natively support GPUs, you would need to integrate it with Google Kubernetes Engine (GKE), which supports GPUs.
Data Science DevOps Python Feb. 5, 2024Host and monetize your Streamlit app cost-effectively - Hosting and monetizing a Streamlit app for many users can be quite tricky, but that's not as impossible as it looks like.
Jupyter Notebook Python Serverless Serverless Spark Feb. 5, 2024Paperless: Dataproc Serverless Meets Jupyter - Paperless is a Python package designed to streamline the execution of Jupyter Notebooks with a Spark kernel.
BigQuery Machine Learning Python Jan. 15, 2024BigFrames — Scikit and Pandas for BigQuery SQL - This article aims to introduce BigFrames, a library that offers both a Pandas and SKLearn like API acting directly on BigQuery tables.
Data Analytics Python Jan. 8, 2024Building an end-to-end ETL pipeline with Spotify and Google Cloud Platform (Part 1) - A data pipeline from Spotify API to GCP.
Colab Python Visualization Jan. 8, 2024From iPhone to Insight: Crafting a Fitness Dashboard with Python, Google Cloud, and Streamlit - Creating the steps tracker dashboard to visualize the step count data stored in the iPhone.
Cloud Run Python Terraform Jan. 8, 2024How to deploy a Django app to Google Cloud Run using Terraform - How to deploy a Django app to Cloud Run.
Cloud SQL Google Kubernetes Engine Python Jan. 8, 2024Streamlining Flask App Deployment on GKE with Cloud SQL and a Secure Sidecar Proxy - Deploying Flask appliaction on GKE.
Cloud Logging Cloud Run Python Serverless Jan. 1, 2024How to Fix Cloud Run Jobs Logging - Python code snippet to improve logging in Cloud Run jobs.
Cloud Run Python Dec. 25, 2023An Overview of Cloud Run Jobs and Prefect - A brief overview of Cloud Run Jobs and Prefect.
Generative AI LLM Machine Learning Python Dec. 18, 2023Google Imagen (through GCP Vertex AI Studio) as fashion design assistant - In this article, we will explore how generative AI can assist fashion designers in generating new ideas and designs using Google’s suite of generative models for text and image generation.
Artifact Registry Python Dec. 11, 2023Python packages via GCP’s Artifact Registry - This blog post shows how to publish and install packages from GCP’s Artifact Factory using pip and poetry.
Apache Beam Dataflow Python Oct. 30, 2023Quick way to learn the basics of Apache Beam Programming - Coding exercises to learn Beam concepts in Python.
BigQuery Official Blog Python Oct. 16, 2023Build AI/ML and generative AI applications in Python with BigQuery DataFrames - Learn how to perform analytics on BigQuery data using BigQuery DataFrames and its bigframes.pandas and bigframes.ml APIs.
BigQuery Cloud Dataproc Data Science dbt Python Oct. 16, 2023Choosing the right tool while building your Data Platform: DBT vs. Spark (By example) - Table of contents.
dbt Python Oct. 9, 2023Finally, a better way to deploy DBT on Google Cloud! - All the code for this article can be found in the template repository linked below and you can also read this artlice on my website.
Data Science Machine Learning Python Vertex AI Oct. 9, 2023Multimodal Prediction Model Using Google Vertex Ai - Multimodal Embeddings are a powerful tool to use for ML applications, with many use cases.
Cloud Run Cloud SQL Cloud Storage Python Tutorial Oct. 9, 2023How to Deploy Production Django 4 using Google Cloud Run, Cloud SQL, and Cloud Storage - A step by step tutorial to deploy Django 4 applications on Google Cloud using Cloud Run.
Cloud Run Flutter Python Aug. 28, 2023Flutter for data engineering and data science! - Deploying Flutter app (written in Python?!) to Cloud Run.
IAM Python Aug. 28, 2023Everything Your Cloud Provider Won’t Tell You About Service Accounts - Learn service account logic, use cases and the unavoidable business problem they solve.
Flutter Generative AI Machine Learning Python Aug. 28, 2023Build Flutter application in Python to chat in ANY language with Google Cloud LLMs available on… - Creating & deploying chat application on GCP using PaLM 2 model.
BigQuery Python Teradata Aug. 28, 2023Migrating SQL Workflows from Teradata to BigQuery using Python - This article explores how to create a migration workflow for Batch SQL Translation from Teradata to BigQuery using Python.
Data Science Python Aug. 21, 2023Python Logs Aren’t Code. They’re A Communication Tool. - Embrace logs as communication plus 3 non-negotiables you must include for a functional, transparent data pipeline.
AI Python Aug. 21, 2023How to Use Google’s PaLM 2 API with Python - Customize and integrate Google’s LLM in your application.
Billing Data Science GCP Experience Python Aug. 14, 2023Taking 5 Minutes To Make These Tweaks Reduced My GCP VM Costs From $110 to $30 A Month - Understand Google Cloud Platform pricing, VM configurations and virtual environments to save > $700 a year.
Jupyter Notebook Python Serverless Aug. 14, 2023Schedule and Invoke Notebooks as Web Services using Jupyter API - This article explains how to run Jupyter Notebook with serverless GCP products.
BigQuery Data Science Python Aug. 7, 2023Introducing BQFlow ETL - BQFlow is a Python library that moves data between Google APIs and BigQuery with minimal overhead and configuration.
BigQuery Python July 10, 2023Transferring software into open-source space - BQuest is a library for running unit test for BigQuery.
Machine Learning Python Vertex AI July 10, 2023Vertex AI Feature Store - Feature ingestion and serving pipeline on GCP with Python.
Docker Machine Learning Python July 3, 2023Practical Guide: How To Create A Docker Image In GCP Artifact Registry - Step-by-step guide to create a custom docker image in Artifact Registry using Cloud Build yaml file in your Git Repo.
Machine Learning Python June 19, 2023Using Google Cloud from Colab - Colab is a great tool for Pythonistas. It can be used for a variety of tasks and also offers a simple way to use Google Cloud services.
Colab Jupyter Notebook Python June 19, 2023A Better Way to Use Google Cloud from Colab - Using GCP products on Colab.
Cloud Run GitHub NoSQL Python June 19, 2023Creating a Scalable Flask App with HarperDB and Deploying on Google Cloud: A Step-by-Step Guide - In this step-by-step guide, that goes through the process of creating a Flask app with HarperDB as the backend database and deploying it on the Cloud Run via CI/CDD pipeline with GitHub Actions.
Artifact Registry Java Python Terraform June 12, 2023Migration to Google Cloud part 1 — Migrating dependencies to Artifact Registry - Migrating Maven artifacts to the Artifact registry.
Cloud Run Python May 29, 2023Cloud Run Service with a Python module FastApi and Uvicorn - The goal of this article is showing a complete use case with a Cloud Run service written with a Python module, multiple files, Uvicorn and FastApi.
Cloud Run Python May 29, 2023How to Connect a FastAPI Server to PostgreSQL and Deploy on GCP Cloud Run - An extensive guide on how to connect your FastAPI application with a custom database and deploy the whole application stack on GCP.
Cloud Resource Manager Python May 22, 2023Exploring Google Cloud Resource Manager with Python — V1.0 - Listing projects under google cloud organisation hierarchy using Python.
BigQuery Data Science Machine Learning Python May 1, 2023Analysing 260.000 Text Documents - An end to end NLP project to find trend and discover topics.
DevOps Kubernetes Python May 1, 2023Build an end-to-end CI/CD pipeline for Flask Application on GCP deployed on GKE - DevOps in Google Cloud Platform (GCP) — Part II.
Big Data BigQuery Data Science Python April 17, 2023Simplify Data Science Workflows on BigQuery with Fugue and Python - Speed Up Iteration and Cut Computation Cost.
Data Science Python April 10, 2023Creating a Google Looker Studio Dashboard — Populating it with data - A step-by-step guide on building an automated process to update a Looker Studio dashboard.
Cloud SQL Contact Center AI Dialogflow Python March 27, 2023Python Webhook for integrating Dialogflow CX chatbot with CloudSQL database - This article is about Building a Hotel booking Chatbot in Dialogflow CX and integrating it with MySQL backend database which is hosted on Google Cloud SQL using Python webhooks.
BigQuery Cloud Run Data Analytics Python March 20, 2023A data engineering project with Prefect, Docker, Terraform, Google CloudRun, BigQuery and Streamlit - Orchestrate data pipelines to find late buses in real-time — from raw data to live data visualisation.
Document AI Python March 20, 2023From pixels to information with Document AI - An overview of Document AI with practical and visual examples.
Cloud Pub/Sub Cloud Run Python Serverless Feb. 27, 2023Build a serverless Telegram bot on GCP with Cloud Run - Or “A praise for streaming architectures and Cloud Pub/Sub”.
Cloud Functions Cloud Run Python Feb. 20, 2023Tutorial: Connecting Cloudrun and Cloudfunctions to Redis and other Private Services using Goblet - This tutorial will walk you through the steps of deploying a Cloud Run service that privately connects to a Redis Instance using a VPC Connector.
BigQuery Cloud Storage Eventarc Python Feb. 20, 2023Event Driven Cloud Function : Load GCS file to BigQuery with Event Arc - The goal of this article is to showing a complete example to trigger a Cloud Function with Event Arc, when a file is uploaded to Cloud Storage.
Monitoring Python Serverless Jan. 30, 2023GCP Alerts the Easy Way: Alerting for Cloudfunctions and Cloudrun using Goblet. - Using Goblet framework to deploy monitoring alerts.
Cloud SDK Python Jan. 23, 2023Become a GCP Master: Get Comfortable with the gcloud CLI - Become a GCP power user by learning how to use the gcloud CLI for almost any tasks you need to achieve in GCP.
Python Jan. 23, 2023How to Set GOOGLE_APPLICATION_CREDENTIALS in Python - Configuring Application Default Credentials and fixing oauth2client.client.ApplicationDefaultCredentialsError.
Cloud Workstations Python Jan. 16, 2023Build Your Castles In The Sky - Set up a powerful remote development environment on Google’s new Cloud Workstations.
BigQuery Python Jan. 2, 2023Auto-Generate BigQuery Schema from a Pandas DataFrame - Save yourself time and headaches creating BigQuery schemas from your DataFrame with this one simple function.
Cloud Dataflow Python Dec. 5, 2022Deploy a Reusable Custom Data Pipeline Using Dataflow Flex Template in GCP - This article explains an approach to building and deploying a Dataflow Flex template.
Machine Learning Python Vertex AI Nov. 21, 2022Making Better Coffee using Artificial Intelligence - How to quickly build a Latte Art Detector on Google Cloud using Vertex AI, some Python and Cloud Run (almost no coding).
BigQuery Python Nov. 21, 2022BigQuery’s schema auto-detection does not work perfectly like we want it to, so we build our own. - Python library to automatically generate BigQuery schema based on the input file.
BigQuery Python Serverless Serverless Spark Nov. 7, 2022Creating Serverless Spark Jobs with Google Cloud - Write scalable Spark applications and data pipelines without any manual infrastructure provisioning or tuning.
Cloud Functions Python Nov. 7, 2022Cloud Functions – Develop it the right way - Using Functions Framework to develop Cloud Functions locally with a ease.
BigQuery Data Science Python Oct. 10, 20223 BigQuery SQL Tricks to Undo Your Screw Ups - Messing up while writing and running SQL is inevitable; your recovery determines whether this is a hiccup or an apocalypse.
AI Cloud Functions Python Sept. 12, 2022Run Stable Diffusion in a GCP Cloud Function — a step-by-step guide. - Generating Stable Diffusion Images via Cloud Function.
DevOps Google Kubernetes Engine Kubernetes Python Sept. 12, 2022Extending GKE with NGINX IC - Using NGINX Ingress Controller on GKE.
Cloud Dataproc GCP Experience Python Sept. 12, 2022Why we don’t use Spark - A use case of migrating from Dataproc to Kubernetes.
Cloud Run Python Sept. 12, 2022Tutorial: Deploying Cloud Run Jobs - Deploy new Cloud Run jobs using the Goblet Python framework.
Compute Engine Machine Learning Python Sept. 12, 2022How to Run a Stable Diffusion Server on Google Cloud Platform - A step-by-step guide to build and deploy a Flask app.
Cloud Run GIS Python Sept. 5, 2022Running a serverless, Geospatial, Python app in Google Cloud - Deploying Geo web app on Cloud Run.
BigQuery Google Maps Platform Looker Python Sept. 5, 2022Find nearby cafes on Looker using Google Maps API and BigQuery Remote Functions - Running a little snippet of python from a Looker dashboard.
Cloud SQL Official Blog Python Aug. 29, 2022How to Connect to Cloud SQL using Python … the easy way! - Learn how to connect to a Cloud SQL database from Python using the Cloud SQL Python Connector.
Artifact Registry Python Security Aug. 29, 2022Avoid Public PyPI Using Google Cloud Artifact Registry - Set up a private Python index using Artifact Registry, following instructions that also work when users do not have internet access.
BigQuery Monitoring Python Aug. 22, 2022How I build a Real-time BigQuery Pipeline for Cost Saving and Capacity Planning - Cost and resource management in BigQuery.
Cloud Run Python Terraform Visualization Aug. 1, 2022Dash on GCP — Part 3 - Deploy the dashboard to Cloud Run.
BigQuery Data Analytics GPU Official Blog Python July 25, 2022Scalable Python on BigQuery using Dask and NVIDIA GPUs - To accelerate data analytics and machine learning workflows, we introduce the Dask BigQuery connector to read data through BigQuery storage API and deploy at scale on NVIDIA GPUs using Dask and RAPIDS on Google Dataproc.
Compute Engine Official Blog Python July 4, 2022How to migrate a group of individual instances to a stateful MIG using Python script - Requirements and examples of python script usage for automated and safe instance migration between configurations.
BigQuery Python June 20, 2022Read BigQuery data faster using the Storage Read API with Python - Using BigQuery Storage API to load a large number of rows from BigQuery to Jupyter Notebook.
Big Data Python June 13, 2022How to build a DAG based Task Scheduling tool for Multiprocessor systems using python - Scheduling Big Data Workloads and Data Pipelines in the Cloud with pyDag.
Cloud Logging Python May 30, 2022How to Use Logging Query Language to Analyze GCP Logs Data in Python - How to use Google Cloud’s Logs API and Logging Query Language in Python to obtain real-time data on active GCP instances.
Cloud IoT IoT Python May 16, 2022Building Smart Home IoT Devices with the Google Cloud Platform - How to connect your first device to IoT Core.
Cloud Dataproc Python May 16, 2022Churn Prediction with PySpark and Google Cloud Dataproc - Using PySpark on Cloud Dataproc to predict users' churn.
BigQuery Python May 16, 2022BigQuery transactions over multiple queries, with sessions - Example of using transactions in BigQuery.
Machine Learning Python Vertex AI May 2, 2022Creating A Machine Learning Model For An NFT Horse Racing Game Using Vertex AI - A process of the training ML model in Vertex AI.
Machine Learning Python Vertex AI May 2, 2022Serving a Spark ML model on Vertex AI using a CI/CD Pipeline with Cloud Build and Cloud Function - Example of using PySpark on Vertex AI.
Jupyter Notebook Python Vertex AI April 25, 2022How to start Jupyter in Google Cloud — the Python way - Managing Jupyter Notebooks in Vertex AI using Python SDK.
Airflow Artifact Registry Python April 25, 2022If You Are Using Python and Google Cloud Platform, This Will Simplify Life for You (Part 2) - Manage your private packages with artifact registry and import them in Cloud Composer DAGs.
Artifact Registry Cloud Functions Python April 18, 2022If you are using Python and Google Cloud Platform, this will Simplify Life for you (Part 1) - Manage your Private Packages with Artifact Registry And Import them in your Cloud Functions and Cloud Run Services.
Cloud Memorystore Official Blog Python April 18, 2022Using Memorystore for Redis to cache your Django applications - With the release of Django 4.0, Redis is now a core supported caching backend. Learn how to implement caching for your Django deployments on Google Cloud.
Cloud Functions Cloud Monitoring Python Stackdriver April 18, 2022GCP Operations Suite Alerts into Google Chat - Publishing Monitoring notifications to Google Chat using custom solution built with Pub/Sub and Cloud Functions.
Cloud Firestore Cloud Run Python April 18, 2022Building a Mobility Dashboard with Cloud Run and Firestore - Monitoring data that is actively changing every second using a real-time dashboard using Cloud Run and Cloud Firestore.
App Engine Cloud Run Official Blog Python April 18, 2022Follow the pink pony: A story of CSRF, managed services, and unicorns - One engineer's story into the depths of managed services, web server gateway interfaces, and magic strings.
Cloud Functions Cloud Storage Python April 4, 2022Secret Sauce — Google Cloud Functions For Autonomous Global Storage Synchronization - Code samples to replicate files in Cloud Storage buckets.
Cloud Dataproc Python March 28, 2022Running pyspark jobs on Google Cloud using Serverless Dataproc - Run Spark batch workloads without having to bother with the provisioning and management of clusters!.
Artifact Registry Python March 7, 2022Manage private Python packages using Artifact Registry (Google Cloud) - Setting up Python package and use in Artifact Registry.
API Cloud Functions Cloud Run Python Feb. 28, 2022Serverless APIs made simple on GCP with Goblet backed by Cloud Functions and Cloud Run - By Austen Novis, Staff Software Engineer.
Cloud Pub/Sub Cloud Run Kubernetes PubSub Python Feb. 14, 2022Pub/sub adventures: From Pull to Push with Cloud Run - Sample application on Cloud Run that is triggered by Pub Sub message and switching from Pull to Push delivery.
Cloud Logging Python Feb. 7, 2022Introducing Google Cloud Logging Python v3.0.0 - Manage your app’s Python logs and related metadata using Google Cloud.
Cloud Vision API Machine Learning Python Jan. 31, 2022Process Images With Google Cloud AI - Example of the image analysis process on Google Cloud.
Python Terraform Jan. 24, 2022Deploy Cloud Functions on GCP with Terraform - In this tutorial you are going to deploy a simple Cloud Function triggered by a Cloud Storage event with Terraform.
Cloud Logging Python Jan. 24, 2022Enable feature-rich Logging for FastAPI on Google Cloud Logging - Set up Cloud Logging for FastAPI (Python framework).
Cloud Logging Python Visualization Jan. 17, 2022How to Visualize Google Logs with Grafana - Writing logs in Python application and visualizing them in Grafana.
Beginner Cloud Pub/Sub Python Jan. 17, 2022How to use Google Pub/Sub to build an asynchronous messaging system in Python - Basic concepts of Pub/Sub and give step-by-step instructions for how to use it in Python.
BigQuery Python Jan. 17, 2022How to Restore Deleted BigQuery Tables - How to leverage BigQuery snapshots for data restoration using Python client library.
Beginner Cloud Logging Python Stackdriver Jan. 10, 2022How to Write Logs to Google Cloud Logging in Python? - This tutorial explains how to write logs from the application to Cloud Logging with Python.
Airflow BigQuery Python Jan. 10, 2022Why I built the python-bigquery-validator package - A tool to verify Jinja templated SQL queries used in Apache Airflow.
Cloud Run Python Visualization Jan. 3, 2022Deploy Bokeh Apps on GCP Cloud Run - Deploying Boken (interactive visualization) app to Cloud run.
API Gateway Cloud Functions Python Jan. 3, 2022Connect a webapp with CORs and Google API Gateway - Example of setting up API Gateway with Cloud Functions.
BigQuery Python Dec. 27, 2021How to keep metadata of all tables in BigQuery? - This article explains how to keep metadata of all tables in BigQuery.
Apache Beam BigQuery Cloud Dataflow Python Dec. 27, 2021Streaming Data to BigQuery with Dataflow and Updating the Schema in Real-Time - Updating BigQuery schema during Cloud Dataflow streaming.
Cloud Functions Python Dec. 13, 2021Build a Twitter dashboard with bubble / python / cloud function - Discover this simple stack that uses NoCode, Python, Cloud, and Serverless computing to build great web apps.
Cloud Spanner Official Blog Python Dec. 13, 2021Google Cloud Spanner Dialect for SQLAlchemy - Enabling Python SQLAlchemy applications to use Google Cloud Spanner as a database.
Cloud Functions Cloud Pub/Sub Python Dec. 13, 2021Mocking Events in Pub/Sub Triggered Cloud Functions (GCP, Python) - Mocking Pub/Sub data when writing tests for Cloud Functions which are triggered by Pub/Sub message.
Apache Beam BigQuery Python Nov. 29, 2021Using Apache Beam to automate your Preprocessing in Data Science - Extracting, Cleaning and Exporting the data from a public API with the help of Apache Beam and GCP.
Cloud Functions Official Blog Python Nov. 22, 2021Avoiding GCF anti-patterns part 5: How to run background processes correctly in Python - Fifth post in a series on how to avoid anti-patterns in Google Cloud Functions as seen by the Support team. This post explores how Python developers mistakenly use os.fork() or the multiprocessing.Process() package for async tasks; however, the best practice is to use Cloud Tasks.
App Engine Beginner Cloud SQL Python Nov. 22, 2021Getting Started with GCP: Building a Registration Application using App Engine and Cloud SQL - Introducing App Engine and Cloud SQL with example.
Cloud Dataflow Data Analytics Official Blog Python Nov. 22, 2021Debunking myths about Python on Dataflow - Python developers have access to the greatest breadth of features when they use Dataflow for their data processing applications, contrary to popular belief.
Python Vertex AI Nov. 22, 2021Deploy ML models on Vertex AI using custom containers - This blog post covers the creation of a custom container that serves your model and deploying it on Vertex AI.
Machine Learning Python Vertex AI Nov. 15, 2021Developing and Deploying a Machine Learning Model on Vertex AI using Python - Write training pipelines that will make your MLOps team happy.
Firebase Python Nov. 8, 2021Firebase Admin Python SDK v5.1.0
Cloud Spanner Official Blog Python Nov. 1, 2021Django ORM support for Cloud Spanner is now Generally Available - Today we're happy to announce GA support for Google Cloud Spanner in the Django ORM.
BigQuery Python Oct. 18, 2021Back Up your Valuable BigQuery Views and Scheduled Queries - This tutorial will show you how to back up all the BigQuery SQL code into a Git repository using Python.
Jupyter Notebook Machine Learning Python Oct. 18, 2021Colab is now available on GCP Marketplace - This gives you the ability to connect Colab to a custom GCE VM that you can configure as you wish.
BigQuery Data Science Machine Learning Python Oct. 11, 2021BigQuery fetching + multiprocessing - Does multiprocessing improve the fetching speed of BigQuery API requests?
API Gateway Cloud Functions Python Oct. 11, 2021Secure Google Cloud Functions with API Gateway - Configuring API Gateway for Cloud Functions.
BigQuery Python Terraform Sept. 27, 2021Importing existing BigQuery Resources to Terraform Automatically - Importing datasets and tables from BigQuery into Terraform.
Python Translation API Sept. 27, 2021Updating glossaries in Google Cloud Translation - How to progressively improve your translations without training any model.
BigQuery Data Science Machine Learning Python Sept. 20, 2021The fastest way to fetch BigQuery tables - A benchmark of the fastest methods used to fetch tables from BigQuery. Also introducing bqfetch: an easy-to-use tool for fast fetching.
Machine Learning Official Blog Python Vertex AI Sept. 13, 2021PyTorch on Google Cloud: How To train and tune PyTorch models on Vertex AI - With the PyTorch on Google Cloud blog series, we will share how to build, train and deploy PyTorch models at scale, how to create reproducible machine learning pipelines on Google Cloud Vertex AI and emphasize first class support for training and deploying PyTorch models on Vertex AI.
CI Cloud Run Cloud SQL Python Serverless Sept. 4, 2021Django on Google Cloud Run - This tutorial explains the creation of a fully containerized Django app and deploying it to Cloud Run with CI/CD, credentials management, and static file hosting.
BigQuery Data Science Jupyter Notebook Python Aug. 23, 2021How Data Scientists Can Increase Their Productivity With the Aid of Data Engineers Solutions Using BigQuery, Google Colab and Python - This article aims to bring a set of solutions in Python used by Data Engineers that will increase the productivity of Data Scientists that needs to use Google BigQuery in daily operations and just want this thing to work.
Data Analytics Python Aug. 23, 2021StarThinker 2.0 Is Here - StarThinker, is a simple and intuitive web UI that allows users to create, edit, run, and schedule data pipelines consistently.
API Monitoring Python Aug. 16, 2021Missing data points in your monitoring API response? Use page iterators! - Iterators simplify the process of paging through API responses. Learn to use page iterators to get all data points from the `list_time_series` call.
API Python Security Aug. 16, 2021Examine Google Cloud Platform security vulnerabilities using Cloud Functions. - API to examine your Google Cloud Platform security vulnerabilities using Cloud Functions.
Cloud Spanner Official Blog Python Aug. 16, 2021Data Validation for Oracle to Cloud Spanner Migration - Data Validation Tool is an open sourced python CLI based tool that compares heterogeneous data source tables and provides multi-level validation functions. DVT can connect to different types of source and target databases and create validation reports based on the criteria defined. In this blog, we will see how to set up the Data Validation Tool to compare data between Oracle and Spanner tables and create validation reports in BigQuery.
Airflow BigQuery Monitoring Python Aug. 16, 2021Get that crucial report in Slack Channel - Python code to post visualized data from BigQuery to Slack channel.
NodeJS Official Blog Python Aug. 9, 2021Try a tutorial in the Google Cloud Console - You can follow tutorials and walkthroughs in the Google Cloud Console, allowing you to view the instructions and the console at the same time. The tutorials include links and highlights, making it easy to find the screens and buttons you're looking for.
AI Official Blog Python Aug. 9, 2021Image search with natural language queries - This post shows how to build an image search utility using natural language queries. Our aim is to use different GCP services to demonstrate this.
Billing Python Aug. 9, 2021Extract Committed use discount details from Recommendation Hub - This post discusses on how to retrieve committed use discount details from the Google Cloud Recommender across all GCP Projects in an Organization.
Machine Learning Python Video Intelligence API Aug. 2, 2021See what Video Intelligence API can do with this visualisation tool - A visualiser for the Google Cloud Video Intelligence API allows anybody to explore all of the API features.
Compute Engine Data Science Machine Learning Python Aug. 2, 2021Remote development with PyCharm and Google Cloud - Data Scientists guide to setting up remote development with PyCharm and GCP.
API Google Cloud Platform Python Recommender July 26, 2021Retrieve recommendation details across all GCP Projects - Getting data from Recommender API.
Official Blog Python July 26, 2021Introducing the Data Validation Tool for EDW migrations - New open-sourced Python CLI tool helps take the headache out of data validation.
Data Analytics Firebase Python July 19, 2021Mindfulness App: How to Analyse User Behaviour Using Google Firebase Events Data - This article presents the solutions to some of the most common challenges in analyzing Firebase events data to generate app use insights.
Cloud Firestore NodeJS Python July 19, 2021Try a Tutorial in the Google Cloud Console - How the console can help you clean up your tab game.
Cloud Data Fusion Cloud Functions Python July 19, 2021Google Data Fusion: Using Cloud Storage file uploads to trigger Data Fusion ETL Pipelines - Google Cloud Functions and Google Data Fusion’s REST API can be jointly used to deliver event-based execution.
Cloud Pub/Sub NodeJS Python July 12, 2021Exploring Pub/Sub and Pub/Sub Lite - Exploring and comparing Pub/Sub and Pub/Sub Lite.
Beginner Python Terraform July 12, 2021First steps in Pulumi with Python & Google Cloud Platform - Getting started with Pulumi on GCP.
BigQuery Data Science Python July 5, 20213 ways to query BigQuery in Python - SQLAlchemy, Python Client for Google BigQuery, and bq command-line tool.
BigQuery Data Science Python July 5, 2021Build Robust Google BigQuery Pipelines with Python: Part II - BigQuery STRUCT in Python.
Cloud Dataflow Java Python July 5, 2021Quick Steps to Build & Deploy Dataflow Flex Templates (Python & Java) - Flex Templates package the Dataflow pipeline artefacts as a Docker image and stage these images on Google Container Registry.
BigQuery Cloud Dataflow Python Serverless June 22, 2021Export Datastores from multiple projects to BigQuery - How to export datastores from multiple projects using Google Dataflow — with additional filtering of entities.
AI Platform Notebooks Python Vertex AI June 22, 2021How to Generate Logs with Vertex AI in Google Cloud - Use Vertex AI notebooks to communicate with centralized logging in Google Cloud.
Artifact Registry Cloud Build Cloud Functions Python Serverless June 14, 2021Python Packages in Artifact Registry - Example of using Artifact Registry for Python package.
Cloud Natural Language API Data Science Python June 14, 2021How to categorise text in a Pandas dataframe using Google’s Natural Language API - Using Cloud Natural API for text categorization.
Cloud Functions Python June 14, 2021Use multiple paths in Cloud Functions, Python and Flask - Modifying Flask application to handle multiple URL paths for Cloud Function.
API Cloud Monitoring Monitoring Python June 14, 2021Getting started with Google Cloud Monitoring APIs— Part 1 - Creating custom metrics and dashboard using Python's client library for Cloud Monitoring.
Java NodeJS Official Blog Python June 14, 2021Node, Python and Java repositories now available in Artifact Registry - Expanded language support lets you store Java, Node and Python artifacts in Artifact Registry, for a more secure software supply chain.
BigQuery Data Science GIS Python May 31, 2021Transforming GeoJSON’s Geometric Features into BigQuery’s Polygon Format with Simple Python Script - Bridging the geometric data available in GeoJson.io into analytics use cases.
Cloud Functions Cloud Storage Python May 31, 2021Develop and test Google Cloud Functions locally and deploy - A sample setup and template to manage, develop and deploy your Cloud Functions.
App Engine Microservices Python May 17, 2021How to build Microservices on Google Cloud Platform and App Engine - Using App Engine for microservices.
Cloud AutoML Cloud Run Python Tutorial May 3, 2021Introduction to Google AutoML Vision - An introduction to AutoML and creating a real AI application for Cats — Dogs Classification using AutoML Vision and deploying to Cloud Run step by step.
BigQuery Docker Python April 25, 2021Copy SQL Server data to BigQuery without CDC - Automated export of data from SQL Server to BigQuery.
BigQuery Looker Python April 25, 2021Simple Period-to-Date Comparisons in BigQuery - Performing period-over-period analyses with SQL via Colab or Looker.
Beginner Cloud SDK Cloud Storage Python April 25, 2021How to use gsutil and Python to deal with files in Google Cloud Storage? - Working with Cloud Storage using a command-line tool or Python's client library.
BigQuery Cloud Dataflow Cloud Datastore Python April 12, 2021Export Datastore to BigQuery using Google Dataflow - How to employ Google Dataflow to export Datastore to BigQuery with additional filtering of entities.
Big Data Cloud Dataproc Python April 12, 2021How to migrate your on-premise pyspark jobs to GCP using Dataproc Workflow Templates using Dataproc Workflow Templates with Production-Grade Best Practices Standards - Complete pattern example of how to migrate (or create from scratch) pyspark jobs to GCP with Dataproc Workflow Templates.
Cloud Speech API Python April 12, 2021Capturing the Elusive World of Sound: Fetch and Transcribe Google Podcasts with Python - Transcribing in bulk podcast audio files.
Apache Beam BigQuery Cloud Pub/Sub Dataflow Python March 29, 2021A Dataflow Journey: from PubSub to BigQuery - Exploiting Google Cloud Services to build a custom real time streaming data pipeline.
Cloud Speech API Python March 29, 2021Using Google’s Speech-to-Text API with Python - This post provides steps and python syntax for utilizing the Google Cloud Platform speech transcription service.
Airflow CI Cloud Build DevOps Python March 22, 2021Composer CI/CD pipeline with Cloud Build and Python script - The objective of this article is to show one way of implementing CI/CD on Composer using only GCP tools and Python.
Cloud Storage Python March 22, 2021TransparentPath : A python package to manage paths on Google Cloud Storage - Are you used to pathlib’s Path objects and frustrated when using GCSFileSystem objects ? The TransparentPath package is made for you.
Data Studio Machine Learning Python March 8, 2021Monitoring and Retraining your Machine Learning Models - With Google Data Studio, lakeFS and Great Expectations.
BigQuery Cloud Run Data Analytics Official Blog Python March 8, 2021Inventory management with BigQuery and Cloud Run - Building a simple inventory management system with Cloud Run and BigQuery.
AI AI Platform Machine Learning Python March 1, 2021Training PyTorch Transformers on GCP AI Platform - How to use highly popular ML framework PyTorch on AI Platform Training.
API BigQuery Cloud Scheduler Python Feb. 22, 2021Loading API Data into Google BigQuery with Cloud Functions and Scheduler - Google BigQuery is a fantastic tool for SQL based analysis of data —here’s an easy way to load in API data and set up automated updates.
Cloud Spanner Official Blog Python Feb. 22, 2021Introducing Django ORM support for Cloud Spanner - Today we're happy to announce beta support for Google Cloud Spanner in the Django ORM. The django-google-spanner package is a third-party database backend for Cloud Spanner, powered by the Cloud Spanner Python client library.
Official Blog Python Feb. 15, 2021Supporting the Python ecosystem - Google's support for the Python Software Foundation.
Artifact Registry Cloud Functions Cloud Security Command Center Python Feb. 15, 2021Centrally Managing Artifact Registry Container Image Vulnerabilities on Google Cloud: Part Two - Writing vulnerabilities directly into Security Command Center from Cloud Function.
Machine Learning Official Blog Python Feb. 8, 2021How to develop with PyTorch at lightning speed - Increase your productivity using PyTorch Lightning, a popular wrapper, and Google Cloud Platform.
Cloud Vision API Python Feb. 1, 2021Detect text on image using Google Cloud Vision API (python) - Extracting IMEI number from images using Cloud Vision API and Python.
Cloud Run Docker Python Jan. 18, 2021FastAPI: Deploy Containerized Apps On Google Cloud Run - Example of deploying FastAPI webapp to Cloud Run.
Cloud Dataprep Cloud Functions Python Jan. 11, 2021Google Cloud Functions for Cloud Dataprep - Examples of Google Cloud Functions for Cloud Dataprep.
BigQuery Data Science Python Jan. 4, 2021A gentle introduction to the 5 Google Cloud BigQuery APIs - An overview of BigQuery APIs / client libraries.
Cloud Functions Machine Learning Python TensorFlow Dec. 28, 2020Machine Learning in Production - Serving Tensorflow model via Cloud Functions.
API BigQuery Cloud Functions Cloud Scheduler Python Tutorial Dec. 28, 2020Scheduling Cloud Functions to Update BigQuery - The is a bare bones tutorial focused on quickly setting up Cloud Scheduler -> Cloud Function -> BigQuery.
AI Platform AI Platform Notebooks Jupyter Notebook Python Dec. 28, 2020AI Platform Notebooks “headless” training - This article focuses on two approaches to running your training in a headless manner.
BigQuery Python Dec. 21, 2020Investigate BigQuery slowness with Python and INFORMATION_SCHEMA - Investigation of slot resource contention in BigQuery jobs.
Cloud Run DevOps Python Serverless Dec. 21, 2020How I design 12-factor cloud native app on GCP. - Discussion and implementing 12 factor app on GCP.
Data Science Machine Learning Python TensorFlow Dec. 21, 2020A machine learning pipeline with TensorFlow Estimators and Google Cloud Platform - TensorFlow on GCP — a way to industrialise complex machine learning pipelines.
Apache Beam BigQuery Cloud Dataflow Data Science Dataflow Jupyter Notebook Machine Learning Python Dec. 21, 2020Getting started with Machine Learning on GCP — Part 2: Making data clean and usable - Creating Beam/Dataflow pipeline in Jupyter Notebook.
Airflow Cloud Composer Python Dec. 14, 2020StarThinker On Airflow / Composer - StarThinker is a Google gTech built python framework for creating and sharing re-usable workflow components.
Cloud Dataproc Data Analytics Official Blog Python Dec. 14, 2020Improve the data science experience using scalable Python data processing - Announcement of the Dask support for Dataproc, Google Cloud’s fully managed Apache Hadoop and Apache Spark service, via a new initialization action.
Apache Beam Cloud Dataflow Python Dec. 7, 2020Profiling Apache Beam Python pipelines - Profiling Python Beam pipelines running on Cloud Dataflow without using Cloud Profiler.
App Engine Cloud Run Data Science Firebase Python Nov. 16, 2020Deploying a Python Dash app on App Engine with a Flask/Cloud Run backend and Firebase auth - Learn how to deploy a beautiful dashboard using Python and Dash on GCP. Then add user authentication with Firebase.
App Engine Python Nov. 16, 2020Deploying FastAPI application in Google App Engine in Standard Environment - Deploying FastAPI (a modern, fast/high-performance web framework for building APIs with Python 3.6+ on App Engine.
CI Cloud Run Python Nov. 9, 2020Deploy To Google Cloud Run Using Github Actions - A CI/CD solution with GitHub Actions and Cloud Run.
BigQuery Cloud Dataflow Cloud Dataproc Python Nov. 9, 2020BigFlow — a Python framework for data processing on GCP - BigFlow is a Python framework for big data processing on GCP.
API BigQuery Cloud Functions Python Nov. 2, 2020Post BigQuery data on Facebook Marketing API - How to easily post data from a BigQuery table on Facebook Marketing API, using Python and the Google Cloud Platform.
Apache Beam Dataflow Python Nov. 2, 2020How to Deploy Your Apache Beam Pipeline in Google Cloud Dataflow - Deployments of Beam pipelines on Cloud Dataflow.
CI Cloud Functions DevOps Python Nov. 2, 2020Deploying serverless GCP Cloud Function via Bitbucket Pipelines - Setting CI/CD pipeline in Bitbucket to deploy Cloud Function.
App Engine CI Cloud Build Python Oct. 26, 2020Continuous Integration and Deployment using Google Cloudbuild - CI/CD Cloud Build pipeline to test and deploy App Engine application.
BigQuery Python Oct. 5, 2020BigQuery REST API call using JWT - This post looks at calling BigQuery through REST API and authenticating with JWT tokens.
BigQuery Jupyter Notebook Public Datasets Python Sept. 21, 2020Python Bar Chart Race Animation: COVID-19 Cases - Analyzing and visualizing the COVID-19 public dataset.
Cloud Monitoring Monitoring Python Sept. 21, 2020Creating Custom Metrics in Google Cloud with Python - Python script to send custom metrics.
Cloud Functions Cloud Speech API Machine Learning Python Sept. 21, 2020Analyze Your Call Recordings With Google AI - An example of how Cloud Speech can be used to transcribe call center phone calls.
Cloud Endpoints Cloud Run Python Sept. 14, 2020How to deploy a simple Flask app on Cloud Run with Cloud Endpoint - Deploying Python web app on Cloud Run and Cloud Endpoints.
API API Gateway Python Serverless Sept. 14, 2020Manage Serverless APIs With API Gateway in GCP - Example of using API Gateway to connect various serverless applications on GCP.
BigQuery Python Aug. 31, 2020Getting Started With Python Google BigQuery. - Introduction to BigQuery with Python.
BigQuery Cloud Dataproc Data Studio Jupyter Notebook Python Aug. 31, 2020How to Set up a COVID-19 Workflow and Dashboard Using the Google Cloud Platform - Building a data pipeline to process and visualize data regarding COVID-19.
Cloud Endpoints Python Security Serverless Aug. 31, 2020Secure APIs in Cloud Run, Cloud Functions and App Engine Using Cloud Endpoints ESPv2 (Beta) - In this blog, we will see how to secure API’s in Cloud Run, Cloud Functions and App Engine Standard environment using API Keys and Bearer Token.
AI Platform Notebooks Jupyter Notebook Machine Learning Python Aug. 24, 2020Create a new AI Platform Notebooks using Python - New client library for Python to create new AI Platform Notebooks.
App Engine Python Serverless Aug. 17, 2020My 3 years experience in Google Cloud App Engine (Python 2 & Python 3) - Experience of using App Engine with a brief overview.
BigQuery Python Aug. 17, 2020Introducing BQconvert — BigQuery Schema Converter Tool - BQconvert is a Python opensource tool that helps you to convert any database’s schema into BigQuery compatible schema.
Cloud Natural Language API Machine Learning Python Aug. 17, 2020Using Google Cloud NLP API to analyze writings featured in the Hamilton Broadway Play - A Google Cloud Natural Language Processing project focused on the writings featured in the Hamilton Broadway Play.
Cloud Tasks Python Aug. 10, 2020Looking for an emulator for Cloud Tasks? - Introducing a simple Tasks emulator that makes it easy to deploy and debug.
Cloud Firestore Firebase Python Aug. 10, 2020Upload Data to Firebase Cloud Firestore with 10 line of Python Code - Example of uploading local CSV files to Cloud Firestore using Python.
BigQuery Data Science Python July 20, 2020BigQuery + Python for Production Data Science - Accessing BigQuery using Pandas, PySpark, and OS/Python.
Data Loss Prevention API Python Tutorial July 20, 2020Getting Started with Google’s Data Loss Prevention API in Python - Using the Data Loss Prevention API in Python code.
AI Platform Machine Learning Python July 20, 2020Model Training using Google Cloud AI Platform - This story demonstrates how to use AI Platform to train a simple classification model using scikit-learn framework.
Cloud Monitoring Cloud Run Java Python July 20, 2020Google Cloud Trace, Debug, Error reporting - Setting Tracing, Debugging, and Error reporting for Python and Java applications on Cloud Run.
Apache Beam Cloud Dataflow Go Python July 13, 2020A Data Engineering Perspective on Go vs. Python (Part 2 — Dataflow) - A comparison of Python and Go Beam SDK with benchmarks.
Cloud AutoML Machine Learning Python July 13, 2020Google AutoML Vision for Image Classification - Train a Custom Machine Learning Model to Classify Images, then Deploy it to the Cloud or on the Edge.
Cloud Functions Cloud Scheduler Python July 13, 2020Google Cloud Platform Case Study: Automate COVID19 Monitoring - Using Cloud Functions and Cloud Scheduler to periodically retrieve data about COVID-19.
Apache Beam Beginner BigQuery Cloud Dataflow Python July 13, 2020Apache Beam Pipeline for Cleaning Batch Data Using Cloud Dataflow and BigQuery - An overview of basic Beam concepts with an example of a simple pipeline.
BigQuery Cloud Functions Data Science Python July 6, 2020Part 2: Building a Simple ETL Pipeline with Python and Google Cloud Functions — MySQL to BigQuery - Extracting data from a MySQL database and loading into Google BigQuery using Google Cloud Functions.
DevOps Python Serverless July 6, 2020How to Set Up a Deployment Pipeline on GCP with Cloud Build and Cloud Functions - Automatically deploying Cloud Function instances when changes get pushed to your Git repositories.
BigQuery Cloud Dataflow Cloud Datastore Python July 3, 2020The Python implementation of Dataflow to transfer Datastore entities to BigQuery - Transferring entities of Google Cloud Datastore into BigQuery in bulk with Dataflow implemented in Python.
BigQuery Python July 3, 2020Load files faster into BigQuery - Benchmarking CSV, GZIP, AVRO and PARQUET file types for ingestion.
Data Science Machine Learning Python TensorFlow July 3, 2020Model with TensorFlow and Serve on Google Cloud Platform - Serving TensorFlow Models on a scalable cloud platform.
Beginner Cloud Functions Python Security June 29, 2020Setup and Invoke Cloud Functions using Python - This articles describes the process of development, deployment and setting access for Cloud Functions (in Python).
Cloud Pub/Sub Python June 15, 2020Deduplication, Delayed Messaging and FIFO with Pub/Sub - Handling deduplication, delayed messaging, and FIFO for Pub/Sub.
Data Analytics Python June 8, 2020How to automate financial data collection with Python using Tiingo API and Google Cloud Platform - A step-by-step tutorial for Python programmers looking to anayze stock prices and automate data collection through GCP.
Cloud Run Cloud Vision API Python Serverless June 1, 2020That’s a llama! Tag photos with Cloud Run and Vision API in 60 lines of code — Serverless Toolbox - On this episode of Serverless Toolbox, see how to automatically label uploaded photos using Python, Cloud Run, and the Vision API.
Cloud Functions Python Terraform June 1, 2020Asynchronous Cloud Functions in GCP (Python) - This article deals with the usage of Cloud Functions to track long-running jobs in an asynchronous manner with a focus on trackable and stateful long-running operations.
Airflow BigQuery Python May 25, 2020Airflow with Twitter Scraper, Google Cloud Storage, Big Query — tweets relating to Covid19 - Part Two of a Four-part Data Engineering Pipeline.
Airflow Google Kubernetes Engine Kubernetes Python May 25, 2020Apache Airflow and Kubernetes — Pain Points and Plugins to the Rescue - Some of the Airflow pain points and how they were solved when deployed on Kubernetes Engine.
IAM Python May 25, 2020Google Cloud — IAM users extraction across all projects in a GCP org - A simple script to get all users for organisation in GCP.
App Engine Cloud Datastore Python May 25, 2020My definitive guide to getting datastore emulator to work with python - Setting local datastore emulator to be used in App Engine.
App Engine Cloud Run Google Kubernetes Engine Python May 18, 2020Deploying Python Application in Google Cloud (GCE, GAE, GKE & Cloud Run) — Part 1 - Group of articles which describes several ways of deploying Python web application on GCP products.
Cloud Run Python May 4, 2020Deploying a PyPI Server in minutes with GCP - PyPI is a repository of software for Python; well, if you are here you already know it.
Cloud Build Python May 4, 2020How to build a Python package with Cloud Build in GCP - Deploying PyPI server on Cloud Run for Python packages.
AI Platform Machine Learning Python May 4, 2020Baking with machine learning - Training an ML model to predict based on ingredients what kind of type food recipe is for.
BigQuery Cloud Functions Python April 27, 2020Building a Simple ETL Pipeline with Python and Google Cloud Platform - Extracting data from an FTP server using Google Cloud Functions.
BigQuery Cloud Dataproc Python April 27, 2020Apache Spark & Google Cloud DataProc - The article goes through a process of setting Dataproc cluster and executing batch Spark job which stores results in BigQuery.
Cloud Dataprep Cloud Functions Cloud Scheduler Data Analytics Data Studio Python April 27, 2020Creation of an ETL in Google Cloud Platform for automated reporting - Learn how to create your own serverless and fully scalable ETL for automated reporting using PyTrends as an example.
BigQuery Python April 27, 2020Optimize BigQuery costs with Flex Slots - Explanation of BigQuery Flex Slots and how to provision via Python library.
Cloud Speech API Python April 13, 2020Converting Audio Recorded Speech to Text using Google’s Speech-to-Text API, Drive, Cloud Storage, and Colaboratory - Code samples in Python to do Speech to Text conversion.
Big Data BigQuery Data Analytics Python April 13, 2020Ibis: A Python Data Analysis Framework for Development and Production - An example of using Ibis (Python Data Analysis Productivity Framework) with BigQuery.
App Engine Monitoring Python Stackdriver March 28, 2020How to Debug an Unresponsive app on GCP - The article explains how to investigate problems in a web app deployed on Google App Engine.
BigQuery Python March 23, 2020How to backup a BigQuery table (or dataset) to Google Cloud Storage and restore from it - Python scripts to backup data or restore from BigQuery table to Cloud Storage in AVRO format.
CI Cloud Build Kubernetes Python March 16, 2020Parameterised Kubernetes deployments without Helm via GCP Cloud Build - Setting Cloud Build for Google Kubernetes Engine CI/CD.
AWS Cloud Dataproc GCP Experience NoSQL Python March 9, 2020Cross-Cloud HBase/Phoenix Data Migration - Using Cloud Dataproc to run Spark job which migrates data from AWS to GCP.
Beginner Cloud Natural Language API Python March 9, 2020Introduction to Natural Language Processing with the Google NLP API - Exploring Cloud Natural API
AI Platform Data Science Docker Machine Learning Python March 2, 2020Serverless machine learning using Docker - Running containers in Google AI Platform.
Compute Engine DevOps Python Recommender Feb. 24, 2020New ground — What about optimizing the size of machines? - Using Recommender API to get information about resizing Compute Engine instances.
BigQuery Python Feb. 17, 2020Simplify BigQuery ETL jobs using SQLAlchemy - Using SQLAlchemy (Python's ORM library) for BigQuery.
BigQuery Python Feb. 17, 2020Revisiting Google Search Console Data into Google BigQuery - Taking a fresh look at sending Google Search Console data into BigQuery, using Python, for free.
Machine Learning Python TensorFlow TPU Feb. 10, 2020Train Neural Networks Faster with Google’s TPU from your LapTop. - Tutorial on how to set up Cloud TPU and train ML models.
AI Platform Machine Learning Python Feb. 3, 2020Pipelines for production ML systems - You’ll see how to train a model using open-source components, deploy a model for serving, and create a pipeline for this workflow.
Cloud Functions Go NodeJS Python Secret Manager Serverless Jan. 27, 2020“Init” Cloud Functions - Code samples for initializing Cloud Functions with data from Secret Manager.
AI Platform Data Science Machine Learning Python Jan. 20, 2020Using Scikit-learn on Google Cloud Platform - Training Scikit-learn models on GCP’s AI Platform.
BigQuery Cloud Storage Python Jan. 13, 2020Building and using an inventory of your Google Cloud Storage objects in BigQuery - Uploading metadata about fIles from Cloud Storage files and analyzing them in BigQuery.
Cloud Run Cloud SQL IoT Python Jan. 13, 2020IoT Tank Monitoring Solution Part 1 — Build a Rest API using Cloud Run and Django Rest Framework - End to end solution to track tank level using cloud computing without having to worry too much with managing infrastructure.
Cloud Functions Python Jan. 13, 2020A Python Cloud Function to compose and send a PDF via e-mail - An example of using Cloud Functions to convert text to PDF and send an email.
Cloud Functions Python Serverless Jan. 13, 2020Portable Cloud Functions with the Python Functions Framework - Functions Framework for Python allows running and deploying the same code in Cloud Functions, Cloud Run, Knative and locally.
Cloud Functions Cloud Scheduler Python Jan. 6, 2020Algorithmic Trading Automated in Python with Alpaca and Google Cloud - Example of using Cloud Scheduler and Cloud Functions to automate stock trading.
App Engine Python Jan. 6, 2020Step-up your Developer skills with App Engine Part I - Create a twitter sentiment analyzing bot. Use Cloud NLP to analyze sentiment and use a corn Job to automate crawling and showing data.
AI Platform Machine Learning Python Dec. 23, 2019Deploy Keras model on GCP and making custom predictions via the AI Platform Training & Prediction API - This tutorial will show how to train a simple Keras model locally using Colab and then how to deploy this model to the AI Platform.
Google Kubernetes Engine Kubeflow Machine Learning Python Dec. 23, 2019E2E Kubeflow Pipeline for time-series forecast — Part 2 - Building end to end pipeline with Kubeflow on Google Kubernetes Engine.
Machine Learning Python TensorFlow Dec. 16, 2019Tales of a machine learning startup - How to build and deploy a diabetes diagnostic app from A to Z using Tensorflow, Google Cloud Platform, and Flask.
Cloud Functions Python Serverless Dec. 9, 2019Using system packages and custom binaries in Google Cloud Functions. - Examples of using system packages and custom binaries in Google Cloud Functions.
Apache Beam Python Dec. 9, 2019Advent of Code 2019 in Apache Beam - Solutions to the Advent of Code challenge in Python using Apache Beam.
Big Data Compute Engine Puppet Python Dec. 2, 2019New ground — Automatic increase of Kafka LVM on GCP - Adding more storage to each node of Kafka cluster on Google Cloud.
Big Data BigQuery Python Nov. 25, 2019Simplify BigQuery ETL jobs using SQLAlchemy - Extract and move data between BigQuery and relational databases using a plugin for SQLAlchemy.
Cloud Vision API IoT Machine Learning Python Nov. 25, 2019Machine Learning from IoT Core with the Cloud Vision API - Analyzing images from Arduino with Cloud Vision API.
AI Platform Data Science Machine Learning Python Nov. 25, 2019Predicting Taxi fares in NYC using Google Cloud AI Platform (Billion + rows) Part 3 - The objective of this series of articles is to create a Machine Learning model that is able to estimate taxi fares in NYC before the ride commences.
App Engine BigQuery Data Science Python Nov. 18, 2019Python / Pandas & BigQuery in 7 minutes - Using BigQuery in Django app.
API Cloud Vision API Python Nov. 11, 2019GCP Goodies Part 10— Measuring happiness with Google Cloud Vision API - An attempt to measure happiness in a fully-remote company using Google Cloud Platform and the Selenium Python script.
Apache Beam Cloud Dataflow Data Analytics Official Blog Python Nov. 11, 2019Introducing Python 3, Python streaming support from Cloud Dataflow - Python 3, support for Python streaming is now available for data processing with Cloud Dataflow.
BigQuery Blockchain Python Nov. 4, 2019Getting started with Bitcoin data on Kaggle with Python and BigQuery - Analyzing Blockchain data from BigQuery with Python.
Machine Learning Python Nov. 4, 2019Developing on a Virtual Machine from your local IDE - A walkthrough to set up a live development environment that runs on a Virtual Machine from within your local IDE.
Big Data BigQuery Data Science Python Oct. 28, 2019How to get into BigQuery analysis on Kaggle with Python? - Exploring ways to use BigQuery in Kaggle.
Cloud Functions Python Oct. 21, 2019How to build an event driven application on Google Cloud using Cloud Functions - Examples of Cloud Functions applications.
BigQuery Docker Python Sept. 30, 2019Migrating our ETL pipeline to Luigi on a Cloud - Running Luigi framework for scheduling ETL jobs.
Cloud Storage Python Sept. 30, 2019Pagination, Batching & Restricting result data with Google Cloud Storage python client library - Few tips for using Pythons client library for Cloud Storage.
App Engine Cloud Firestore Python Sept. 30, 2019How to use the Firestore Emulator with a Python 3 Flask app - Using Firestore emulator for App Engine local development.
Cloud Deployment Manager Kubernetes Python Sept. 23, 2019GCP Goodies Part 1 — Google Deployment Manager Basics - When setting up cloud infrastructure consisting of more than a single server and a database the Infrastructure as Code (IaC) solutions are very important. Here is a toolset from Google to help.
BigQuery Machine Learning Python TensorFlow Sept. 23, 2019ML Design Pattern #1: Transform - Illustration of Transform design pattern using BigQuery ML & SQL.
Cloud Dataflow Cloud Functions Cloud Scheduler Python Sept. 9, 2019Serverless architecture to deploy and run google dataflow pipelines - Using Cloud Scheduler, Cloud Functions to run Dataflow jobs.
BigQuery Data Science Python Sept. 2, 2019Slow BigQuery results no more - How the use of BigQuery Storage API improves the speed of results retrieving from BigQuery.
Cloud Firestore Cloud Run Python Tutorial Sept. 2, 2019Building a Flask CRUD API with Cloud Firestore and Deploying on Cloud Run. - Deploying CRUD web app on Cloud Run which is using Cloud Firestore as database.
Cloud Run Firebase Python Sept. 2, 2019Hosting Flask servers on Firebase from scratch - Demonstration of Firebase Hosting with Cloud Run.
Cloud AutoML Python Aug. 12, 2019Working with Google Cloud AutoML in Python - Process of extracting images from the video and using that to build machine learning model with AutoML.
AI Cloud Composer Machine Learning Python Aug. 5, 2019Machine Learning Operations (MLOps) Pipeline using Google Cloud Composer - Example of setting a ML pipeline on GCP.
BigQuery Cloud Functions Cloud Pub/Sub Dataflow Python Aug. 5, 2019Copy data from Pub/Sub to BigQuery - Inserting data from PubSub to BigQuery with Cloud Functions.
Cloud Functions Cloud Scheduler Official Blog Python July 29, 2019GCP developer pro-tips: How to schedule a recurring Python script on GCP - Automating recurring Python scripts using Cloud Scheduler.
BigQuery Python July 22, 2019How to load GeoJSON files into BigQuery GIS - An ETL pipeline for GeoJSON to BigQuery.
Apache Beam Cloud Dataflow Python July 22, 2019Input source reading patterns in Google Cloud Dataflow - Most common input reading patterns for Dataflow jobs.
Cloud Build Cloud Functions Python July 15, 2019A Journey Into Cloud Functions - Example of use for Cloud Functions.
Machine Learning Python July 15, 2019Transferring data from Google Drive to Google Cloud Storage using Google Colab - Simple and fast transfer of data between Google Drive and Google Cloud Storage without the need to download or upload to your local computer
App Engine Python July 15, 2019Building React and Django Web Application and Deploy It on Google Cloud - Example of deploying Django & React app to App Engine.
BigQuery Machine Learning Python July 8, 2019How to do hyperparameter tuning of a BigQuery ML model - Bayesian Optimization using Cloud AI Platform.
BigQuery Data Science Python July 8, 2019BigQuery and Public Datasets. Overview for Data Analysts - In this article we’ll briefly explore what is BigQuery and how a data analyst can access and use it through various interfaces with…
Machine Learning Python July 8, 2019Colab synergy with MLflow: how to monitor progress and store models. - A guide on how to setup MLflow on Google Cloud.
Machine Learning Python TensorFlow July 8, 2019Codeless ML with TensorFlow - Building an end-to-end machine learning pipeline without writing any ML code.
Machine Learning Python July 8, 2019Using Data from a Data Pipeline in BigQuery - An example of using BigQuery ML.
BigQuery Python June 24, 2019Creating a Serverless Data Pipeline in GCP - Example of simple serverless data pipeline.
Python June 24, 2019Manage Files in Google Cloud Storage With Python - Manage files in your Google Cloud Storage bucket using the google-cloud-storage Python library.
Cloud IoT IoT Python June 17, 2019Connecting MicroPython devices to Google Cloud IoT Core - Tutorial on how to use your ESP32 device with Google IoT Core.
Knative Python June 17, 2019Building serverless event driven apps with Knative and Python - Using Event component (serverless event driven architecture which runs your container when an event is fired) of Knative.
Machine Learning Python May 27, 2019Hyperparameter Tuning On Google Cloud Platform With Scikit-Learn - Using Hyperparameter tuning feature on ML Engine.
Cloud Run Cloud SQL Cloud Storage Python May 27, 2019Preparing your Django Application for Google Cloud Run - Deploying Django application on Cloud Run.
BigQuery Machine Learning Python May 27, 2019New York Taxi data set analysis - Creating Machine Learning model based on BigQuery's New York Taxi drives dataset.
Apache Beam Cloud Dataflow Data Science Python May 13, 2019Let’s Build a Streaming Data Pipeline - Creating Apache Beam / DataFlow pipeline to parse web server logs.
Python Stackdriver May 6, 2019Python and Stackdriver Logging - Example of using synchronous / asynchronous Stackdriver logging in Python.
Cloud Functions Go NodeJS Official Blog Python Serverless May 6, 2019Your favorite runtimes, now generally available on Cloud Functions - Python, Go and Node.js are now supported runtimes on Cloud Functions.
Cloud Functions Cloud Scheduler Python May 6, 2019Moving your cron job to the cloud with Google Cloud Functions - Example of migrating cron job from server to Google Cloud.
Compute Engine Python April 29, 2019Auto-scaling from zero machine on Google Compute Engine - Auto-Scaling Instance Groups on Compute Engine.
Apache Beam Cloud Dataflow Firebase Python April 29, 2019Going further with Cloud Dataflow: conception of a real-time polls app — part 2 - Learn how to use Cloud Dataflow to aggregate unbounded data streams.
Cloud Datastore Python April 29, 2019Entity Groups, Ancestors, and Indexes in Datastore - A Working Example - Example of designing database schema with entity groups for Cloud Datastore.
Cloud Run Machine Learning Python April 22, 2019Deploy Machine Learning Model in Google Cloud using Cloud Run - Deploying PyTorch model in Cloud Run.
Python March 25, 2019Your Superpower User Manual • Marc Cohen - Combining Google Cloud services (like Dataflow, BigQuery, and AutoML), along with modern Python tools to analyze and visualize some interesting and practical questions.
AI Compute Engine Machine Learning Official Blog Python March 25, 2019NVIDIA’s RAPIDS joins our set of Deep Learning VM images for faster data science - RAPIDS, NVIDIA’s open source and Python-based GPU-accelerated data processing and machine learning libraries are available on Deep Learning VM images
BigQuery Python March 18, 2019BigQuery API To Manage Tables + Cloud Functions = ❤️ - Using BigQuery API and Cloud Functions to delete temporary tables.
Big Data Python March 11, 2019Enlightened DataLab Notebooks - Starting with Data Science on GCP.
Python March 11, 2019GCP Podcast - #165 Python with Dustin Ingram
App Engine Python Feb. 4, 201911 Things To Understand Before Migrating Your Python 2 GAE App To Python 3 - Switching from the old GAE environment to the new one.
DevOps Official Blog Python Jan. 28, 2019Otto Group CLASH: an open-source tool to run bash scripts directly on GCP - CLoud bASH, or CLASH, which takes a bash script as an input and simply runs it inside a cloud environment.
BigQuery Python Jan. 21, 2019Managing BigQuery field descriptions — bq-utils 0.1.0 - A small Python library that helps you with copying and uploading your BigQuery field descriptions.
BigQuery Cloud Functions Python Dec. 31, 2018Google Cloud Functions Python Overview and Data Processing Example - Event driven serverless functions-as-a-service.
Machine Learning Python Dec. 31, 2018PyTorch on Google Cloud Platform - How to build a custom VM on GCP with specific PyTorch versions and CUDA support for Deep Learning.
App Engine Official Blog Python Dec. 24, 2018Python 3.7 for App Engine is now generally available - Python 3.7 is now generally available on Google App Engine.
Cloud Functions Dialogflow Python Dec. 24, 2018Hey Google! Talk to… - Create voice command for the Google Assistant with Python, Dialogflow and Google Cloud Functions.
Cloud Dataproc Java Python Dec. 17, 2018Big Data Analytics with Java and Python, using Cloud Dataproc, Google’s Fully-Managed Spark and Hadoop Service - Exploring Cloud Dataproc’s ability to quickly and efficiently run Spark jobs written in Java and Python.
BigQuery Python Dec. 3, 2018Loading JSON formatted strings into Google BigQuery (Python3) - Loading JSON into Google BigQuery using Python.
IAM Python Security Nov. 26, 2018Using ImpersonatedCredentials for Google Cloud APIs - Article describe process of obtaining and using tokens for communication between services.
Google Cloud Platform Python Oct. 29, 2018Deep Learning with Python and fast.ai, Part 0: Setup GPU Virtual Machine on Google Cloud - Setup a Google Cloud virtual machine for fast.ai 1.0.
Cloud Functions Python Oct. 22, 2018Creating Google Cloud Functions Running Python - Comparison of Google Cloud Functions with AWS Lambda on Python example.
Cloud Firestore Cloud Functions Python Oct. 15, 2018How I used Google Cloud Platform to start investing in stocks - Personal project which consists of fetching and processing data from stocks.
BigQuery Official Blog Python Sept. 24, 2018Ibis and BigQuery: scalable analytics with the comfort of Python - How Ibis works with BigQuery to provide an elegant and flexible Python interface for composing SQL queries.
Compute Engine Firebase Python Sept. 3, 2018Firebase: Using the Python Admin SDK on Google Cloud Functions - Deploy simple web service build using Python, Flask and Firebase Admin SDK with Google Compute Engine.
Docker Python Aug. 27, 2018Running a python script using Docker, Pycharm & Google Cloud Platform - Setup local environment using Pycharm which integrates well with Docker.
Cloud Dataflow Python Aug. 20, 2018Creating a Template for the Python Cloud Dataflow SDK - Creating a template for Google Cloud Dataflow, using python.
App Engine Official Blog Python Aug. 13, 2018Introducing App Engine Second Generation runtimes and Python 3.7 - Python 3.7 is available today in beta on the App Engine standard environment.
BigQuery Cloud Dataflow Cloud Pub/Sub Python Aug. 13, 2018Aggregated Audit Logging With Google Cloud and Python - Taking Apache2 server access logs from a web server, converting the log file line-by-line to JSON data, publishing that JSON data to a Google PubSub topic, transforming the data using Google DataFlow, and storing the resulting log file in Google BigQuery long-term storage.
BigQuery Google Cloud Platform Python Aug. 6, 2018Aggregated Audit Logging with Google Cloud and Python - Aggregating all of logs into Google BigQuery Audit Logs.
App Engine Official Blog PHP Python July 30, 2018Bringing the best of serverless to you - Support for new second-generation App Engine standard runtimes such as Python 3.7 and PHP 7.2 in addition to recent support for Node.js 8.
Cloud Speech API Python July 30, 2018Create your own Voice based application using Python - Steps to create your own Voice based application using Python.
Cloud Functions Python July 30, 2018Writing Google Cloud Functions with Python 3 - Writing Google Cloud Functions with Python 3.7.0 version.
Cloud Functions Python July 30, 2018Getting Started with Python for Google Cloud Functions - Overview and Python tutorial with Google Cloud Functions.
Compute Engine Python July 23, 2018Using gcloud and Python Client Library with Google Compute Engine - How to use gcloud and Python Client Library with Google Compute Engine.
Apache Beam Cloud Datastore Python July 23, 2018Apache Beam Tricks: Querying Google Datastore with Python - Querying Google Datastore with Python.
App Engine Python July 23, 2018How do you manage environments in Django on Google App Engine? - Managing environments in Django on Google App Engine.
DevOps Python July 23, 2018Deploy a basic Python application using Jenkins X & Kubernetes - Creating Kubernetes cluster using Jenkins X and setting CI/CD.
Apache Beam Python July 2, 2018Dataflow Stream Processing now supports Python - Release 2.5 of Apache Beam introduces beta support for streaming in Python.
BigQuery Python July 2, 2018Google Search Console Data into Google BigQuery - Adapting an existing Python script to pull bulk data from Google Search Console into Google BigQuery.
Cloud Dataflow Python June 25, 2018Python Development Environments for Apache Beam on Google Cloud Platform - How to set up a development environment for Python Dataflow jobs.
Big Data Cloud Dataflow Cloud Datalab Python Serverless June 18, 2018Analyzing Reddit’s Top Posts & Images With Google Cloud (Part 1) - Analyzing everything from Reddit.
Apache Beam Cloud Dataflow Python TensorFlow June 18, 2018Customer segmentation using DataFlow and TensorFlow - Using DataFlow and TensorFlow for retail Customer segmentation.
App Engine Python May 7, 2018Code that debugs itself: Fixing a deadlock with a watchdog - Debug deadlock scenarios for Python web application running on Google App Engine.
NodeJS Python Stackdriver April 9, 2018Stackdriver Custom Metrics in Python - Stackdriver Custom Metrics in Python with example of how to use it in Node.js.
BigQuery Python April 2, 2018Getting Started with Google BigQuery in Python — Part 1: Setting Up the Dev Environment - Setting Up the Dev Environment for using BigQuery in Python
Beginner Cloud Speech API Python Tutorial March 12, 2018Auto-Transcribe : Google Speech API Time Offsets in Python - Demonstration of Google Speech API with Python.
Compute Engine Python Tutorial March 5, 2018An Ideal Data Science Environment on a Google Virtual Machine - Setting up data science computing environment (Python stack) on a Google Compute Engine virtual machine.
AWS Google Cloud Platform Python Feb. 26, 2018Moving a Python app from AWS to GCP - Checklist to help migrate your Python app from AWS to GCP.
App Engine Python Feb. 26, 2018Building a REST API on Google App Engine based on web scraping - Learn to build a REST API on Google App Engine based on web scraping.
App Engine Python Feb. 26, 2018The Nitty-Gritty of OAuth 2.0 Flow - Take deep dive to understand the inner workings of handling the OAuth 2.0 flow using Google’s REST API.
App Engine Python Feb. 19, 2018Using an in-memory hash vs. a MySQL table - Article explains resolved performance issues for message processing and MySQL server.
App Engine Firebase Python Feb. 5, 2018An Authul Backend - Guide to add python app engine APIs to a Firebase front end app and utilize Firebase authentication.
Beginner Docker Python TensorFlow Tutorial Jan. 15, 2018What’s After Setting up a GCP Computing Instance? Running a Custom Docker Container with Tensorflow - In this post, you will learn how to setup a custom docker image, create a container with the image and and get your python + Tensorflow scripts running in that.
Cloud IoT Python Jan. 8, 2018Refreshing JSON Web Tokens (JWTs) in Google Cloud IoT Core - This post explains refreshing JSON Web Tokens (JWTs) in Google Cloud IoT Core.
BigQuery Python Jan. 8, 2018pandas-gbq Version 0.3.0 - Quick note on pandas-gbq Version 0.3.0
App Engine Beginner Cloud Pub/Sub Python Tutorial Dec. 25, 2017Decentralize your application with Google Cloud Platform - Example of creating web app using microservices.
Beginner Firebase Python Tutorial Dec. 25, 2017Developing a Web Service with Admin SDK, Flask and Google Cloud - Example of accessing Firebase from a server-side Python app using Firebase Admin SDK.
Python TensorFlow Tutorial Nov. 27, 2017From Solving Equations to Deep Learning: A TensorFlow Python Tutorial - Introduction to Tensorflow through examples.
App Engine Python Nov. 27, 2017Running webapp2 outside of Google App Engine - Sample web application which demonstrates how to run webapp2 framework on Google Compute Engine.
Compute Engine Python Nov. 20, 2017Intel Performance Libraries and Python Distribution enhance performance and scaling of Intel® Xeon® Scalable (‘Skylake’) processors on GCP - To use full potential of Skylake processors, you can use specific libraries.
Python Oct. 9, 2017Load Testing with Locust (Part 2) - Deploying Locust (load testing framework) on Google Container Engine
Kubernetes Python Oct. 9, 2017Moving our Django Monolith to Google Cloud
Compute Engine GPU Python Sept. 18, 2017Jupyter+Keras+ Nvidia Docker with GPU on Google Cloud in an instant - Kit to create an environment with Jupyter notebook, Keras and Nvidia docker with GPU on google cloud
Python Sept. 4, 2017Getting Started w/ Python on GCP
Python TensorFlow Aug. 7, 2017TensorFlow Photo x-Ray Object Detection with App Engine - In this part of serial, description how to set up Tensorflow on Google App Engine Flexible is described.
Cloud Resource Manager IAM Python July 31, 2017Importing GCP Projects into your Organization with Python - Importing Google Cloud Platform projects under Organization resource
Machine Learning Python July 24, 2017How to run any ML package on GCP | The Models - Running Jupyter, Keras or PyTorch on Google Cloud Platform
Python July 24, 2017Jupyter Notebook on GCP for Pythoners - Step by step tutorial about how to create Google Compute Engine VM and install and use Jupyter
Docker Kubernetes Python July 24, 2017Deploy Python Application to Google Cloud with Docker and Kubernetes - Deploying Python Flask web app on Google Container Engine
Python June 4, 2017Enhancing the Python experience on App Engine - Updating supported Python's versions both for Standard and Flexible GAE
App Engine Cloud Datastore Python March 27, 2017Are you the Keymaster? - In depth article about Keys in Google Cloud Datastore
Cloud Dataflow Python March 27, 2017Announcing general availability of Google Cloud Dataflow for Python
Python March 6, 2017GCP Podcast #64 - This time Python with Jon Wayne Parrott
BigQuery Cloud Functions PythonTurning GA360 BigQuery exports into partitioned tables using Cloud Functions - Article describes how to create a cloud function that will copy a BigQuery GA360 data export to another BigQuery table.
App Engine Beginner Python TutorialDeploying a Django Application to Google App Engine - How to deploy a Django Application to Google App Engine.
Useful Links
Contact
Třebanická 183
Prague, Czech Republic
Phone: +420 777 283 075
Email: [email protected]