#428 Issue
Dec. 9, 2024
Tag: Data Analytics
Data Analytics Official Blog Streaming Dec. 23, 2024Cloud Pub/Sub 2024 highlights: Native integrations, sharing and more
Data Analytics Official Blog Dec. 23, 2024Looker now available in the AWS Marketplace, bringing AI for BI to multi-cloud environments
Data Analytics GCP Certification Looker Official Blog Dec. 16, 2024Boost your Looker Studio Pro skills with new on-demand course from Google Cloud - The new Looker Studio Pro Essentials on-demand course from Google Cloud provides comprehensive training on Looker Studio Pro's advanced features and capabilities. It covers topics such as enhancing collaboration, scheduling and sharing reports, ensuring data security and control, and leveraging Google Cloud customer care.
Data Analytics Official Blog Streaming Dec. 9, 2024Google Cloud named a Leader in the 2024 Gartner Magic Quadrant for Data Integration Tools - Google Cloud has been recognized as a Leader in the 2024 Gartner Magic Quadrant for Data Integration Tools. Google Cloud's unified data and AI capabilities, combined with its comprehensive suite of fully managed services, empower organizations to ingest, process, transform, orchestrate, analyze, and activate their data with unprecedented speed and efficiency.
Cloud Dataflow Data Analytics GCP Experience Official Blog Dec. 9, 2024PayPal's Real-Time Revolution: Migrating to Google Cloud for Streaming Analytics - PayPal migrated its streaming analytics platform to Google Cloud's Dataflow to overcome challenges with reliability, efficiency, security, and scalability. The migration resulted in significant cost savings, enhanced stability, and accelerated development cycles, empowering PayPal to focus on high-value initiatives and deliver exceptional customer experiences.
Data Analytics GCP Experience Dec. 9, 2024Metadata-Driven Insights in Data Mesh - The article discusses the challenges of maintaining transparency, coordination, and governance in complex data platforms for Tchibo's data platform team.
BigQuery Data Analytics Paywall Dec. 2, 2024Dynamic Query Execution for Sharded Tables in BigQuery - Using EXECUTE IMMEDIATE to clean up rows from multiple sharded tables in BigQuery.
Cloud Dataproc Data Analytics Official Blog Streaming Nov. 18, 2024Dataproc Serverless: Now faster, easier and smarter - Dataproc Serverless now offers faster performance with native query execution in the Premium tier, improving query performance by ~47% in tests. It also introduces a built-in Spark UI for seamless monitoring and troubleshooting, eliminating the need for setting up and maintaining persistent history servers.
AI Data Analytics Official Blog Security Nov. 18, 2024Secure your data ecosystem: a multi-layered approach with Google Cloud - New ebook, "Building a Secure Data Platform with Google Cloud," explores many data security capabilities within Google Cloud and how they can support data-based innovation strategies.
Data Analytics GCP Experience Official Blog Nov. 18, 2024How Deutsche Bank built a new retail data platform on Google Cloud - Deutsche Bank built a new retail data platform (PBDP) on Google Cloud to gain insights into customer preferences and needs. The PBDP serves as a central and holistic data platform with flexible data modeling options, an analytical workplace for exploration and analysis, and easy data ingestion using real-time events and daily batch processes. It provides a foundation for simple, central data retrieval, improving data quality and reliability, and making data sharing more cost-efficient.
BigQuery Data Analytics GCP Experience Official Blog Nov. 18, 2024How PUMA leverages built-in intelligence with BigQuery for greater customer engagement - PUMA, a leading sportswear company, leverages the power of Google Cloud's BigQuery to enhance customer engagement through advanced audience segmentation. By utilizing machine learning capabilities, PUMA creates custom predictive models that analyze first-party data, enabling them to identify users with a high purchase propensity.
BigQuery Data Analytics Dataplex Official Blog Nov. 18, 2024Dataplex Automatic Discovery makes Cloud Storage data available for Analytics and governance - Dataplex, a unified platform for intelligent data to AI governance, now offers automatic discovery and cataloging of Google Cloud Storage data. This feature helps organizations locate valuable data assets, harvest metadata, and enable analytics for data science and AI use cases at scale. By eliminating the challenges associated with dark data, Dataplex empowers businesses to make data-driven decisions with confidence.
BigQuery Data Analytics Document AI Official Blog Nov. 11, 2024How to simplify building RAG pipelines in BigQuery with Document AI Layout Parser - BigQuery now offers simplified document preprocessing for retrieval-augmented generation (RAG) pipelines through its integration with Document AI. The ML.PROCESS_DOCUMENT function, now generally available, can access new processors, including Document AI's Layout Parser processor, allowing you to parse and chunk PDF documents with SQL syntax. The blog provides a step-by-step example of building a RAG pipeline in BigQuery using Document AI's Layout Parser to analyze a complex financial document.
BigQuery Data Analytics Official Blog Nov. 11, 2024Getting started with NL2SQL (natural language to SQL) with Gemini and BigQuery - Natural Language to SQL (NL2SQL) translates human language questions into structured SQL queries, enabling non-technical users to explore data and gain insights without specialized SQL knowledge. Google Cloud offers solutions to address these challenges, including BigQuery vector search for embedding and retrieval, contribution analysis for multi-step reasoning, and Gemini for ambiguity checks and user feedback.
AI BigQuery Data Analytics Official Blog Partners Nov. 11, 2024A practical guide to synthetic data generation with Gretel and BigQuery DataFrames - This guide demonstrates how to generate synthetic data using Gretel AI and BigQuery DataFrames, ensuring data privacy and compliance. It includes steps for de-identifying data with Gretel Transform v2, fine-tuning a model with Navigator Fine Tuning, evaluating data quality and privacy, and writing synthetic data back to a BigQuery table.
BigQuery Data Analytics Official Blog Oct. 28, 2024BigQuery's AI-assisted data preparation is now in preview - BigQuery data preparation, powered by AI, streamlines and simplifies the data preparation process. It offers AI-powered suggestions, data cleansing and standardization, visual data pipelines, and data pipeline orchestration. With BigQuery data preparation, organizations can significantly reduce the time spent on manual data preparation tasks, improve data quality, and empower users to make informed decisions.
BigQuery Data Analytics Looker Oct. 28, 2024From Data to Insights: Building a Data Engineering Pipeline Analyzing BayWheels Bike Data - The example of end-to-end data pipeline.
BigQuery Data Analytics Official Blog Oct. 21, 2024Revolutionizing SQL with pipe syntax, now available in BigQuery and Cloud Logging - Pipe syntax is a new feature in BigQuery and Cloud Logging that makes SQL simpler, more concise, and more flexible. It supports the same underlying operators as standard SQL, with the same semantics and mostly the same syntax, but allows applying operators in any order, any number of times.
Cloud Dataflow Data Analytics Official Blog Oct. 21, 2024How Shopify improved consumer search intent with real-time ML - Shopify improved consumer search intent with real-time machine learning (ML) using embeddings, which translate textual and visual content into numerical vectors. These embeddings enable more accurate and context-aware search results. Shopify processes roughly 2,500 embeddings per second across image and text pipelines in near real time using Google Cloud's streaming analytics service Dataflow. This helps merchants boost sales and offer positive interactive experiences for consumers.
BigQuery Data Analytics Official Blog Oct. 21, 2024Get up to 100x query performance improvement with BigQuery history-based optimizations - BigQuery history-based optimizations, now generally available, can improve query performance by up to 100x. It uses statistical data from previous executions of similar queries to identify and apply additional improvements to the query execution. These optimizations are self-tuning and self-correcting, requiring no user intervention.
BigQuery Data Analytics Official Blog Streaming Oct. 14, 2024BigQuery tables for Apache Iceberg: optimized storage for the open lakehouse - BigQuery tables for Apache Iceberg, a fully managed, Apache Iceberg-compatible storage engine from BigQuery, offer optimized storage for the open lakehouse. It provides features like autonomous storage optimizations, clustering, and high-throughput streaming ingestion.
BigQuery Cloud Bigtable Data Analytics Databases Official Blog Oct. 14, 2024Building a real-time analytics platform using BigQuery and Bigtable - BigQuery and Bigtable are two powerful Google Cloud services that can be used together to build real-time analytics platforms. By using Reverse ETL (Extract, Transform, Load) between BigQuery and Bigtable, you can bridge the gap between analytics and operational systems and get the best of both worlds: the high performance of Bigtable and the powerful analytics capabilities of BigQuery.
BigQuery Cloud Spanner Data Analytics Databases Official Blog Oct. 14, 2024Better together: BigQuery and Spanner expand operational insights with external datasets - Spanner external datasets for BigQuery allow analysts to connect Spanner schema to BigQuery datasets, enabling them to explore and query Spanner tables as if they were native BigQuery tables.
BigQuery Data Analytics Official Blog Streaming Oct. 14, 2024Using BigQuery Omni to reduce log ingestion and analysis costs in a multi-cloud environment - BigQuery Omni helps reduce the cost of log analytics in multi-cloud environments by eliminating the need for Apache Spark workloads and providing a unified querying process across cloud providers. It offers reduced engineering and compute resources, as well as lower egress costs.
Apache Flink Data Analytics Official Blog Streaming Oct. 14, 2024Real-time data for real-world AI with support for Apache Flink in BigQuery - BigQuery Engine for Apache Flink, now in preview, provides a serverless real-time intelligence platform. It allows users to easily migrate existing streaming applications relying on Apache Flink to Google Cloud without code rewriting or third-party services.
Apache Kafka Data Analytics Official Blog Oct. 14, 2024Accelerate AI production with data agents and BigQuery platform enhancements - Google Cloud introduces new capabilities to connect all your data to AI, making data accessible, actionable, and transformative for enterprises. With a data cloud based on open standards, you can now ingest, configure, tune, scale, monitor, and upgrade real-time workloads with new managed services for Flink and Kafka.
Analytics Hub BigQuery Data Analytics GCP Experience Official Blog Oct. 14, 2024How Virgin Media O2 simplified internal data sharing with BigQuery’s Analytics Hub - Virgin Media O2, a media and telecommunications company, faced challenges in sharing data across departments, leading to inefficiencies and slow decision-making. They implemented Google Cloud's BigQuery Analytics Hub to streamline internal data sharing, enabling real-time access, improved data management, and reduced manual effort.
BigQuery Data Analytics Official Blog Oct. 14, 2024New BigQuery capabilities for data and AI governance - Dataplex provides unified governance for data and AI assets in the cloud, enabling automated discovery, curation, and management at scale. With new features such as automated cataloging, enhanced lineage tracking, intelligent search, AI-powered data insights, and governance rules, Dataplex empowers organizations to navigate the complexities of data in the era of generative AI and unlock its full potential for innovation and transformation.
Data Analytics GCP Experience Official Blog Oct. 14, 2024From products to process: Delivering personalization at scale with data at EE - EE, a leading UK mobile network, transformed its customer experience by leveraging Google Cloud's data and machine learning capabilities. Through its Household360 initiative, EE captures and analyzes customer data to deliver personalized offers, enhance communication, and reduce marketing fatigue.
BigQuery Cloud Logging Data Analytics Official Blog Oct. 14, 2024Write better log queries, faster: Introducing pipe syntax in BigQuery and Cloud Logging - BigQuery and Cloud Logging introduce new features to revolutionize log management and analysis. BigQuery's pipe syntax simplifies SQL for log data, enabling intuitive data transformations and faster insights.
Data Analytics Official Blog Partners Oct. 14, 2024Generating synthetic data with BigQuery and Gretel - Create synthetic data with Gretel in BigQuery. Generate privacy-preserving synthetic versions of your BigQuery datasets directly within your existing workflows using the Gretel SDK. Protect data privacy, enhance data accessibility, and accelerate testing and development. Unlock the full potential of your data while mitigating privacy risks, improving data accessibility, and accelerating innovation.
Cortex Framework Data Analytics Official Blog Partners Oct. 14, 2024Integrate Oracle EBS insights faster with Google Cloud Cortex Framework - Google Cloud Cortex Framework now supports Oracle EBS, making it easier to integrate Oracle EBS operational data with other enterprise information into a single, scalable data foundation in BigQuery.
Cloud Dataflow Data Analytics Official Blog Streaming Oct. 7, 2024Mastering Dataflow: 5 In-Depth Guides to Real-World Applications - Google Cloud's Dataflow offers a range of solutions for real-time data processing. These include machine learning and generative AI, ETL and integration, log replication and analytics, marketing intelligence, and clickstream analytics. Each solution guide provides an overview, detailed sketch, and link to a comprehensive guide with code samples and best practices. With Dataflow's scalability, flexibility, and reliability, developers can build real-time solutions efficiently.
Data Analytics Looker Official Blog Sept. 30, 2024Winners of the 2024 Looker Hackathon (Vertex AI Edition) - The 2024 Looker Hackathon (Vertex AI Edition) invited developers and data communities to collaborate and create AI-driven applications, tools, and data experiences using Looker, Looker Studio, and Vertex AI. Over 160 participants from 34 countries participated, resulting in 20 innovative hacks.
BigQuery Data Analytics Official Blog Sept. 30, 2024BigQuery vector search now GA, setting the stage for a new class of AI-powered analytics - BigQuery vector search integrates generation, management, and search of embeddings within the data platform, providing a serverless and integrated vector-analytics solution for various use cases.
Data Analytics Gemini Looker Official Blog Sept. 30, 2024AI-powered visualization and LookML assistants debut for Gemini in Looker - Gemini in Looker, a business intelligence tool, introduces two new AI-powered features: LookML Assistant and Visualization Assistant. LookML Assistant simplifies LookML code creation, while Visualization Assistant allows users to customize visualizations using natural language. These innovations enhance data analysis and collaboration within organizations.
Data Analytics Looker Official Blog Workspace Sept. 30, 2024Empower data-driven insights with new Google Workspace Analytics Block for Looker - Google Workspace Analytics Block is now available in the Looker Marketplace. It offers pre-built metrics for Workspace administrators to create dashboards that capture valuable business and user productivity metrics.
Data Analytics Official Blog Sept. 30, 2024BigQuery jobs explorer: Your central hub for monitoring and troubleshooting BigQuery jobs - BigQuery jobs explorer, now generally available, provides a central hub for monitoring and troubleshooting BigQuery jobs. With real-time monitoring, powerful filtering, and actionable insights, jobs explorer empowers users to identify performance bottlenecks, control costs, and maintain a healthy and performant BigQuery environment.
BigQuery Data Analytics Data Science Paywall Sept. 30, 2024Checking Differences Between Two Tables in BigQuery SQL: A Step-by-Step Guide - The easiest method to detect changes and discrepancies.
Airflow Cloud Composer Data Analytics Official Blog Sept. 23, 2024Apache Airflow ETL in Google Cloud - Apache Airflow is a popular choice for running complex tasks like ETL or data analytics pipelines. There are three different ways to run Apache Airflow on Google Cloud: Compute Engine, GKE Autopilot, and Cloud Composer. Each approach has its own advantages and disadvantages in terms of cost, performance, and availability.
BigQuery BigQueryML Data Analytics Official Blog Sept. 23, 2024Find key insights with contribution analysis in BigQuery ML - Contribution analysis in BigQuery ML helps organizations find insights and patterns in their data by identifying combinations of contributors that cause unanticipated changes. It supports both summable metrics (e.g., revenue) and summable ratio metrics (e.g., earnings per share). The model uses pruning optimizations to reduce the search space and quickly find relevant segments.
Data Analytics Official Blog Partners Vertex AI Sept. 23, 2024Unleashing the Power of AI: Automating SQL Query Generation and Real-Time Data Streaming with Confluent and Google Cloud - This blog post explores how to integrate large language models (LLMs) with Confluent and Google Cloud Vertex AI to create a powerful, end-to-end solution for real-time data processing and insights.
Data Analytics Gemini Looker Official Blog Sept. 23, 2024Chat with your business data - Conversational Analytics comes to Gemini in Looker - Conversational Analytics, a new feature in Looker, allows users to ask questions of their data in natural language and receive insights powered by AI. It connects to BigQuery and Google Sheets, enabling users to directly ask questions of their data stored in these locations.
BigQuery Data Analytics Official Blog Sept. 16, 2024Experimenting with BigQuery data compression - This blog post explores factors that influence compression ratios in BigQuery, including record reordering, dictionary usage, string sorting, and comparisons with other file formats.
Data Analytics Security Sept. 16, 2024Using VPC Service Controls to isolate data analytics use cases in Google Cloud - Pushing the limits of VPC Service Controls to implement complex data access requirements.
Billing Cloud Dataflow Data Analytics Official Blog Streaming Sept. 9, 2024Cut costs and boost efficiency with Dataflow's new custom source reads - Dataflow's new custom source reads feature helps cut costs and boost efficiency in streaming environments by better distributing workloads and proactively relieving overwhelmed workers with load balancing.
BigQuery Data Analytics Generative AI LLM Official Blog Partners Sept. 9, 2024BigQuery and Anthropic’s Claude: A powerful combination for data-driven insights - Google Cloud has integrated Anthropic's Claude models with BigQuery, allowing organizations to leverage advanced AI capabilities directly within their data platform. This integration enables tasks like text generation, summarization, translation, and more, to be performed directly on data in BigQuery.
BigQuery Data Analytics Gemini Official Blog Sept. 2, 2024Get started with the new generally available features of Gemini in BigQuery - Gemini in BigQuery, now generally available, brings AI-powered experiences to enhance data discovery, preparation, analysis, and insight generation. Features include SQL and Python code generation with natural language prompts, explanations for complex queries, a data canvas for intuitive exploration, data insights with pre-validated queries, and recommendations for partitioning and clustering to optimize performance.
Data Analytics Looker Official Blog Sept. 2, 2024Grounding Analytical AI Agents with Looker’s Trusted Metrics - Bytecode, a Google Cloud partner, explains how to integrate Looker's trusted metrics with analytical AI agents to provide fast and reliable insights for AI-powered Business Intelligence. By combining large language models with Looker's semantic layer, businesses can quickly fine-tune and ground their analytical agents in their business truths, enabling end users to access trusted insights easily.
Data Analytics Official Blog Sept. 2, 2024The modern marketer’s strategic advantage: AI-powered data clean rooms - AI-powered data clean rooms offer a secure environment for sharing, collaborating, and analyzing sensitive data without compromising privacy. They enable modern marketers to unlock valuable insights from collaborative data analysis across various industries, driving strategic decision-making and business growth.
Data Analytics GCP Experience Official Blog Aug. 26, 2024At Box.Inc, Dataplex brings data governance and observability to its data platform - Box.Inc, a global leader in Cloud Content Management, adopted Google Cloud Dataplex to enhance data governance, discovery, and observability. Dataplex serves as a central data catalog, providing streamlined data discovery, comprehensive data observability, and strengthened security posture. By leveraging Dataplex, Box.Inc transformed its data platform into a secure, efficient, and scalable data ecosystem, empowering teams to unlock the full potential of data and drive continued growth and innovation.
Airflow Cloud Composer Data Analytics Official Blog Streaming Aug. 26, 2024Scalable alerting for Apache Airflow to improve data orchestration reliability and performance - This guide reviews the hierarchy of alerting on Cloud Composer and various alerting options available to Google Cloud engineers using Cloud Composer and Apache Airflow.
Cloud Bigtable Data Analytics Databases Official Blog Aug. 26, 2024Distributed counting in Bigtable: why you need it, and how to get started - Bigtable, Google's NoSQL database, now offers powerful tools that simplify data aggregation and enhance analytics capabilities. By enabling calculations in the database at write-time, Bigtable saves time, reduces complexity, and provides instant access to critical insights. It offers aggregate types like SUM, MIN, MAX, and HyperLogLog (HLL) for approximate unique value counting.
BigQuery Data Analytics Official Blog Aug. 26, 2024Introducing ScaNN in BigQuery vector search for large query batches - BigQuery's new TreeAH vector index, based on Google's ScaNN algorithm, offers significant latency and cost reductions for large query batches compared to the previous IVF index.
Cloud Dataflow Data Analytics GCP Experience Official Blog Streaming Aug. 19, 2024Yahoo compares Dataflow vs. self-managed Apache Flink for two streaming use-cases - Yahoo compared the cost and performance of Apache Flink in a self-managed environment and Google Cloud Dataflow for two streaming use cases: writing Avro to Parquet and data enrichment and calculation. Dataflow was found to be around 1.5 - 2 times more cost-effective than Flink, primarily due to the Streaming Engine's ability to handle heavy computations, resulting in fewer required vCPUs and more consistent throughput.
Data Analytics Official Blog Streaming Aug. 19, 2024Try the new Managed Service for Apache Kafka and take cluster management off your todo list - Google Cloud has launched a new Managed Service for Apache Kafka, which simplifies the process of running an Apache Kafka cluster. The service takes care of infrastructure management, security, networking, and scaling, allowing users to focus on building and running their applications. It offers built-in security features, automated network design, and flexible sizing options.
Data Analytics Looker Official Blog Aug. 19, 2024Looker opens semantic layer via new SQL Interface and connectors for Tableau & others - Looker, a business intelligence platform, introduces new BI connectors, including a custom-built connector for Tableau, and an Open SQL Interface for easier integration with SQL-based tools.
Airflow Cloud Composer Data Analytics Official Blog Streaming Aug. 12, 2024Announcing Apache Airflow operators for Google generative AI - Apache Airflow now has operators to interact with Vertex AI's generative models. These operators enable the integration of Vertex AI's generative models into data pipelines orchestrated by Apache Airflow and Cloud Composer.
BigQuery Data Analytics Official Blog Streaming Aug. 12, 2024Real-time in no time: Introducing BigQuery continuous queries for up-to-the-minute insights - BigQuery continuous queries, now available in preview, enables real-time data analysis and event-driven processing using SQL. It simplifies real-time pipelines, unlocks AI use cases, streamlines reverse ETL, and provides scalability and performance. With BigQuery continuous queries, businesses can gain real-time insights, make informed decisions, and deliver exceptional customer experiences.
Cloud Bigtable Data Analytics Databases Official Blog Aug. 5, 2024Bigtable transforms the developer experience with SQL support - Bigtable, a fast and flexible NoSQL database used by Google services like Search and YouTube, now supports GoogleSQL, an ANSI-compliant SQL dialect. With over 100 SQL functions at launch, Bigtable SQL support makes it easier to analyze and process large amounts of data directly within Bigtable, unlocking its potential for a wider range of use cases. Key use cases include NoSQL migrations, interactive and ever-changing data, low-latency lookup of non-uniform data, BigQuery serving layer, SQL-based time-series solutions, and write-time aggregates.
BigQuery Data Analytics Gemini Official Blog Aug. 5, 2024Google Cloud announces new data analytics innovations to help fuel customers’ AI use cases - New data analytics innovations include Gemini in BigQuery for AI-powered experiences, Gemini in Looker for conversational analytics, a unified data platform with support for open formats and streaming, and simplified data processing and streaming with Apache Spark and Apache Kafka.
AI BigQuery Data Analytics Gemini Official Blog Aug. 5, 2024Understanding new Gemini model inference, tuning, grounding and safety settings in BigQuery - BigQuery now supports the latest Gemini models, including Gemini 1.5 Pro and Gemini 1.5 Flash, enabling users to analyze text, images, audio, and PDF files from a single model. Grounding with Google search and customizable safety settings ensure responsible AI responses, while support for Gemini 1.0 model tuning and evaluation allows further customization of AI capabilities.
Cloud SQL Data Analytics Databases Dataplex Official Blog Aug. 5, 2024Unlocking the power of your Cloud SQL data with Dataplex Catalog - Cloud SQL customers can now easily catalog their Cloud SQL data within Dataplex Catalog, Google Cloud’s next-generation data asset inventory platform. This integration provides a centralized repository for all Cloud SQL assets, allowing users to easily search, browse, and explore their Cloud SQL data.
Airflow Cloud Composer Data Analytics Official Blog Streaming July 29, 2024Understanding Airflow DAG and task concurrency on Google Cloud Composer - Airflow DAG and task concurrency are crucial for optimizing Cloud Composer performance. This guide provides comprehensive insights into concurrency settings across four levels: Composer environment, Airflow installation, DAG, and task. By understanding these settings, you can ensure efficient resource utilization, scalability, and fault tolerance in your data pipelines.
BigQuery Data Analytics GCP Experience Official Blog July 29, 2024Shiseido: building a data analysis platform using BigQuery for 80% cost savings - Shiseido, a leading beauty brand, built a data analysis platform using Google Cloud's BigQuery to achieve faster processing, reduced costs, and streamlined operations. By consolidating disparate servers and optimizing data processing, they achieved an 80% cost reduction and a 90% reduction in processing time.
Data Analytics Migration Official Blog July 29, 2024Get paid to migrate to a modern data platform with BigQuery and Dataproc incentives - Google Cloud introduces a Data Platform Migration incentives program to simplify and reduce the cost of migrating data warehouses and data lakes from on-premises and other clouds to Google Cloud. The program offers Google Cloud credits, implementation credits, and cloud egress credits to offset migration costs.
Data Analytics Databases Datastream Official Blog Streaming July 29, 2024Datastream’s SQL Server source is generally available - Datastream, a serverless change data capture (CDC) and replication service, now supports SQL Server as a source for replicating data to BigQuery, Cloud Storage, and other Google Cloud destinations. Key enhancements include change tables CDC, stream recovery, gcloud API and Terraform support, and server-side SSL/TLS encryption.
Data Analytics Gemini Looker Official Blog July 22, 2024AI-powered slide generation and formula assistant come to Gemini in Looker - Gemini in Looker, a business intelligence tool, introduces two new features: automated Google Slides generation and an AI-powered formula assistant. With Google Slides generation, users can create presentations with insightful chart summaries from Looker Studio Pro in seconds.
Cloud Bigtable Data Analytics Databases Infrastructure Official Blog July 22, 2024One database to rule them all with Bigtable hybrid transactional and analytical processing (HTAP) - Bigtable recently added distributed counters, request priorities, write flow control, and Data Boost features to make it easier to perform both OLAP and OLTP with a single database. These features can help you spread your batch jobs out over time with greater reliability and reduced operational management, use fewer resources, and avoid impacting your serving workload.
Data Analytics Dataplex Official Blog July 22, 2024Discover a brand new catalog experience in Dataplex, now generally available - Dataplex Catalog, Google Cloud's next-generation data asset inventory platform, provides a unified inventory for all your metadata, whether your resources are in Google Cloud or on-premises.
BigQuery Data Analytics Official Blog Partners July 22, 2024How BioCorteX uses BigQuery to help answer the question “Will this drug work?” - BioCorteX, a leading techbio company, uses Google Cloud's BigQuery to accelerate drug development by uncovering hidden interactions between bacteria, human physiology, diseases, and drugs. Their biology emulator, Carbon Mirror, built on the massive biology-based knowledge graph, Carbon Knowledge, stored in BigQuery, enables fast and accurate in-silico trials, reducing failure rates and increasing the chances of successful drug development.
BigQuery Data Analytics Official Blog July 15, 2024Get your BigQuery production sample, all self-serving - Google's self-service production sample data from BigQuery allows data scientists to access fresh samples of production data without manual intervention. It ensures data safety through policies and avoids accidental data exfiltration. The solution utilizes Cloud Scheduler, Cloud Pub/Sub, Cloud Storage, Cloud Functions, Secret Manager, and Cloud Monitoring.
Analytics Hub Cloud Pub/Sub Data Analytics Official Blog Streaming July 15, 2024Share your streaming data with Pub/Sub topics in Analytics Hub - Analytics Hub now supports sharing Pub/Sub topics, enabling organizations to curate, share, and monetize their streaming data assets. By leveraging Analytics Hub Exchanges and Listings, businesses can logically categorize and group sets of Pub/Sub topics and provision access at scale.
Cloud Dataproc Data Analytics Official Blog Streaming July 15, 2024Deployment patterns for Dataproc Metastore on Google Cloud - This blog post explores four DPMS deployment patterns: a single centralized multi-regional DPMS, centralized metadata federation with per-domain DPMS, decentralized metadata federation with per-domain DPMS, and ephemeral metadata federation. Each pattern has its own advantages and disadvantages, and the best choice for an organization will depend on its specific needs and requirements.
BigQuery Data Analytics Official Blog July 8, 2024Understanding BigQuery data canvas: how to easily transform data into insights with AI - BigQuery data canvas is a revolutionary data analytics tool that simplifies the entire data analysis journey — from data discovery and preparation to analysis, visualization, and collaboration — all in one place, all within BigQuery. With data canvas, users can explore, transform, and visualize their BigQuery data without leaving the environment where their data resides.
BigQuery Data Analytics Generative AI LLM Official Blog July 8, 2024Prompting best practices for BigQuery data canvas - Tips to increase Natural Language to SQL or Chart queries in Bigquery Data Canvas.
Cloud Data Fusion Data Analytics Official Blog July 8, 20243 ways to restrict access to your Cloud Data Fusion instance and pipelines - Cloud Data Fusion offers robust capabilities to minimize risks associated with unauthorized access or unintentional data modification. You can create a tailored and secure data environment that aligns with your organization's requirements by carefully designing roles and strategically leveraging namespaces.
Data Analytics Datastream Official Blog Streaming July 8, 2024Announcing new stream recovery capabilities for Datastream - Datastream stream recovery enables quick resumption of data replication with minimal to no data loss in scenarios like database failovers or network outages.
Batch Data Analytics July 8, 2024Real-World Nextflow on GCP - This post describes how to use Nextflow (a scientific workflow system) on Google Cloud Batch, including how to set up a Nextflow configuration file, use Google Batch features, and configure enterprise considerations.
BigQuery Data Analytics Official Blog Translation API July 1, 2024The new Tower of Babel? Using multilingual embeddings and vector search in BigQuery - A BigQuery solution for analyzing text in multiple languages is presented. It uses multilingual embeddings, vector index, and vector search to enable customers to search for products or business reviews in their preferred language and receive results in that same language. The solution also uses the Translation API to translate reviews from various languages into the language of the user's choice. This way, businesses can easily analyze and gain insights from reviews written in different languages, and users can access and understand reviews in their preferred language.
Data Analytics Gaming GCP Experience Official Blog July 1, 2024Square Enix’s journey of building an AI-driven Customer Data Platform - Square Enix, a Japanese video game and entertainment company, built a customer data platform (CDP) with Google Cloud to enhance its first-party data strategy. The CDP, called Single Gamer View (SGV), unifies all of Square Enix's databases, provides marketing automation, and feeds data back into marketing platforms to drive fan engagement. SGV has helped Square Enix increase player engagement, enhance marketing ROI measurement, and improve work efficiency.
Data Analytics Official Blog July 1, 2024Google is a Leader in the 2024 Gartner® Magic Quadrant for Analytics and Business Intelligence Platforms - Google has been named a Leader in the 2024 Gartner® Magic Quadrant for Analytics and Business Intelligence Platforms.
Data Analytics Python July 1, 2024Did Google Just Kill Streamlit? - Checking out Google’s Mesop Framework to see if it’s better than Streamlit.
Data Analytics July 1, 2024Unlocking Data Quality on Google Cloud Platform: Integrating Soda for Enhanced Data Integrity - Soda is a tool that enables Data Engineers, Data Scientists, and Data Analysts to test data for quality where and when they need to.
Data Analytics Datastream Official Blog Streaming June 24, 2024Simplify historical data tracking in BigQuery with Datastream's append-only CDC - Datastream's append-only mode simplifies change data capture by preserving every change as a new row in your target BigQuery table. It offers cost efficiency, improved data accuracy, and real-time insights. With append-only mode, businesses can maintain a historical record of changes, track data modifications, and gain deeper insights from their data.
Data Analytics Official Blog June 24, 2024Boost your log analysis with BigQuery vector search and LLMs - BigQuery vector search enables semantic similarity search in BigQuery. It can be used to analyze logs and asset metadata stored in BigQuery tables. For example, SRE or incident response teams can search for semantically similar logs to validate anomalies. These relevant search results can provide more complete context for large language models (LLMs) to identify relationships, patterns, and nuances. This can accelerate user workflows, from threat detection and investigation to network forensics, business insights, and application troubleshooting.
Data Analytics Official Blog June 24, 2024Google is a Leader in the 2024 Gartner® Magic Quadrant™ for Data Science and Machine Learning Platforms - Google has been recognized as a Leader in the 2024 Gartner® Magic Quadrant™ for Data Science and Machine Learning Platforms. The company's Vertex AI platform provides a unified AI experience for building, deploying, and managing any type of AI/ML model. Vertex AI offers a wide range of features, including pre-trained models, infrastructure, and tools for data governance and privacy.
BigQuery Data Analytics Official Blog June 17, 2024BigQuery community UDFs go global to simplify data transformations for everyone - BigQuery User Defined Functions (UDFs) are now available in all BigQuery regions. UDFs are custom functions you can create in BigQuery to handle specific tasks, and they work like built-in SQL functions but are tailored to your unique needs.
BigQuery Data Analytics Official Blog Partners June 17, 2024Build maps in the cloud with BigQuery DataFrames, Gemini, and CARTO - BigQuery DataFrames, a set of open-source libraries, provides the common pandas and scikit-learn APIs for processing massive geospatial datasets in the cloud. It allows data scientists to work within a single platform like Jupyter notebooks, avoiding data transfers between Python environments and databases. By integrating with pydeck-CARTO, BigQuery DataFrames enables the creation of interactive maps directly within the notebook environment, enhancing data exploration and analysis capabilities. This streamlined approach simplifies tasks such as data cleaning, aggregation, and preparation for machine learning, empowering users to extract valuable insights from geospatial data effortlessly.
BigQuery Data Analytics Generative AI Official Blog June 17, 2024Build your own generative AI chatbot directly from BigQuery - DataSageGen is a chatbot that can access and process information from various sources, including product documentation, blog posts, community knowledge, and product announcements. It uses advanced techniques like retrieval augmented generation (RAG) and BigQuery ML to understand the context of a query and deliver relevant and insightful responses. The chatbot is built on a secure and scalable architecture that ensures authorized access, efficient traffic management, and cost-effective resource utilization.
BigQuery Data Analytics LLM Official Blog June 17, 2024Exploring synthetic data generation with BigQuery DataFrames and LLMs - BigQuery DataFrames enables the generation of synthetic data directly within BigQuery, eliminating the need for third-party solutions or data movement. It integrates seamlessly with Vertex AI, allowing users to leverage advanced language models like Gemini to generate code that produces synthetic data based on specified schemas or existing table structures. This approach addresses data privacy concerns and accelerates AI development by providing a scalable and cost-efficient platform for synthetic data generation.
Data Analytics Official Blog June 10, 2024How to integrate Gemini and Sheets with BigQuery - Gemini, Google's advanced multimodal model, can now be integrated into Google Sheets, enabling users to enhance their productivity with AI-powered features like summarizing sheets and creating formulas. This integration can be achieved directly through Sheets using the urlFetchApp function, or through BigQuery, which serves as a broker between Apps Script and Gemini. With BigQuery, users can create menu items linked to Apps Script functions, allowing them to query Gemini with selected prompts and place the responses in designated columns. This integration empowers users to leverage Gemini's capabilities for various tasks and save time on custom assignments.
BigQuery Data Analytics GCP Experience Official Blog June 10, 2024Chugai Pharmaceutical: Accelerating drug discovery through AI, machine learning and data analysis - Chugai Pharmaceutical, a leading pharmaceutical company, is accelerating drug discovery through AI, machine learning, and data analysis. The company is leveraging BigQuery for data analysis and app development, and plans to expand the use of Google Cloud to its subsidiary Tech Kobo for mobile application development and mBaaS using Firebase.
Data Analytics GCP Experience Official Blog Partners June 10, 2024Helping marketers access data warehousing with Supermetrics Storage - Supermetrics Storage centralizes cross-channel marketing data in BigQuery, enabling faster and more efficient data access and analysis without the need for technical expertise. It offers data ownership, a single source of truth, faster report loading, and access to historical data for advanced analytics. Built with BigQuery, Supermetrics Storage provides speed, scale, and security, reducing the need for technical skills and allowing marketers to focus on impactful reporting.
BigQuery Data Analytics Gemini Official Blog June 10, 2024Hands on with Gemini models in BigQuery: Decoding sentiment in customer reviews - Gemini, Google's most advanced multimodal model, can be used in BigQuery for sentiment analysis of customer reviews. With ML.GENERATE_TEXT function, you can directly utilize powerful large language models from Vertex AI within your SQL queries to analyze text in a BigQuery table. This allows you to perform sophisticated text generation and analysis tasks on data stored in BigQuery without needing to move data or write complex code outside the BigQuery environment. You can also identify recurring themes in the reviews using techniques like topic modeling and keyword extraction.
Cloud Dataflow Data Analytics Official Blog Streaming June 10, 2024Boost developer productivity with new pipeline validation capabilities in Dataflow - Dataflow pipeline validation is now generally available. It performs dozens of checks to ensure that your batch or streaming job is error-free and can run successfully.
BigQuery Data Analytics Official Blog June 10, 2024Announcing BigQuery Encrypt and Decrypt function compatibility with Sensitive Data Protection - BigQuery now offers seamless integration with Sensitive Data Protection, supporting native SQL functions that enable interoperable deterministic encryption and decryption between BigQuery and Sensitive Data Protection. This integration simplifies the protection of sensitive data in various scenarios, including securing PII, healthcare records, and financial data, and facilitating secure data sharing with external parties. Enhanced performance optimizations leverage BigQuery's distributed architecture to accelerate token-based encryption and decryption tasks, significantly improving the overall performance of these operations.
AI Billing Data Analytics June 10, 2024How We Halved Our Data Pipeline Costs Using Applied AI - A digital marketing agency built a data pipeline using Google Cloud Platform to ingest data from various marketing APIs into BigQuery for analysis. To optimize processing costs, they applied a hill climbing algorithm with a logarithmic probability function to each job, finding the optimal chunk size for faster and cheaper processing. This resulted in a 50% reduction in processing costs within a month of deployment.
Cloud Dataproc Data Analytics Distributed Cloud Official Blog June 3, 2024Build a hybrid data processing footprint using Dataproc on Google Distributed Cloud - Dataproc on Google Distributed Cloud enables organizations to modernize their data lake infrastructure while maintaining regulatory compliance by processing sensitive on-prem data locally and moving the rest to the cloud. It supports full local execution of Spark jobs, allowing for aggregation and anonymization of sensitive data before uploading it to the data lake on the cloud. This hybrid data processing approach ensures data residency requirements are met while still enabling comprehensive data analysis and integration with Google Cloud Data Analytics services.
AWS Cloud Pub/Sub Data Analytics Official Blog Streaming June 3, 2024Easily stream data from AWS Kinesis to Google Cloud with Pub/Sub import topics - Pub/Sub import topics enable streaming ingestion into BigQuery from external sources, with the first supported external source being Amazon Kinesis Data Streams. Import topics provide a simplified way to ingest data from Amazon Kinesis Data Streams directly into Pub/Sub, reducing the complexity of setting up data pipelines between clouds. Once the connection is established, Amazon Kinesis producers can be gradually migrated to Pub/Sub publishers. Data from Amazon Kinesis Data Streams can be routed to BigQuery using BigQuery subscriptions, and Pub/Sub autoscales to adapt to changes in the Amazon Kinesis data stream.
Data Analytics Official Blog Partners May 27, 2024From data chaos to data clarity: How Tamr's Data Products leverage Google generative AI - Tamr's Data Products leverage Google's generative AI to deliver accurate entity resolution and golden record creation at scale. These turnkey solutions improve data quality using ML-based mastering models, data cleaning, and standardization services. With Google's Gemini model, Tamr can extract structured data from text fields and perform flexible classification tasks without complex ETL pipelines or extensive ML model development. This partnership simplifies data management, accelerates time-to-value, and enhances data-driven insights for businesses.
BigQuery Data Analytics Official Blog May 27, 2024Achieve higher performance and lower query cost for BigQuery integer or timestamp lookups - BigQuery numeric search indexes enable optimized lookups on INT64 and TIMESTAMP data types, improving performance and reducing query costs for account IDs, transaction IDs, and log timestamps.
Data Analytics GCP Experience Official Blog Partners May 27, 2024UPS leverages BigQuery and Striim for AI-secured package delivery - UPS Capital leverages Google’s Data Cloud and AI technologies to safeguard packages from porch piracy. UPS Capital’s customers have reduced losses by 35% with DeliveryDefense by redirecting shipments to a safer location or adding an adult signature in response to alerts about high-risk deliveries.
Cloud Dataflow Data Analytics Official Blog Streaming May 27, 2024More flexibility for your Dataflow jobs with new controls for latency versus cost - Dataflow Streaming Engine users can now choose between lower peak latency or lower streaming costs for their workloads by adjusting the autoscaling utilization hint value. The autoscaling hint value can be set to a higher or lower value using a Dataflow service option. Dataflow’s autoscaling UI provides insights on when it’s worth adjusting the autoscaling behavior and additional dashboards and metrics to monitor the impact of changes.
Data Analytics Official Blog Streaming May 27, 2024Google Data Cloud innovations for continuous real-time intelligence - Google Cloud offers innovations for continuous real-time intelligence, enabling organizations to harness real-time analytics and make informed decisions. With Dataflow, BigQuery, and Apache Kafka for BigQuery, enterprises can leverage streaming infrastructure for visibility, predictions, and activation. Customers like Spotify, Puma, Compass, and Tyson Foods have achieved significant business impact using Google Cloud's data, AI, and real-time solutions.
BigQuery Data Analytics LLM Official Blog May 27, 2024Unlocking enhanced LLM capabilities with RAG in BigQuery - Now you can build smarter AI applications from right inside your data warehouse.
Data Analytics May 27, 2024How I became Google Cloud Champion Innovator in less than 1 year - Is a Google Cloud Champion Title in Your Reach? One-Year Journey Shows You How.
Data Analytics Official Blog May 6, 2024Google Cloud named a leader in the 2024 Forrester Wave™: Data Lakehouses
BigQuery Data Analytics GCP Experience April 29, 2024Transforming Data Management: Leveraging GCP Serverless Solutions at a Chilean NGO - Developing a Customer Data Platform on GCP for NGO.
BigQuery Data Analytics April 29, 2024What’s new in data? My reflection on Google Cloud Next ‘24 - A look at Google Next 2024.
Data Analytics Official Blog April 15, 2024What’s next for data analytics at Google Cloud Next ’24
BigQuery Data Analytics Official Blog April 15, 2024Get to know BigQuery data canvas: an AI-centric experience to reimagine data analytics
Data Analytics GCP Experience Official Blog March 11, 2024Dividends from data: Building a lean data stack for a Series C Fintech - PrimaryBid is a regulated capital markets technology platform connecting public companies to their communities during fundraisings, in this article they described their data stack.
AI AlloyDB Cloud Spanner Cloud SQL Data Analytics Machine Learning Official Blog March 4, 2024Google Cloud databases stand ready to power your gen AI apps with new capabilities - Recent AI improvements for GCP databases.
BigQuery Data Analytics Feb. 26, 2024I spent 4 hours figuring out how BigQuery executes the SQL query internally. Here’s what I found. - What happens after you submit the query?
BigQuery Data Analytics Official Blog Partners Feb. 5, 2024Automated fraud detection with Fivetran and BigQuery - The combination of Fivetran and BigQuery provides a simple design to a complex problem — an effective fraud detection solution capable of real-time, actionable alerts.
BigQuery Data Analytics Jan. 29, 2024How to break down your query costs in BigQuery - Using information schema in BigQuery to breakdown cost of the executed queries.
Data Analytics Official Blog Partners Jan. 8, 2024How to deploy data observability with Monte Carlo on Google Cloud
Data Analytics Python Jan. 8, 2024Building an end-to-end ETL pipeline with Spotify and Google Cloud Platform (Part 1) - A data pipeline from Spotify API to GCP.
BigQuery Data Analytics dbt Looker Dec. 11, 2023How Rittman Analytics Does Web Analytics and Marketing Attribution, using Google BigQuery, Looker, dbt and Segment - Creating a web performance dashboard that brings together key web performance metrics in one place.
Data Analytics Official Blog Dec. 11, 2023Accelerate data-driven growth with Google Cloud and Fivetran - This blog post explores how Google Cloud and Fivetran, a SaaS data integration platform, can help you centralize and analyze your marketing data in real time.
Cloud Dataflow Data Analytics Official Blog Dec. 11, 2023Google Cloud Is a Leader in the 2023 Forrester Wave: Streaming Data Platforms
CI Data Analytics dbt Nov. 27, 2023How to customize and serve DBT documentation in Google Cloud Platform - This article explores how to implement a Data Mesh architecture using DBT.
AI BigQuery Data Analytics Official Blog Nov. 6, 2023Data analytics in the age of AI: How we’ve enhanced our data platforms this year - In this blog, we will summarize the key innovations to our Data and AI Cloud in 2023 across three strategic areas.
Data Analytics GCP Experience Official Blog Partners Nov. 6, 2023How TEKsystems Global Services is helping retail brands break down data silos through platform modernization - A break down of what retail brands experience and how Google Cloud can help overcome these challenges.
Data Analytics Official Blog Partners Oct. 16, 2023Generate additional revenue streams with an enterprise data platform using Google Cloud - Pythian’s Google Cloud-based enterprise data platform provided the customer with demand modeling, better product recommendations, and anonymized data.
BigQuery Data Analytics Oct. 16, 2023Mage, BigQuery, and Bundled-Up Bike Trips - A brief end-to-end data project on Montreal year-round cycling.
Data Analytics Official Blog Security Oct. 9, 2023How Sensitive Data Protection can help secure generative AI workloads - Here’s a data-focused approach to protecting gen AI applications with Google Sensitive Data Protection, along with some real-life examples.
Data Analytics Google Kubernetes Engine Official Blog Oct. 2, 2023Data on Kubernetes has crossed the chasm: the case for running stateful apps on GKE - Today, Kubernetes is increasingly used to run stateful and data applications such as databases, big data, data analytics, and machine learning.
BigQuery Data Analytics Official Blog Oct. 2, 2023So long data silos: Announcing BigQuery Omni cross-cloud joins
Data Analytics Oct. 2, 2023Google Cloud Cortex Framework brings Packaged Analytics to the Modern Data Stack - Google Cloud Cortex Framework is a new packaged analytics initiative from Google Cloud Platform that provides pre-build data extractors, data transformations and interactive dashboards for SAP, Salesforce and a number of marketing and advertising data sources.
BigQuery Data Analytics Official Blog Partners Sept. 25, 2023How 'Anything is Possible' automated data pipelines with BigQuery and Windsor.ai
Data Analytics Official Blog Partners Sept. 25, 2023Built with BigQuery: Bloomreach Engagement brings power to marketers with advanced personalization - Bloomreach Engagement, an omnichannel marketing automation product, now integrates with BigQuery, providing hyper-personalized customer experiences.
Cloud Data Fusion Data Analytics GitHub Official Blog Sept. 25, 2023Use a GitHub repository to manage pipelines across Data Fusion instances/namespaces - Push deployed pipelines from namespace to repository, or pull and deploy pipelines from repository to namespace.
BigQuery Data Analytics Generative AI Official Blog Sept. 18, 2023Applying Generative AI to product design with BigQuery DataFrames - Generative AI is a powerful tool for accelerating the branding process for new products or compounds.
BigQuery Data Analytics GIS Official Blog Sept. 11, 2023Delivering greater insights for insurance underwriters with BigQuery geospatial analytics - CNA worked with Google Cloud and several third-party data vendors to develop a solution to address challenges with underwriting flood risk assessment.
Data Analytics Official Blog Sept. 4, 2023What’s new with Bigtable at Next ‘23? - Learn about the latest Bigtable capabilities. From HTAP, to new cost savings announcements, plus ways to integrate with Google Cloud and open-source.
Data Analytics Official Blog Sept. 4, 2023How supply chain organizations can use data and AI to drive efficiency and optimization - How supply chain organizations use Google’s Data and AI Cloud to drive efficiency and optimization.
AI BigQuery Data Analytics Official Blog Sept. 4, 2023Harnessing the power of PaLM in BigQuery - By integrating Vertex AI foundation models in BigQuery, you can analyze unstructured data from right inside BigQuery.
BigQuery Data Analytics Official Blog Sept. 4, 2023Announcing BigQuery Studio — a collaborative analytics workspace to accelerate data-to-AI workflows - BigQuery Studio lets analytics practitioners use SQL, Python, Spark or natural language directly within BigQuery, to streamline analytics workflows.
BigQuery Data Analytics Official Blog Sept. 4, 2023BigQuery data clean rooms now available in preview - BigQuery data clean rooms offer security and privacy controls to help teams conduct meaningful analyses while protecting the underlying data.
Data Analytics Official Blog Sept. 4, 2023Reimagine data analytics for the era of AI
Data Analytics Duet AI Official Blog Sept. 4, 2023Expanding Duet AI, an AI-powered collaborator, across Google Cloud - Google Cloud expanded Duet AI preview to include AI assistance capabilities across more products and services to serve cloud users of all types.
Data Analytics Official Blog Partners Aug. 28, 2023Supporting generative AI development with our data cloud partners - Google Cloud’s open, flexible partner ecosystem helps organizations innovate with generative AI.
Data Analytics Official Blog Partners Aug. 28, 2023Talk to the map: How CARTO is making GIS more conversational using BigQuery - Carto’s conversational GIS relies on BigQuery to provide information to generative AI, while BigQueryML connects to Vertex AI and PaLM2.
Data Analytics Official Blog Partners Sustainability Aug. 28, 2023Built with BigQuery: Sustainable supply chains start with a data sharing ecosystem - TraceMark’s sustainable sourcing monitoring platform provides transparency into global supply chains about the sourcing of raw materials.
Data Analytics Official Blog Partners Aug. 28, 2023Built with BigQuery: How Atlas AI helps build a more resilient future - Atlas AI ‘s geospatial artificial intelligence platform that helps organizations anticipate changing societal conditions to help them make investment decisions.
Data Analytics Official Blog Aug. 28, 202310 must-attend sessions for data professionals at Google Cloud Next ‘23 - Check out these breakout sessions for data professionals at Google Cloud Next ‘23.
Data Analytics Official Blog Aug. 21, 2023How one telecom giant increases advertising conversions and saves millions annually - Virgin Media O2 is improving conversions and saving millions of dollars thanks to personalized advertising powered by Google Cloud and Zeotap.
Data Analytics GCP Experience Official Blog Aug. 14, 2023How Asahi Group fostered a culture of innovation by building a data analysis platform - Through a data analysis platform built on Google Cloud, Asahi Group can accelerate its pace of innovation and improve how it uses data across the organization.
Data Analytics Official Blog July 31, 2023Streamlining ML development with Feast - Feast, which is integrated with Bigtable, ensures that ML models remain portable throughout the model development and deployment process.
Data Analytics Official Blog July 31, 2023Announcing Tecton on Google Cloud: Accelerate the development of ML-powered applications - Tecton on Google Cloud provides an easy and fast way to build, process, manage, and share ML features to power your ML applications.
Data Analytics Official Blog July 31, 2023Navigating Google Cloud: a decision tree for data & analytics workloads - Introducing a decision tree for data analytics that helps you select the best services in Google Cloud to match your unique workload needs.
Data Analytics Official Blog July 24, 2023Put your data to use across organizations with a Data Sharing and Analytics Platform - Working with a large UK Public Sector organization, we’re developing a large hybrid and multi-cloud data sharing and analysis capability.
BigQueryML Data Analytics Official Blog July 24, 2023How to use custom holidays for time-series forecasting in BigQuery ML - With custom holiday modeling features, BigQuery users can build more powerful and accurate time-series forecasting models using BigQuery ML.
Data Analytics Looker Official Blog July 24, 2023Access to Looker data models from Power BI now generally available - Power BI users can now access centrally defined metrics and data relationships from Looker’s semantic layer through Power BI Desktop.
BigQuery Data Analytics Official Blog July 17, 2023Join optimizations with BigQuery primary keys and foreign keys - Understand how unenforced Key Constraints can benefit queries in BigQuery.
Data Analytics GCP Experience Official Blog July 17, 2023How Bank Jago optimized its customer onboarding system with GPU time-sharing and spot instances - To enhance its customer onboarding process, Bank Jago implemented an OCR system on Google Cloud, tapping GPU time-sharing to drive higher performance.
Data Analytics Looker Official Blog July 3, 2023Making insights actionable with new Looker Studio scheduling capabilities - When scheduling a report, Looker Studio now lets you apply distinct filter conditions, and create and manage multiple schedules.
Data Analytics Official Blog July 3, 2023Google named a Leader in The Forrester Wave™: Cloud Data Warehouses, Q2 2023 - Forrester says Google’s Data and AI Cloud offers a unified analytics offering, an open data ecosystem, and built-in machine learning intelligence.
Data Analytics Looker Official Blog June 19, 2023Top hacks from Cloud BI Hackathon 2022 - Check out the top hacks from Cloud BI Hackathon 2022.
BigQuery Data Analytics GCP Experience Official Blog June 19, 2023Built with BigQuery: Quantum Metric unlocks data for frictionless customer experiences - Quantum Metric uses BigQuery to analyze vast amounts of data to drive customer-centric digital experiences.
Cloud Dataproc Data Analytics Official Blog June 19, 2023Statsig unlocks new features by migrating Spark to BigQuery - Migrating to BigQuery from Spark helped Statsig to develop new features for customers and help them run scalable experimentation programs.
Data Analytics Official Blog June 19, 2023Discover the benefits of cross-cloud geospatial analytics with BigQuery Omni - BigQuery Omni lets you do data analytics on data, including geospatial data, stored across public cloud environments.
BigQuery Data Analytics Official Blog June 12, 2023Improve query performance and optimize costs in BigQuery using the anti-pattern recognition tool - A new BigQuery anti-pattern recognition tool scans SQL queries to identify anti-patterns, and provides optimization recommendations.
Cloud Build Data Analytics Dataform Official Blog June 12, 2023Productionizing SQL-based workflows in Google Cloud - How to set up a repeatable and scalable ELT pipeline in Google Cloud using Dataform and Cloud Build.
AI Data Analytics Official Blog June 12, 2023Predict, personalize, and wow your customers with better analytics and AI - Learn how analytics and AI can provide a true 360 view of the customer and help create better financial services experiences.
BigQueryML Data Analytics Machine Learning Official Blog June 12, 2023Building ML workflows in BigQuery the easy way, without code - A flexible, automated analytic workflow tool that integrates with BigQueryML allows no-code forecasting and model training.
Data Analytics Dataform Official Blog June 12, 2023Announcing Dataform in GA: Develop, version control, and deploy SQL pipelines in BigQuery - Dataform, now GA, lets data engineers build SQL pipelines in BigQuery while following best practices like Git, CI/CD, and code lifecycle management.
BigQueryML Data Analytics Official Blog June 5, 2023Build an image data classification model with BigQuery ML - Step-by-step instructions for building an image classifier with ResNet, Cloud Storage and BQML.
AI BigQueryML Data Analytics Machine Learning Official Blog June 5, 2023How to simplify unstructured data analytics using BigQuery ML and Vertex AI - How BigQuery’s ML inference engine can be used to run inferences against unstructured data in BigQuery using Vertex AI pre-trained models.
Data Analytics Official Blog May 29, 2023Get more insights out of your Google Search data with BigQuery - Bulk data exports in the Google Search console let you export search data to BigQuery and run complex queries and create custom reports on it.
Data Analytics NoSQL Official Blog May 29, 2023Streaming graph data with Confluent Cloud and Neo4j on Google Cloud - Enrich your graph data on Google Cloud and keep it up to date in real time using Confluent Cloud and Neo4j.
BigQuery Data Analytics Official Blog May 29, 2023Introducing partitioning and clustering recommendations for optimizing BigQuery usage - The BigQuery partitioning and clustering recommender analyzes workloads and tables and identifies potential cost-optimization opportunities.
BigQuery Data Analytics Official Blog May 29, 2023Transform your unstructured data with AI using BigQuery object tables, now GA - BigQuery object tables offer a structured record interface for unstructured data, so you can process and manage it securely and programmatically.
Data Analytics Official Blog May 22, 2023Faster together: How Dun & Bradstreet datasets accelerate your real-time insights - Much of Dun & Bradstreet’s catalog is on Analytics Hub and the Google Cloud Marketplace, for simplified procurement and consolidated billing.
Cloud Dataflow Data Analytics Official Blog May 22, 2023Introducing Dataflow Cookbook: Practical solutions to common data processing problems - The new Dataflow Cookbook covers common data processing topics like windowing and triggers, and advanced pipeline patterns.
BigQuery Data Analytics May 22, 2023Unlocking Efficiency and Flexibility: Clone Tables in BigQuery - This article explores the benefits, use cases, and best practices of using clone tables in BigQuery.
Data Analytics Looker Official Blog May 15, 2023Looker now available from Google Cloud console - Creating a Looker (Google Cloud core) instance from the Cloud console makes it easy to test the business intelligence solution in your environment.
BigQuery Data Analytics Official Blog May 15, 2023Introducing BigQuery differential privacy and partnership with Tumult Labs - In partnership with Tumult Labs, BigQuery differential privacy can help to anonymize data, and will integrate with BigQuery data clean rooms.
Data Analytics Official Blog May 15, 20235 steps to automating and streamlining your regulatory reporting - More efficient regulatory reporting is just 5 steps away. Read our latest infographic to learn how financial institutions can scale for the future.
Data Analytics Official Blog May 15, 2023Your new regulatory reporting mantra: simple, fast, and repeatable - See how Google Cloud can help financial services firms automate and streamline their regulatory reporting processes.
Data Analytics Official Blog May 8, 2023All data cloud, all the time: Recapping the Google Data Cloud & AI Summit - This year’s Google Data Cloud & AI Summit featured new product announcements, customer stories, and countless learning opportunities.
BigQuery Data Analytics Official Blog May 8, 2023Jumpstart Your BigQuery Remote Function development today - Use remote functions to handle DLP, unstructured data analysis and security or compliance constraints inside your BigQuery dataset.
Data Analytics Official Blog May 8, 2023Meet our Data Champions: Credit Karma’s Scott Wong on doing 60 billion model predictions per day - Credit Karma uses Google services like Cloud Bigtable and BigQuery to power financial recommendations for nearly 130 million members.
Cloud Run Data Analytics GCP Experience Official Blog Serverless May 8, 2023BBC: Keeping up with a busy news day with an end-to-end serverless architecture - The BBC built its log-processing infrastructure on Google Cloud serverless tools including Cloud Run and BigQuery.
Data Analytics Official Blog May 1, 2023Built with BigQuery: BigCommerce teams up with Tech Partners to make gathering, analyzing and acting on retail data easy - BigCommerce has teamed up with BigQuery to create a native integration to its ecommerce platform that makes data analysis easier than ever.
BigQuery Data Analytics Official Blog May 1, 2023Introducing BigQuery Partner Center — a new way to discover and leverage integrated partner solutions - BigQuery Partner Center lets customers easily discover and try out a diverse range of validated partner solutions from the Cloud Console directly.
Data Analytics Dataplex GCP Experience Official Blog April 24, 2023How a green energy provider used Dataplex for its data governance and quality
BigQuery Billing Data Analytics Official Blog April 24, 2023Track your cloud costs with BigQuery for easy analysis - With Billing export to Cloud Storage going away, you can easily track costs using BigQuery direct reporting.
BigQuery Data Analytics GCP Experience Official Blog April 24, 2023Built with BigQuery: How Mercari US turned BigQuery into an ML-powered customer-growth machine
Data Analytics Official Blog April 24, 2023Google named a Leader in the 2023 Forrester Wave: Data Management for Analytics
Data Analytics Official Blog Serverless Spark April 17, 2023Best practices of orchestrating Notebooks on Serverless Spark - Shift your notebook workloads to Spark and enjoy automated scaling, easier version tracking and automated logging.
Data Analytics Official Blog April 17, 2023Announcing the public preview of BigQuery change data capture (CDC) - BigQuery change data capture lets you replicate, insert, update, and/or delete changes from source systems without DML MERGE-based ETL pipelines.
Data Analytics Dataplex Official Blog April 10, 2023How Dataplex can improve data auditing, security, and access management - Data is one of the most important assets of any enterprise. Here’s how you can use Google Cloud’s Dataplex to improve data auditing, security, and access management.
Data Analytics Official Blog April 10, 2023Unify your data assets with an open analytics lakehouse - An analytics lakehouse on Google Cloud is designed to address the data needs for all users including data analysts, data engineers, and data scientists.
Cloud Dataflow Data Analytics Official Blog April 10, 2023Introducing vertical autoscaling for batch Dataflow Prime jobs - The new vertical autoscaling feature reduces the incidence of out-of-memory (OOM) errors in Dataflow Prime jobs.
Data Analytics Official Blog SAP April 10, 2023Accelerate Inventory Management insights with Google Cloud Cortex Framework - Now, you can leverage Cortex for Supply Chain operational reporting on inventory management.
Data Analytics Official Blog SAP April 10, 2023Accelerate Procure-to-Pay insights with Google Cloud Cortex Framework - Leverage Cortex Framework to accelerate Procure-to-Pay operational reporting on vendor performance, spend analysis and accounts payable.
BigQuery Data Analytics Official Blog April 10, 2023Bring analytics to your data: What’s new with BigQuery federated queries - BigQuery federated queries gets SQL pushdown, private IP access, priority queues for Spanner federation, and Spanner-to-BigQuery JSON type mapping.
Data Analytics GCP Experience Official Blog April 10, 2023Why next-gen analytics needs comprehensive data quality monitoring with Anomalo - How Anomalo, a Google Cloud Ready - BigQuery partner, helps solve the need for deep data observability in Google BigQuery.
BigQuery Billing Data Analytics Visualization April 10, 2023How to Monitor BigQuery Usage and Costs on GCP with Interactive Visualizations in Looker Studio - Five visualizations that provide comprehensive insights into BigQuery usage and costs.
Data Analytics Looker Official Blog April 3, 2023Introducing Looker Modeler: a single source of truth for BI metrics - By defining metrics and storing them in Looker Modeler, users can consume metrics based on fresh data across popular BI tools and cloud databases.
BigQuery Data Analytics Official Blog April 3, 2023Secure and privacy-centric sharing with data clean rooms in BigQuery - BigQuery data clean rooms can help organizations create and manage secure environments for privacy-centric data sharing, analysis, and collaboration.
AI Data Analytics Machine Learning Official Blog April 3, 2023Solving for the next era of innovation and efficiency with data and AI - Announcing new products to help optimize price-performance, embrace open ecosystems, securely set data standards, and add AI and ML to existing data.
BigQuery Billing Data Analytics Official Blog April 3, 2023New BigQuery editions: flexibility and predictability for your data cloud - New BigQuery pricing editions and autoscaling let you choose the right price-performance for your workloads, and pay for only what you use.
Data Analytics Official Blog April 3, 2023Accelerate time to value with Google’s Data Cloud for your industry - Learn the latest data solutions and frameworks for building a modern data cloud for your industry with Google’s Data Cloud.
Data Analytics Official Blog March 27, 2023Effective strategies to closing the data-value gap - Learn how to maximize the ROI from your data and AI investments with data strategy, models, tools, technology and talent best practices.
Data Analytics Official Blog March 27, 2023Meet our Data Champions: Jan Riehle, at the intersection of beauty and data with Beauty for All (B4A) - How Brazil’s B4A uses Google Cloud to bring a data-driven mind to “beauty-tech” innovation.
Data Analytics Official Blog PubSub March 27, 2023Pub/Sub schema evolution is now GA - With the GA launch of Cloud Pub/Sub’s schema evolution feature, Pub/Sub now supports safe and convenient modifications to Pub/Sub schemas.
Data Analytics Event Official Blog March 27, 2023Solving for what’s next in Data and AI at this year’s Gartner Data & Analytics Summit - We’re gearing up for the 2023 Gartner Data & Analytics Summit March 20 - 22nd in Orlando, Florida to highlight our unified and intelligent Data Cloud.
BigQuery Data Analytics Official Blog March 20, 2023BigQuery under the hood: Behind the serverless storage and query optimizations that supercharge performance - BigQuery’s serverless architecture features storage and query optimizations that deliver transformational data analytics performance.
Data Analytics GCP Experience Official Blog March 20, 2023Coop reduces food waste by forecasting with Google’s AI and Data Cloud - Coop ingested data from SAP systems to BigQuery, and used Vertex AI Forecast to train ML forecasting models to optimize its fresh produce stock.
Data Analytics Dataplex Official Blog March 20, 2023Understand and trust data with Dataplex data lineage - Track data movement across your organization using Dataplex data lineage, which is now generally available.
BigQuery Data Analytics Official Blog March 20, 2023Built with BigQuery: How Sift delivers fraud detection workflow backtesting at scale - How Sift Delivers Fraud Detection Workflow Backtesting at Scale powered by BigQuery.
Data Analytics Looker Official Blog March 20, 2023Sumitovant more than doubles its research output in its quest to save lives - Sumitovant chose Looker to quickly build and scale flexible queries on massive data sets and integrate with more data sources via API.
BigQuery Cloud Run Data Analytics Python March 20, 2023A data engineering project with Prefect, Docker, Terraform, Google CloudRun, BigQuery and Streamlit - Orchestrate data pipelines to find late buses in real-time — from raw data to live data visualisation.
Data Analytics Google Kubernetes Engine Official Blog March 13, 2023Game on and on and on: Google Cloud's strategy for live service games - With Google Cloud for Games, we’re bringing Google scale and analytics to the developers creating live service games for players around the world.
Data Analytics NoSQL Official Blog March 13, 2023Enriching Knowledge Graphs in Neo4j with Google Enterprise Knowledge Graph - Neo4j delivers a graph data platform. Google Enterprise Knowledge Graph is a knowledge store. Learn how they differ from and complement one another.
Cloud Bigtable Data Analytics Official Blog March 13, 2023At Box, a game plan for migrating critical storage services from HBase to Cloud Bigtable - Migrating to Cloud Bigtable from Apache HBase had clear benefits for Box. This highlights a game plan for migrating critical storage services to Bigtable.
BigQuery Data Analytics GIS Official Blog March 6, 2023Unlocking Retail Location Data with CARTO and BigQuery - Retail companies can easily visualize and analyze their geospatial data in BigQuery using the CARTO platform.
BigQuery Data Analytics Official Blog March 6, 2023Built with BigQuery and Google AI: How Glean enhances enterprise search quality and relevance for teams - Elements of the Google Data Cloud including BigQuery, DataFlow, and Vertex AI are behind Glean’s personalized enterprise search platform.
BigQuery Data Analytics Official Blog March 6, 2023Shorten the path to insights with Aiven for Apache Kafka and Google BigQuery - Unify data from diverse sources and formats using Aiven Kafka's open source streaming. Analyze with BigQuery for swift, accurate insights.
Data Analytics Official Blog March 6, 2023Introducing Telecom Subscriber Insights: Helping CSPs grow business with AI-driven digitization and personalization - Telecom Subscriber Insights helps CSPs accelerate subscriber growth with insights from a variety of data sources, in order to better engage customers.
Data Analytics Official Blog Serverless Feb. 27, 2023Getting started with Terraform and Datastream: Replicating Postgres data to BigQuery - Datastream, a serverless database replication service, has integrated with Terraform to enhance app modernization, data analytics and ML pipelines.
BigQuery Cloud Pub/Sub Cloud Run Data Analytics Official Blog Feb. 27, 2023Building streaming data pipelines on Google Cloud - This article reviews three approaches to building a streaming data pipeline on Google Cloud, using Pub/Sub and BigQuery.
Data Analytics Official Blog Feb. 27, 2023The top five global data and AI trends in 2023 - Refresh your data strategy with the top 5 data and AI trends for 2023, as seen by Google experts and research from IDC.
Data Analytics Official Blog Feb. 27, 2023The Denodo Platform meets BigQuery - How Denodo Platform’s data integration and data management capabilities work seamlessly with BigQuery.
BigQuery Data Analytics Machine Learning Official Blog Serverless Feb. 20, 2023Building your own private knowledge graph on Google Cloud - Building a private knowledge graph using the Enterprise Knowledge Graph and querying entities in the Google Knowledge Graph Search API.
Book Data Analytics Official Blog Feb. 20, 20238 ways to cut costs and drive profits using data and AI - Google Cloud’s new ebook, “Make Data Work for You,” distills the strategies and actions you can use to pare costs, increase profitability, and monetize your data.
Data Analytics Official Blog Feb. 20, 2023Optimizing the retail experience and developing customer loyalty with advanced analytics - Canadian Tire uses BigQuery and Quantum Metric to power a massive and successful loyalty program.
BigQuery Data Analytics GCP Experience Official Blog Feb. 20, 2023Built with BigQuery: Aible's serverless journey to challenge the cost vs. performance paradigm - Built with BigQuery: Aible's Serverless Journey to challenge the Cost vs. Performance Paradigm.
Data Analytics Official Blog Feb. 20, 2023Meet our Data Champions: Emily Bobis, driving road intelligence in Australia - Join Emily Bobis from Compass IoT, an Australian road intelligence company, as she shares her career journey, lessons, and advice to Data/AI leaders.
BigQuery Data Analytics Official Blog Feb. 20, 2023Built with BigQuery: How BigQuery helps Leverege deliver business-critical enterprise IoT solutions at scale - Leverege uses BigQuery as a key component of its data and analytics pipeline to deliver innovative IoT solutions at scale.
Data Analytics Looker Official Blog Feb. 20, 2023Connected Sheets for Looker is now generally available - Connected Sheets for Looker allows you to access centrally defined metrics and data relationships from Looker’s semantic layer through Google Sheets.
Data Analytics Official Blog Feb. 20, 2023Meet our Data Champions: Di Mayze, calling creative brains to draw stories from data - Join Di Mayze, Global Head of Data & AI at WPP, creative transformation company, as she shares her career journey, lessons, and advice to Data/AI leaders.
Data Analytics Dataform Official Blog Feb. 13, 2023Transform SQL into SQLX for Dataform - This guide shows the first steps of transitioning legacy SQL into SQLX for Dataform to enable metadata management, data quality testing, and efficient development.
Cloud Pub/Sub Data Analytics Official Blog Feb. 13, 2023Pub/Sub Lite’s Apache Spark Structured Streaming Connector is now Generally Available - The Pub/Sub Lite Spark connector supports the use of Pub/Sub Lite as both an input and output source for Apache Spark Structured Streaming.
Data Analytics Infrastructure Official Blog Feb. 13, 2023How to migrate Cloud Storage data from multi-region to regional - Considerations and process for migrating your Google Cloud Storage data from multi-region to regional buckets.
BigQueryML Data Analytics Official Blog Feb. 6, 2023How to use advance feature engineering to preprocess data in BigQuery ML - How to preprocess data using BigQuery ML.
Data Analytics Earth Engine Machine Learning Official Blog Feb. 6, 2023New study uses Google Earth Engine to tackle climate inequities in California cities - Researchers used Google Earth Engine to identify new targets for urban afforestation — planting new trees — in over 200 urban clusters in California.
BigQuery Data Analytics GCP Experience Official Blog Feb. 6, 2023Built with BigQuery: How Oden provides actionable recommendations with network resiliency to optimize manufacturing processes - Oden uses BigQuery to provide real-time visibility, efficiency recommendations and resiliency in the face of network disruptions in manufacturing systems.
BI Engine Data Analytics Official Blog Feb. 6, 2023Demystifying BigQuery BI Engine - In depth look at BigQuery BI Engine.
BigQuery Data Analytics GCP Experience Official Blog Feb. 6, 2023How Arvind Fashions Ltd leads the fashion industry with powerful data analytics on BigQuery - Arvind Fashions Ltd digital transformation unlocks the value of existing applications, new insights, and build solid workflow through Google Cloud.
Data Analytics GCP Experience Official Blog Feb. 6, 2023Built with BigQuery: Lytics launches secure data sharing and enrichment solution on Google Cloud - Lytics leverages Google BigQuery to offer data infrastructure as a service, and Google Cloud AI/ML stack to identify and create unique audience segments.
Data Analytics Dataplex Official Blog Feb. 6, 2023Establish consistent business language and improve trust in your data - Learn how Dataplex business glossary helps establish consistent business language, improve trust, & enable self-serve data usage.
Data Analytics Official Blog Feb. 6, 2023What Data Pipeline Architecture should I use? - There are numerous design patterns that can be implemented when processing data in the cloud; here is an overview of data pipeline architectures you can use today.
Data Analytics Looker Official Blog Jan. 30, 2023Better together: Looker connector for Looker Studio now generally available - You can now access your Looker modeled data in Looker Studio with the Looker connector, now generally available.
Cloud Dataflow Data Analytics Official Blog Jan. 30, 2023Scaling machine learning inference with NVIDIA TensorRT and Google Dataflow - A collaboration between Google Cloud and NVIDIA has enabled Apache Beam users to maximize the performance of ML models within their data processing pipelines, using NVIDIA TensorRT and NVIDIA GPUs, along side the new Apache Beam TensorRTEngineHandler.
Cloud Bigtable Cloud Firestore Cloud Spanner Data Analytics GCP Experience Official Blog Jan. 30, 2023Transforming customer experiences with modern cloud database capabilities - Learn how Google Cloud customers are transforming customer experiences with modern cloud database capabilities.
Airflow Cloud Composer Data Analytics Official Blog Jan. 23, 2023Optimize Cloud Composer via Better Airflow DAGs - Think of Cloud Composer as the engine and the Apache Airflow DAGs as the fuel you provide. This guide suggests a variety of ways to improve your Airflow DAGs and keep your Cloud Composer environment running as efficiently as possible.
BigQuery Data Analytics Official Blog Jan. 23, 2023Built with BigQuery: How Tamr delivers Master Data Management at scale and what this means for a data product strategy - Built with BigQuery: How Tamr delivers Master Data Management at scale and what this means for a data product strategy.
BigQuery BigQueryML Data Analytics Machine Learning Official Blog Jan. 23, 2023How to do multivariate time series forecasting in BigQuery ML - Multivariate time series forecasting allows BigQuery users to use external covariate along with target metric for forecasting.
BigQuery Cloud Logging Data Analytics Official Blog Jan. 23, 2023Log Analytics in Cloud Logging is now GA - Cloud Logging’s Log Analytics, with advanced search, as well as aggregation and transformation of all log data types, is now generally available.
Data Analytics Official Blog Jan. 23, 2023How to deploy Tink for BigQuery encryption on-prem and in the cloud - Google Cloud customers who want app-level encryption in hybrid cloud data warehouses can encrypt and decrypt that data outside BigQuery. Here’s how to do that securely.
Data Analytics Official Blog Jan. 23, 2023Built with BigQuery: How to accelerate data-centric AI development with Google Cloud and Snorkel AI - Built with BigQuery: How to Accelerate Data-Centric AI development with Google Cloud and Snorkel AI.
BigLake Data Analytics HPC Official Blog Jan. 23, 2023Run data science workloads without creating more data silos - Build a data lake solution enabling data science teams to run workloads without creating new data silos, no matter how complex your organization is.
Data Analytics Official Blog Jan. 16, 2023Built with BigQuery: Solving scale and complexity in retail pricing with BigQuery, Looker, Analytics Hub and more - Building a data-driven pricing platform for speed, scale and automation with BigQuery, Looker and more.
Data Analytics Official Blog Jan. 16, 2023How Kibo Commerce wows their customers with composable analytics using Looker - How Kibo Commerce uses Looker composable analytics for faster development and happy customers.
Cloud Dataproc Data Analytics Official Blog Jan. 16, 2023Run faster and more cost-effective Dataproc jobs - Are your Dataproc jobs running too slow? Do you need to optimize the costs of your Dataproc job strategy? This blog explores a step-by-step approach to improving your Dataproc jobs.
BigQuery Data Analytics Official Blog Jan. 16, 2023Announcing the GA of BigQuery multi-statement transactions - BigQuery multi-statement transactions are now generally available and offer greater scale and additional functionality to handle the most complex of transactions.
Cloud Pub/Sub Data Analytics Infrastructure Official Blog Jan. 16, 2023Seamlessly export Pub/Sub Lite messages to Pub/Sub - Pub/Sub Lite now offers export subscriptions to Pub/Sub. This new subscription type writes Lite messages directly to Pub/Sub - no code development or Dataflow jobs needed. Great for connecting disparate data pipelines and migration from Lite to Pub/Sub.
Data Analytics Official Blog Jan. 16, 2023Accelerate integrated Salesforce insights with Google Cloud Cortex Framework - Google Cloud Cortex Framework launches new data analytics solution accelerator content for Salesforce insights with BigQuery and Looker.
Cloud Identity Aware Proxy Data Analytics Kubernetes Visualization Jan. 16, 2023Deploying Metabase on Google Kubernetes Engine with Identity-Aware Proxy - Deploying Metabase (a data analysis tool) on Google Cloud Platform.
Data Analytics Official Blog Jan. 16, 2023How a multi-national CPG brand clocked a 90-day time-to-value with Lytics and Google Cloud - Multi-national CPG brand removes data silos between brands, teams, and channels with help from Lytics and Google Cloud.
Data Analytics GCP Experience Official Blog Vertex AI Jan. 9, 2023SAVI transforms global surgical instrument tracking with Google Cloud - Powered by Vertex AI (Google Cloud’s platform for accelerating development and deployment of machine learning models into production), SAVI (Semi Automated Vision Inspection) is transforming surgical instrument identification and cataloging, leading to fewer canceled surgeries, and easing pressure on surgery waitlists.
BigQuery Data Analytics Data Science Jan. 9, 2023Reproducible Random Split in BigQuery SQL (For Beginners) - A complete tutorial to randomly split a dataset into multiple groups.
Data Analytics Official Blog R Vertex AI Dec. 26, 2022Perform hyperparameter tuning using R and caret on Vertex AI - How to perform hyperparameter tuning on Vertex AI using custom containers for models written in R.
Data Analytics Official Blog Dec. 19, 2022Google named a Leader in 2022 Gartner® Magic Quadrant™ for Cloud Database Management Systems - For the third straight year, Gartner named Google a Leader in the 2022 Gartner Magic Quadrant for Cloud Database Management Systems.
Data Analytics Official Blog Dec. 19, 2022Understand and optimize your BigQuery analytics queries using the query execution graph - The query execution graph provides an intuitive interface with insights to help you understand, troubleshoot and optimize your BigQuery analytics queries.
BigLake Data Analytics Dataplex Official Blog Dec. 19, 2022Automate data governance, extend your data fabric with Dataplex-BigLake integration - Learn how to automate data governance and your data fabric with Dataplex & BigLake integration. Allow centralizing policies in data lakes & warehouses.
BigQuery Data Analytics Official Blog Dec. 19, 2022BigQuery Omni: solving cross-cloud challenges by bringing analytics to your data - Customers can solve marketing analytics, data governance and data sharing challenges with cross-cloud analytics.
Data Analytics GCP Experience Official Blog Dec. 19, 2022How Vodafone Hungary migrated their data platform to Google Cloud - How Vodafone Hungary migrated their data platform to Google Cloud.
AlloyDB Data Analytics Infrastructure Official Blog Dec. 19, 2022Announcing the General Availability of AlloyDB for PostgreSQL - Migrate and modernize legacy databases with AlloyDB for PostgreSQL, a PostgreSQL-compatible database for demanding enterprise database workloads.
Data Analytics Dataplex Dec. 19, 2022Data Profiling using Dataplex in GCP - Data users can now easily understand common characteristics of their data in GCP by leveraging the Data Profile feature of Dataplex.
Data Analytics GCP Experience Official Blog Dec. 12, 2022How NTUC created a centralized Data Portal for frictionless access to data across business lines - Using Google Cloud tools, NTUC integrated data across its sprawling enterprise ecosystem in a centralized Data Portal platform.
BigQuery Data Analytics GCP Experience Official Blog Dec. 12, 2022How to build comprehensive customer financial profiles with Elastic Cloud and Google Cloud - Google Cloud and Elastic Cloud reference architecture for financial transaction search.
Data Analytics GCP Experience Official Blog Dec. 12, 2022How StreamNative facilitates integrated use of Apache Pulsar through Google Cloud - StreamNative, a company founded by the original developers of Apache Pulsar and Apache BookKeeper, is partnering with Google Cloud to build a streaming platform on open source technologies.
Cloud Dataproc Data Analytics Official Blog Dec. 12, 2022Best practices of Dataproc Persistent History Server - The challenge with ephemeral clusters and serverless Spark is that you will lose the application logs when the cluster machines are deleted after the job. Persistent History Server (PHS) enables you to monitor Spark applications running on different ephemeral clusters or serverless Spark.
Cloud SQL Data Analytics Infrastructure Official Blog Dec. 12, 2022The business value of Cloud SQL: how companies speed up deployments, lower costs and boost agility - Migrating your databases to Cloud SQL can lower costs, boost agility, and speed up deployments, with a 3-year ROI of 246%. Get details in this IDC report.
Data Analytics Official Blog Dec. 12, 2022Performance considerations for loading data into BigQuery - Performance considerations for loading data into BigQuery for various file types.
Data Analytics Looker Official Blog Dec. 12, 2022Getting started with Looker Studio Pro - Using Looker Studio Pro gives you dedicated support, and helps with challenges like seeing who uses which reports and managing access to content.
Cloud Pub/Sub Data Analytics Official Blog Dec. 12, 2022Pub/Sub Group Kafka Connector now GA: a drop-in solution for data movement - The open source Pub/Sub Group Kafka Connector makes it much simpler and more cost-effective to transmit data between Kafka and Google Cloud.
BigQuery Data Analytics GCP Experience Official Blog Dec. 5, 2022Built with BigQuery: How Datalaksa provides a unified marketing and customer data warehouse for brands in South East Asia - Learn how Datalaksa rapidly built a customer data warehouse with full Customer Data Platform capabilities by leveraging the Google BigQuery.
BigQuery Data Analytics GIS Official Blog Serverless Dec. 5, 2022BigQuery Geospatial Functions - ST_IsClosed and ST_IsRing - Use new BigQuery geospatial functions ST_IsClosed and ST_IsRing.
Data Analytics Official Blog Dec. 5, 2022Built with BigQuery: Zeotap uses Google BigQuery to build highly customized audiences at scale - Zeotap is a next-generation Customer Data Platform hosted in Google Cloud aimed at building customized Audience segments and activating at scale.
Data Analytics GCP Experience Looker Official Blog Dec. 5, 2022Seer Interactive gets the best marketing results for their clients using Looker - Seer Interactive turned to Looker as their Business Intelligence platform, helping them design a new, data analytics foundation in tandem with BigQuery.
Cloud SQL Data Analytics Infrastructure Official Blog Dec. 5, 2022Migrating your Oracle and SQL Server databases to Google Cloud - Learn how to migrate your Oracle and SQL Server databases to Google Cloud with these five new videos by Google product experts.
Analytics Hub Data Analytics Official Blog Dec. 5, 2022Secure data exchanges with Analytics Hub, now generally available - Efficiently and securely exchange valuable data and analytics assets across organizational boundaries with Analytics Hub. Start your free trial today.
BigQuery Data Analytics Official Blog Dec. 5, 2022Break down data silos with the new cross-cloud transfer feature of BigQuery Omni - Cross-cloud analytics are critical to breaking down data silos. Moving data with usability, security, low-latency, and audibility makes it a reality.
Data Analytics Official Blog Nov. 21, 2022How The FA is moving the goal posts with a data cloud approach in Qatar - Google Cloud is helping The FA prepare for a tournament like no other.
Data Analytics GCP Experience Official Blog Nov. 21, 2022Built with BigQuery: How Connected-Stories leverages Google Data Cloud and AI/ML for creating personalized Ad Experiences - Connected-Stories NEXT is an end-to-end creative management platform built on Google Cloud to develop, serve, and optimize interactive video and display ads that scale across any channel.
BigQuery Data Analytics GCP Experience Official Blog Nov. 21, 2022BigQuery helps Soundtrack Your Brand hit the high notes without breaking a sweat - BigQuery performance helps Soundtrack Your Brand transform big data into music to offer businesses personalized music recommendations.
BigQuery Data Analytics Nov. 21, 2022How to create robust data pipeline for BigQuery and Google Cloud? - Kestra is an open-source data orchestration and scheduling platform and has an entire range of plugins for Google Cloud.
Data Analytics Data Studio Official Blog Nov. 14, 2022Access modeled data from Looker Studio, now in public preview - The integration between Looker and Looker Studio (Data Studio) is now available in public preview with additional functionality.
Apache Beam Data Analytics Official Blog Scala Nov. 7, 2022Building advanced Beam pipelines in Scala with SCIO
Data Analytics Official Blog Nov. 7, 2022Real-time Data Integration from Oracle to Google BigQuery Using Striim - A performance study on real-time data Integration from Oracle to Google BigQuery Using Striim.
Data Analytics Official Blog Nov. 7, 2022Unleashing the power of BigQuery to create personalized customer experiences - BigQuery’s high performance drives real-time, actionable decision-making that enables Wunderkind to bring large brands closer to their customers.
Cloud Logging Data Analytics Official Blog Nov. 7, 2022Top 10 reasons to get started with Log Analytics today - Cloud Logging launched Log Analytics powered by BigQuery. The top 10 reasons to get started with Log Analytics for no additional cost.
Data Analytics Official Blog Nov. 7, 2022How to build customer 360 profiles using MongoDB Atlas and Google Cloud for data-driven decisions - Learn how to build Customer 360 Profiles, including the architecture and a reusable repository that customers can use in their environments.
Data Analytics GCP Experience Official Blog Oct. 31, 2022UKG Ready, People Insights on Google Cloud - Entity standardization is a complex problem to solve. This is UKG’s solution to help their small and medium business get realtime insights with Google Cloud and Machine Learning. UKG discusses the steps they took and the solution architecture in Google Cloud.
Data Analytics Official Blog Oct. 31, 2022Unlocking the power of connected vehicle data and advanced analytics with BigQuery - Sibros’ Connected Vehicle Platform on Google Cloud delivers OTA data updates, collection, and commands with the flexibility and scale of the cloud.
Data Analytics Event Official Blog Oct. 31, 2022Join the Google Cloud BI Hackathon - Join the Google Cloud BI Hackathon and collaborate and build new innovative applications, tools, and data experiences on Looker and Looker Studio.
Data Analytics Official Blog Oct. 31, 2022An annual roundup of Google Data Analytics innovations - Data Analytics product innovations in 2022. Innovations for an open data ecosystem, unified business intelligence, continuous intelligence, and data management and governance.
BigQuery Data Analytics Official Blog Oct. 31, 2022Improved text analytics in BigQuery: search features now GA - General availability of text indexes and search functions in BigQuery. This enables you to perform scalable text searches.
BigQuery Data Analytics Machine Learning Official Blog Vertex AI Oct. 31, 2022Accelerate your data to AI journey with new features in BigQuery ML - BigQuery ML reduces data to AI barrier by making it easy to manage the end-to-end lifecycle from exploration to operationalizing ML models using SQL.
Cloud Dataproc Data Analytics Official Blog Oct. 31, 2022Best practices for migrating Hadoop to Dataproc by LiveRamp - Liveramp sharing best practices for migrating apache hadoop from on-prem to Google Cloud Dataproc.
Data Analytics Dataplex Official Blog Oct. 31, 2022Accelerate speed to insights with data exploration in Dataplex - Dataplex announces Data Exploration Workbench providing a Spark-powered serverless data exploration experience.
BigQuery Data Analytics GCP Experience Official Blog Oct. 31, 2022BigQuery’s performance and scale means that everyone gets to play - Today, we’re hearing from telematics solutions company Geotab about how Google BigQuery enables them to democratize data across their entire organization and reduce the complexity of their data pipelines.
BigLake BigQuery Data Analytics Official Blog Oct. 24, 2022Announcing Apache Iceberg support for BigLake - BigLake now supports Apache Iceberg, an open source table format, enabling users to take advantage of Iceberg’s capabilities to build an open format data lake.
Data Analytics Official Blog Oct. 24, 2022Build a modern, distributed Data Mesh with Google Cloud - Data Mesh is an architectural paradigm that decentralizes data ownership into the teams that have the highest business context for a data domain.
BigQuery Data Analytics Official Blog Oct. 24, 2022Unlocking the value of unstructured data at scale using BigQuery ML and object tables - Object tables provide a structured record interface that enables you to directly run analytics and machine learning on unstructured data in BigQuery.
BigQuery Data Analytics Official Blog Oct. 24, 2022Build limitless workloads on BigQuery: New features beyond SQL - BigQuery announces preview of Stored Procedures for Spark, letting customers build ML & ETL jobs written in Python directly into BigQuery’s environment.
Apache Beam Cloud Dataproc Data Analytics Jupyter Notebook Official Blog Oct. 24, 2022Run interactive pipelines at scale using Beam Notebooks - Run Apache Beam pipelines for ML inference interactively in Jupyter Notebooks with FlinkRunner at scale using Dataproc on Google Cloud under the hood.
BigQuery Data Analytics Official Blog Oct. 24, 2022Unifying data and AI to bring unstructured data analytics to BigQuery - Object tables provide a structured record interface that enables you to directly run analytics and machine learning on unstructured data in BigQuery.
Cloud Dataflow Data Analytics GCP Experience Official Blog Oct. 24, 2022Top recommendations for building real-time intelligence on Google Cloud - How Exabeam built real-time product capabilities on Google Cloud with unified batch and streaming.
Data Analytics Google Cloud Platform Oct. 24, 2022My Thoughts on Google Cloud Next 2022 - Some thoughts around the analytics launches at Google Cloud Next 2022.
Data Analytics Looker Official Blog Oct. 17, 2022Introducing the next evolution of Looker, your unified business intelligence platform - Presenting the future of business intelligence: Looker, which now has deep integration with Data Studio and Google’s top products in AI/ML, productivity and more.
AI Data Analytics Official Blog Oct. 17, 2022New AI agents can drive business results faster: Translation Hub, Document AI, and Contact Center AI - Google Cloud announces new AI agents — Translation Hub, Document AI Workbench and Document AI Warehouse — and continues to update Contact Center AI.
Data Analytics Official Blog Oct. 17, 2022Building the most open data cloud ecosystem: Unifying data across multiple sources and platforms - A robust Data Cloud ecosystem lets you use all your data, from all sources, in all storage formats and styles of analysis, across all cloud providers.
Data Analytics Official Blog Oct. 17, 2022Google Cloud Next for data professionals: analytics, databases and business intelligence - Here are just a few of the breakout sessions at Google Cloud Next ‘22 about what’s new in data analytics, databases and business intelligence.
AI Data Analytics Machine Learning Official Blog Oct. 17, 2022Google Cloud Next: top AI and ML sessions - Join us at Google Cloud Next ‘22 for our latest AI and ML announcements and insights.
BigQuery Data Analytics GCP Experience Official Blog Oct. 10, 2022Built with BigQuery: How Tinyclues and Google Cloud deliver the CDP capabilities that marketers need - Built with BigQuery: How TinyClues delivers their next generation headless CDP solution.
Data Analytics Official Blog Oct. 10, 2022Moving to Log Analytics for BigQuery export users - Log Analytics combines the power of BigQuery with Cloud Logging. Learn why you should migrate to Log Analytics and how to convert SQL queries originally made for BigQuery log sink.
Data Analytics Infrastructure Official Blog Oct. 10, 2022Secure streaming data with Private Service Connect for Confluent Cloud - Confluent Cloud supports Google Cloud Private Service Connect making it easier for organizations to get secure private network connectivity.
BigQuery Data Analytics Official Blog Oct. 10, 2022How to simplify and fast-track your data warehouse migrations using BigQuery Migration Service - A suite of tools for enabling end-to-end data warehouse migrations to BigQuery.
Data Analytics Official Blog Serverless Oct. 10, 2022Analyzing satellite images in Google Earth Engine with BigQuery SQL - Learn how to use BigQuery SQL inside Google Earth Engine to analyze satellite imagery to track farm health.
BigQuery Data Analytics Official Blog Oct. 10, 2022Building an automated data pipeline from BigQuery to Earth Engine with Cloud Functions - This post walks through the architecture for a recently open sourced architecture of an automated data pipeline with BigQuery and Earth Engine.
Contact Center AI Data Analytics Official Blog Oct. 10, 2022CCAI Platform goes GA: Faster time to value with AI for your Contact Center - Google Cloud Contact Center AI provides end-to-end capabilities that bring AI to the call center.
BigQuery Data Analytics Oct. 10, 2022GCP — Proactive DQ Alert Setup - Using Data Quality library to manage pro-active data quality alerts on the data ingested in BigQuery.
Data Analytics Official Blog Oct. 3, 2022Introducing Device Connect for Fitbit: How Google Cloud and Fitbit are working together to help people live healthier lives - How Google Cloud and Fitbit are working together to help people live healthier lives with Device Connect for Fitbit.
BigQuery Cloud Dataflow Data Analytics NoSQL Official Blog Oct. 3, 2022A data pipeline for MongoDB Atlas and BigQuery using Dataflow - Optimize moving and transforming data between MongoDB Atlas and BigQuery using Dataflow templates.
Data Analytics GCP Experience Machine Learning Official Blog Oct. 3, 2022Built with BigQuery: BigQuery ML enables Faraday to make predictions for any US consumer brand - How Building with BigQuery ML enables Faraday to make predictions for any US consumer brand.
Data Analytics Official Blog Oct. 3, 2022Lufthansa increases on-time flights by wind forecasting with Google Cloud ML - Learn how Lufthansa worked with Google engineers to do a wind forecasting prototype on Google Cloud, to reduce flight delays.
Cloud Dataflow Data Analytics Official Blog Sept. 26, 2022Benchmarking your Dataflow jobs for performance, cost and capacity planning - Learn how to test your own Dataflow pipelines for performance optimization, capacity planning and TCO estimation using open-source PerfKit Benchmarker.
Data Analytics Official Blog Sept. 26, 2022Meet Optimus, Gojek’s open-source cloud data transformation tool - Gojek’s open-source Optimus is workflow orchestrator for data transformation, data modeling, data pipelines, and data quality management.
Data Analytics Official Blog Sept. 26, 2022What’s New with Google’s Unified, Open and Intelligent Data Cloud - Google’s unified, open and intelligent data cloud provides insights at every level of the enterprise to empower leaders to drive results.
Data Analytics Dataplex GCP Experience Official Blog Sept. 26, 2022Building trust in the data with Dataplex - American Eagle® and Aerie® is a leading global specialty retailer offering high-quality clothing using Dataplex for logistics/delivery partners.
Data Analytics Official Blog Sept. 26, 2022Built with BigQuery: Retailers drive profitable growth with SoundCommerce - SoundCommerce uses Analytics Hub to increase the pace of innovation by sharing datasets with its customers in real-time by using the streaming functionality of BigQuery.
Cloud Pub/Sub Data Analytics Official Blog Sept. 19, 2022Announcing Pub/Sub metrics dashboards for improved observability - New Pub/Sub metrics dashboards are easily accessible from Google Cloud Console, helping you build better solutions with Pub/Sub.
Data Analytics Official Blog Sept. 19, 2022Sign up for the Google Cloud Fly Cup Challenge - Learn more about how to participate in the Google Cloud Fly Cup, brought to you in partnership with The Drone Racing League.
BigQuery Data Analytics Datastream Official Blog Sept. 19, 2022Introducing Datastream for BigQuery - Serverless, seamless, and low-latency replication from relational databases directly to BigQuery, enabling real-time insights on operational data.
Data Analytics Official Blog Sept. 19, 2022How Google scales ad personalization with Bigtable - Learn how Google leverages Bigtable’s scale, performance and feature set to drive large-scale user modeling for ad personalization.
BigQuery Data Analytics Official Blog Sept. 12, 2022How to use Google Cloud to find and protect PII - Google Cloud’s open source automatic tagging solution can automate column-level access controls in order to minimize the risk of unrestricted access to sensitive data or PII in BigQuery.
Cloud Dataflow Data Analytics Official Blog Sept. 12, 2022Pro tools for Pros: Industry leading observability capabilities for Dataflow - Introducing several new observability capabilities for Google Cloud Dataflow such as more metrics for streaming jobs, Dataflow insights and Datadog integration.
BigQuery Data Analytics Official Blog Sept. 12, 2022Cloud Wisdom Weekly: 6 tips to optimize data management and analytics - How to save money while ensuring your data and analytics efforts scale, with examples featuring BigQuery.
Data Analytics Official Blog Security Sept. 5, 2022Data governance building blocks on Google Cloud for financial services - Financial services firms have special governance requirements for their data, and there are several Google Cloud tools that can help.
Data Analytics Official Blog Sept. 5, 2022Integrating ML models into production pipelines with Dataflow - A deep dive into Dataflow’s integration with Apache Beam's machine learning prediction and inference transform for infusing models into data pipelines.
Cloud Dataflow Data Analytics Official Blog Sept. 5, 2022Introducing Vertical Autoscaling in streaming Dataflow Prime jobs - Introducing Vertical Autoscaling in Dataflow Prime to automatically scale workers memory.
BigQuery Data Analytics Sept. 5, 2022Data quality in Google Cloud BigQuery and Data Lake using Great Expectations. - Integrating Great Expectations (open-source data quality framework) with BigQuery.
BigQuery Data Analytics Official Blog Aug. 29, 2022Spatial Clustering on BigQuery - Best Practices - Reduce cost and increase performance of your geospatial queries by leveraging spatial clustering in BigQuery.
Cloud Storage Data Analytics Infrastructure Official Blog Aug. 29, 2022New prefix and suffix lifecycle rules for Cloud Storage - Google Cloud Storage now offers lifecycle rules based on prefix or suffix, and for multipart uploads.
Data Analytics Official Blog Aug. 22, 2022Best practices of migrating Hive ACID Tables to BigQuery - Do you have lots of Hive ACID tables that you are looking to migrate to Google BigQuery? This blog explores an approach to migrate Hive ACID tables to BigQuery.
Cloud Storage Data Analytics Official Blog Aug. 15, 2022Introducing easier de-identification of Cloud Storage data - Many organizations require effective processes and techniques for removing or obfuscating certain sensitive information in the data they store. An important tool to achieve this goal is de-identification, which can reduce the privacy risk associated with collecting, processing, archiving, distributing or publishing information.
Data Analytics Aug. 15, 2022Batch processing options on GCP through a practitioner’s lens - his posts covers a different tools and technologies you can use on GCP to run batch processing workloads.
Data Analytics Official Blog Aug. 8, 2022How Wayfair is reaching MLOps excellence with Vertex AI - Without a comprehensive AI platform and Feature Store, Wayfair data scientists had to build their own unique model productionization processes on legacy infrastructure components.
BigQuery Cloud Bigtable Data Analytics Official Blog Aug. 8, 2022Zero-ETL approach to analytics on Bigtable data using BigQuery - Query Bigtable directly from BigQuery and combine with other datasets for real-time analytical insights. Now Generally Available.
Data Analytics Data Studio Official Blog Aug. 8, 2022Introducing Data Studio as our newest Google Cloud service - Data Studio, our self-service business intelligence and data visualization platform, is now a Google Cloud service.
Cloud Run Cloud Scheduler Data Analytics Official Blog Aug. 8, 2022Scheduling a command in GCP using Cloud Run and Cloud Schedule - How to efficiently and quickly schedule commands like Gsutil using Cloud Run and Cloud Scheduler.
Data Analytics Official Blog Aug. 8, 2022Keeping track of shipments minute by minute: How Mercado Libre uses real-time analytics for on-time delivery - Using the continuous intelligence approach, the shipping operations team built a new solution that provides near real-time data monitoring and analytics for their transportation network to keep up with the demands of exponential order growth while still meeting the 48-hour delivery timelines that customers have come to expect.
Data Analytics Official Blog Aug. 8, 2022Introducing Cloud Analytics by MITRE Engenuity Center in collaboration with Google Cloud - To better analyze the growing volumes of heterogeneous security data, Google has partnered with MITRE to create the Cloud Analytics project. Here’s why, and what it does to help improve cloud security.
BigQuery Data Analytics Aug. 8, 2022How to Build a Unique MD5 Row Hash Using SQL in BigQuery (Plus a Few Related Things) - Using native BigQuery functionality to generate a dynamic, unique row identifier in SQL.
Data Analytics DevOps Looker Official Blog SRE Aug. 1, 2022Managing the Looker ecosystem at scale with SRE and DevOps practices - Following DevOps and SRE best practices can help organizations bring order to distributed Looker environments.
BigQuery Data Analytics Official Blog Aug. 1, 2022Top 5 Takeaways from Google Cloud’s Data Engineer Spotlight - Google Cloud Data Hero’s Top Five Takeaways from the Data Engineer Spotlight.
BigQuery Cloud Pub/Sub Data Analytics Official Blog Aug. 1, 2022No pipelines needed. Stream data with Pub/Sub direct to BigQuery - We are introducing a new type of Pub/Sub subscription that writes directly from Pub/Sub to BigQuery. This new ELT path will be able to simplify your event-driven architecture.
Data Analytics Machine Learning Official Blog R Vertex AI Aug. 1, 2022Use R to train and deploy machine learning models on Vertex AI - How to train and deploy a machine learning model with R on Vertex AI.
Cloud Composer Data Analytics GCP Experience Official Blog Aug. 1, 2022Cloud Composer at Deutsche Bank: workload automation for financial services - Deutsche Bank’s use of Cloud Composer service is a showcase of workload automation in the financial services sector.
BigLake Data Analytics Official Blog Aug. 1, 2022Unify data lakes and warehouses with BigLake, now generally available - BigLake, a storage engine that extends innovations in BigQuery storage to open file formats running on cloud object stores, is generally available.
BigQuery Data Analytics Machine Learning Official Blog Vertex AI July 25, 2022New 20+ pipeline operators for BQML - We describe the new BigQuery and BigQuery ML (BQML) components now available for Vertex AI Pipelines, enabling data scientists and ML engineers to orchestrate and automate any BigQuery and BigQuery ML functions. We also showed an end-to-end example of using the components for demand forecasting involving BigQuery ML and Vertex AI Pipelines.
Data Analytics Data Catalog Dataplex Official Blog July 25, 2022Streamline data management and governance with the unification of Data Catalog and Dataplex - Data Catalog will be unified with Dataplex, providing an enterprise-ready data fabric that enables data management and governance at scale.
Cloud Dataflow Data Analytics Official Blog July 25, 2022The next generation of Dataflow: Dataflow Prime, Dataflow Go, and Dataflow ML - Dataflow is GCP’s Cloud Native way for all data processing workloads, powered by the universal batch and streaming model of Apache Beam.
BigQuery Data Analytics Official Blog July 25, 2022Google Cloud Data Heroes Series: Meet Tomi, a data engineer based in Germany and creator of the ‘Not So BigQuery Newsletter’ - In the Data Heroes series we share stories of people who use data analytics tools to do incredible things. In this month’s edition, Meet Tomi.
BigQuery Data Analytics GPU Official Blog Python July 25, 2022Scalable Python on BigQuery using Dask and NVIDIA GPUs - To accelerate data analytics and machine learning workflows, we introduce the Dask BigQuery connector to read data through BigQuery storage API and deploy at scale on NVIDIA GPUs using Dask and RAPIDS on Google Dataproc.
BigQuery Data Analytics Mainframe Official Blog July 18, 2022Moving data from the mainframe to the cloud made easy - The bigquery-zos-mainframe-connector makes migrating from mainframe to cloud easy by providing gsutil and bq equivalent utilities for the mainframe.
BigQuery Data Analytics Official Blog July 18, 2022Performance considerations for loading data into BigQuery - Performance considerations for loading data into BigQuery for various file types.
Data Analytics Official Blog Vertex AI July 18, 2022Introducing model co-hosting to enable resource sharing among multiple model deployments on Vertex AI - Learn about resource sharing among multiple model deployments on Vertex AI for improved utilization of memory and computational resources.
Cloud SQL Data Analytics Official Blog July 18, 2022Multicloud reporting and analytics using Google Cloud SQL and Power BI - Multicloud reporting and analytics using Google Cloud SQL and Microsoft Power BI.
Data Analytics GCP Certification Official Blog July 18, 2022Prepare for Google Cloud certification with top tips and no-cost learning - Prepare for Google Cloud Certification with no-cost access to Professional Certificates on Coursera and top tips from the Google Cloud Training team.
BI Engine Data Analytics Official Blog July 4, 2022Now in preview, BigQuery BI Engine Preferred Tables - Launching preferred tables in preview for BigQuery BI Engine, enabling customers to achieve predictable performance and optimized use of their BigQuery investments.
Data Analytics Official Blog July 4, 2022Twitter: gaining insights from Tweets with an API for Google Cloud - The Twitter API toolkit for Google Cloud enables data processing automation at the click of a button because it provisions the underlying infrastructure it needs to work.
Data Analytics GCP Certification Official Blog July 4, 2022Earn Google Cloud swag when you complete the #LearnToEarn challenge - Earn swag with the Google Cloud #LearnToEarn challenge.
BI Engine BigQuery Data Analytics Official Blog June 27, 2022Learn how BI Engine enhances BigQuery query performance - This blog explains how BI Engine enhances BigQuery query performance, different modes in BI engine and its monitoring.
BigQuery Data Analytics Official Blog June 27, 2022Google Cloud Data Heroes Series: Meet Francisco, the Ecuadorian American founder of Direcly, a Google Cloud Partner - In the Data Heroes series we share stories of people who use data analytics tools to do incredible things. In this month’s edition, Meet Francisco.
BigQuery Data Analytics Official Blog June 27, 2022Announcing new BigQuery capabilities to help secure sensitive data - As businesses increasingly store and use sensitive data, it’s critical to control access to and mask this data to mitigate security breaches.
BigQuery Data Analytics Official Blog June 27, 2022Introducing Firehose: An open source tool from Gojek for seamless data ingestion to BigQuery and Cloud Storage - The Firehose open source tool allows Gojek to turbocharge the rate it streams its data into BigQuery and Cloud Storage.
Data Analytics Official Blog June 27, 2022Forrester names Google Cloud a leader in Document Analytics Platforms - Forrester names Google Cloud a leader in Document-Oriented Text Analytics Platforms.
Data Analytics GCP Experience Official Blog June 20, 2022Wayfair: Accelerating MLOps to power great experiences at scale - Wayfair adopts Vertex AI to support data scientists with low-code, standardized ways of working that frees them up to focus on feature computation logic instead of worrying about the infrastructure challenges of deploying features into production.
Data Analytics Official Blog June 20, 2022How The Home Depot is teaming up with Google Cloud to delight customers with personalized shopping experiences - The Home Depot, Inc. surfaces more relevant, personalized content to customers with the help of Google Cloud.
BigQuery Data Analytics Official Blog June 20, 2022Transform satellite imagery from Earth Engine into tabular data in BigQuery - With Geobeam on Dataflow, you can transform Geospatial data from raster format in Earth Engine to vector format in BigQuery.
BigQuery Data Analytics Official Blog June 13, 2022Smooth sailing: The resource hierarchy for adopting Google Cloud BigQuery across Twitter - To provide one-to-one mapping from on-prem Hadoop to BigQuery, the Google Cloud and Twitter team created this resource hierarchy architecture.
BigQuery Data Analytics Official Blog June 13, 2022Accelerating BigQuery migrations with automated SQL translation - Readable translations of legacy SQL queries across a wide breadth of data warehouses with just a push of a button.
Data Analytics GCP Experience Official Blog June 6, 2022Google Cloud helps ADAM and THOR find asteroids - Google Cloud and the Asteroid Institute discover 104 new asteroids using existing images of the sky and public cloud resources.
BigQuery Data Analytics Official Blog May 30, 2022Built with BigQuery: Gain instant access to comprehensive B2B data in BigQuery with ZoomInfo - Built with BigQuery shows how ZoomInfo helps its customers incorporate market intelligence into other internal data sets.
Cloud Spanner Data Analytics Official Blog May 30, 2022Change streams for Cloud Spanner: now generally available - Cloud Spanner change streams are now generally available. With change streams, you can capture and stream out changes from your Cloud Spanner databases in near real-time.
Data Analytics Official Blog May 30, 2022Discover our new edge concepts at Hannover Messe that bring smart factories to life - Intel and Google Cloud demonstrate edge-to-cloud technology at Hannover Messe.
BigQuery Data Analytics Official Blog May 30, 2022Google Cloud Data Heroes Series: Meet Antonio, a Data Engineer from Lima, Peru - Google Cloud continues their Data Hero series with a profile on Antonio C., a data engineer, teacher, writer, and enthusiast on GCP.
Data Analytics GCP Experience Machine Learning Official Blog May 30, 2022Notified team gets smart on MLOps through Advanced Solutions Lab for Machine Learning - Notified worked with Google Cloud and the Advanced Solutions Lab to train their team on Machine Learning Operations (MLOps).
BigQuery Data Analytics Official Blog May 30, 2022Get value from data quickly with Informatica Data Loader for BigQuery - With Informatica’s Data Loader on Google Cloud, accelerate data uploads and keep data flowing to get insights and answers faster.
Data Analytics Dataplex May 30, 2022Google Cloud Dataplex -Part 1-Lakes, Zones, Assets and discovery - Intro to Dataplex.
BigQuery Data Analytics May 23, 2022How to Modify BigQuery Table Definition at No Costs - Cost efficient way how to change structure of BigQuery tables like partition key and type, ….
Data Analytics GCP Experience Official Blog May 23, 2022Built with BigQuery: Material Security’s novel approach to protecting email - Material Security’s novel approach to protecting email depends on Google Cloud’s BigQuery. Here’s why.
BigQuery Data Analytics Official Blog May 23, 2022Unlock real-time insights from your Oracle data in BigQuery - A tutorial on how to replicate operational data from an Oracle database into BigQuery so that you can keep multiple systems in sync real-time.
Data Analytics Official Blog May 23, 2022Twitter takes data activation to new heights with Google Cloud - Twitter transformed its approach to data processing using Google Cloud services. In this blog, Pradip Thachile, cloud adoption lead at Twitter, shares how BigQuery and Dataflow helped the team modernize the way they process data, uncover insights, and develop offerings that delight advertisers and customers.
Cloud Dataflow Data Analytics Official Blog May 16, 2022New observability features for your Splunk Dataflow streaming pipelines - Splunk Dataflow operators can now more easily monitor performance of their log export pipelines with new observability metrics and fine-grained logging.
Data Analytics Official Blog Serverless May 16, 2022Extending BigQuery Functions beyond SQL with Remote Functions, now in preview - Remote Functions are user-defined functions (UDF) that let you extend BigQuery SQL with your own custom code, written and hosted in Cloud Functions, Google Cloud’s scalable pay-as-you-go functions as a service.
Data Analytics Official Blog SAP May 16, 2022How Google Cloud and SAP solve big problems for big companies - On the occasion of SAP Sapphire, here’s a rundown of the key Google Cloud and SAP initiatives we’ll be talking to customers about at the show.
Data Analytics Data Science May 16, 2022Accelerating Cloud Migration with Data Mesh Solution Patterns - The article introduces the notion of a data gravity well to describe a consistent pattern: applications and use-cases will be developed closer to where the data they need can be accessed.
Cloud Spanner Data Analytics Datastream May 9, 2022Real-Time Streaming | MySQL & Oracle to Cloud Spanner - Migrating data to Cloud Spanner.
Data Analytics Official Blog May 9, 2022The Future of Data: Unified, flexible, and accessible - Google Cloud’s whitepaper explores why the future of data will involve three key themes: unified, flexible, and accessible.
BI Engine BigQuery Data Analytics Official Blog May 9, 2022Now generally available: BigQuery BI Engine supports any BI tool or custom application - Learn about BigQuery BI Engine and how to analyze large and complex datasets interactively with sub-second query response time and high concurrency. Now generally available.
Data Analytics Official Blog May 9, 2022Solving for food waste with data analytics in Google Cloud - This blog post explores why it is so necessary as a retailer to bring your data to the cloud to apply analytics to minimize food waste.
Data Analytics Official Blog May 9, 2022Introducing new Google Cloud manufacturing solutions: smart factories, smarter workers - Google Cloud Manufacturing Solutions Announcement.
Cloud Composer Data Analytics Looker Official Blog May 9, 2022Orchestrate Looker data transformations with Cloud Composer - New Looker operators in Cloud Composer help you orchestrate Looker data transformations at scale.
BigQuery Data Analytics Official Blog May 9, 2022Ingesting GA4 Events for Discovery solutions - Ingest existing Google Analytics 4 events for Discovery solutions.
Data Analytics May 9, 2022Designing Malloy — Introduction - Malloy is a new query language for data.
Data Analytics GCP Certification Official Blog May 2, 2022Build your cloud skills with no-cost access to Google Cloud training on Coursera - Advance your technical skills and boost your career by getting hands-on practice with Google Cloud projects.
BigQuery Data Analytics Official Blog May 2, 2022Monitor & analyze BigQuery performance using Information Schema - This blog equips the BigQuery user base with an easy way to analyze and decipher the key BigQuery metrics using the Information Schema to understand Slot Consumption and Query Concurrency / Throughput.
Cloud Dataflow Data Analytics Official Blog May 2, 2022Data movement for the masses with Dataflow Templates - Dataflow Templates enable data and application engineers to deploy data pipelines without writing any code, leveraging the fully-managed Dataflow service.
BigQuery Data Analytics Public Datasets May 2, 2022Predicting Conversion Events from Google Analytics Dataset for Google Merchandise Store in BigQuery - Analyzing Google Analytics sample dataset for BigQuery.
BigQuery Data Analytics Data Loss Prevention API Official Blog April 18, 2022Automatic data risk management for BigQuery using DLP - Automatic DLP for BigQuery, a fully managed service that continuously scans your data to give visibility of data risk, is now generally available.
Data Analytics Official Blog April 18, 2022BigQuery Omni innovations enhance customer experience to combine data with cross cloud analytics - Use BigQuery Omni’s single-pane-of-glass to analyze data across clouds and build pipeless pipelines to drive advanced analytics.
Data Analytics Official Blog April 18, 2022Top 5 Takeaways from Data Cloud Summit ‘22 - Data Cloud Summit 2022 was a great success thanks to all of our customers, partners, and members of the data community. Here’s what you missed.
Big Data BigQuery Data Analytics Data Science April 18, 2022Google Data Cloud Summit 2022: Recap - An overview of the many new updates coming to Google Cloud Platform!
BigQuery Data Analytics Official Blog Vertex AI April 11, 2022MLOps in BigQuery ML with Vertex AI Model Registry - Vertex AI Model Registry enables new capabilities within BigQuery ML. Learn how to streamline model management and easily deploy models for real time predictions.
Analytics Hub Data Analytics Official Blog April 11, 2022Securely exchange data and analytics assets at scale with Analytics Hub, now available in Preview - Efficiently and securely exchange valuable data and analytics assets across organizational boundaries with Analytics Hub. Start your free trial today.
BigQuery Data Analytics Official Blog April 11, 2022Now in preview, BigQuery search features provide a simple way to pinpoint unique elements in data of any size - Now in preview, BigQuery search features provide a simple way to pinpoint unique elements in data of any size.
Data Analytics Official Blog Serverless Spark April 11, 2022Introducing Serverless Spark for interactive development - Integrations with Vertex AI, BigQuery, and Dataproc for GKE make Serverless Spark ready for interactive development.
Data Analytics Data Studio Looker Official Blog April 11, 2022Bringing together the best of both sides of BI with Looker and Data Studio - Get the self-serve speed you need with the certainty of central BI by integrating Looker and Data Studio.
BigLake Data Analytics Official Blog April 11, 2022BigLake: unifying data lakes and data warehouses across clouds - BigLake unifies data warehouses and data lakes into a consistent format for faster data analytics across Google Cloud and open source formats and engines.
Data Analytics Official Blog April 11, 2022Meet Google’s unified data and AI offering - By bridging data and AI, data analysts can take advantage of user-friendly ML tools and data scientists get the most out of data. Built-in MLOps ensure AI work is ready for production.
Data Analytics Official Blog Security April 11, 2022Build a secure data warehouse with the new security blueprint - Introducing our new security blueprint that helps enterprises build a secure data warehouse.
Cloud Spanner Data Analytics Official Blog April 11, 2022Boost the power of your transactional data with Cloud Spanner change streams - Change streams track changes in your Spanner database and integrate this data with other systems for analytics, event triggering, and compliance.
Big Data Data Analytics Official Blog April 11, 2022Limitless Data. All Workloads. For Everyone - Read about the newest innovations in data cloud announced at Google Cloud’s Data Cloud Summit.
BigQuery Data Analytics Official Blog April 4, 2022Introducing Active Assist recommendations for BigQuery capacity planning - Optimize BigQuery usage and capacity planning with insights and recommendations powered by Active Assist, part of Google Cloud’s AIOps solution.
BigQuery Data Analytics Official Blog Public Datasets April 4, 2022Enhance your analysis with new international Google Trends datasets in BigQuery - International Google Trends datasets now available in BigQuery to accelerate business insights.
BigQuery Data Analytics Official Blog Serverless Spark April 4, 2022Ingesting Google Cloud Storage files to BigQuery using Cloud Functions and Serverless Spark - Ingesting Google Cloud Storage files to BigQuery using Cloud Functions and Serverless Spark.
BigQuery Data Analytics GIS Official Blog March 28, 2022Using GeoJSON in BigQuery for geospatial analytics - Learn about BigQuery’s new geospatial support for geoJSON files and how to use it for spatial analytics.
Cloud Data Fusion Data Analytics Official Blog March 28, 2022Bulk import and exports with Cloud Data Fusion for Contact Center AI Insights made easy - Public availability of Contact Center AI (CCAI) Insights Accelerator in Cloud Data Fusion, an out-of-the-box approach to importing and exporting large amounts of data to and from Contact Center AI Insights.
BigQuery Data Analytics March 21, 2022Plotting Bar Charts in BigQuery Using a SQL User Defined Function (UDF) - Minimise context switching and make your workflow faster.
Data Analytics Event Official Blog March 21, 2022Ready to solve for the future? Data Cloud Summit '22 is coming April 6 - Hear from customers, leaders and builders from Google Cloud at Data Cloud Summit 2022 to get the insight you need for your data organization.
Data Analytics Official Blog March 21, 2022Data Governance in the Cloud - part 2 - Tools - Data governance tools and technologies to ensure security, compliance, and drive data democratization.
Data Analytics Official Blog Security March 14, 2022Introducing Community Security Analytics - Introducing Community Security Analytics, an open-source repository of queries for self-service security analytics to help you get started analyzing your Google Cloud logs and detecting potential threats to your workloads & data.
BigQuery Data Analytics GIS Official Blog March 14, 2022ArcGIS and BigQuery - a match made for geodata - Learn how to use power of BigQuery inside Esri ArcGIS to analyze geospatial or location data at scale.
BigQuery Cloud Spanner Data Analytics Official Blog March 14, 2022How Spanner and BigQuery work together to handle transactional and analytical workloads - We’ll discuss how Cloud Spanner and BigQuery are a match made in heaven, and can be used together to process transactions at scale and generate real-time insights to deliver amazing customer experiences.
Cloud Run Data Analytics GCP Experience Official Blog Serverless March 14, 2022The L’Oréal Beauty Tech Data Platform - A data story of terabytes and serverless - Data warehousing at L’Oréal got a makeover when the company selected BigQuery and Cloud Run as the basis for its revamped data analytics platform.
BigQuery Data Analytics Official Blog March 14, 2022Learn how to stream JSON data into BigQuery using the new BigQuery Storage Write API - Walks through a code example that streams GitHub commit data to BigQuery for real-time analysis.
Cloud Data Fusion Data Analytics Official Blog SAP March 14, 2022Google Cloud Cortex Framework: Connect SAP data via Cloud Data Fusion - Learn how Cloud Data Fusion provides scalable data integration pipelines to help consolidate a customer’s SAP and non-SAP datasets within BigQuery.
Big Data Data Analytics March 14, 2022Building a Data Lake on Google Cloud Platform - Big Data is gaining a lot of popularity. Here we explain how to build a big data pipeline on Google Cloud Platform using Open Source.
Big Data BigQuery Data Analytics Machine Learning March 7, 2022Predicting the Fare on a Billion Taxi Trips with BigQuery - How long time does it take and how much does it cost to analyse and train a model on a billion taxi trips in the cloud?
BigQuery Data Analytics Official Blog Feb. 28, 2022Google Cloud Data Heroes Series: Meet Lynn, a cloud architect equipping bioinformatic researchers with genomic-scale data pipelines on GCP - Google Cloud introduces their Data Hero series with a profile on Lynn Langit, a data cloud architect, educator, and developer on GCP.
Data Analytics Dataplex Official Blog Feb. 28, 2022Build a data mesh on Google Cloud with Dataplex, now generally available - Dataplex centrally manage, monitor, and govern data across distributed data, and make it securely accessible to a variety of analytics tools.
Data Analytics Feb. 28, 2022Recipe for building your first Data Product in a Data Mesh - A journey of a thousand miles begins with a single step. For a Data Mesh, this journey begins with a single Data Product. This article covers a recipe for building your first Data Product.
Big Data Data Analytics Feb. 28, 2022Data Workflow Modernization - Drive transformational improvement in users’ workflows, not an incremental improvement in the tools you use.
BigQuery Data Analytics Official Blog Feb. 21, 2022Streaming data into BigQuery using Storage Write API - Using BigQuery Storage Write API in Beam pipelines.
BigQuery Data Analytics Official Blog Feb. 21, 2022Google data experts share top data practitioner skills needed in 2022 - Top data analytics skills to learn in 2022 as a data practitioner, Google Cloud experts weigh in.
BigQuery Data Analytics Official Blog Teradata Feb. 21, 2022Speed up your Teradata migration with the BigQuery Permission Mapper tool - The BigQuery Permission Mapper tool eases the migration of a customer’s Teradata access rights codes to Google Cloud IAM by automating the permissions mapping process between the two data warehouse solutions.
Data Analytics Official Blog Feb. 21, 2022Free your mainframe data with data-first digitization - By moving mainframe data to Google Cloud, data-first digitization allows you to integrate your mainframe with BigQuery and other industry solutions.
Data Analytics Document AI Official Blog Feb. 21, 2022Add intelligence to your document processing with Google's Enterprise Knowledge Graph - Enterprise Knowledge Graph normalizes and enriches Document AI extracted entities with real world knowledge.
BigQuery Data Analytics Official Blog Feb. 21, 2022To user-friendly SQL with love from BigQuery - BigQuery expands user-friendly SQL with support for new data types, SQL expressions and scripting control statements, table copy DDL and information schema views.
BigQuery Data Analytics Feb. 21, 2022Google Analytics sequence segments with BigQuery - Recreating sequence segments from Google Analytics in BigQuery.
Data Analytics Official Blog Feb. 14, 2022Why you should be using Flex templates for your Dataflow deployments - This blog describes best security, CI/CD and development practices when using Dataflow Flex Templates.
BigQuery Data Analytics GCP Experience Official Blog Feb. 14, 2022How Wayfair says yes with BigQuery—without breaking the bank - BigQuery’s performance and cost optimization have transformed Wayfair’s internal analytics to create an environment of "yes".
BigQuery Data Analytics Official Blog Vertex AI Feb. 14, 2022Unified data and ML: 5 ways to use BigQuery and Vertex AI together - Vertex AI is a single platform with every tool you need to build, deploy, and scale ML models. Get started quickly with five easy integrations between Vertex AI and BigQuery.
Cloud Dataflow Data Analytics Official Blog Feb. 14, 20223 ways Dataflow is delivering 50%+ productivity boost and cost savings to customers - Deliver 50% + productivity boost and cost savings with less than 6 month payback with Dataflow’s unified batch and streaming ETL platform.
Data Analytics Official Blog Feb. 14, 2022Measure and maximize the value of Data Science and AI teams - Suggestions to measure and maximize the value of artificial intelligence teams. Learn from customer cases and how they delivered and measured value.
Cloud Pub/Sub Data Analytics Official Blog Feb. 7, 2022Pub/Sub Lite low cost messaging, now with higher availability - To provide cost-conscious customers with higher availability, Pub/Sub Lite offers regional topics that are stored across two zones.
Data Analytics Official Blog Serverless Spark Feb. 7, 2022Simplify data processing and data science jobs with Serverless Spark, now available on Google Cloud - Spark on Google Cloud, Serverless and Integrated for Data Science and ETL jobs.
BigQuery Data Analytics Official Blog SAP Feb. 7, 2022BigQuery Connector for SAP: Power your cloud data analytics strategy - This announcement blog describes the capabilities and benefits of the real-time BigQuery Connector for SAP.
Cloud Operations Data Analytics Official Blog Vertex AI Jan. 31, 2022Optimize your applications using Google Vertex AI Vizier - Software performance Optimization using novel Bayesian Optimization and Evolutionary Search algos with Google Vizier instead of traditional Operational Research methods.
BigQuery Data Analytics Looker Machine Learning Official Blog Jan. 31, 2022Explaining machine learning models to business users using BigQueryML and Looker - Explainable AI can help business users understand why a machine learning model makes a prediction. In this post, we show how BigQuery and Looker make it easier to build interpretable AI models.
Big Data Data Analytics GCP Experience Jan. 31, 2022Journey of Transforming and Architecting Data Platforms using Lambda Architecture - An outline of architecting Data Platforms using Lambda architecture on Google Cloud.
Cloud Data Fusion Data Analytics Official Blog Jan. 24, 2022Encrypt Data Fusion data and metadata using Customer Managed Encryption Keys (CMEK) - General availability of Customer Managed Encryption Keys (CMEK) for encrypting Cloud Data Fusion data and metadata at-rest.
Cloud Data Fusion Data Analytics Official Blog SAP Jan. 24, 2022Data Fusion SAP Connectors - Unlock the value of your SAP data on Google Cloud with Data Fusion SAP connectors.
Cloud Data Fusion Data Analytics Official Blog SAP Jan. 24, 2022Data Fusion SAP accelerator for Procure 2 Pay - Google Cloud Data Fusion accelerator for SAP Procure to Pay, consisting of SAP connector, pipeline templates, target BigQuery schemas and Looker block.
Cloud Logging Cloud Operations Data Analytics Official Blog Jan. 24, 2022Patterns for better insights and troubleshooting with hybrid cloud logs - Read this blog to discover how Google Cloud is helping customers improve cost and get better insights from their apps and services with cloud logs.
Data Analytics Infrastructure Official Blog Serverless Jan. 24, 2022Data considerations for early-stage startups - Google Cloud technology stack considerations for early-stage startups.
BigQuery Data Analytics GCP Experience Official Blog Jan. 17, 2022How Bayer Crop Science uses BigQuery and geobeam to improve soil health - Understand how to use Google Cloud’s geospatial capabilities to modernize GIS workloads and build geospatial analytics at scale.
Data Analytics Official Blog Jan. 17, 2022Use graphs for smarter AI with Neo4j and Google Cloud Vertex AI - Solve many business analysis problems by representing them as graphs. Neo4j and Google Cloud Vertex AI make it easy to use AI with these data.
Data Analytics Official Blog Jan. 17, 2022Data governance in the cloud - part 1 - People and processes - The role of data governance, why it's important, and processes that need to be implemented to run an effective data governance program.
Data Analytics Looker Official Blog Jan. 17, 2022Top 10 takeaways from Looker’s 2021 JOIN@Home conference - Get motivated to up your data game with the 10 most important takeaways from Looker’s 2021 user conference.
Data Analytics GCP Experience Official Blog SAP Jan. 17, 2022Carrefour Belgium: Driving a seamless digital experience with SAP on Google Cloud - Carrefour Belgium runs SAP on Google Cloud to reduce enterprise risk, increase security and availability and to drive data analytics.
Data Analytics Machine Learning Jan. 17, 2022An Agile Architecture for Analytics and AI on Google Cloud - Bet on low-code/no-code and serverless.
BigQuery Data Analytics Official Blog Jan. 10, 2022Announcing preview of BigQuery’s native support for semi-structured data - With BigQuery’s native JSON support, customers can now write to BigQuery without worrying about future changes to their data.
BigQuery Data Analytics Jan. 10, 2022SQL String Templating in BigQuery: Four Methods - Powerful foundational techniques to help unlock the power of BigQuery scripting and automation.
Big Data Data Analytics Jan. 10, 202210 reasons why you are not ready to adopt data mesh - The goal of this article is to encourage constructive conversations around Data Mesh adoption by describing where Data Mesh may not be the right solution.
Data Analytics Official Blog Dec. 27, 2021Google Cloud Data Analytics 2021: The year in review - How we’ve helped break down silos, unearth the value of data, and apply that data to solve big problems.
BigQuery Data Analytics Official Blog Dec. 27, 2021Leveraging BigQuery Audit Log pipelines for Usage Analytics - Use BigQuery Audit Logs for deep dive monitoring and analytics of BigQuery generated log events for various personas and use cases.
BigQuery Data Analytics Official Blog Dec. 27, 2021The top three insights we learned from data analytics customers in 2021 - Google Cloud announces the top data analytics stories from 2021 including the top three trends and lessons they learned from customers this year.
BigQuery Data Analytics Official Blog Dec. 20, 2021How to migrate an on-premises data warehouse to BigQuery on Google Cloud - Checkout how Independence Health Group is addressing their enterprise data warehouse (EDW) migration, and learn how to plan your own migration.
Data Analytics Official Blog Dec. 20, 20212021 Gartner® Magic Quadrant™ for Cloud Database Management Systems recognizes Google as a Leader - Unified capabilities for transactional and analytical use cases highlighted, as well as progress in security, elasticity, advanced analytics, and more.
BigQuery Data Analytics Official Blog Dec. 20, 2021Google Cloud enables the National Cancer Institute's Institute for Systems Biology-Cancer Gateway in the Cloud to support breast cancer research with fast and secure data sharing - Google’s open, cloud-based data and analytics enable the National Cancer Institute’s Institute for Systems Biology-Cancer Gateway in the Cloud (ISB-CGC) to securely and safely share up-to-the-minute research.
Data Analytics Official Blog Public Datasets Dec. 20, 2021Better data for better AI: new speech datasets and benchmarks for data - Good data is essential to building good ML apps. Learn about a new and useful public dataset from Google Cloud and benchmarks to drive better datasets.
Cloud Pub/Sub Data Analytics Official Blog Dec. 13, 2021Store more and worry less with 31 day retention in Pub/Sub - Cloud Pub/Sub now supports 31 days of message retention for easier reprocessing, cache initialization, and event sourcing.
BigQuery Data Analytics GCP Experience Official Blog Dec. 13, 2021Tokopedia’s journey to creating a Customer Data Platform (CDP) on Google Cloud Platform - Using tools like Big Query, and Data Flow, Tokopedia can better personalize search results and product recommendations for customers.
Data Analytics Official Blog Dec. 6, 2021Learn Beam patterns with Clickstream processing of Google Tag Manager data - Technical blog to show how to build out common patterns for an application built on Apache Beam SDK for the Dataflow runner. E-commerce is simply used as an exemplar for the techniques.
Data Analytics Datastream Official Blog Dec. 6, 2021Unlock the power of change data capture and replication with new, serverless Datastream, now GA - A change data capture (CDC) and replication service that works across heterogeneous databases, cloud and on-premises, for real-time analytics.
Data Analytics Official Blog Dec. 6, 2021Unlocking opportunities with data transformation - Data-driven transformations provide businesses with real-time insights and competitive advantage. Learn how to gear up for the future of data.
BigQuery Data Analytics Official Blog Dec. 6, 2021Easier administration and management of BigQuery with Resource Charts and Slot Estimator - With BigQuery Administrator Hub, customers can now better manage BigQuery at scale. Two key features, Resource Charts and Slot Estimator help administrators understand their BQ environments like never before.
Data Analytics GCP Experience Official Blog Nov. 29, 2021Vodafone provides anonymized mobile phone signal data to help monitor the spread of COVID-19 and inform early warning systems for new outbreaks - European Union calls on Vodafone to share anonymized mobile phone signal data to help monitor the spread of COVID-19.
Cloud Dataflow Data Analytics Official Blog Nov. 22, 2021Export Google Cloud data into Elastic Stack with Dataflow templates - Learn how to set up a streaming pipeline for Google Cloud data into Elastic Cloud and Elastic Stack with new purpose-built Dataflow templates.
Cloud Dataflow Data Analytics Official Blog Python Nov. 22, 2021Debunking myths about Python on Dataflow - Python developers have access to the greatest breadth of features when they use Dataflow for their data processing applications, contrary to popular belief.
Data Analytics Firebase Official Blog Nov. 22, 2021Faster time to value with Data Analytics Design Patterns - Design Patterns provide customers with tools they need to accelerate time to value and implement common use cases so they can focus on innovation.
Cloud Data Fusion Data Analytics Official Blog Nov. 15, 2021Using Google Cloud Vision API from within a Data Fusion Pipeline - This blogs shows how to connect Data Fusion Pipelines to the Vision Rest API using OAuth.
Data Analytics Looker Official Blog Nov. 15, 2021JOIN 2021: Sharing our product vision with the Looker community - JOIN is Looker’s annual user conference, and this blog welcomes everyone to the event and gives a sneak peak into the product capabilities and features we will be announcing during the product keynote.
Data Analytics Looker Official Blog Nov. 15, 2021Going beyond BI with the Looker Marketplace - This post explores how the Looker marketplace acts as an inspiration for developers to build content for the Looker marketplace.
Data Analytics Looker Official Blog Nov. 15, 2021Solving business problems with data - Learn how to understand your customer journey, unlock value from first-party data, and optimize existing cloud infrastructure with Looker solutions.
Data Analytics Official Blog Nov. 15, 2021Bring governance and trust to everyone with Looker’s universal semantic model - Looker’s semantic modeling layer works across all experiences and standardizes common metrics and definitions for business users.
Data Analytics GCP Experience Looker Official Blog Nov. 15, 2021Predict hospital readmission rates with Google Cloud Platform - Examine real-world use cases for predicting 7-day hospital readmission rates utilizing FHIR data stored in BigQuery, along with BigQuery ML, Looker, and Cloud Functions.
BigQuery Data Analytics GCP Experience Nov. 15, 2021Building a Data Warehouse on Google Cloud Platform That Scales With the Business - A story of how Policygenius built their Data Warehouse in Google Cloud.
BigQuery Data Analytics Official Blog Nov. 1, 2021Quickly, easily and affordably back up your data with BigQuery table snapshots - Learn how to use BigQuery table snapshots to quickly, easily and affordably back up your data.
Data Analytics Official Blog Nov. 1, 2021Open data lakehouse on Google Cloud - Exploring a new architecture choice has emerged: the data lakehouse, which combines key benefits of data lakes and data warehouses. Discuss the data lakehouse architecture and its key benefits.
AWS Azure BigQuery Data Analytics Official Blog Nov. 1, 2021BigQuery Omni now available for AWS and Azure, for cross cloud data analytics - BigQuery Omni helps teams break down silos by securely and cost-effectively analyzing data across clouds.
Data Analytics Official Blog Nov. 1, 2021Google Cloud Next Rollup for Data Analytics - Google Cloud Data Analytics - Summary of launches, announcements and customer stories from Next.
Data Analytics Official Blog Nov. 1, 2021Google Cloud's data ingestion principles - Google Cloud's six principles for planning your data ingestion work.
Anthos BigQuery Data Analytics Official Blog Oct. 25, 2021Here’s what you missed at Next ’21 - Too much to take in at Google Cloud Next 2021? No worries - here’s a breakdown of the biggest announcements at the 3-day event.
Cloud Dataproc Data Analytics Official Blog Oct. 25, 2021Spark on Google Cloud: Serverless Spark jobs made seamless for all data users - Spark on Google Cloud allows data users of all levels to write and run Spark jobs that autoscale, from the interface of their choice, in 2 clicks.
Data Analytics Official Blog Oct. 18, 2021Introducing Intelligent Products Essentials: helping manufacturers build AI-powered smart products, faster - Introducing Intelligent Products Essentials: helping manufacturers build AI-powered smart products, faster.
Data Analytics Official Blog Oct. 18, 2021Turn data into value with a unified and open data cloud - At Google Cloud Next we announced Google Earth Engine with Bigquery, Spark on Google Cloud and Vertex AI Workbench.
Data Analytics Official Blog SAP Oct. 18, 2021Accelerate SAP innovation with Google Cloud Cortex Framework - Google Cloud Cortex Framework is a foundation with endorsed reference architectures for customers to more quickly deploy technologies from Google.
Cloud Composer Data Analytics GCP Experience Looker Oct. 11, 2021Out of the data Tar Pit: How loveholidays escaped from a legacy reporting system and kept the data flowing - How Loveholiday improved their reporting by investing in technology simplification and building a brand new ETL system using GCP products.
Data Analytics Official Blog Workflows Oct. 11, 2021Analyzing Twitter sentiment with new Workflows processing capabilities - The combination of iteration syntax and connectors enables you to implement robust batch processing use cases. Let’s take a look at a concrete sample. In this example, you will create a workflow to analyze sentiments of the latest tweets for a Twitter handle.
Cloud Dataflow Data Analytics Official Blog Oct. 11, 2021Dataflow Pipelines, deploy and manage data pipelines at scale - Dataflow Pipelines is a new feature in Dataflow that enables users to deploy and manage data pipelines at scale.
Data Analytics Official Blog Oct. 11, 2021Building the data analyst driven organization from the first principles - Learn about the basics and best practices on how to build a data analyst driven culture depending on what type of organization you are.
Data Analytics Official Blog Oct. 11, 2021Liberating your mainframe data with Confluent and Google Cloud - Google Cloud and Confluent have teamed up to provide an end-to-end solution for connecting your mainframe application data with the advanced analytics capabilities of Google.
Cloud Dataflow Data Analytics Official Blog Oct. 11, 2021Unlocking the hidden value of data: Launching Dataflow Templates for Elastic Cloud - Unlocking data potential: Launching Dataflow Templates for Elastic Cloud.
Data Analytics Official Blog Oct. 4, 2021Building the data science driven organisation from the first principles - Learn about the basics and best practices on how to build a data science driven culture depending on what type of organization you are.
Cloud Pub/Sub Data Analytics Official Blog Oct. 4, 2021Manage Capacity with Pub/Sub Lite Reservations. It’s easier and cheaper. - Inexpensive and simpler messaging for large scale streaming analytics and data integration. Like Apache Kafka, Pub/Sub Lite a partitioned, ordered log.
Data Analytics GCP Certification Official Blog Sept. 27, 2021Build your data analytics skills with the latest no cost BigQuery trainings - A no-cost, on-demand training opportunities to make the most of BigQuery.
Data Analytics Official Blog Sept. 27, 2021Building the data engineering driven organization from the first principles - Learn about the basics and best practices on how to build a data engineering driven culture depending on what type of organization you are.
BigQuery Cloud Dataprep Data Analytics Official Blog Sept. 27, 2021Data Driven Price Optimization - Learn how to transform and centralize disparate data sources into BigQuery with Dataprep by Trifacta for pricing optimization analysis and machine learning.
Airflow Data Analytics Workflows Sept. 27, 2021Why you should try something else than Airflow for data pipeline orchestration - A comparison of a few data orchestrator pipelines.
Data Analytics Official Blog Sept. 20, 2021What type of data processing organization are you? - Data driven transformation requires technical and organizational changes. Success depends on what tech you choose, but also the type of data driven organization you are.
BigQuery Cloud SQL Data Analytics Official Blog Sept. 20, 2021SQL Server SSRS, SSIS packages with Google Cloud BigQuery - The following blog details patterns and examples on how Data teams can use SQL Server Integration Services (SSIS) and SQL Server Reporting Services (SSRS) with Google BigQuery.
Data Analytics Dataplex Sept. 20, 2021One on One with Google Cloud Product Director Irina Farooq - An interview with Irina Farooq about Data solutions on GCP.
Data Analytics Official Blog Serverless Sept. 13, 2021Wrapping up the summer: A host of new stories and announcements from Data Analytics - August rollup of the Google Cloud Data Analytics blog, feature announcements from across the portfolio, how-to articles and customer stories.
BigQuery Data Analytics GCP Experience Sept. 13, 2021Ad agencies choose BigQuery to drive campaign performance - Two advertising agencies use BigQuery cloud data warehouse to streamline reporting and get real-time access to data to ensure the highest campaign performance.
BigQuery Cloud Healthcare Data Analytics Official Blog Sept. 4, 2021Google Cloud improves Healthcare Interoperability on FHIR - Google Cloud improves healthcare interoperability using the FHIR schema using Healthcare Data Engine, BigQuery, and Looker.
BigQuery Data Analytics Official Blog Sept. 4, 2021BigQuery Admin reference guide: Recap - Looking for a path to jumpstart your BigQuery architecture and administration knowledge? This series walks you through the BigQuery fundamentals.
BigQuery Cloud Data Fusion Data Analytics Official Blog Sept. 4, 2021How to load Salesforce data into BigQuery using a code-free approach powered by Cloud Data Fusion - Move Salesforce data into BigQuery using an intuitive drag-and-drop solution based on pre-built connectors, and the self-service model of a code-free data integration service provided by Cloud Data Fusion.
BigQuery Data Analytics Official Blog Public Datasets Sept. 4, 2021What are the newest datasets in Google Cloud? - Want to know about the latest datasets from Google Cloud? Find information here in one handy location. Check back regularly as we update this blog with new datasets and best practices so you can enrich your analytics or ML initiatives.
BigQuery Data Analytics Security Sept. 4, 2021Back to the future of the Datawarehouse Episode 2/3 - An overview of security issues for BigQuery and other data-related services on Google Cloud.
BigQuery Data Analytics Official Blog Aug. 30, 2021BigQuery Admin reference guide: Monitoring - This blog aims to simplify monitoring and best practices related to BigQuery, with a focus on slots and automation.
Cloud Pub/Sub Data Analytics Official Blog Aug. 30, 2021Save messages, money, and time with Pub/Sub topic retention - With new topic retention functionality, you can back up and replay messages that are published to Pub/Sub topic.
Data Analytics GCP Experience Official Blog Aug. 30, 2021How Renault solved scaling and cost challenges on its Industrial Data platform using BigQuery and Dataflow - Renault worked with Google Cloud’s professional services to design and build a new architecture for its data management platform.
Data Analytics Official Blog Aug. 30, 2021Converging architectures: Bringing data lakes and data warehouses together - The convergence of data lake and data warehouse means that users can now access the data regardless of the infrastructure limitations, in where or how data is stored.
Cloud Dataproc Data Analytics GPU HPC Official Blog Aug. 30, 2021Single-cell genomic analysis accelerated by NVIDIA on Google Cloud - Learn about single-cell genomic analysis on Google Cloud using NVIDIA and Dataproc.
Cloud Dataflow Cloud Pub/Sub Data Analytics Official Blog Aug. 30, 2021Handling duplicate data in streaming pipelines using Dataflow and Pub/Sub - How to handle duplicate data in your streaming data pipeline using Pub/Sub and Dataflow.
BigQuery Data Analytics Data Science Aug. 30, 2021Best Practices when working with Google’s BigQuery - How to optimize Usage and Costs.
BigQuery Data Analytics Data Science Aug. 30, 2021Working with Strings in BigQuery - What you have to know when working with String Functions.
BigQuery Data Analytics Official Blog Aug. 23, 2021BigQuery Admin reference guide: API landscape - Explore the different BigQuery APIs that can help you programmatically manage and leverage your data.
Data Analytics GCP Experience Official Blog Aug. 23, 2021IDC reveals 323% ROI for SAP customers using BigQuery - Resulting from interviews with seven customers leveraging BigQuery for SAP data, IDC demonstrates a 323% ROI and 52% lower 3-year cost of operations.
BigQuery Data Analytics Official Blog Aug. 23, 2021BigQuery workload management best practices - This blog aims to simplify the concept of slots and related metrics, benefits of dedicated slots, monitoring best practices and, optimize workload with Automation.
BigQuery Data Analytics GCP Experience Aug. 23, 2021Piloting Google Cloud Platform to enhance data access and usability at NYC Planning - How New York City’s Department of City Planning is using GCP to develop data products for the future of the city.
Data Analytics Python Aug. 23, 2021StarThinker 2.0 Is Here - StarThinker, is a simple and intuitive web UI that allows users to create, edit, run, and schedule data pipelines consistently.
Cloud Dataflow Data Analytics Official Blog Aug. 16, 2021What’s new with Splunk Dataflow template: Automatic log parsing, UDF support, and more! - Announcing new features for Splunk Dataflow template with improved compatibility with Splunk Add-on for GCP, more extensibility using user-defined functions (UDFs), and general pipeline reliability enhancements.
BigQuery Data Analytics Official Blog Aug. 16, 2021BigQuery Admin reference guide: Data governance - Learn how to ensure your data is discoverable, secure and usable inside of BigQuery.
Cloud Dataflow Data Analytics Official Blog Aug. 16, 2021Extend your Dataflow template with UDFs - Learn how to easily extend a Cloud Dataflow template with user-defined functions (UDFs) to transform messages in-flight, without modifying or maintaining Apache Beam code.
Data Analytics Official Blog Aug. 16, 2021Building a unified analytics data platform on Google Cloud - Data-driven transformation starts with a modern data platform, built on Google Cloud.
Data Analytics Official Blog Aug. 9, 2021New This Month in Data Analytics: Taking Home the Gold in Data - Highlights from the July blogs for Data Analytics.
BigQuery Data Analytics Official Blog Aug. 9, 2021BigQuery Admin reference guide: Query optimization - Understand complex query execution and explore techniques to refine your SQL for faster, more efficient data processing.
Data Analytics Visualization Aug. 9, 2021Tableau Server on Google Cloud Platform - This whitepaper is a technical guide for deploying Tableau on the Google Cloud Platform.
Data Analytics Official Blog Aug. 2, 2021All you need to know about Datastream - Learn about Datastream: Serverless and easy-to-use change data capture and replication service.
Data Analytics Looker Official Blog Aug. 2, 2021Building with Looker made easier with the Extension Framework - The Extension Framework is a fully hosted development platform that enables developers to build any data-powered application, workflow or tool right in Looker. By eliminating the need to spin up and host infrastructure, the Extension Framework lets developers focus on building great experiences for their users.
BigQuery Data Analytics Official Blog Aug. 2, 2021BigQuery Admin reference guide: Query processing - An in depth view of query processing in BigQuery.
Cloud Data Fusion Data Analytics GCP Experience Official Blog Aug. 2, 2021How LiveRamp scales identity data management in the cloud - LiveRamp simplifies data operations, and enable customers to connect, control, and activate user data safely and securely with CDAP and Data Fusion.
Cloud Data Fusion Data Analytics Official Blog July 26, 2021Bridge data silos with Data Fusion - An overview of Cloud Data Fusion.
BigQuery Data Analytics Looker Official Blog Security July 26, 2021Extending the power of Chronicle with BigQuery and Looker - Google Cloud security analytics platform, Chronicle, now integrated with BigQuery and Looker improving security operations.
Cloud Dataflow Data Analytics GPU Official Blog July 26, 2021Give your data processing a boost with Dataflow GPU - With Dataflow GPU, customers can leverage the power of NVIDIA GPUs in their data pipelines.
Data Analytics Looker Official Blog July 26, 2021Reimagining the way we experience data with new Looker product features - Google Cloud introduces new features to Looker to help organizations deliver data-driven experiences at scale.
BigQuery Data Analytics Official Blog Public Datasets July 26, 2021Make informed decisions with Google Trends data - Walk through example queries and workflows to blend the newly launched Google Trends public dataset with other actional data.
BigQuery Data Analytics GCP Experience Official Blog July 26, 2021Crux chose BigQuery for rock-solid, cost-effective data delivery - Crux uses BigQuery as central cloud data warehouse and data hub.
Cloud SQL Data Analytics Official Blog July 26, 2021Use Cloud SQL Read Replicas to separate your analytics and production workloads - Learn the steps to use Cloud SQL Read Replicas to separate your analytics and production workloads.
Data Analytics Firebase Python July 19, 2021Mindfulness App: How to Analyse User Behaviour Using Google Firebase Events Data - This article presents the solutions to some of the most common challenges in analyzing Firebase events data to generate app use insights.
BigQuery Data Analytics Official Blog July 12, 2021New This Month in Data Analytics: Simple, Sophisticated, and Secure - We used all the hours we could in June to deliver a flurry of new features across BigQuery, Dataflow, Data Fusion, and more. Let’s take a look!
BigQuery Data Analytics July 12, 2021Why We Shouldn’t Ignore Null Values and How to Treat Them - Data cleaning using Google BigQuery SQL.
CI Data Analytics dbt July 12, 2021Step-by-step guide to run dbt in production with Google Cloud Platform - A step-by-step guide to run dbt in production with GCP.
BigQuery Data Analytics Official Blog July 5, 2021BigQuery admin reference guide: Tables & routines - Understand the differences between table types and routines in BigQuery, and how to choose the right one for your needs.
BigQuery Data Analytics Firebase Looker Official Blog July 5, 2021Creating a unified analytics platform for digital natives - Learn how to leverage Firebase, BigQuery and Looker to create a central platform for cross-functional analytics.
BigQuery Data Analytics Official Blog July 5, 2021What's new with BigQuery ML: Unsupervised anomaly detection for time series and non-time series data
BigQuery Data Analytics Official Blog July 5, 2021Mercury Rising in BigQuery with Multistatement Transactions - Multistatement transactions in BigQuery now in Preview supports COMMIT and ROLLBACK operations.
Cloud Dataflow Data Analytics Official Blog July 5, 2021Dataflow, the backbone of data analytics - An overview of Cloud Dataflow.
BigQuery Data Analytics Official Blog July 5, 2021Shine on with user-friendly SQL capabilities in BigQuery - We are pleased to announce new capabilities in three themes: Powerful Analytics Features, Flexible Columns, and Secure with SQL.
BigQuery Cloud AutoML Data Analytics Official Blog July 5, 2021AutoML Tables is now generally available in BigQuery ML - AutoML Tables model type is now generally available as supported ML model within BigQuery ML.
BigQuery Data Analytics Official Blog Public Datasets July 5, 2021Top 25 Google Search terms, now in BigQuery - Google Trends datasets for the Top 25 terms and Top 25 Rising terms now available in BigQuery to enhance your business analyses.
BigQuery Data Analytics Official Blog June 28, 2021The BigQuery admin reference guide: Resource Hierarchy - Learn about the BigQuery Resource Hierarchy, and how to structure Projects, in the first part of our series to help BigQuery administrators master the fundamentals.
BigQuery Data Analytics Official Blog June 28, 2021BigQuery row-level security enables more granular access to data - BigQuery row-level security provides more granular access control over your data.
Cloud Dataproc Data Analytics Official Blog June 22, 2021Dataproc best practices guide - Best practices for Storage, Compute and Operations when using Dataproc for running Hadoop- or Spark-based workloads.
Data Analytics June 22, 2021The Multi-Cloud Future (5) — How To Do “Data” The Multi-Cloud Way - Some ways Google Cloud lets you make the best use of all of your data — wherever they are.
Airflow BigQuery Data Analytics Terraform June 22, 2021Bootstrap a Modern Data Stack in 5 minutes with Terraform - Setup Airbyte, BigQuery, dbt, Metabase, and everything else you need to run a Modern Data Stack using Terraform.
Data Analytics June 22, 2021Unit Testing in dbt — Part 1 - Custom testing within dbt for data in BigQuery.
BigQuery Data Analytics Monitoring Official Blog June 14, 2021Monitoring BigQuery reservations and slot utilization with INFORMATION_SCHEMA - BigQuery Reservations help manage your BigQuery workloads. Learn how to use BigQuery’s INFORMATION_SCHEMA system tables to create the System Tables Reports Dashboard.
Data Analytics Official Blog June 14, 2021New This Month: From leadership in real-time streaming to intelligent data fabric and analytics exchanges - May was a very busy month for data analytics product innovation. If you didn’t have the chance to attend our inaugural Data Cloud Summit, video replays of all our sessions are now available so feel free to watch them at your own pace.
Cloud Dataflow Data Analytics Official Blog June 14, 2021Google Dataflow is a Leader in The 2021 Forrester Wave™: Streaming Analytics - Forrester gave Dataflow a score of 5 out of 5 across 12 different criteria in its 2021 Forrester Wave: Streaming Analytics.
BigQuery Data Analytics GCP Experience Official Blog June 7, 2021PedidosYa: BigQuery reduced our total cost per query by 5x - Online food ordering app switches to Google Cloud, speeds up deployment 3x and cuts costs per query 5x.
BigQuery Data Analytics June 7, 2021Back to the future of the Datawarehouse Episode 1/3 - New series about Data warehousing, the good the bad, and the ugly!
Data Analytics Datashare Official Blog May 31, 2021Introducing Datashare solution for financial services for licensed market data discovery, access and analytics on Google Cloud - Datashare brings together the entire capital markets ecosystem—data publishers, aggregators, and consumers—to exchange market data securely and easily.
BigQuery Data Analytics Datastream Official Blog May 31, 2021Real-time Change Data Capture for data replication into BigQuery - Examples of using various integrations to BigQuery.
Analytics Hub Data Analytics Official Blog May 31, 2021Introducing Analytics Hub: secure and scalable sharing for data and analytics - Analytics Hub makes data sharing across organizations secure and easy.
Data Analytics Official Blog May 31, 2021New Google Cloud innovations to unify your data cloud - Google Cloud unveils news data analytics products and services to support open data cloud.
Data Analytics Dataplex Official Blog May 31, 2021Introducing Dataplex—an intelligent data fabric for analytics at scale - Dataplex unifies distributed data to help automate data management and power analytics at scale.
Cloud Dataflow Data Analytics Official Blog May 31, 20213x Dataflow Throughput with Auto Sharding for BigQuery - Google is launching Dataflow Auto Sharding - a new capability that enables users to get increased performance when writing to Big Query in Dataflow. With Auto sharding, Dataflow automatically sets the number of shards for Big Query sink without manual user work.
BigQuery Data Analytics Official Blog May 31, 2021Have a cool summer with BigQuery user-friendly SQL - We are pleased to announce three categories of BigQuery user-friendly SQL launches: Powerful Analytics Features, Flexible Schema Handling, and New Geospatial Tools.
BigQuery Data Analytics Official Blog Public Datasets May 24, 2021Discover datasets to enrich your analytics and AI initiatives - Discover and access datasets and pre-built dataset solutions from Google, or public and commercial data providers.
Business Data Analytics Official Blog May 24, 2021Transforming your business with the data cloud - Accelerate your business transformation with the data cloud.
BigQuery Data Analytics Official Blog Public Datasets May 24, 2021Datasets for Google Cloud: Introducing our new reference architecture - Get a deep dive on the new reference architecture we built that offers a more streamlined data onboarding process for the Google Cloud Public Datasets Program.
Data Analytics Official Blog May 24, 2021How insurers can use severe storm data for dynamic pricing - Check out how insurance companies can use public datasets, like those from NOAA with storm data, to do predictive analytics and create better risk assessments.
BigQuery Data Analytics May 24, 2021Using Census Data For Advertising Campaign Funnel Analysis - StarThinker is a simple and intuitive web UI that allows users to create, edit, run, and schedule data pipelines consisting of data transfer and data processing jobs. StarThinker deploys on Google Cloud in minutes without engineering or coding required.
Data Analytics Official Blog May 10, 2021Databricks on Google Cloud is now generally available - With the GA of Databricks on Google Cloud, enterprises get the benefits of an open data cloud platform with greater analytics flexibility, unified infrastructure management, and optimized performance.
Cloud Dataflow Data Analytics Official Blog TensorFlow May 3, 2021Using TFX inference with Dataflow for large scale ML inference patterns - Walk-through of TensorFlow Extended ( TFX ) RunInference API with Google Cloud Dataflow. Abstracting you away from the manual toil of implementing inference patterns at scale.
Data Analytics GCP Experience Official Blog May 3, 2021Seven-Eleven Japan uses Google Cloud to serve up real-time data for fast business decisions - Learn how 7-Eleven Japan's built Seven Central, a new platform for practical data use to support the company’s future IT strategies and digital transformation initiatives.
BigQuery Cloud Bigtable Data Analytics Official Blog April 25, 2021Bigtable vs. BigQuery: What’s the difference? - Bigtable vs BigQuery? What’s the difference? In this blog, you'll get a side-by-side view of Google BigQuery and Google Cloud Bigtable.
Data Analytics Event Official Blog April 19, 2021Announcing Google Cloud 2021 Summits [frequently updated] - Google Cloud Summit digital event series to support industries ranging from Financial Services to Manufacturing & Supply Chain to Retail & Consumer Goods.
BigQuery Data Analytics Official Blog April 19, 2021Churn prediction for game developers using Google Analytics 4 (GA4) and BigQuery ML - To retain a larger percentage of users after their first use of an app, developers can take steps to motivate and incentivize certain users to return. But to do so, developers need to identify the propensity of any specific user returning after the first 24 hours.
Cloud Dataproc Data Analytics Official Blog April 19, 2021Broadcom improves customer threat protection with flexible data management - Broadcom uses decentralized data lake infrastructure to speed development of security analytics.
Cloud Data Fusion Data Analytics Official Blog SAP April 19, 2021Introducing SAP Integration with Cloud Data Fusion - Google Cloud native data integration platform Cloud Data Fusion now offers the capability to seamlessly get data out of SAP Business Suite, SAP ERP and S/4HANA.
Data Analytics GCP Experience Official Blog April 12, 2021Fintech startup, Branch makes data analytics easy with BigQuery - FinTech startup, Branch, built its data platform with BigQuery making data accessible to its analysts and scientists.
BigQuery Cloud Dataflow Data Analytics Official Blog April 12, 2021Creating a serverless pipeline for real-time market data - See how to create a real-time data analytics pipeline for use with market data, using serverless technology for ingestion and storage.
BigQuery Cloud Dataprep Data Analytics Official Blog April 12, 2021New flexibility: Run your Dataprep jobs with BigQuery or Dataflow - Dataprep can now run using either BigQuery or Dataflow.
BigQuery Data Analytics Official Blog April 5, 2021New this month: Data champions, a key analyst report & features you’re going to want to check out! - Sudhir Hasbe, senior director of product management, shares the latest on how customers and industries are using Google Cloud smart analytics to grow and innovate.
BigQuery Data Analytics Official Blog April 5, 2021Troubleshoot BigQuery performance with these dashboards - A few key dashboards can help monitor and optimize BigQuery performance to keep your apps running reliably.
BI Engine BigQuery Data Analytics Official Blog April 5, 2021Speeding up small queries in BigQuery with BI Engine - A quick and easy way to speed up small queries in BigQuery is to use BI Engine. Now, it is available to any application, not just dashboards.
Data Analytics Official Blog April 5, 2021Why Google Cloud is the ideal platform for Block.one and other DLT companies - We’re sharing more on why Google Cloud is uniquely positioned to be an excellent partner for Block.one and other distributed ledger technology (DLT) companies.
BigQuery Data Analytics GIS Google Maps Platform Official Blog April 5, 2021Unlock geospatial insights with Data Studio and BigQuery GIS - Learn how to create arbitrary-polygon choropleth maps in Data Studio with BigQuery GIS and Google Maps.
BigQuery Data Analytics Official Blog April 5, 2021Spring forward with BigQuery user-friendly SQL - The newest set of user-friendly SQL features in BigQuery are designed to enable you to load and query more data with greater precision, allow users to evolve their data rapidly as your needs change, and lower your query and storage costs.
BigQuery Data Analytics Official Blog April 5, 2021How BigQuery helps scale and automate insights for baseball fans - An in depth look at how BigQuery features and functionality can create insights from data for baseball fans.
Data Analytics Official Blog April 5, 2021Creating an experience management (XM) data warehouse with survey responses - Google Cloud and Trifacta have partnered to create a design pattern to easily shape, display, and use survey data.
Cloud Dataproc Data Analytics Official Blog April 5, 2021Data Lake management just got easier with Dataproc Metastore GA - Today, we are excited to announce the general availability of Dataproc Metastore. A fully managed, serverless technical metadata repository based on the Apache Hive metastore.
Data Analytics Data Science Event April 5, 2021Data Cloud Summit - May 26, 2021 - Join us to learn how leading companies are powering innovation with our data solutions. Attend sessions, demos, and live Q&As to discover how data can help you make smarter business decisions and solve your organization’s most complex challenges.
BigQuery Data Analytics April 5, 2021A comparative analysis between BigQuery, Redshift, and Snowflake - A complete analysis of the three cloud databases. The post goes into a performance, usability, and functional comparisons.
BigQuery Data Analytics Official Blog March 29, 2021Using BigQuery Administrator for real-time monitoring - Resource Charts for BigQuery Administrator makes it easy to understand historical patterns across slot consumption, job concurrency, & job performance.
BigQuery Data Analytics Official Blog March 29, 2021Google BigQuery is a Leader in The 2021 Forrester Wave: Cloud Data Warehouse - Forrester places Google as a Leader in the 2021 Forrester Wave™ Cloud Data Warehouse.
BigQuery Data Analytics Firebase March 29, 2021Understanding Customer Mobile App Journey Using Firebase Events and BigQuery. - Querying Firebase user events in BigQuery.
Cloud Build Data Analytics Docker March 29, 2021Node-RED solution deployment on GCP - Securing Node-RED deployments on GCP.
BigQuery Data Analytics March 29, 2021LTV — lifetime value - Analyzing user behavior in BigQuery.
BigQuery Data Analytics Official Blog March 22, 2021Analyzing Python package downloads in BigQuery - Dig into trends in Python package downloads with BigQuery’s new public dataset.
Data Analytics Official Blog March 22, 2021Meet the Authors: Data Governance–The Definitive Guide - Hear from the authors of a new book, Data Governance: The Definitive Guide, about the people, processes, and tools to operationalize data trustworthiness. O'Reilly © 2021.
Airflow BigQuery Cloud Functions Data Analytics Serverless March 22, 2021Workload Management using Bigquery Reservation Slots. - Scheduling BigQuery Flex slots using Airflow.
Data Analytics Official Blog March 15, 2021Open innovations, scaling data science, and amazing data analytics stories from industry leaders - What’s new in data analytics, from the official Google Cloud blog: how to democratize data, how customers are transforming, and new data analytics features.
BigQuery Data Analytics March 15, 2021Discussing privacy at Hacker News: an explorative text-mining analysis - Compiled dataset in Google BigQuery and analyzed posts about privacy with simple text-mining methods.
Cloud Pub/Sub Data Analytics Official Blog March 8, 2021Introducing Apache Spark Structured Streaming connector for Pub/Sub Lite - Introducing Pub/Sub Lite connector for Apache Spark for cost-effective streaming data analytics.
Data Analytics Official Blog March 8, 2021Data champions: How the Golden State Warriors are turning on-court data into a competitive advantage - Learn how the Warriors are using intelligent technologies with Google’s Data Cloud to better serve the needs of coaches, front office, staff, players and fans.
Data Analytics GCP Experience Infrastructure Official Blog March 8, 2021Helping small business customers think big with help from cloud technology - See how CRM provider Keap moved its on-premises infrastructure to Google Cloud to save costs, ensure redundancy and scalability for customers, and free up time for DevOps work.
Data Analytics Official Blog March 8, 2021Reducing risk through credit card fraud detection - Google Cloud data analytics plus Quantiphi provide a solution to credit card fraud detection.
BigQuery Cloud Run Data Analytics Official Blog Python March 8, 2021Inventory management with BigQuery and Cloud Run - Building a simple inventory management system with Cloud Run and BigQuery.
BigQuery Cloud Pub/Sub Data Analytics Official Blog Serverless March 8, 2021How to build a serverless real-time credit card fraud detection solution - A smart analytics design pattern that enables you to build a scalable real-time fraud detection solution in one hour using serverless, no-ops products on Google Cloud.
BigQuery Data Analytics Data Science March 8, 2021Google BigQuery Date & Time Quick Reference Guide - Common date and time operations in BigQuery.
Cloud Composer Cloud Data Fusion Data Analytics Official Blog March 1, 2021Framework for building a configuration driven data lake using Data Fusion and Composer - This article provides a framework for building a configuration driven data lake on Google Cloud using Data Fusion and Composer.
Data Analytics Looker Official Blog March 1, 2021Accelerate data science workflows with Looker, plus free training to help get started - Learn how data analysts and scientists can use Looker to help with data governance, join our training to walk through working examples of how Looker can be leveraged to help automate and productionalize data science workflows.
BigQuery Data Analytics Official Blog March 1, 2021BigQuery delivers a modern view of materialized views - BigQuery materialized views is now GA and provides query cost-optimization and increased performance.
BI Engine BigQuery Data Analytics Official Blog March 1, 2021New in BigQuery BI Engine: faster insights across popular BI tools - BigQuery BI Engine ensures significantly faster queries across popular BI tools.
BigQuery Data Analytics Machine Learning Official Blog March 1, 2021How to use a machine learning model from a Google Sheet using BigQuery ML - By combining Sheets with BigQuery ML, you can bring the power of machine learning to data in your spreadsheet.
Data Analytics Official Blog March 1, 2021Run data science at scale with Dataproc and Apache Spark - Dataproc Hub, a feature now generally available for Dataproc users, provides an easier way to scale processing for common data science libraries and notebooks, govern custom open source clusters, and manage costs so that enterprises can maximize their existing skills and software investments.
AI Platform Data Analytics GPU Official Blog March 1, 2021Scale model training in minutes with RAPIDS + Dask and NVIDIA GPUs on AI Platform - Scale model training from 10 GB to 640 GB in minutes with RAPIDS + Dask and NVIDIA GPUs on AI Platform.
Cloud Composer Cloud Data Fusion Data Analytics Official Blog Feb. 22, 2021Architect your data lake on Google Cloud with Data Fusion and Composer - Designing a data lake on Google Cloud with Data Fusion and Composer.
Data Analytics Official Blog Feb. 22, 2021Databricks on Google Cloud: an open integrated platform for data, analytics and machine learning - Databricks and Google Cloud partner to provide an open, integrated platform for data, analytics, and machine learning.
BigQuery Data Analytics GCP Experience Official Blog Feb. 15, 2021Why Verizon Media picked BigQuery for scale, performance and cost - See the proof of concept (POC) numbers that Verizon’s Yahoo got when testing and verifying the improved performance, cost, and scale of BigQuery for their data warehouse.
BigQuery Cloud Run Data Analytics Official Blog Serverless Feb. 15, 2021How to trigger Cloud Run actions on BigQuery events - This post explains how to trigger a Cloud Run task whenever rows are inserted into your BigQuery table. This works off pretty much any BigQuery event, and because it’s Cloud Run, you can do pretty much anything in response.
Data Analytics Official Blog Feb. 15, 2021Architecting a data lineage system for BigQuery - Use Data Catalog as an interface to attach business metadata to your cloud analytics data or on-prem data to create a data lineage system with structured tags.
BigQuery Cloud Scheduler Data Analytics Official Blog Feb. 8, 2021Continuous model evaluation with BigQuery ML, Stored Procedures, and Cloud Scheduler - Continuous evaluation—the process of ensuring a production machine learning model is still performing well on new data—is an essential part in any ML workflow. Performing continuous evaluation can help you catch model drift, a phenomenon that occurs when the data used to train your model no longer reflects the current environment.
Cloud Data Fusion Data Analytics Official Blog Feb. 8, 2021Introducing real-time data integration for BigQuery with Cloud Data Fusion - See how Cloud Data Fusion makes it easy to replicate and integrate data in real-time, low-latency pipelines from cloud databases into cloud data warehouse BigQuery.
Data Analytics Official Blog Feb. 1, 2021The evolution of data architecture at The New York Times - See how the New York Times uses Google Cloud’s end-to-end data platform for fast streaming pipelines, advanced analytics, and record-high site traffic during the 2020 election.
Data Analytics Official Blog Feb. 1, 2021Retailers find flexible demand forecasting models in BigQuery ML - Try BigQuery’s design pattern for demand forecasting to create predictive analytics models for retail use cases.
Data Analytics Official Blog Feb. 1, 2021How our customers modernize business intelligence with BigQuery and Looker - BigQuery and Looker customers use modern business intelligence (BI) to find data insights and allow self-service discovery for all teams.
Data Analytics Official Blog Jan. 18, 2021Powering open source healthcare research on Google Cloud - Google Cloud partners with OHDSI on standardizing health data analytics with open source tools.
AI Platform Notebooks Data Analytics GPU Jan. 18, 2021Powerful yet familiar workflow for the Data Analyst - Accelerating data processing using GPUs.
BigQuery Data Analytics Data Studio Jan. 11, 2021Analyze Jira Issues using BigQuery and Data Studio - Analyzing Jira issues in BigQuery.
BigQuery Data Analytics Machine Learning Jan. 11, 2021Agile Machine Learning with dbt and BigQuery ML - Combine the orchestration power of dbt with the ML power of BigQuery.
Data Analytics Official Blog Dec. 28, 2020In case you missed it: here’s what happened in data analytics in 2020 - From the official Google Cloud blog: here’s what was new and exciting in cloud data analytics in 2020, including multicloud querying, BI, AI and ML, and more.
Data Analytics Official Blog Dec. 28, 2020A revolution is coming for data and the cloud: 6 predictions for 2021 - Check out the 6 predictions on what to look for in data analytics in 2021 and beyond, including multicloud, data sovereignty, cloud data lakes, and more.
BigQuery Data Analytics Dec. 28, 2020Some query samples to interpret Google Analytics data using Bigquery - Sample queries for Google Analytics data in BigQuery.
Data Analytics Official Blog Dec. 21, 2020Most popular public datasets to enrich your BigQuery analyses - Free public datasets from Google Cloud, available to help you get started easily with big data analytics in BigQuery and Cloud Storage.
Cloud Data Fusion Data Analytics Official Blog Dec. 21, 2020Create a secure and code-free data pipeline in minutes using Cloud Data Fusion - Learn how to set up a secure, no-code data pipeline and see how you can move data easily and anonymize it in your cloud data warehouse.
Cloud Dataproc Data Analytics Official Blog Dec. 21, 2020Dataproc Metastore: Fully managed Hive metastore now in public preview - Dataproc Metastore lets you use your Apache Hive metastore to simplify technical metadata management when you’re building a data lake on Google Cloud.
Big Data BigQuery Data Analytics Data Studio Public Datasets Dec. 21, 2020How to compute a growth rate in BigQuery using SQL - Analyzing Google Analytics public dataset with BigQuery to obtain various data.
Data Analytics Official Blog Dec. 15, 2020Faster machine learning on Dataproc with new initialization action - Setting up environments for Machine Learning is tricky. This blog post explains how to do so with a new initialization action.
Cloud Dataproc Data Analytics Official Blog Python Dec. 14, 2020Improve the data science experience using scalable Python data processing - Announcement of the Dask support for Dataproc, Google Cloud’s fully managed Apache Hadoop and Apache Spark service, via a new initialization action.
BigQuery Data Analytics Dataform Official Blog Dec. 14, 2020Dataform is joining Google Cloud: Deploy data transformations with SQL in BigQuery - With our of Dataform, you can now leverage software development best practices to define, document, test and deploy data transformations using SQL executed within BigQuery.
Data Analytics Official Blog Dec. 14, 2020Pub/Sub makes scalable real-time analytics more accessible than ever - Here’s how the move from daily batch processing to real-time processing for data analytics gets easier with Pub/Sub to scale fast.
Cloud Pub/Sub Data Analytics Dec. 14, 2020Things I wish I knew about Google Cloud Pub/Sub: Part 2 - This is a continuation of our three part series in providing useful tidbits in using Pub/Sub effectively.
Cloud Dataflow Data Analytics Machine Learning Official Blog Dec. 7, 2020Machine learning patterns with Apache Beam and the Dataflow Runner, part I - As more people use ML inference in Dataflow pipelines to extract insights from data, we’ve seen some common patterns emerge. In this post, we explore the process of providing a model with data and extracting the resulting output.
Apache Beam Data Analytics Official Blog Dec. 7, 2020Simplify creating data pipelines for media with Spotify’s Klio - Spotify open-sources Klio: scalable, efficient media processing on top of Apache Beam.
Big Data Cloud Dataproc Data Analytics Official Blog Dec. 7, 2020Best practices to use Apache Ranger on Dataproc - Run managed open source like Apache Hadoop and Spark in the cloud. Get tips on secure deployment with Dataproc and the Apache Ranger authorization OSS.
Data Analytics Official Blog Storage Dec. 7, 2020Gartner 2020 Magic Quadrant for Cloud Database Management Systems names Google a Leader - Gartner’s first-ever database management systems (DBMS) Magic Quadrant (MQ) names Google Cloud a Leader.
BigQuery Data Analytics Machine Learning Official Blog Nov. 30, 2020What’s new in BigQuery ML: non-linear model types and model export - Check out new non-linear machine learning (ML) model types built into cloud data warehouse BigQuery, along with ML model export capabilities.
Data Analytics Official Blog Nov. 22, 2020Use real-time anomaly detection reference patterns to combat fraud - Algorithms and machine learning models can help you implement a streaming anomaly detection architecture using pre-designed reference patterns and cloud data analytics.
BigQuery Data Analytics GCP Experience Official Blog Nov. 22, 2020How BigQuery helped Theta Labs and NASA bring science and hope to streaming - See how Theta Labs helped livestream the SpaceX launch with help from Google Cloud’s databases and data analytics tools.
BigQuery Data Analytics Official Blog Nov. 22, 2020Data governance in Google Cloud–new ways to securely access and discover data - As organizations bring ever more sensitive data analytics workloads to the cloud, BigQuery column-level security, now GA, provides fine-grained controls to help them satisfy principles of least-privileged access.
Data Analytics Machine Learning Official Blog Nov. 22, 2020The democratization of data and insights: Expanding machine learning access - Learn why machine learning is critical to generating insights in today’s world of big data, as well as what Google Cloud is doing to expand access to this powerful method of analysis.
Cloud Dataproc Data Analytics Official Blog Nov. 16, 2020Dataproc cooperative multi-tenancy - How you can use Dataproc Cooperative Multi-Tenancy to share Dataproc clusters across multiple users.
Data Analytics Official Blog Nov. 9, 2020The democratization of insights: Empowering data analysts and business users - We explore how what it means to be “data-driven” has changed over time, and how Google Cloud is helping customers push those boundaries today.
Big Data Data Analytics Docker Nov. 9, 2020A step-by-step guide deploying Amundsen on Google Cloud Platform - Amdunsen is Lyft’s Data Discovery Platform and metadata engine. It helps the data team to be more productive by saving time spent in the discovery phase — less time searching, more time finding.
AI Platform Data Analytics Machine Learning Official Blog Serverless Nov. 2, 2020Using remote and event-triggered AI Platform Pipelines - Setting up remote and event-triggered ML pipeline jobs on Google Cloud.
Data Analytics Official Blog Nov. 2, 2020All treats, no tricks with product recommendation reference patterns - Get started with predictive analytics for retail using product recommendation design patterns. Try other cloud reference patterns with sample code for analytics use cases.
Data Analytics Official Blog Oct. 26, 2020MLB uses Google Cloud Smart Analytics platform to scale data insights - Learn how Google Cloud tools were applied to Statcast data to derive insights that enable MLB broadcasters and content generators to determine relevant storylines and add richer context to games.
Big Data Cloud Dataproc Data Analytics Official Blog Oct. 26, 2020Preparing for serverless big data open source software - Serverless capabilities at Google Cloud continue to develop, and serverless is now meeting open source as tools like Dataproc let you build on your open foundation in the cloud.
Data Analytics GCP Experience Official Blog Oct. 26, 2020Meeting the need for speed with a cloud data warehouse - See how e-commerce company Trendyol migrated their data warehouse to BigQuery to meet SLAs and get better performance.
BigQuery Data Analytics Machine Learning TensorFlow Oct. 26, 20205 Machine Learning Models You Can Deploy Using BigQuery - Overview of machine learning models supported by BigQuery ML.
Cloud Pub/Sub Data Analytics Oct. 26, 2020Google Cloud Pub/Sub Ordered Delivery - This article discusses the details of how the Pub/Sub ordering works and talks about some common gotchas when trying to process messages in order in distributed systems.
Data Analytics Official Blog Oct. 19, 2020What’s happening in BigQuery: Time unit partitioning, Table ACLs and more - Check out new cloud data warehouse features from BigQuery, such as time unit partitioning, table ACLs, and expanded metadata access.
Cloud Dataproc Data Analytics Official Blog Oct. 19, 2020New Dataproc optional components support Apache Flink and Docker - Run native Apache Spark and Hadoop clusters on Dataproc fast and cost-effectively. New optional components for Docker and Flink available.
BigQuery Data Analytics Official Blog Oct. 19, 2020Smile with new user-friendly SQL capabilities in BigQuery - New commands, functions, scripting, and SQL language improvements in BigQuery.
Data Analytics Official Blog Oct. 19, 2020Learn at no cost how to get insights from your data, regardless of your analytics experience - How Google Cloud helps IT practitioners of all skill levels, from beginners to experts, to build their data analytics skills.
BigQuery Data Analytics Official Blog Oct. 19, 2020BigQuery explained: Blog series - Find links to all posts in the BigQuery Explained series.
BigQuery Data Analytics GCP Experience Oct. 19, 2020How we use Supermetrics & Google BigQuery at Supermetrics - Description of how Supemetrics is using BigQuery.
Data Analytics Genomics Official Blog Oct. 12, 2020Providing open access to the Genome Aggregation Database (gnomAD) on Google Cloud - The Genome Aggregation Database (gnomAD) brings together data from numerous large-scale sequencing projects and is one of the most comprehensive sources in genomic research.
BigQuery Data Analytics Oct. 12, 2020New BigQuery Integration for App + Web Properties - This article explains how to set Google Analytics event data export to BigQuery.
Cloud Dataflow Data Analytics Official Blog Oct. 5, 2020Turn any Dataflow pipeline into a reusable template - Flex Templates allow you to create templates from any Dataflow pipeline with additional flexibility to decide who can run jobs, where to run the jobs, and what steps to take based on input and output parameters.
BigQuery Data Analytics Serverless Oct. 5, 2020Scheduling BigQuery Slots - Reliably adding and removing short term slot capacity on a schedule.
BigQuery Data Analytics Oct. 5, 2020Leveraging BigQuery with Google Analytics Data - Analyzing Google Analytics with BigQuery.
Data Analytics Firebase Official Blog Oct. 5, 2020Why you should add Google Analytics to your Crashlytics integration - Combining Crashlytics with Google Analytics to simplify keeping track of all the crashes users experience.
BigQuery Data Analytics Official Blog Sept. 21, 2020Data warehouse migration tips: preparation and discovery - In this post, we’ll explore a few important questions that come up during the initial preparation and discovery phase for data warehouse migration.
Cloud SQL Data Analytics Official Blog Sept. 21, 2020Export data from Cloud SQL without performance overhead - We’re launching export offloading in Cloud SQL so you can export data from your MySQL and PostgreSQL database instances without impacting performance or risking your production workloads.
BigQuery Cloud Run Data Analytics gRPC Serverless Sept. 21, 2020Serverless Log Data Ingestion Pipelines - Manage your data, not infrastructure & I like protobuf for real-time analytics!
Data Analytics Official Blog SAP Sept. 14, 2020Analytics get smarter for SAP customers with Informatica and Google Cloud - Informatica and Google Cloud have partnered to help SAP customers better integrate and manage their data and gain new, powerful capabilities like world class analytics and AI at scale.
Airflow Cloud Composer Data Analytics Sept. 14, 2020Setup DBT with Cloud Composer - Google Cloud Composer, and dbt can work together to develop ETL processes. This article will show you how to set up the two together.
BigQuery Data Analytics Sept. 14, 2020Cool things you can do using window functions in BigQuery - Using windowing functions in BigQuery.
Data Analytics Official Blog Sept. 7, 2020Automating data pipelines with BigQuery and Fivetran - Learn how one customer is using Fivetran's automated data integration to reduce complexity, as well as step-by-step instructions on how to implement something similar in your environment.
BigQuery Cloud Dataflow Data Analytics Networking Serverless VPC Service Controls Sept. 7, 2020Designing Secure Data Pipelines with VPC Service Controls - This blog post describes an example of how to build a Data Platform using Cloud Functions, Dataflow, Google Cloud Storage, and Bigquery with VPC Service Controls.
Data Analytics Data Catalog Official Blog Aug. 31, 2020Understanding the fundamentals of tagging in Data Catalog - See how to use tagging and templates inside Data Catalog, Google Cloud’s metadata management service that covers operational and business metadata.
Data Analytics Official Blog Aug. 31, 2020Dataflow Under the Hood: comparing Dataflow with other tools - See how fully managed streaming service Dataflow helps make stream and batch processing and data analytics easier.
Data Analytics Official Blog Aug. 24, 2020Synthetic data generation with Dataflow data generator flex template - Dataflow Flex template Streaming Data Generator lets businesses generate synthetic data at a high QPS.
Cloud Dataflow Data Analytics Official Blog Aug. 24, 2020Dataflow Under the Hood: the origin story - See how Dataflow, Google’s cloud batch and stream data processing tool, works to offer modern stream analytics with data freshness options.
Data Analytics Official Blog Public Datasets Aug. 17, 2020COVID-19 public datasets: our continued commitment to open, accessible data - COVID-19 public datasets from Google Cloud let you explore data for predictive analytics and more. See how news and scientific organizations are using COVID-19 data.
BigQuery Data Analytics GCP Experience Official Blog Aug. 17, 2020Accelerating Mayo Clinic’s data platform with BigQuery and Variant Transforms - See how Mayo Clinic uses Google Cloud to work with genomic variant data for research purposes. Cloud data warehouse BigQuery lets them save on costs and time.
BigQuery Data Analytics Official Blog Aug. 17, 2020How fleet management gets easier with smart analytics on Google Cloud - Check out this data analytics demo on how to use sensor data to make real-time decisions for a fleet management environment using BigQuery and more.
BigQuery Data Analytics Official Blog Aug. 17, 2020BigQuery now offers industry-leading uptime SLA of 99.99% - Cloud data warehouse BigQuery now offers a service-level agreement (SLA) of 99.99% from its previous 99.9%. Four nines of availability helps ensure business continuity.
BigQuery Data Analytics Official Blog Aug. 17, 20206 tips for database pros to adapt to cloud data warehouses - Cloud data warehouses bring flexibility and scale, but affect people as well as technology. Here’s how DBAs can adapt and use modern data warehouses.
Data Analytics GCP Experience Official Blog Aug. 17, 2020How Revionics brings advanced analytics to retailers with help from Google Cloud - See how Revionics migrated to Google Cloud’s BigQuery enterprise data warehouse (EDW) to build data lakes and warehouses to better serve retail customers.
Data Analytics GCP Experience Official Blog Aug. 17, 2020MLB's fan data team hits it out of the park with data warehouse modernization - See how the fan data team at Major League Baseball (MLB) migrated its enterprise data warehouse (EDW) from Teradata to BigQuery.
Data Analytics Official Blog Aug. 17, 2020What’s new and what’s next with data analytics — Next OnAir - See how Google’s cloud data analytics platform, including the BigQuery data warehouse, can help you save time and cost with these Next OnAir sessions.
BigQuery Data Analytics Official Blog Aug. 17, 2020Better BigQuery pricing flexibility with 100 slots - Cloud data warehouse BigQuery offers flat-rate pricing, which you can now use with a minimum of 100 slots.
BigQuery Cloud Dataflow Data Analytics Data Loss Prevention API Machine Learning Official Blog Aug. 17, 2020Anomaly detection using streaming analytics & AI - How to build a secure, real-time anomaly detection solution using Dataflow, BigQuery ML and Cloud DLP.
Data Analytics Official Blog Aug. 17, 202012 smart analytics sessions to check out at Next OnAir - Check out more than 40 digital sessions on data analytics solutions and topics to learn more about multi-cloud, natural language, and BigQuery, with Google Cloud Next ‘20: OnAir.
Data Analytics Looker Official Blog Aug. 10, 2020Getting to know Looker: How LookML can simplify BI workflows - LookML from Looker, now part of Google Cloud, offers better business intelligence (BI) workflows for data analysts, modelers, engineers, CDOs, IT security, and more.
Data Analytics Official Blog July 27, 2020Migrate and modernize your on-prem data lake with managed Kafka - Make sure your data lake is working for your business and see how to use tools like Apache Kafka to migrate from on-prem.
BigQuery Data Analytics Official Blog Teradata July 20, 2020Use IAM custom roles to manage access to your BigQuery data warehouse - When you’re migrating your data warehouse from Teradata to BigQuery, pay attention to mapping user permissions using identity and access management tools.
Data Analytics Looker Official Blog July 20, 2020Getting to know Looker – common use cases - Business intelligence (BI) tool Looker can help your cloud data work better for you with dashboards, visualizations, data modeling, and more.
AWS BigQuery Data Analytics Official Blog July 20, 2020Bringing multi-cloud analytics to your data with BigQuery Omni - BigQuery Omni, powered by Anthos, lets you analyze data in Google Cloud, as well as AWS and Azure (coming soon). It’s multi-cloud data analytics for the modern age.
BigQuery Data Analytics Official Blog July 13, 2020Enhancing multi-cloud data governance on Google Cloud - Good data governance practices are essential for cloud computing. See how Google Cloud’s BigQuery and Collibra work for multi-cloud data governance.
Cloud Dataproc Data Analytics Official Blog July 3, 2020Presto optional component now available on Dataproc - The Presto query engine optional component is now available for Dataproc, Google Cloud’s fully managed Spark and Hadoop cluster service.
Data Analytics Official Blog July 3, 2020Building a genomics analysis architecture with Hail, BigQuery, and Dataproc - Try a cloud architecture for creating large clusters for genomics analysis with BigQuery and Google-built healthcare tooling.
Data Analytics Official Blog July 3, 2020Genomics analysis with Hail, BigQuery, and Dataproc - Try data analytics for genomics research in the cloud using BigQuery, Dataproc and Hail for fast large-scale research.
Cloud Dataproc Data Analytics Official Blog July 3, 2020Dataproc Metastore: Fully managed Hive metastore now available for alpha testing - Dataproc Metastore is a fully managed open source Apache Hive metastore service, so you can easily build data lakes on Google Cloud.
Data Analytics GCP Experience Official Blog June 22, 2020How Unity analyzes petabytes of data in BigQuery for reporting and ML initiatives - Learn how development platform Unity Technologies moved to BigQuery for a cloud data warehouse that enables ML and.
Cloud Dataproc Data Analytics Official Blog June 22, 2020Introducing Spark 3 and Hadoop 3 on Dataproc image version 2.0 - Dataproc image version 2.0 is ready for testing, with Spark 3 and Hadoop 3 capabilities for open source data and analytics testing.
BigQuery Data Analytics Official Blog June 15, 2020Introducing table-level access controls in BigQuery - Check out table-level access controls (ACLs) in cloud data warehouse BigQuery to share data more easily and help meet compliance.
Data Analytics Python June 8, 2020How to automate financial data collection with Python using Tiingo API and Google Cloud Platform - A step-by-step tutorial for Python programmers looking to anayze stock prices and automate data collection through GCP.
Cloud Dataproc Data Analytics Jupyter Notebook Official Blog June 1, 2020Combining the power of Apache Spark and AI Platform Notebooks with Dataproc Hub - Dataproc Hub: Administering Jupyter notebooks for Spark workloads on Dataproc.
AI Platform Notebooks Data Analytics Official Blog June 1, 2020Google Cloud adds smart analytics frameworks for AI Platform Notebooks - Smart analytics notebooks is an enterprise notebook experience that extends the capabilities of the GCP Smart Analytics Platform.
Cloud Dataproc Data Analytics Official Blog June 1, 2020Migrating Apache Hadoop clusters to Google Cloud - Moving on-premises Hadoop clusters can help your data analysts, data scientists, and more to work faster and more quickly in the cloud.
BigQuery Billing Data Analytics Official Blog June 1, 2020Effectively using BigQuery Reservations - Cloud data warehouse BigQuery Reservations is a platform for cost and workload management.
BigQuery Billing Data Analytics Official Blog June 1, 2020Optimize BigQuery costs with Flex Slots - Try Flex Slots in cloud data warehouse BigQuery to save costs when running jobs or workloads such as querying large tables.
BigQuery Billing Data Analytics Official Blog June 1, 2020Choosing between BigQuery on-demand and flat rate pricing - Tips on using your BigQuery cloud data warehouse efficiently and saving costs with both on-demand and flat-rate pricing models.
Cloud Dataproc Data Analytics Official Blog May 25, 2020Burst data lake processing to Dataproc using on-prem Hadoop data - Use Dataproc and Alluxio to burst workload processing to cloud from Hadoop on-prem data stores.
Billing Cloud Dataflow Data Analytics Official Blog May 25, 2020Predicting the cost of a Dataflow job - Estimate the cost of batch and streaming analytics service jobs in Google Cloud’s Dataflow.
Cloud Composer Data Analytics Docker May 18, 2020Get Started with Airflow + Google Cloud Platform + Docker - Setting up Airflow with Docker compose to connect to GCP.
BigQuery Data Analytics Official Blog May 11, 2020Automating BigQuery exports to an email - Set up automated emails to export data from cloud data warehouse BigQuery, especially for regular queries or reports.
Data Analytics Official Blog May 11, 2020Easy access to stream analytics with SQL, real-time AI, and more - Helping data engineers, ops teams access unified stream and batch data pipelines.
Cloud Composer Data Analytics Kubernetes May 11, 2020Argo workflows as alternative to Cloud Composer - Using Argo Workflows on Kubernetes as an alternative for Cloud Composer.
BigQuery Data Analytics Data Studio Firebase Visualization May 11, 2020How to make fast and convenient visualization in Data Studio based on BigQuery - Visualizing data in BigQuery from a Firebase app in Data Studio.
BigQuery Data Analytics Official Blog May 4, 2020What’s happening in BigQuery: Efficient new views and Cloud AI integrations - Cloud data warehouse BigQuery now offers materialized views for improved query efficiency, plus new ML models and column-level security.
Data Analytics Official Blog May 4, 2020Discover, understand and manage your data with Data Catalog, now GA - New cloud metadata management service available to discover, understand, and manage data from one interface for data discovery and more.
Billing Cloud Dataproc Data Analytics Official Blog May 4, 2020Optimize Dataproc costs using VM machine type - Try optimizing big data clusters from Spark, Hadoop, and Presto with fully managed Dataproc. Choosing VMs wisely can save on Dataproc costs.
Billing Data Analytics Official Blog April 27, 2020Best practices for optimizing your cloud costs - Following these best practices will help optimize your cloud costs to the needs of your business, so you can get through these unpredictable times.
Cloud Dataprep Cloud Functions Cloud Scheduler Data Analytics Data Studio Python April 27, 2020Creation of an ETL in Google Cloud Platform for automated reporting - Learn how to create your own serverless and fully scalable ETL for automated reporting using PyTrends as an example.
Big Data Cloud Dataflow Data Analytics Official Blog April 20, 2020Introducing Dataflow template to stream data to Splunk - Learn how to set up a streaming pipeline for Google Cloud data into Splunk Cloud or Enterprise with this new Pub/Sub to Splunk Dataflow template.
BigQuery Cloud Dataflow Data Analytics Official Blog April 13, 2020How do I move data from MySQL to BigQuery? - See how to perform MySQL data migration to cloud with this change data capture (CDC) example. This helps move data into cloud data warehouse BigQuery.
Cloud Dataprep Data Analytics Official Blog April 13, 2020New AI-driven features in Dataprep enhance the wrangling experience - Check out new AI-powered features in Cloud Dataprep from Trifacta to make your data wrangling experience easier.
Cloud Dataproc Data Analytics GPU Official Blog April 13, 2020Machine learning with XGBoost gets faster with Dataproc on GPUs - Machine learning workloads can move a lot faster when run on GPUs vs. CPUs. See how to do it with NVIDIA, XGBoost and Dataproc for ML model building.
Big Data BigQuery Data Analytics Python April 13, 2020Ibis: A Python Data Analysis Framework for Development and Production - An example of using Ibis (Python Data Analysis Productivity Framework) with BigQuery.
BigQuery Data Analytics Machine Learning Official Blog April 6, 2020Filling the NCAA void: Using BigQuery to simulate March Madness - Check out how to simulate college basketball brackets with BigQuery and BigQuery ML, using ML predictions, in a year where March Madness isn’t happening.
BigQuery Data Analytics Official Blog April 6, 2020Introducing BigQuery column-level security: new fine-grained access controls - Cloud data warehouse column-level security controls let you put policies on data classes for compliance reasons -- new in BigQuery.
BigQuery Data Analytics Official Blog Public Datasets April 6, 2020COVID-19 public dataset program: Making data freely accessible for better public outcomes - Explore valuable data related to COVID-19 with free public datasets, available in Google Cloud’s BigQuery.
BigQuery Data Analytics Visualization April 6, 2020Building a Custom Jira Reporting Solution with BigQuery, Stitch & Tableau - Using BigQuery as a data lake for Jira data and a source for visualization.
BigQuery Data Analytics Official Blog March 28, 2020Loading geospatial data into BigQuery just got easier with FME - Load geospatial data into BigQuery using FME to load, transform, and ingest GIS file types for data analytics.
BigQuery Data Analytics March 28, 202010 tips for self-service analytics with Google BigQuery and Tableau - Tips and tricks when visualizing data from BigQuery in Tableau.
BigQuery Cloud Functions Data Analytics March 28, 2020BigQuery + Cloud Functions: how to run your queries as soon as a new Google Analytics table is available - A step-by-step guide on how to make sure your tables, dashboards and data transfers are always up-to-date.
Data Analytics GCP Experience Official Blog March 23, 2020Modernizing Twitter's ad engagement analytics platform - See how Twitter has modernized its ad engagement platform using Google Cloud to build data transformation pipelines to scale.
CI Cloud Data Fusion Data Analytics March 23, 2020CI/CD and Change Management for Pipelines — Part 2 - Examples for extracting pipelines from CDF/CDAP and using GitHub as a repository for storing pipelines and related artifacts.
AWS BigQuery Data Analytics Official Blog March 16, 2020Modern analytics made easy with new Redshift, S3 migration tools - Data warehouse migrations to Google Cloud’s BigQuery are now easier with new tools to move your Redshift and S3 workloads.
Anthos Cloud Marketplace Data Analytics Official Blog March 16, 2020Get the Flink Operator for Kubernetes in Anthos on Marketplace - The open source Apache Flink for Kubernetes operator is now available in the Google Cloud Marketplace to deploy in your own cluster.
CI Cloud Data Fusion Data Analytics DevOps March 16, 2020CI/CD and Change Management for Pipelines — Part 1 - Process and steps to take in order to implement a CI/CD pipeline for CDAP (Cloud Data Fusion).
BigQuery Data Analytics March 16, 2020How to query and calculate GA App + Web event data in BigQuery - In-depth of new Firebase Google Analytics way of measurement and how to use raw data in BigQuery.
BigQuery Data Analytics GCP Experience Official Blog March 9, 2020Discord's migration from Redshift to BigQuery: lessons learned - Gaming app creator Discord moved from Amazon Redshift to Google Cloud BigQuery to eliminate downtime and scale faster.
BigQuery Data Analytics Official Blog March 9, 2020DML without limits, now in BigQuery - Cloud data warehouse BigQuery removes all quota limits to support unlimited DML statements and make working with BigQuery tables easier.
BigQuery Data Analytics Official Blog March 2, 2020BigQuery leads the way toward modern data analytics - BigQuery’s customer, partner, and analyst momentum is strong. The cloud data warehouse makes migration easy and brings data analytics to enterprises.
BigQuery Data Analytics Official Blog March 2, 2020Introducing BigQuery Flex Slots for unparalleled flexibility and control - Cloud data warehouse BigQuery now offers Flex Slots, so you can buy analytics resources for short amounts of time to scale up and down quickly.
Data Analytics Official Blog Feb. 17, 2020Taking a practical approach to BigQuery slot usage analysis - See how to understand slots in BigQuery, Google Cloud’s enterprise data warehouse, to keep an eye on resource usage.
Business Data Analytics Official Blog Feb. 17, 2020Google completes Looker acquisition - We’re pleased to announce that Google has completed its acquisition of Looker. Together, we’ll support more businesses globally to address their most challenging data analytics and business intelligence needs.
Data Analytics Official Blog Feb. 17, 2020Google Cloud named a Leader in the Forrester Wave: Data Management for Analytics - Google is a Leader in the Forrester Wave: Data Management for Analytics, the first time this category has existed. See why cloud data analytics at Google won praise.
BigQuery Data Analytics Official Blog Feb. 17, 2020BigQuery under the hood: How zone assignments work - Get a look at the technical details of zone assignments in BigQuery, the cloud enterprise data warehouse.
Data Analytics GCP Certification Official Blog Feb. 17, 2020Now updated: Our Data Engineering Learning Path - To address the evolving skill set today’s data engineers need, we updated our Data Engineering on Google Cloud Platform learning path.
Cloud Dataflow Data Analytics Official Blog Feb. 17, 2020Bring 20/20 vision to your pipelines with enhanced monitoring - New observability features in cloud batch and stream data processing let Google Cloud users identify pipeline problems faster.
Cloud Data Fusion Data Analytics Official Blog Feb. 10, 2020Building more secure data pipelines with Cloud Data Fusion - Building more secure ELT and ETL pipelines in the cloud can help protect your data. See how you can easily build integrated pipelines with Cloud Data Fusion.
Cloud Composer Data Analytics Official Blog Feb. 10, 2020Scale your Composer environment together with your business - Write pipelines across on-prem data centers and cloud with Cloud Composer workflow orchestration service. See how to improve Cloud Composer performance.
BigQuery Data Analytics Firebase Feb. 10, 2020Firebase Event Analytics with Google BigQuery - An extensive guide to help you get started with app analytics.
BigQuery Data Analytics Firebase Feb. 10, 2020Free Product Analytics with Firebase + BigQuery + Rakam - Exporting Firebase Analytics to BigQuery and visualizing in Rakam
BigQuery Data Analytics Official Blog Feb. 3, 202010 top tips: Unleash your BigQuery superpowers - The BigQuery data warehouse offers a lot of analytics superpowers. Check out how you can take advantage of teleportation, time travel, and super speed.
Cloud Pub/Sub Data Analytics Official Blog Feb. 3, 2020Exploring an Apache Kafka to Pub/Sub migration: Major considerations - Yes, it’s possible to migrate from Apache Kakfa to Google Cloud Pub/Sub.
BigQuery Data Analytics Official Blog Feb. 3, 2020What’s happening in BigQuery: New federated queries, easier ML, and more metadata - An enterprise cloud data warehouse should be flexible and forward-looking. See new federated queries, better ML options and more metadata in BigQuery.
Data Analytics Official Blog Jan. 27, 2020New GA Dataproc features extend data science and ML capabilities - Data scientists can now use features like autoscaling, notebooks, logging and monitoring, and attaching GPUs to clusters in cloud Dataproc.
BigQuery Data Analytics Jan. 20, 2020Check-list: selecting the right data transformation service for Google BigQuery - List of products on Google Cloud Platform to use for moving data to BigQuery.
Data Analytics Official Blog Jan. 13, 2020Exploratory data analysis, feature selection for better ML models - Before you start a machine learning project, you need clean, up-to-date data. Use exploratory data analysis (EDA) to help find ML success.
Cloud Dataproc Data Analytics Official Blog Jan. 6, 2020Getting started with new table formats on Dataproc - You can now use table format projects Apache Iceberg and Delta Lake with Google Cloud’s Dataproc, built to run Hadoop systems in the cloud.
Big Data Data Analytics Official Blog Dec. 23, 2019Opening doors, embracing change with cloud data warehouses - Cloud data warehouse migrations bring technology changes and new ways of working for data analysts and administrators. Change management is important.
Data Analytics Official Blog Dec. 23, 2019Big data, big world: new NOAA datasets available on Google Cloud - Weather, climate and more datasets from NOAA are now available on Google Cloud. Explore atmospheric and other big data.
Data Analytics Official Blog Dec. 23, 2019Year in review: smart analytics makes great strides - Cloud data analytics highlights from 2019 include data warehouse, streaming, and BI news. See how smart analytics at Google Cloud made strides.
Big Data BigQuery Cloud Dataflow Data Analytics Official Blog Dec. 16, 2019Using HLL++ to speed up count-distinct in massive datasets - There’s a better way to do the count distinct function using Google’s HyperLogLog++ algorithm in Dataflow and BigQuery.
BigQuery Data Analytics Official Blog Dec. 16, 2019New climate model data now in Google Public Datasets - Explore new climate model data in Google Cloud’s public dataset program. Climate model datasets include details and simulations.
BigQuery Data Analytics Dec. 16, 2019Analyzing BigQuery Public Datasets - Analyzing Motor Vehicle Collision BigQuery Public Dataset.
Data Analytics Official Blog Dec. 9, 2019Simplified data transformations for machine learning in BigQuery - New features in BigQuery ML do the work of cleansing data, with data transformation and preprocessing now available to help you build models faster.
Data Analytics Official Blog Dec. 9, 2019Announcing the GA of Data Fusion, the bridge to data analytics - Cloud Data Fusion is a data integration and ingestion service that lets you build ETL and ELT pipelines.
Cloud Dataflow Data Analytics Official Blog Nov. 25, 2019Streaming analytics now simpler, more cost-effective in Cloud Dataflow - Cloud streaming data analytics is now easier and more cost-effective with Streaming SQL and FlexRS in Cloud Dataflow.
BigQuery Data Analytics Official Blog Nov. 25, 2019Achieve peace of mind with BigQuery pricing and control - Flexibility and easier planning for data warehousing costs arrive with BigQuery Reservations.
BigQuery Data Analytics Nov. 25, 2019A Journey into BigQuery Fuzzy Matching — 4 of [1, ∞) — A Tribute to FuzzyWuzzy - Implementing and using Fuzzy matching in BigQuery.
Data Analytics Official Blog Nov. 18, 2019Leave manual cluster resizing behind with Cloud Dataproc’s autoscaling - New autoscaling capabilities help cluster admins right-size their clusters for data analytics projects and deal with traffic spikes.
Apache Beam Cloud Dataflow Data Analytics Official Blog Python Nov. 11, 2019Introducing Python 3, Python streaming support from Cloud Dataflow - Python 3, support for Python streaming is now available for data processing with Cloud Dataflow.
BigQuery Data Analytics Official Blog Nov. 11, 2019Command and control now easier in BigQuery with scripting and stored procedures - Scripting and stored procedures are now available in BigQuery to make queries and tasks easier to execute.
BigQuery Data Analytics Nov. 11, 2019Analysis of Google Political Ads using BigQuery - Analyzing Google Political Ads public data source in BigQuery.
BigQuery Data Analytics Official Blog Nov. 4, 2019Show off your BigQuery ML and Kaggle skills: Competition open now - Show off your BigQuery ML and Kaggle skills: Competition open now.
Cloud Composer Cloud Dataprep Data Analytics Official Blog Nov. 4, 2019How to orchestrate Cloud Dataprep jobs using Cloud Composer - Integrate your data analytics prep tools with orchestration services in the cloud, like Cloud Dataprep and Cloud Composer.
AI Data Analytics Machine Learning Official Blog Oct. 28, 2019Updates make Cloud AI platform faster and more flexible - Improvements in AI Platform provide more flexibility to ML teams looking to optimize their workloads for cost and performance.
Cloud Dataflow Data Analytics Official Blog Oct. 28, 2019Is your pipeline fine? Managing and monitoring a Cloud Dataflow setup - Qubit discusses how it manages its Cloud Dataflow real-time streaming pipeline on Google Cloud.
Cloud Dataflow Data Analytics Official Blog Security Oct. 28, 2019Keeping your Cloud Dataflow pipelines safe with customer-managed encryption keys - Protect your data analytics pipelines with customer-managed encryption keys, new for Cloud Dataflow from Google Cloud.
Data Analytics Official Blog Oct. 28, 2019Bringing Teradata Vantage to Google Cloud - Beginning next year, customers will be able to run Teradata’s cloud analytics platform, Vantage, on Google Cloud Platform.
BigQuery Data Analytics Official Blog Oct. 21, 2019New geospatial data comes to BigQuery public datasets with CARTO collaboration - Data analytics on public datasets from CARTO and BigQuery.
BigQuery Data Analytics Official Blog Oct. 21, 2019Grafana and BigQuery: Together at last - Visualizing data from BigQuery in Grafana.
BigQuery Data Analytics Oct. 21, 2019How to instantly recover a table in Google BigQuery - If you need to Ctrl-Z (undo) in BigQuery after something went wrong, here are a couple of ways to get your data back.
Data Analytics GCP Experience Official Blog Oct. 14, 2019S4 Agtech picks Google Cloud to transform agricultural risk management - See how S4 Agtech is using Google Cloud to speed up data analytics for farmers to improve crop yields and other agricultural innovations.
BigQuery Data Analytics Official Blog Oct. 6, 2019How to manage BigQuery flat-rate slots within a project - Learn how to manage slots when using BigQuery’s flat-rate pricing, so you can run queries specific to applications within the same project.
BigQuery Data Analytics Official Blog Oct. 6, 2019What’s the weather like? Using Colab to get more out of BigQuery - Use BigQuery and Colab, plus Python, to explore weather datasets to make data science predictions.
BigQuery Data Analytics Oct. 6, 2019Multi-Session & Multi-Channel Funnel Reporting in Google Analytics BigQuery - Using data from Google Analytics API in BigQuery.
Data Analytics Official Blog Sept. 30, 2019Data warehouse migration challenges and how to meet them - Moving legacy data warehouse to cloud can bring challenges. Here are some tips to make the data warehouse cloud migration process easier.
Data Analytics GCP Experience Official Blog Sept. 30, 2019Adopting cloud, with new inventions along the way, charges up HSBC - Learn how moving their legacy data warehouse to BigQuery and using custom-built tools and an automation-first approach allowed HSBC to make huge leaps in data analytics capabilities and ensure high-fidelity data.
Data Analytics Machine Learning Official Blog Sept. 30, 2019Building ML models for everyone: understanding fairness in machine learning - The article explains why implementing ML fairness into an ML workflow is so important, and goes through tools and techniques to get started.
BigQuery Data Analytics Official Blog Sept. 30, 2019Cost optimization best practices for BigQuery - Find tips to optimize your BigQuery data warehouse costs so you’re getting the most for your business under budget.
Data Analytics Google Cloud Platform Official Blog Sept. 30, 2019Google Cloud named a leader in the Forrester Wave: Streaming Analytics - Google Cloud has been named a Leader in The Forrester Wave: Streaming Analytics Q3 2019. See why Cloud Pub/Sub and Cloud Dataflow scored high marks.
Data Analytics Official Blog Sept. 23, 2019Moving a publishing workflow to BigQuery for new data insights - Using BigQuery from Google Cloud can help streamline an internal process, like web publishing, to get better data insights faster.
BigQuery Data Analytics Sept. 23, 2019Using MySQL as a Cache Layer for BigQuery - Using MySQL as a cahing layer BigQuery in Cube.js, open-source analytics framework.
BigQuery Data Analytics Official Blog Sept. 16, 2019Quantum Metric gets answers from customer data at light speed
Business Data Analytics GCP Experience Official Blog Sept. 16, 2019Architecting data pipelines at Universe.com puts customer experience on center stage
Cloud Dataproc Data Analytics Google Kubernetes Engine Official Blog Sept. 16, 2019Cloud Dataproc Spark Jobs on GKE: How to get started - Cloud Dataproc offers alpha access to Spark jobs on Google Kubernetes Engine (GKE) for data analytics with speed and scale.
Cloud Dataproc Data Analytics Google Kubernetes Engine Official Blog Sept. 16, 2019Modernize Apache Spark with Cloud Dataproc on Kubernetes - Alpha availability of Cloud Dataproc for Kubernetes.
BigQuery Cloud Dataprep Data Analytics Data Studio Sept. 9, 2019Understanding Self-Service Analytics on BigQuery with Cloud Dataprep - Using Google Cloud products for analytics.
Data Analytics Official Blog Sept. 2, 2019New release of Cloud Storage Connector for Hadoop: Improving performance, throughput and more - The latest release of the Google Cloud Storage Connector for Hadoop makes it even easier to substitute your HDFS with Cloud Storage for high performance.
BigQuery Data Analytics Official Blog Sept. 2, 2019Expanding your patent set with ML and BigQuery - You can use BigQuery and Python to perform faster patent landscaping.
BigQuery Data Analytics Official Blog Sept. 2, 2019What’s happening in BigQuery: Adding speed and flexibility with 10x streaming quota, Cloud SQL federation and more - The latest updates for Google Cloud’s BigQuery data warehouse include a streaming quota increase, automatic re-clustering, and lots more features.
BigQuery Data Analytics Official Blog Aug. 26, 2019Skip the maintenance, speed up queries with BigQuery's clustering - Google Cloud’s BigQuery data warehouse automates tasks and maintenance. Here’s how automatic re-clustering works to save you time.
Data Analytics Official Blog Aug. 26, 2019Analyzing GCP costs using folders and BigQuery Billing export - Check out how to get your Google Cloud billing data into BigQuery using folders and Billing export for comprehensive spending reports.
Data Analytics Official Blog Aug. 26, 20195 reasons your legacy data warehouse won’t cut it - Legacy data warehouses are expensive and hard to maintain. Here are 5 reasons they aren’t cutting it, and why migrating to the cloud opens up lots of possibilities.
BigQuery Data Analytics Official Blog Aug. 26, 2019Introducing the BigQuery Terraform module - The BigQuery module for Terraform brings an open-source data analytics option, so you can automate instantiation and deployment of BigQuery datasets and tables.
BigQuery Data Analytics Official Blog Aug. 26, 2019Skip the heavy lifting: Moving Redshift to BigQuery easily - Moving data from AWS S3 into Google Cloud’s BigQuery data warehouse is now easier with a new data transfer service.
Data Analytics GCP Experience Official Blog Aug. 19, 2019GlideFinder: How we built a platform on Google Cloud that can monitor wildfires - Dmitry Kryuk, founder and CTO of GlideFinder, shares how they built a platform that can locate wildfires, alert subscribers, and provide analytics that can help prevent or contain wildfires in a timely manner.
Cloud Spanner Data Analytics Aug. 19, 2019How to connect Tableau to Google Cloud Spanner - The article describes how to connect Tableau with Cloud Spanner.
BigQuery Cloud Functions Data Analytics Official Blog Aug. 12, 2019Streaming data from Cloud Storage into BigQuery using Cloud Functions - See how to move stored data easily into BigQuery from Google Cloud Storage using Cloud Functions to build a pipeline.
Big Data BigQuery Data Analytics Official Blog Aug. 12, 2019Migrating Teradata and other data warehouses to BigQuery - Migration framework and architecture when moving data warehouse, like Teradata, to Google Cloud BigQuery.
BigQuery Data Analytics July 29, 2019How to query and calculate Google Analytics data in BigQuery - Examples of BigQuery queries to analyze Google Analytics data.
BigQuery Data Analytics Machine Learning Official Blog July 29, 2019How to use BigQuery ML for anomaly detection - Step by step tutorial which demonstrates how to use BigQuery ML to perform unsupervised anomaly detection.
Cloud Datalab Data Analytics Machine Learning July 29, 2019Analyzing Financial Time Series Using BigQuery and Cloud Datalab - This solution illustrates the power and utility of BigQuery and Cloud Datalab as tools for quantitative analysis.
Big Data Data Analytics Machine Learning July 29, 2019Beginners Introduction to Data Lifecycle on Google Cloud Platform - Description of 4 categories of data lifecycle on GCP.
AI Platform Notebooks Cloud Deployment Manager Data Analytics July 29, 2019Automating AI Platform Notebook Instance Creation With GCP Deployment Manager - Creating Deep Learning Notebook VM with Deployment Manager.
BigQuery Data Analytics July 22, 2019Building an analytics stack - Process of creating analytics solution on GCP.
BigQuery Data Analytics Official Blog July 15, 2019Goodbye Hadoop. Building a streaming data processing pipeline on Google Cloud - Qubit discusses how they moved from Apache Hadoop and MapReduce to Google BigQuery, Dataflow and Cloud Pub/Sub.
BigQuery Data Analytics Official Blog July 15, 2019Geolocation with BigQuery: De-identify 76 million IP addresses in 20 seconds - You can use the BigQuery data warehouse to explore large public datasets -- here’s how to de-identify user data for compliance.
Data Analytics Official Blog July 8, 2019Tips and tricks to get your Cloud Dataflow pipelines into production - Doing stream and batch processing with Cloud Dataflow depends on good data pipelines. Here are some tips to build and manage those pipelines.
Big Data Data Analytics Data Catalog Data Science July 8, 2019Google Cloud Data Catalog hands-on guide: templates & tags with Python - This quickstart guide brings a practitioner approach to Data Catalog, covering Templates & Tags management using the Python client library.
Data Analytics Data Catalog Official Blog July 1, 2019Google Cloud Data Catalog now available in public beta - Data Catalog, our fully managed data discovery and metadata management service is now available in public beta so you can quickly discover, manage, and understand your data in Google Cloud.
AI BigQuery Data Analytics Machine Learning Official Blog July 1, 2019Analyze BigQuery data with Kaggle Kernels notebooks - BigQuery users can now query and create BQML models within an integrated development environment using Kaggle Kernels.
Big Data Data Analytics July 1, 2019Data and Analytics on Google Cloud Platform - Overview of data and analytics services available on Google Cloud Platform.
BigQuery Data Analytics Machine Learning Official Blog June 24, 2019Predictive marketing analytics using BigQuery ML machine learning templates - To make machine learning more accessible to data scientists, BigQuery ML is now generally available, and we’ve published three new templates in collaboration with SpringML for marketing analytics use cases.
Cloud Dataflow Data Analytics Official Blog June 17, 2019How to efficiently process both real-time and aggregate data with Cloud Dataflow - How to use design pipeline for both streaming inserts and load jobs, with significant cost savings.
Cloud Dataproc Data Analytics Official Blog June 17, 20197 best practices for running Cloud Dataproc in production - Best practices to develop reliant and stable production processes with Cloud Dataproc.
Big Data BigQuery Data Analytics GCP Experience June 17, 2019A Song of Data and Fire: Building Bnext Wall (Data Lake) - Process of building data lake on Google Cloud Platform.
Apache Beam Cloud Dataflow Data Analytics Java June 17, 2019Creating a simple Cloud Dataflow with Kotlin - Simple Beam pipeline which subscribes to a Pub/Sub topic and creates Entities of Datastore for each message and runs on Cloud Dataflow, written in Kotlin.
BigQuery Data Analytics Official BlogWhat’s happening in BigQuery: New persistent user-defined functions, increased concurrency limits, GIS and encryption functions, and more - List of most recent releases and updates regarding BigQuery.
Useful Links
Contact
Třebanická 183
Prague, Czech Republic
Phone: +420 777 283 075
Email: [email protected]