GCP AI/ML and Vertex AI Complete Guide: From Model Training to Production Deployment

Want to adopt AI in your company but don't know where to start?

Training your own model is too complex, but using ready-made APIs might not be flexible enough?

GCP's AI services offer solutions ranging from "no-code" to "fully customized." This article will introduce you to GCP's AI ecosystem, from the Vertex AI platform to Gemini API, helping you find the best entry point.

Want to understand GCP's core services first? Please refer to "GCP Complete Guide: From Beginner Concepts to Enterprise Practice."

---

GCP AI/ML Service Ecosystem Overview

GCP's AI services aren't just one product—they're an entire ecosystem.

Google Cloud AI Market Position and Advantages

What advantages does Google have in AI?

Technical Foundation:

• TensorFlow is open-sourced by Google
• TPU (Tensor Processing Unit) is developed by Google
• Transformer architecture (the basis of GPT, BERT) was invented by Google

Practical Experience:

• Google Search, YouTube recommendations, Gmail spam filtering all use ML
• These experiences are reflected in GCP's AI service design

Unique Advantages:

• The most powerful data analytics platform (BigQuery)
• Native AI infrastructure (TPU)
• Complete MLOps toolchain

Choosing Between Pre-trained APIs and Custom Models

GCP AI services fall into two categories:

Pre-trained APIs (Ready-made):

• Call the API directly to use
• No training data needed
• No ML knowledge required
• Suitable for: common tasks, quick validation

Custom Models (Train your own):

• Train with your data
• Can optimize for specific needs
• Requires ML knowledge or using AutoML
• Suitable for: special requirements, seeking best results

How to Choose?

Scenario	Choice	Reason
Recognize common objects	Vision API	Already trained
Detect product defects	AutoML Vision	Need your own data
Translate common languages	Translation API	Quality is already good
Translate technical terms	Custom model	Requires domain knowledge
Quick prototype validation	Pre-trained API	Get results quickly
Seeking best results	Custom model	Targeted optimization

AI Service Architecture Diagram

GCP AI Service Layers:

┌─────────────────────────────────────────────────┐
│        Application Layer: Gemini API, Agent Builder │
├─────────────────────────────────────────────────┤
│              Platform Layer: Vertex AI              │
│  ┌──────────┬──────────┬──────────┬──────────┐ │
│  │ Workbench │ AutoML   │ Pipelines │ Model    │ │
│  │          │          │           │ Garden   │ │
│  └──────────┴──────────┴──────────┴──────────┘ │
├─────────────────────────────────────────────────┤
│          Data Layer: BigQuery, Cloud Storage        │
├─────────────────────────────────────────────────┤
│      Infrastructure: GPU, TPU, Compute Engine       │
└─────────────────────────────────────────────────┘

---

Vertex AI Platform Deep Dive

Vertex AI is GCP's unified AI platform. All ML work can be completed here.

Vertex AI Core Features

What does Vertex AI integrate?

Feature	Description	Previous Service
Workbench	Jupyter Notebook environment	AI Platform Notebooks
Training	Model training service	AI Platform Training
Prediction	Model deployment service	AI Platform Prediction
AutoML	Automated machine learning	AutoML Vision/NL/Tables
Pipelines	ML workflow	Kubeflow Pipelines
Feature Store	Feature management	New feature
Model Registry	Model version management	New feature
Model Garden	Pre-trained model library	New feature

Benefits:

• One interface to manage all ML work
• Seamless integration between tools
• Unified permissions and billing management

Workbench (Jupyter Notebook Environment)

The first step in ML is usually opening a Notebook to explore data.

Workbench Types:

Type	Features	Suitable For
Managed Notebooks	Fully managed, quick start	Most users
User-Managed Notebooks	More control	Need custom configuration

Create Workbench Instance:

gcloud workbench instances create my-notebook \
  --location=asia-east1-b \
  --machine-type=n1-standard-4

Pre-installed Tools:

• JupyterLab
• TensorFlow, PyTorch
• Pandas, Scikit-learn
• BigQuery connector
• Git integration

Model Registry Management

Trained models need version management.

Features:

• Model version tracking
• Model metadata management
• Deployment status tracking
• A/B testing support

Upload Model to Registry:

from google.cloud import aiplatform

aiplatform.init(project='my-project', location='asia-east1')

model = aiplatform.Model.upload(
    display_name='my-model',
    artifact_uri='gs://my-bucket/model/',
    serving_container_image_uri='us-docker.pkg.dev/vertex-ai/prediction/tf2-cpu.2-8:latest'
)

Pipelines Workflow Automation

Automate the entire ML workflow.

What a Pipeline includes:

1. Data loading
2. Data preprocessing
3. Model training
4. Model evaluation
5. Model deployment

Using Kubeflow Pipelines SDK:

from kfp import dsl
from kfp.v2 import compiler

@dsl.pipeline(name='my-pipeline')
def my_pipeline():
    # Define each step
    data_op = load_data_component()
    train_op = train_model_component(data=data_op.output)
    deploy_op = deploy_model_component(model=train_op.output)

# Compile and execute
compiler.Compiler().compile(my_pipeline, 'pipeline.json')

Feature Store Engineering

Features are the core of ML. Feature Store helps you manage them.

What problems does it solve?

• Training and inference use the same features
• Features can be shared across teams
• Feature version management
• Point-in-time correctness

Use Cases:

• User features (age, preferences, behavior)
• Product features (category, price, rating)
• Real-time features (recent clicks, cart status)

---

AutoML: No-Code AI Modeling

Can you train ML models without writing code? AutoML makes this possible.

How AutoML Works

AutoML automatically handles:

1. Data exploration and cleaning
2. Feature engineering
3. Model architecture search
4. Hyperparameter tuning
5. Model training
6. Model evaluation

You only need to:

1. Prepare labeled data
2. Upload to Vertex AI
3. Click "Train"
4. Wait for completion

AutoML Vision (Image Recognition)

Supported Tasks:

• Single-label classification (What is this?)
• Multi-label classification (What things are there?)
• Object detection (Where is it?)

Data Requirements:

• Minimum 100 images per category
• Recommended 1,000+ images for better results
• Supports JPG, PNG, BMP, GIF

Use Cases:

• Manufacturing: Defect detection
• Retail: Product classification
• Healthcare: Medical imaging assistance

AutoML Natural Language (Text Analysis)

Supported Tasks:

• Text classification (sentiment analysis, topic classification)
• Entity extraction (find names, places, organizations)
• Sentiment analysis (positive, negative, neutral)

Data Requirements:

• Minimum 1,000 documents
• At least 100 per category
• Supports plain text or CSV

Use Cases:

• Customer service: Auto-classify complaints
• Media: News topic classification
• Social: Sentiment analysis

AutoML Tables (Structured Data)

Supported Tasks:

• Classification (Will this customer churn?)
• Regression (How many will this product sell?)

Data Requirements:

• Minimum 1,000 rows of data
• At least 2 feature columns
• Supports CSV or BigQuery tables

Use Cases:

• Finance: Credit risk assessment
• Retail: Sales forecasting
• Marketing: Customer churn prediction

AutoML Use Cases and Limitations

Good for AutoML:

• No ML team
• Want to quickly validate ideas
• Task is a standard type
• Data volume is not particularly large

Not suitable for AutoML:

• Need cutting-edge model performance
• Have complex custom requirements
• Extremely large data volume (custom training more cost-effective)
• Need special architectures (like GAN, reinforcement learning)

Cost Considerations:

• AutoML charges by training hour
• Training an image model costs about $3-20/hour
• Complex tasks may require tens of hours of training

---

Gemini API and Generative AI

The hottest AI technology in 2024-2025: Generative AI.

Gemini Model Version Comparison (Pro / Flash / Ultra)

Model	Features	Suitable For	Price
Gemini 2.0 Flash	Ultra-fast, low cost	Real-time apps, high-volume requests	Lowest
Gemini 1.5 Pro	Balanced performance and cost	General business apps	Medium
Gemini 1.5 Flash	Fast response	Conversation systems, lightweight tasks	Lower
Gemini Ultra	Best performance	Complex reasoning, professional tasks	Highest

Selection Recommendations:

• Start with Flash for prototyping
• Evaluate Pro after confirming feasibility
• Only use Ultra when truly needed

API Calls and Billing

Basic Call Example:

import google.generativeai as genai

genai.configure(api_key='YOUR_API_KEY')

model = genai.GenerativeModel('gemini-1.5-pro')
response = model.generate_content('Explain what machine learning is')

print(response.text)

Calling from Vertex AI:

from vertexai.generative_models import GenerativeModel

model = GenerativeModel('gemini-1.5-pro')
response = model.generate_content('Write a product description')

print(response.text)

Billing Method:

• Charged by tokens (input + output)
• 1,000 English words ≈ 700-900 tokens
• Different models have different prices

Prompt Engineering Best Practices

A good prompt looks like this:

You are a professional product copywriter.

Task: Write a 50-word promotional copy for the following product.

Product Information:
- Name: Ultra-lightweight Laptop
- Weight: 900g
- Features: 16-hour battery life, military-grade durability

Requirements:
1. Use clear, professional English
2. Tone is lively but professional
3. Emphasize lightweight and battery advantages

Prompt Techniques:

• Role Setting: Tell the model what role it is
• Clear Task: Clearly state what to do
• Provide Examples: Give one or two expected output examples
• Specify Format: JSON? Bullet points? Paragraphs?
• Set Constraints: Word count, language, tone

Enterprise Application Cases

Case 1: Customer Service Auto-Reply

• Use Gemini to understand customer questions
• Find answers from knowledge base
• Generate natural language responses

Case 2: Document Summarization

• Upload lengthy reports
• Auto-generate key summaries
• Extract key data

Case 3: Code Assistance

• Explain existing code
• Generate test cases
• Suggest refactoring directions

Case 4: Content Generation

• Product descriptions
• Marketing copy
• Technical documentation

---

BigQuery ML: SQL-Driven Machine Learning

Can data analysts do ML? They can with SQL.

BQML Supported Model Types

Model Type	SQL Command	Suitable Tasks
Linear Regression	LINEAR_REG	Predict values
Logistic Regression	LOGISTIC_REG	Binary classification
K-Means	KMEANS	Customer segmentation
Time Series	ARIMA_PLUS	Trend forecasting
XGBoost	BOOSTED_TREE_CLASSIFIER	Complex classification
DNN	DNN_CLASSIFIER	Deep learning
AutoML Tables	AUTOML_CLASSIFIER	Automated ML

Create and Train Model Syntax

Create Model:

CREATE OR REPLACE MODEL `my_dataset.sales_forecast`
OPTIONS(
  model_type='ARIMA_PLUS',
  time_series_timestamp_col='date',
  time_series_data_col='sales',
  time_series_id_col='product_id'
) AS
SELECT
  date,
  product_id,
  sales
FROM
  `my_dataset.sales_data`
WHERE
  date < '2024-01-01'

Forecast:

SELECT *
FROM ML.FORECAST(
  MODEL `my_dataset.sales_forecast`,
  STRUCT(30 AS horizon, 0.95 AS confidence_level)
)

Evaluate Model:

SELECT *
FROM ML.EVALUATE(MODEL `my_dataset.my_model`)

Use Cases and Performance Considerations

Good for BQML:

• Data is already in BigQuery
• Team is familiar with SQL
• Want to quickly validate ideas
• Task is standard classification/regression

Not suitable for BQML:

• Need cutting-edge performance
• Task requires custom architecture
• Image, audio, and other unstructured data

Cost Tips:

• Training costs calculated by data processed
• Complex models take longer to train
• Can set training budget limits

---

AI/ML Cost Planning and Optimization

AI projects can easily go over budget. Good cost planning is important.

Training vs Inference Cost Structure

Training Costs:

• One-time cost
• Charged by compute time
• GPU/TPU costs are high
• Can use Spot VMs to save money

Inference Costs:

• Ongoing cost
• Charged by predictions or time
• Need to consider 24/7 running costs
• Batch inference is cheaper than real-time

Cost Comparison Example:

Item	Training Cost	Inference Cost (Monthly)
Small Model	$50-200	$100-300
Medium Model	$500-2,000	$500-1,500
Large Model	$5,000-20,000	$2,000-10,000

GPU/TPU Selection and Cost Comparison

GPU Options:

GPU	Memory	Suitable For	Hourly Cost
T4	16GB	Inference, small training	~$0.35
L4	24GB	Balanced	~$0.70
A100 40GB	40GB	Large training	~$3.00
A100 80GB	80GB	Very large models	~$4.00
H100	80GB	Latest and most powerful	~$8.00

TPU Options:

TPU	Suitable For	Hourly Cost
v2-8	Medium training	~$4.50
v3-8	Large training	~$8.00
v5e	Inference optimized	~$1.20

Selection Recommendations:

• Development phase → T4 or L4
• Production training → A100
• TensorFlow large models → TPU
• Inference service → T4 or v5e

Batch Inference Cost Reduction

Real-time vs Batch Inference:

Type	Latency	Cost	Suitable For
Real-time (Online)	Milliseconds	Higher	Real-time apps
Batch	Minutes to hours	Lower	High-volume processing

Batch Inference Use Cases:

• Daily customer score updates
• Product recommendation pre-calculation
• Report data analysis
• Historical data backfill

Cost Difference: Batch inference can be 60-80% cheaper than real-time inference.

---

Enterprise AI Adoption Best Practices

From POC to production—how do enterprise AI projects progress?

Path from POC to Production

Phase 1: Exploration and Definition (2-4 weeks)

• Confirm business problem
• Assess data availability
• Define success metrics
• Evaluate technical feasibility

Phase 2: POC (4-8 weeks)

• Small-scale data validation
• Quickly build prototype
• Verify if results meet targets
• Estimate production environment costs

Phase 3: Development (8-16 weeks)

• Complete data processing pipeline
• Model tuning
• Build MLOps processes
• Integrate with existing systems

Phase 4: Launch (4-8 weeks)

• Performance testing
• Gradual rollout
• Monitoring and alerting setup
• Documentation and knowledge transfer

Common Failure Reasons:

• Skipping POC and going straight to development
• Underestimating data cleaning work
• No clear success metrics
• No MLOps leading to maintenance difficulties

MLOps and Model Monitoring

What MLOps includes:

• Version control (data, code, models)
• Automated training pipeline
• Automated model deployment
• Continuous monitoring and retraining

Model Monitoring Metrics:

• Prediction performance (accuracy, recall)
• Data drift
• Concept drift
• Latency and throughput

Vertex AI Model Monitoring:

from google.cloud import aiplatform

# Enable monitoring
endpoint = aiplatform.Endpoint('endpoint-id')
endpoint.update(
    traffic_split={'model-v1': 100},
    enable_model_monitoring=True,
    model_monitoring_config={
        'alert_config': {
            'email_alert_config': {
                'user_emails': ['[email protected]']
            }
        }
    }
)

Data Governance and Compliance

Data Privacy:

• PII de-identification
• Data minimization principle
• Access control
• Usage logging and tracking

Model Compliance:

• Model explainability
• Bias detection and mitigation
• Decision transparency
• Human review mechanism

GCP Compliance Tools:

• Data Loss Prevention (DLP): Automatically detect and mask sensitive data
• Cloud Audit Logs: Record all operations
• VPC Service Controls: Network-level isolation

For security details, see "GCP Security and Cloud Armor Protection Complete Guide."

---

Want to Adopt AI in Your Enterprise?

From Gemini to building your own LLM, there are many choices but also many pitfalls.

Schedule AI Adoption Consultation and let experienced professionals help you avoid pitfalls.

CloudInsight's AI Adoption Services:

• Requirements Assessment: Clarify business needs, confirm if AI is the best solution
• Technology Selection: Use ready-made APIs or train your own?
• POC Planning: Quickly validate feasibility and effectiveness
• Cost Estimation: Complete cost estimation for training, inference, and maintenance
• Architecture Design: Complete solution from data to deployment

---

Conclusion: Building Your GCP AI Strategy

GCP's AI services are comprehensive. The key is finding the right entry point for you.

Selection Recommendations:

Your Situation	Recommended Solution
Want to quickly try AI	Gemini API
Have data but no ML team	AutoML
Data is in BigQuery	BigQuery ML
Have ML team wanting more control	Vertex AI Custom Training
Need complete MLOps	Vertex AI Pipelines

Recommendations for Different Roles:

For Business Executives:

• Start with Gemini for internal efficiency tools
• Accumulate experience from small projects
• Expand investment after success

For Engineers:

• Get familiar with the Vertex AI platform
• Practice AutoML and custom training
• Understand MLOps best practices

For Data Analysts:

• Start with BigQuery ML
• Gradually learn AutoML
• Collaborate with engineering teams

AI adoption is a journey, not a single project. Start small, keep learning, and gradually scale up.

---

Further Reading

• To understand GCP basics, refer to GCP Complete Guide
• To learn how compute services work, see GCP Core Services Hands-on Tutorial
• For cost planning, see GCP Pricing and Cost Calculation Complete Guide
• For security and compliance, see GCP Security and Cloud Armor Protection Guide

---

Image Descriptions

Illustration: GCP AI Services Layered Architecture Diagram

Scene Description: Four-layer architecture diagram, from bottom to top: "Infrastructure Layer" (GPU, TPU), "Data Layer" (BigQuery, Cloud Storage), "Platform Layer" (Vertex AI), "Application Layer" (Gemini API, Agent Builder). Each layer uses different shades of blue, with connecting lines between layers.

Visual Focus:

• Main content clearly presented

Required Elements:

• Per description key elements

Chinese Text to Display: None

Color Tone: Professional, clear

Elements to Avoid: Abstract graphics, gears, glowing effects

Slug: gcp-ai-services-layered-architecture

---

Illustration: Vertex AI Features Overview

Scene Description: Hexagon-style feature block diagram with Vertex AI logo in the center, surrounded by six hexagonal blocks labeled Workbench, Training, Prediction, AutoML, Pipelines, Feature Store. Each block uses different colors to distinguish feature types.

Visual Focus:

• Main content clearly presented

Required Elements:

• Per description key elements

Chinese Text to Display: None

Color Tone: Professional, clear

Elements to Avoid: Abstract graphics, gears, glowing effects

Slug: vertex-ai-features-hexagon-overview

---

Illustration: AutoML vs Custom Training Decision Matrix

Scene Description: Two-dimensional matrix diagram, X-axis is "ML Expertise Level" (low to high), Y-axis is "Customization Needs" (low to high). Lower-left quadrant labeled AutoML (green), upper-right quadrant labeled Custom Training (blue), lower-right quadrant labeled BigQuery ML (orange), upper-left quadrant labeled Pre-trained API (gray).

Visual Focus:

• Main content clearly presented

Required Elements:

• Per description key elements

Chinese Text to Display: None

Color Tone: Professional, clear

Elements to Avoid: Abstract graphics, gears, glowing effects

Slug: automl-custom-training-decision-matrix

---

Illustration: AI Project Lifecycle Flowchart

Scene Description: Circular flowchart showing AI project lifecycle. Starting from "Business Problem," moving clockwise through "Data Collection," "Model Development," "Model Deployment," "Monitoring & Maintenance," then back to "Business Problem" forming a cycle. Each phase uses different colored arcs, with "Continuous Improvement" labeled in the center.

Visual Focus:

• Main content clearly presented

Required Elements:

• Per description key elements

Chinese Text to Display: None

Color Tone: Professional, clear

Elements to Avoid: Abstract graphics, gears, glowing effects

Slug: ai-project-lifecycle-circular-diagram

---

References

1. Google Cloud, "Vertex AI Documentation" (2024)
2. Google Cloud, "AutoML Documentation" (2024)
3. Google Cloud, "Gemini API Documentation" (2024)
4. Google Cloud, "BigQuery ML Documentation" (2024)
5. Google Cloud, "MLOps: Continuous delivery and automation pipelines in machine learning" (2024)