> ## Documentation Index
> Fetch the complete documentation index at: https://mintlify.com/cheahjs/free-llm-api-resources/llms.txt
> Use this file to discover all available pages before exploring further.

# Google Cloud Vertex AI

> Free preview access to Meta Llama models on Google Cloud

<Note>
  Google Cloud Vertex AI offers free preview access to select Meta Llama models with generous rate limits.
</Note>

## Overview

Google Cloud Vertex AI provides access to enterprise-grade AI models through Google Cloud Platform. Select Llama models are available for free during their preview period.

<Warning>
  **Payment Verification Required**: Google Cloud requires very stringent payment verification to create an account, even for free tier access.
</Warning>

## Rate Limits

<Info>
  All listed models are **free during preview period**.
</Info>

| Model Name                                                                                                                                  | Requests/Minute | Pricing             |
| ------------------------------------------------------------------------------------------------------------------------------------------- | --------------- | ------------------- |
| [Llama 3.2 90B Vision Instruct](https://console.cloud.google.com/vertex-ai/publishers/meta/model-garden/llama-3-2-90b-vision-instruct-maas) | 30              | Free during preview |
| [Llama 3.1 70B Instruct](https://console.cloud.google.com/vertex-ai/publishers/meta/model-garden/llama-3-1-405b-instruct-maas)              | 60              | Free during preview |
| [Llama 3.1 8B Instruct](https://console.cloud.google.com/vertex-ai/publishers/meta/model-garden/llama-3-1-405b-instruct-maas)               | 60              | Free during preview |

## Available Models

<CardGroup cols={2}>
  <Card title="Llama 3.2 90B Vision" icon="eye">
    Multimodal model with vision capabilities
  </Card>

  <Card title="Llama 3.1 70B" icon="brain">
    Powerful 70B parameter model
  </Card>

  <Card title="Llama 3.1 8B" icon="bolt">
    Efficient 8B parameter model
  </Card>
</CardGroup>

## API Usage

<CodeGroup>
  ```python Python theme={null}
  from google.cloud import aiplatform
  from vertexai.preview.language_models import ChatModel

  aiplatform.init(project="YOUR_PROJECT_ID", location="us-central1")

  chat_model = ChatModel.from_pretrained("llama-3-1-70b-instruct-maas")

  response = chat_model.send_message(
      "Hello, how are you?",
      temperature=0.7,
      max_output_tokens=1024
  )

  print(response.text)
  ```

  ```javascript JavaScript theme={null}
  const {VertexAI} = require('@google-cloud/vertexai');

  const vertexAI = new VertexAI({
      project: 'YOUR_PROJECT_ID',
      location: 'us-central1'
  });

  const model = vertexAI.preview.getGenerativeModel({
      model: 'llama-3-1-70b-instruct-maas'
  });

  const result = await model.generateContent({
      contents: [{
          role: 'user',
          parts: [{text: 'Hello, how are you?'}]
      }]
  });

  console.log(result.response.text());
  ```

  ```bash cURL theme={null}
  curl -X POST \
    -H "Authorization: Bearer $(gcloud auth print-access-token)" \
    -H "Content-Type: application/json" \
    https://us-central1-aiplatform.googleapis.com/v1/projects/YOUR_PROJECT_ID/locations/us-central1/publishers/meta/models/llama-3-1-70b-instruct-maas:predict \
    -d '{
      "instances": [{
        "prompt": "Hello, how are you?"
      }],
      "parameters": {
        "temperature": 0.7,
        "maxOutputTokens": 1024
      }
    }'
  ```
</CodeGroup>

## Getting Started

<Steps>
  <Step title="Create Google Cloud Account">
    Sign up at [cloud.google.com](https://cloud.google.com)
  </Step>

  <Step title="Complete Payment Verification">
    Verify payment method (required even for free tier)
  </Step>

  <Step title="Create Project">
    Create a new project in Google Cloud Console
  </Step>

  <Step title="Enable Vertex AI API">
    Enable the Vertex AI API for your project
  </Step>

  <Step title="Access Model Garden">
    Visit the [Model Garden](https://console.cloud.google.com/vertex-ai/model-garden)
  </Step>

  <Step title="Deploy Model">
    Deploy a free preview model
  </Step>
</Steps>

## Key Features

<CardGroup cols={2}>
  <Card title="Enterprise Grade" icon="building">
    Production-ready infrastructure
  </Card>

  <Card title="Free Preview" icon="gift">
    No cost during preview period
  </Card>

  <Card title="High Rate Limits" icon="gauge-high">
    Up to 60 requests per minute
  </Card>

  <Card title="Vision Support" icon="image">
    Multimodal capabilities with Llama 3.2
  </Card>

  <Card title="Global Infrastructure" icon="globe">
    Google's worldwide network
  </Card>

  <Card title="Security" icon="shield">
    Enterprise security and compliance
  </Card>
</CardGroup>

## Model Details

### Llama 3.2 90B Vision Instruct

* **Capabilities**: Text and image understanding
* **Rate Limit**: 30 requests/minute
* **Best For**: Multimodal applications, image analysis

### Llama 3.1 70B Instruct

* **Capabilities**: Advanced text generation and reasoning
* **Rate Limit**: 60 requests/minute
* **Best For**: Complex tasks, long-form content

### Llama 3.1 8B Instruct

* **Capabilities**: Efficient text generation
* **Rate Limit**: 60 requests/minute
* **Best For**: Fast inference, cost-effective applications

## Important Considerations

<Warning>
  * Payment verification is mandatory, even for free tier
  * Models are free only during preview period
  * Pricing may change when models reach general availability
  * Rate limits are subject to change
</Warning>

## Use Cases

<Info>
  * **Enterprise Applications**: Build production-grade AI apps
  * **Multimodal Projects**: Leverage vision capabilities
  * **Prototyping**: Test Llama models at scale
  * **Migration**: Evaluate before committing to paid tier
</Info>

## Additional Resources

<CardGroup cols={2}>
  <Card title="Vertex AI Console" icon="browser" href="https://console.cloud.google.com/vertex-ai">
    Access the platform
  </Card>

  <Card title="Model Garden" icon="seedling" href="https://console.cloud.google.com/vertex-ai/model-garden">
    Browse available models
  </Card>

  <Card title="Documentation" icon="book" href="https://cloud.google.com/vertex-ai/docs">
    Official documentation
  </Card>

  <Card title="Llama Models" icon="meta" href="https://console.cloud.google.com/vertex-ai/publishers/meta/model-garden">
    Meta Llama on Vertex AI
  </Card>
</CardGroup>