↑↓ Navigateenter Openesc Close
Dashboard
MODEL IDmeta-llava-1-6-mistral-7b
live

LLaVA-1.6-Mistral-7B

LLaVA-1.6-Mistral-7B is a multimodal vision-language model that processes images alongside text to generate descriptive and reasoning-based responses. It enables image captioning and visual understanding by combining a vision encoder with a Mistral 7B language backbone.

LLaVA-1.6-Mistral-7B
Image to Text

Deserted Planetarium Classroom Display

The image presents a classroom setting that has been transformed into a surreal and otherworldly environment. The room is filled with rows of wooden desks, each equipped with an open book, suggesting a space for learning and study. The desks are arranged in a traditional classroom layout, with a teacher's desk positioned at the front of the room. The most striking feature of the room is the ceiling, which has been transformed into a night sky filled with planets and stars.
import { createClient } from '@runware/sdk'

const client = await createClient({ apiKey: process.env.RUNWARE_API_KEY })
await client.connect()

const [result] = await client.run({
  model: 'runware:150@2',
  prompt: 'Provide a detailed caption for this image, describing the setting, notable objects, lighting, mood, and any unusual visual contrasts.',
  inputs: {
    image: 'https://assets.runware.ai/assets/inputs/3fcf73ee-d1f6-40cd-89c6-9d9aa58c93e0.jpg'
  }
})
import asyncio
import os

from runware import Runware


async def main():
    async with Runware(api_key=os.environ["RUNWARE_API_KEY"]) as client:
        results = await client.run({
            "model": "runware:150@2",
            "prompt": "Provide a detailed caption for this image, describing the setting, notable objects, lighting, mood, and any unusual visual contrasts.",
            "inputs": {
                "image": "https://assets.runware.ai/assets/inputs/3fcf73ee-d1f6-40cd-89c6-9d9aa58c93e0.jpg"
            }
        })


asyncio.run(main())
curl https://api.runware.ai/v1 \
  -H "Authorization: Bearer $RUNWARE_API_KEY" \
  -H "Content-Type: application/json" \
  -d '[
    {
      "taskType": "caption",
      "taskUUID": "96c350a1-866b-4685-8bcc-14332636a36d",
      "model": "runware:150@2",
      "prompt": "Provide a detailed caption for this image, describing the setting, notable objects, lighting, mood, and any unusual visual contrasts.",
      "inputs": {
        "image": "https://assets.runware.ai/assets/inputs/3fcf73ee-d1f6-40cd-89c6-9d9aa58c93e0.jpg"
      }
    }
  ]'
runware run runware:150@2 \
  prompt="Provide a detailed caption for this image, describing the setting, notable objects, lighting, mood, and any unusual visual contrasts." \
  inputs.image=https://assets.runware.ai/assets/inputs/3fcf73ee-d1f6-40cd-89c6-9d9aa58c93e0.jpg
{
  "taskType": "caption",
  "taskUUID": "96c350a1-866b-4685-8bcc-14332636a36d",
  "model": "runware:150@2",
  "prompt": "Provide a detailed caption for this image, describing the setting, notable objects, lighting, mood, and any unusual visual contrasts.",
  "inputs": {
    "image": "https://assets.runware.ai/assets/inputs/3fcf73ee-d1f6-40cd-89c6-9d9aa58c93e0.jpg"
  }
}
Response
{
  "taskType": "imageCaption",
  "taskUUID": "96c350a1-866b-4685-8bcc-14332636a36d",
  "text": "The image presents a classroom setting that has been transformed into a surreal and otherworldly environment. The room is filled with rows of wooden desks, each equipped with an open book, suggesting a space for learning and study. The desks are arranged in a traditional classroom layout, with a teacher's desk positioned at the front of the room. The most striking feature of the room is the ceiling, which has been transformed into a night sky filled with planets and stars.",
  "cost": 0.0019
}
Caption

Tidepool Robot Tea Picnic

The image presents a whimsical beach scene featuring a robot sitting on a red and white checkered blanket. The robot, with its friendly face and arms, is the main subject of the image. It is positioned under a large blue and white striped umbrella, which provides shade for the robot and the two cups of coffee placed on the blanket. The beach setting is characterized by sandy shores and a calm sea, with a few seagulls scattered in the background.
import { createClient } from '@runware/sdk'

const client = await createClient({ apiKey: process.env.RUNWARE_API_KEY })
await client.connect()

const [result] = await client.run({
  model: 'runware:150@2',
  prompt: 'Describe this image in 3-5 vivid sentences, identifying the main subject, setting, notable objects, mood, and any surprising visual details.',
  inputs: {
    image: 'https://assets.runware.ai/assets/inputs/3a69fc0c-d298-4fb2-82d8-46074743fa4e.jpg'
  }
})
import asyncio
import os

from runware import Runware


async def main():
    async with Runware(api_key=os.environ["RUNWARE_API_KEY"]) as client:
        results = await client.run({
            "model": "runware:150@2",
            "prompt": "Describe this image in 3-5 vivid sentences, identifying the main subject, setting, notable objects, mood, and any surprising visual details.",
            "inputs": {
                "image": "https://assets.runware.ai/assets/inputs/3a69fc0c-d298-4fb2-82d8-46074743fa4e.jpg"
            }
        })


asyncio.run(main())
curl https://api.runware.ai/v1 \
  -H "Authorization: Bearer $RUNWARE_API_KEY" \
  -H "Content-Type: application/json" \
  -d '[
    {
      "taskType": "caption",
      "taskUUID": "8b27a5b6-eeab-4ee3-a998-0daa0ae48c95",
      "model": "runware:150@2",
      "prompt": "Describe this image in 3-5 vivid sentences, identifying the main subject, setting, notable objects, mood, and any surprising visual details.",
      "inputs": {
        "image": "https://assets.runware.ai/assets/inputs/3a69fc0c-d298-4fb2-82d8-46074743fa4e.jpg"
      }
    }
  ]'
runware run runware:150@2 \
  prompt="Describe this image in 3-5 vivid sentences, identifying the main subject, setting, notable objects, mood, and any surprising visual details." \
  inputs.image=https://assets.runware.ai/assets/inputs/3a69fc0c-d298-4fb2-82d8-46074743fa4e.jpg
{
  "taskType": "caption",
  "taskUUID": "8b27a5b6-eeab-4ee3-a998-0daa0ae48c95",
  "model": "runware:150@2",
  "prompt": "Describe this image in 3-5 vivid sentences, identifying the main subject, setting, notable objects, mood, and any surprising visual details.",
  "inputs": {
    "image": "https://assets.runware.ai/assets/inputs/3a69fc0c-d298-4fb2-82d8-46074743fa4e.jpg"
  }
}
Response
{
  "taskType": "imageCaption",
  "taskUUID": "8b27a5b6-eeab-4ee3-a998-0daa0ae48c95",
  "text": "The image presents a whimsical beach scene featuring a robot sitting on a red and white checkered blanket. The robot, with its friendly face and arms, is the main subject of the image. It is positioned under a large blue and white striped umbrella, which provides shade for the robot and the two cups of coffee placed on the blanket. The beach setting is characterized by sandy shores and a calm sea, with a few seagulls scattered in the background.",
  "cost": 0.0019
}
Caption

Abandoned Library Chess Table

In this image, a cozy library scene is captured, with a cat comfortably sleeping on a stack of books. The room is illuminated by a warm, golden light, creating a serene and inviting atmosphere. The presence of a chess set on a table suggests a quiet, intellectual setting, perhaps hinting at the cat's owner's love for the game.
import { createClient } from '@runware/sdk'

const client = await createClient({ apiKey: process.env.RUNWARE_API_KEY })
await client.connect()

const [result] = await client.run({
  model: 'runware:150@2',
  prompt: 'Provide a vivid caption for this image in 2-3 sentences, identifying the main setting, notable objects, lighting, mood, and any implied story suggested by the scene.',
  inputs: {
    image: 'https://assets.runware.ai/assets/inputs/f201b6da-5fb3-49b7-ada8-dd45295bd014.jpg'
  }
})
import asyncio
import os

from runware import Runware


async def main():
    async with Runware(api_key=os.environ["RUNWARE_API_KEY"]) as client:
        results = await client.run({
            "model": "runware:150@2",
            "prompt": "Provide a vivid caption for this image in 2-3 sentences, identifying the main setting, notable objects, lighting, mood, and any implied story suggested by the scene.",
            "inputs": {
                "image": "https://assets.runware.ai/assets/inputs/f201b6da-5fb3-49b7-ada8-dd45295bd014.jpg"
            }
        })


asyncio.run(main())
curl https://api.runware.ai/v1 \
  -H "Authorization: Bearer $RUNWARE_API_KEY" \
  -H "Content-Type: application/json" \
  -d '[
    {
      "taskType": "caption",
      "taskUUID": "44083438-c1e5-4d76-81d5-ad98c39f4a45",
      "model": "runware:150@2",
      "prompt": "Provide a vivid caption for this image in 2-3 sentences, identifying the main setting, notable objects, lighting, mood, and any implied story suggested by the scene.",
      "inputs": {
        "image": "https://assets.runware.ai/assets/inputs/f201b6da-5fb3-49b7-ada8-dd45295bd014.jpg"
      }
    }
  ]'
runware run runware:150@2 \
  prompt="Provide a vivid caption for this image in 2-3 sentences, identifying the main setting, notable objects, lighting, mood, and any implied story suggested by the scene." \
  inputs.image=https://assets.runware.ai/assets/inputs/f201b6da-5fb3-49b7-ada8-dd45295bd014.jpg
{
  "taskType": "caption",
  "taskUUID": "44083438-c1e5-4d76-81d5-ad98c39f4a45",
  "model": "runware:150@2",
  "prompt": "Provide a vivid caption for this image in 2-3 sentences, identifying the main setting, notable objects, lighting, mood, and any implied story suggested by the scene.",
  "inputs": {
    "image": "https://assets.runware.ai/assets/inputs/f201b6da-5fb3-49b7-ada8-dd45295bd014.jpg"
  }
}
Response
{
  "taskType": "imageCaption",
  "taskUUID": "44083438-c1e5-4d76-81d5-ad98c39f4a45",
  "text": "In this image, a cozy library scene is captured, with a cat comfortably sleeping on a stack of books. The room is illuminated by a warm, golden light, creating a serene and inviting atmosphere. The presence of a chess set on a table suggests a quiet, intellectual setting, perhaps hinting at the cat's owner's love for the game.",
  "cost": 0.0019
}
Caption

Deserted Carnival Under Eclipse

The image depicts a desolate carnival at dusk, with a large Ferris wheel standing tall in the background. The ground is covered in cracked earth, and a few tattered teddy bears are scattered around, adding to the abandoned feel of the scene. The sky is dark, with a large, ominous black sun looming in the center, casting an eerie glow over the entire landscape.
import { createClient } from '@runware/sdk'

const client = await createClient({ apiKey: process.env.RUNWARE_API_KEY })
await client.connect()

const [result] = await client.run({
  model: 'runware:150@2',
  prompt: 'Describe this image in 3-5 sentences, identifying the main setting, notable objects, lighting conditions, and the overall mood. Mention any details that suggest a story.',
  inputs: {
    image: 'https://assets.runware.ai/assets/inputs/499fccbc-e073-421b-be25-81d8c6ad385a.jpg'
  }
})
import asyncio
import os

from runware import Runware


async def main():
    async with Runware(api_key=os.environ["RUNWARE_API_KEY"]) as client:
        results = await client.run({
            "model": "runware:150@2",
            "prompt": "Describe this image in 3-5 sentences, identifying the main setting, notable objects, lighting conditions, and the overall mood. Mention any details that suggest a story.",
            "inputs": {
                "image": "https://assets.runware.ai/assets/inputs/499fccbc-e073-421b-be25-81d8c6ad385a.jpg"
            }
        })


asyncio.run(main())
curl https://api.runware.ai/v1 \
  -H "Authorization: Bearer $RUNWARE_API_KEY" \
  -H "Content-Type: application/json" \
  -d '[
    {
      "taskType": "caption",
      "taskUUID": "34c2fd43-f5b5-4f24-b96e-ecc91d72bfb1",
      "model": "runware:150@2",
      "prompt": "Describe this image in 3-5 sentences, identifying the main setting, notable objects, lighting conditions, and the overall mood. Mention any details that suggest a story.",
      "inputs": {
        "image": "https://assets.runware.ai/assets/inputs/499fccbc-e073-421b-be25-81d8c6ad385a.jpg"
      }
    }
  ]'
runware run runware:150@2 \
  prompt="Describe this image in 3-5 sentences, identifying the main setting, notable objects, lighting conditions, and the overall mood. Mention any details that suggest a story." \
  inputs.image=https://assets.runware.ai/assets/inputs/499fccbc-e073-421b-be25-81d8c6ad385a.jpg
{
  "taskType": "caption",
  "taskUUID": "34c2fd43-f5b5-4f24-b96e-ecc91d72bfb1",
  "model": "runware:150@2",
  "prompt": "Describe this image in 3-5 sentences, identifying the main setting, notable objects, lighting conditions, and the overall mood. Mention any details that suggest a story.",
  "inputs": {
    "image": "https://assets.runware.ai/assets/inputs/499fccbc-e073-421b-be25-81d8c6ad385a.jpg"
  }
}
Response
{
  "taskType": "imageCaption",
  "taskUUID": "34c2fd43-f5b5-4f24-b96e-ecc91d72bfb1",
  "text": "The image depicts a desolate carnival at dusk, with a large Ferris wheel standing tall in the background. The ground is covered in cracked earth, and a few tattered teddy bears are scattered around, adding to the abandoned feel of the scene. The sky is dark, with a large, ominous black sun looming in the center, casting an eerie glow over the entire landscape.",
  "cost": 0.0019
}
Ask AI
Send feedback