Generate captions that describe the content of an image

This flow uses the https://developer.ibm.com/exchanges/models/all/max-image-caption-generator/ deep learning model from the Model Asset Exchange to generate captions that describe the content of the input image. Refer to the documentation for information about the returned message.

Install the following two modules to run this example flow:

Note: The image-caption-generator node has been pre-configured to use a hosted model evaluation instance. We recommend using your own local or cloud instance for purposes other than evaluation.

[
    {
        "id": "2bc957c7.536298",
        "type": "tab",
        "label": "Image caption generator example flow",
        "disabled": false,
        "info": "This flow uses the https://developer.ibm.com/exchanges/models/all/max-image-caption-generator/ deep learning model from the Model Asset Exchange to generate captions that describe the content of the input image. Refer to the documentation for information about the returned message.\n\nInstall the following two modules to run this example flow:\n - [node-red-contrib-model-asset-exchange](https://www.npmjs.com/package/node-red-contrib-model-asset-exchange)\n - [node-red-contrib-browser-utils](https://www.npmjs.com/package/node-red-contrib-browser-utils)\n \n> Note: The image-caption-generator node has been pre-configured to use a hosted model evaluation instance. We recommend using your own local or cloud instance for purposes other than evaluation."
    },
    {
        "id": "28b44380.e1cc6c",
        "type": "debug",
        "z": "2bc957c7.536298",
        "name": "",
        "active": true,
        "tosidebar": true,
        "console": false,
        "tostatus": false,
        "complete": "true",
        "x": 610,
        "y": 120,
        "wires": []
    },
    {
        "id": "6691ff1b.554",
        "type": "fileinject",
        "z": "2bc957c7.536298",
        "name": "",
        "x": 140,
        "y": 120,
        "wires": [
            [
                "ae188a51.a4a658"
            ]
        ]
    },
    {
        "id": "e020695c.2bc528",
        "type": "camera",
        "z": "2bc957c7.536298",
        "name": "",
        "x": 150,
        "y": 180,
        "wires": [
            [
                "ae188a51.a4a658"
            ]
        ]
    },
    {
        "id": "ae188a51.a4a658",
        "type": "image-caption-generator",
        "z": "2bc957c7.536298",
        "service": "ddc1d5ce.a0f198",
        "method": "predict",
        "predict_body": "",
        "predict_bodyType": "str",
        "name": "",
        "x": 390,
        "y": 120,
        "wires": [
            [
                "28b44380.e1cc6c"
            ]
        ]
    },
    {
        "id": "a2347aac.17a248",
        "type": "comment",
        "z": "2bc957c7.536298",
        "name": "Generate captions that describe the content of the input image",
        "info": "",
        "x": 270,
        "y": 40,
        "wires": []
    },
    {
        "id": "ddc1d5ce.a0f198",
        "type": "image-caption-generator-service",
        "z": "",
        "host": "https://max-image-caption-generator.max.us-south.containers.appdomain.cloud",
        "name": "cloud"
    }
]
ptitzler

Flow Info

created 4 months, 3 weeks ago

Node Types

Core
  • comment (x1)
  • debug (x1)
Other

Tags

  • 'deep learning'
  • 'image caption'
  • max
Copy this flow JSON to your clipboard and then import into Node-RED using the Import From > Clipboard (Ctrl-I) menu option