Generate captions that describe the content of an image

README.md

This flow uses the https://developer.ibm.com/exchanges/models/all/max-image-caption-generator/ deep learning model from the Model Asset Exchange to generate captions that describe the content of the input image. Refer to the documentation for information about the returned message.

Install the following two modules to run this example flow:

• node-red-contrib-model-asset-exchange
• node-red-contrib-browser-utils

Note: The image-caption-generator node has been pre-configured to use a hosted model evaluation instance. We recommend using your own local or cloud instance for purposes other than evaluation.

flow.json

[
    {
        "id": "2bc957c7.536298",
        "type": "tab",
        "label": "Image caption generator example flow",
        "disabled": false,
        "info": "This flow uses the https://developer.ibm.com/exchanges/models/all/max-image-caption-generator/ deep learning model from the Model Asset Exchange to generate captions that describe the content of the input image. Refer to the documentation for information about the returned message.\n\nInstall the following two modules to run this example flow:\n - [node-red-contrib-model-asset-exchange](https://www.npmjs.com/package/node-red-contrib-model-asset-exchange)\n - [node-red-contrib-browser-utils](https://www.npmjs.com/package/node-red-contrib-browser-utils)\n \n> Note: The image-caption-generator node has been pre-configured to use a hosted model evaluation instance. We recommend using your own local or cloud instance for purposes other than evaluation."
    },
    {
        "id": "28b44380.e1cc6c",
        "type": "debug",
        "z": "2bc957c7.536298",
        "name": "",
        "active": true,
        "tosidebar": true,
        "console": false,
        "tostatus": false,
        "complete": "true",
        "x": 610,
        "y": 120,
        "wires": []
    },
    {
        "id": "6691ff1b.554",
        "type": "fileinject",
        "z": "2bc957c7.536298",
        "name": "",
        "x": 140,
        "y": 120,
        "wires": [
            [
                "ae188a51.a4a658"
            ]
        ]
    },
    {
        "id": "e020695c.2bc528",
        "type": "camera",
        "z": "2bc957c7.536298",
        "name": "",
        "x": 150,
        "y": 180,
        "wires": [
            [
                "ae188a51.a4a658"
            ]
        ]
    },
    {
        "id": "ae188a51.a4a658",
        "type": "image-caption-generator",
        "z": "2bc957c7.536298",
        "service": "ddc1d5ce.a0f198",
        "method": "predict",
        "predict_body": "",
        "predict_bodyType": "str",
        "name": "",
        "x": 390,
        "y": 120,
        "wires": [
            [
                "28b44380.e1cc6c"
            ]
        ]
    },
    {
        "id": "a2347aac.17a248",
        "type": "comment",
        "z": "2bc957c7.536298",
        "name": "Generate captions that describe the content of the input image",
        "info": "",
        "x": 270,
        "y": 40,
        "wires": []
    },
    {
        "id": "ddc1d5ce.a0f198",
        "type": "image-caption-generator-service",
        "z": "",
        "host": "https://max-image-caption-generator.max.us-south.containers.appdomain.cloud",
        "name": "cloud"
    }
]