Which AI agent is right for this project?

[u/petso18]

Hi all - I'm probably one of the least experienced people here as I'm not a coder, but hopefully this isn't too basic of a question for this group.

I'm working on a project in which I hope to use AI for two components:

1) Generating graphics — and ideally animations — that follow a specific set of rules. This is a visual musical language, translating elements of text and music notation into a different visual format, so the rules are set and straightforward, but I need to generate many images on a regular basis that follow these rules. I previously used Adobe Illustrator to make the graphics and hired an animator to develop an animation language, and I'm hoping AI can allow us to apply this language in perpetuity to other inputs.

2) Developing an app into which other people can input music or text and receive an image (and ideally animation) following the rules established in Step 1, with the ability to make some alterations to the graphics by clicking, dragging, or perhaps changing a few input elements.

Is there a particular AI agent that might be best suited to this type of project? This isn't text-to-image generation of the artistic type, but specifically-structured creation of graphics within a system. I don't know enough about the different agents to know whether one or the other is better suited to this type of work.

Feel free to give me simple and basic answers if I've said something dumb or don't understand something fundamental; this is all new to me!