AI Painting’s Surreal Interpretation of Song Lyrics
- Dec 1, 2023
- 5 min read
With the iteration of artificial intelligence technology, AI painting has become popular recently. AI generators such as DALL-E2 and Stable Diffusion have brought us amazing composition and detailed performance. At the same time, industrial industries such as games, film and television, and fashion design have begun various explorations of its applications.
Recently, some new content forms have quietly appeared on video websites and content about AI painting - using AI painting to depict scenes in songs or directly generate MV works, and have achieved good results on video websites. User reputation.
The first lyric of "Hotel California" depicted by AI: "On the darkness highway"
If the arrangement of a song is the appearance of a song, then the lyrics of a song are the soul and interior of a song. In some popular songs, composition is often an internal interpretation and extension of what the song wants to express. The lyrics of the song have both signifier and narrative attributes, and the reference is relatively vague, the subject matter is wide-ranging, and the imagination is rich. And these illogical, ambiguous, and artistic characteristics are exactly in line with the characteristics of AI painting. However, under specific input parameters, AI-painted works can usually show a sense of surrealism, epicness, nihilism and ethereal inspiration, and even some of the more unpopular works have inadvertently taken on reasonable meanings through people's subjective interpretations. a sense of surrealism, epicness, nihilism and ethereal inspiration, and even some of the more unpopular works have inadvertently taken on reasonable meanings through people's subjective interpretations.
Therefore, the interpretation of the lyrics of the song by AI painting is an extension of the song, which further increases people's deep understanding and empathy for the song.
"Hotel California" lyrics depicted by AI: "Mirrors on the ceiling, the pink champagne on ice"
My point of view:
As a type of art, the importance of music in our lives is self-evident. There are always songs that can touch people's hearts. Compared with previous applications, AI interprets the lyrics in the songs, making the vague emotions and imaginations in people's minds concrete, further triggering people's feelings about the beauty of music, from hearing The enjoyment is transformed into a multi-sensory enjoyment of hearing and vision, which I think is a very good supplement to the song itself.
It is no longer necessary to mention the popularity of AI painting. The main focus is on the attention and playback volume of AI-based lyrics creation videos.
It can be seen from the videos on Bilibili that the views of these videos range from tens to hundreds of thousands, which is relatively good.
Judging from the number of views on YouTube, this type of work also has a stable and good number of views.
At present, this type of video is still relatively niche, and AI still has a lot of room for improvement. After gradual improvement, it will have more widespread attention and application.
Why this important?
User side:
A sense of need and satisfaction for the illusory world in the mind.
AI painting expresses the audience's understanding and imagination of the song in a surreal way, which is rare to satisfy the audience's deep-seated spiritual pursuit at the moment.
When listening to the song, the emotional joy, anger and sorrow are drawn by the ups and downs of the song, and the song itself is in a state of deep empathy, and the mind will unconsciously fantasize, and this emotion is often vague, unfocused and fleeting. AI painting captures the common characteristics and expresses the emotions contained in the pictures one by one, concretizing these emotions to a certain extent, and even bringing more detailed and shocking performances, strengthening the audience's emotional resonance with the songs, and greatly improving the artistic appreciation value of the songs. Obviously, the emergence of AI painting fills the gap in this aspect and satisfies the audience's deep spiritual pursuit.
The lyrics from Queens' "Don't Stop Me Now" created by AI
Desire to briefly blur the line between reality and illusion in AI painting.
Unlike other animals, humans have subjective agency, and AI's seemingly abstract and illogical paintings only reintegrate various elements in the key words, but these things become full of surreal and dreamlike beauty when added to people's subjective thoughts, and the elements in the painting are also endowed with emotions and intentions because of the referencesFor example, the moon in the sky refers to people's melancholy thoughts and homesickness, and the huge industrial city refers to the coldness brought about by the industrial society and the oppression of personal consciousness. These interpretations of songs are like a new kind of MTV, introducing people from the real society into their own conscious world, briefly immersing themselves in their own world during the time of a song, and temporarily putting aside the pressure around them.
Industry side:
Further exploration of AI's "unlimited creative capabilities".
The AI painting application goes from entering text descriptions, to applying inspiration to game illustrations, and then to further applying it to the interpretation of text. NLP semantic segmentation, and the continuous advancement of AI painting have made it possible to use AI for these applications. For abstract and illogical scenes described in the lyrics of some songs, AI can achieve good results
Enlightenment for us in the entertainment industry
At present, the technology of AI painting is still improving rapidly, and the current mainstream AI painting software has some shortcomings, such as language segmentation can only be understood from the literal meaning, and words with ambiguity can usually not be connected with the context, such as "carry on" The meaning is directly interpreted as carrying luggage, and the lyrics want to express that they continue to move forward in the face of difficulties. Secondly, the description of the characters will have distorted facial features and limbs, and some pictures are treated in this way to enhance the tension, but more importantly, it has a certain impact on the perception.
But all of the above problems can be solved. After solving these problems, the depiction of lyrics and other words by AI will have a higher degree of completion and storytelling, making the works generated by AI have more reference value and significance. Record labels or music software companies may refer to AI drawings for MTV production, or use AI graphics to adjust songs to make them more in line with the preferences of specific people.
1. You can launch the AI painting function on the karaoke software. Through the AI that can be adjusted by itself, combined with the emotions and rhythm of the user's own singing, the speed and the pitch of the voice to generate some paintings about the song for display, it can be used as a relatively cutting-edge new function to attract users who pursue self and personality, increase the user's personalized experience, and let users get the pleasure of satisfying their self-worth (their own singing as part of the source of AI creation). At the same time, I got the spiritual sensory enjoyment that fits with myself.
2. For the interludes of the game, you can refer to the depiction images obtained by AI painting as inspiration or draft for further improvement, which increases the efficiency of work and the diversity of themes and expressions.
3. In software such as music and reading books, use further improved AI to draw illustrations for songs and even literary works, and use them as optional functions to add illustrations through appropriate algorithms to fill the lack of visual experience of users and arouse further empathy from users.
Comments