Alessandro Mastroianni

The Sound Design Diaries #7: AI-powered Sound Design, But It’s Not What You Think

< Back

I've been resisting the temptation to express my thoughts on AI for the longest time and the main reason for this is that I don't have a clear opinion on it.

While I recognise the threat it poses to my profession and many others, and while I see its potential to completely disrupt every single aspect of our lives, I am confused over the ways it will do this and the extent of it (aren’t we all?).

As I keep a close eye on it, as I continue to reflect on its impact, Chuck Wendig’s words come to mind:

"The allure of Al entices those people who fetishize ideas but dismiss the work. They're the people who tell writers, "I'll give you the idea, then you write it, and we'll split the profits." For them, the vision is everything, and the work is just an annoying obstacle. But the WORK is everything. The work is how a thing happens, where it's made, where skill is put to work. Al in creativity is for the people who have no skill, no work, no effort, no ethic. They just want to push a button."

And I had a possibly crazy idea.

What if I act as the lazy “creative” and role-play with AI? What if I let AI wear a hat I can’t wear?

It might be a train wreck, but hear me out, here’s what I have in mind: I’m going to ask ChatGPT to write a treatment for a pretend Netflix series, I want to get some ideas about the settings, the characters, the plot and even get some visual representation of this using DALL-E.

Once that is done, I want to use this material to create a pitch to score the series; I will do this both by writing some music and, more interestingly I think, by creating a custom sonic palette in the form of presets, custom samples and virtual instruments that we can possibly release as a sample library through Sonora Cinematic.

I’ll document the process on my YouTube channel.

Here’s why I think this should ethically be fine and artistically interesting, but feel free to let me know if you disagree:

  • This doesn’t take work away from an actual creative: I wouldn’t have hired a writer or an illustrator otherwise;
  • I think it’s an interesting exploration of AI-driven art, as in “human reaction to AI-created raw material” rather than, in Wendig’s words, the act of “pushing a button”.

I also just want to see how original generative AI can be, probably not very much but I’ll leave my bias out as much as possible.

Rather than giving ChatGPT complete freedom, I thought a good way to do this would be to ask the machine to write something based on the five best TV series of the last five years… of course “best” isn’t an objective definition but I went for these purely based on an article by the Guardian:

  • Shogun
  • Industry
  • One Day
  • Baby Reindeer
  • Slow Horses

Interestingly, I’ve only watched three of these (One Day, Shogun and Baby Reindeer). Yes, the selection certainly has a British bias.

Alessandro: So, ChatGPT, would you please write me a treatment for a TV series inspired by Shogun, Industry, One Day, Baby Reindeer and Slow Horses?

Buckle up (I’ve streamlined and tweaked this for you as ChatGPT went a bit over the top if you can believe it)…

Title: Shifting Tides

Logline:

In a high-stakes world where ambition, loyalty, and betrayal clash, Shifting Tides follows an enigmatic young outsider navigating the volatile dynamics of a prestigious financial empire in 1980s Tokyo, blending historical intrigue, modern ambition, and deeply personal revelations.

Synopsis:

Set in the booming financial landscape of 1980s Tokyo, Shifting Tides explores the lives of an international cast of ambitious characters vying for control, survival, and redemption in a world shaped by cultural collisions, power struggles, and personal sacrifices. At the center of it all is Emma Harlow, a British-Japanese woman with a shadowy past, who returns to Tokyo seeking answers about her late father’s mysterious life—and finds herself embroiled in the cutthroat world of Shinsei Capital, a major financial institution.

As Emma earns a coveted spot on the firm’s elite trading floor, she must navigate a treacherous web of professional rivalries, shifting allegiances, and personal entanglements. Torn between the Western ideals she grew up with and the rigid expectations of Japanese society, Emma walks a tightrope between cultures, balancing ambition with loyalty and greed with conscience.

Meanwhile, Takeshi Aoyama, Shinsei's magnetic but ruthless CEO, hides his vulnerabilities behind an unrelenting pursuit of power. Emma’s journey threatens to unravel the carefully curated world Takeshi has built while exposing cracks in the company's pristine image—and the devastating secrets they both share. As the financial tides rise, so too do questions of morality, belonging, and what it means to win in a system built to break you.

Tone:

  • A blend of the dark, gritty intensity of Industry with the historical intrigue and epic scale of Shogun.
  • The raw, deeply personal emotional beats of One Day and Baby Reindeer.
  • The sharp wit and morally ambiguous character dynamics of Slow Horses.

World-Building:

The story is grounded in Tokyo during the 1980s economic boom, a setting of neon-lit skyscrapers, exclusive whiskey bars, and sprawling Zen gardens. The dichotomy of modernity and tradition mirrors the characters’ inner struggles. Key locations include Shinsei Capital's sleek offices, a secretive countryside retreat, and Tokyo’s vibrant underground nightlife scene. The city itself becomes a character, reflecting the cultural collisions at the heart of the story.

Alessandro: Hey ChatGPT, can you generate some pictures of what the Tokyo depicted in Shifting Tides might look like?

ChatGPT: Here’s a cinematic depiction of 1980s Tokyo, reflecting the moody, high-stakes world of Shifting Tides. Let me know if you’d like any tweaks or specific details added!

Alessandro: Thank you, I like what you said about exclusive whiskey bars, I like whiskey! Can you use Dall-E to draw me a picture of one of those?

ChatGPT: Here’s an exclusive whiskey bar in 1980s Tokyo, with that warm, sophisticated ambiance perfect for the world of Shifting Tides. Hope you like it! Let me know if you want any refinements.

Alessandro: Great, tell me something more about the characters.

ChatGPT: Sure!

Characters:

  • Emma Harlow (28): A brilliant but emotionally guarded young woman. Raised in London after her Japanese father’s mysterious death, Emma returns to Tokyo to unravel his secrets and redefine her future. Her sharp intelligence and fluency in Japanese grant her access to Shinsei Capital, but her lack of trust becomes both her strength and her weakness.
  • Takeshi Aoyama (50s): The enigmatic CEO of Shinsei Capital. A self-made man, Takeshi embodies the contradictions of Japan’s financial boom—outwardly traditional but inwardly ruthless. His mentorship of Emma reveals a deep personal connection to her father.
  • Naomi Matsuda (35): Shinsei’s star trader and one of the few women in the firm. Naomi is fiercely ambitious but secretly struggling with the rigid constraints of Japanese corporate culture. She sees Emma as both a rival and an ally.
  • Lucas King (30): An American expat who thrives on Tokyo’s expat party scene while hiding a dark side. As Emma’s closest friend at Shinsei, Lucas represents the pull of Western freedom but also its destructive undercurrents.
  • Kenji Harlow (Emma's Father): Seen through flashbacks, Kenji was a brilliant but troubled man who straddled two cultures and whose death may hold the key to Emma’s present.
  • Akiko Aoyama (40s): Takeshi’s estranged wife, a graceful but disillusioned figure who harbors her own ambitions and secrets.

Alessandro: Can I have a picture of what you imagine Emma Harlow looking like?

ChatGPT: Here’s a cinematic portrait of Emma Harlow, capturing her intelligence, confidence, and the mystery surrounding her past. Let me know if you’d like any refinements!

Alessandro: Great, not stereotypical at all. While you’re at it, can we also have a picture of Takeshi Aoyama and Lucas King?

ChatGPT: Here are cinematic portraits of Takeshi Aoyama and Lucas King, each capturing their distinct personalities and roles in Shifting Tides. Let me know if you'd like any refinements or additional details!

ChatGPT: Here’s a cinematic depiction of Shinsei Capital headquarters—its towering presence, high-tech interior, and intense atmosphere perfectly capturing the cutthroat world of Shifting Tides. Let me know if you'd like any refinements!

Well… I think I have enough to work with. What do you think, should we make this sample library?


Contact