One Step Further: Collaborating with AI Open

Over the weekend, I wrote about using Text to Transformer to start a poem and see where the AI Open-infused text generator — Talk to Transformer — might take my words.

Then, I started to think about how to find a poem inside the text generated by another poem. Could I surface something from inside of something else, inspired by something else altogether? Another nested poem? I’d find out.

Here’s what I did (in case you want to ever do your own):

  • I went into Google Slides (but any slideshow program would work because when you move across slides, it looks like animation) and began to cross out words (blackout poem style).
  • Then I removed the excess words (I cheated, by turning the font color the same color as background, so white text against white background is no longer visible; otherwise, it would have a long formatting exercise of adding spaces where words had been).
  • Finally, I pulled the remaining, revealed text into another poem. I used transitions and animations to make the process more visible in the slides (the whole thing is as visual hoax, really, using different slides layered on each other to seem like the text is being animated).

Sort of odd. I like that kind of weird writing and weird writing processes.

Peace (in the poem),
Kevin

 

Book Review: The Writer’s Map (An Atlas of Imaginary Lands)

Can I fall in love with a book? My wife is a librarian, so she will understand. I am smitten with The Writer’s Map, an oversized book edited by Huw Lewis-Jones that does what it says: it explores the world of writing and reading through sharing of stories by writers, readers, and cartographers of maps with literary landscapes. It’s subtitle, too, is perfect: An Atlas of Imaginary Lands.

This book is just beautiful to hold and to read (no digital version, please), and the wide assortment of maps will make your head spin with wonder.  The sections span from Make Believe, to Writing Maps, to Creating Maps and more, and in each section, novelists and poets and more share stories of how maps informed their work and sparked their imagination.

There are replicas of ancient maps and newer ones, and the oversized nature of the book itself allows the maps to be large for viewing (as is often necessary, for many maps have small print).

If this book doesn’t take you on your own journey of wondering what is just beyond your own maps, I don’t know what will. The Writer’s Map is a powerful argument of how wondering about the world — real and imagined — help us create and appreciate art.

I have this book on loan from the library and intend to keep it right to the last day, if I can.

Peace (mapped beyond what we see),
Kevin

Sometimes, a walk …

Nature Trail Feldgang WalkA walk in the woods with your eyes wide open sometimes leads to a wonderful collection of photos, and a deeper look at nature. Here, I gathered up into a collage some of what I noticed yesterday in our nearby woods as a feldgang/learning walk with a camera lens ready (and a dog waiting patiently each time for me to finish up so we could keep moving along the paths).

Peace (what we see),
Kevin

 

Writing Collaboration with OpenAI: Context and Constraints

What happens when you hand off your poem to a “modern neural network”? Something strange, with a hint of interesting. I was using a site called Talk to Transformer, which is built on the back of some neural network mapping of OpenAI and which is designed to complete your text, using its signifiers and databases.

The site explains that it is:

… an easier way to play with OpenAI’s new machine learning model. In February, OpenAI unveiled a language model called GPT-2 that generates coherent paragraphs of text one word at a time … While GPT-2 was only trained to predict the next word in a text, it surprisingly learned basic competence in some tasks like translating between languages and answering questions.

So, of course, I could not resist feeding it some words to see what would happen, starting the lines of a poem about context and constraints, and in the image above, you can see what it spit out for me. There is something beautiful surfacing there, in the juxtaposition of my poem starter and its story extension, although I am at a loss to really understand how it made the leap from my words to its text.

For example, the point of view shifts from third person to first person, and suddenly, the narrator is talking of their mother’s love (or lack of) in a world fallen apart. But look at the last three lines it generated … it’s almost like the start of something else altogether, maybe a new poem generated by human hand … Maybe the game turns to me to continue onward with the AI’s idea ..

I am what I am when I’m no longer
something that mustn’t be forgotten…
a person so beautiful

So remember me; you must remember us,
as I remember this wasted Earth
when love was nearly lost

and all we had left to hold was each other,
in the days after fallen trees
and warming seas

I still carry the bones of my mother,
that which the soil would no longer hold:
I am young; I am old

The image is a layered gif that I made in Lunapic because I wanted to do something more with the writing. I purposely added non-digital writing tools to contrast the use of AI to make a piece of writing.

Peace (in texts, transformed),
Kevin

 

The NetNarr Field Guide: A Journal Worth Exploring

Eatin memes and makin hay

Early on, I was pretty active in the Networked Narratives course as an open online participant, as a sort of satellite with a few others to the actual university course being taught by Alan Levine and Mia Zamora. My comic strip alter-egos — The Internet Kid and Horse with No Name — were also part of the Twitter conversations and activities.

At some point, I admittedly lost track in a peripheral way (this is the beauty of RSS feeds — I kept up with the basics of the course progress in my RSS reader from the NetNarr site).

So, I was pleasantly surprised by Mia’s sharing of the completed NetNarr Field Digital Alchemy Guide that all the classroom students contributed to as part of their research (I am not sure if any open folks added to the journal, too). The course itself began pretty dark — with all the ways technology is used against us, in terms of privacy and surveillance and more — and then moved into the light — how can we, as individuals, can make a difference and maybe help foster change for the better.

As noted at the NetNarr Journal site:

Each piece of writing is a review of one specific issue of concern about the internet of 2019, following ones we studied, e.g. the surveillance economy, digital identity theft, fake news, digital redlining, toxic data, self expression, bots. Writers were not asked to “fix” or “solve” these big problems, but offer suggestions for individuals how to better thrive in these environments, hence the idea of a “field guide”.

They are written as a dialogue between the students and their invented digital alchemist mentor and will include links to the “notes in the field” left as web annotations.

The work done in the Journal is really rich with topics and insights and resources, and I applaud my former classmates (sort of) for the depth of their sharing in this journal, which is a valuable resource for anyone struggling with finding balance between the potential and the pitfalls of this technologically connected world.

Consider their topics:

I, for one, only vaguely know what F-insta is, so that’s where I’m heading off to learn more from the NetNarr-ians. Which topic grabs your attention? Be a real reader, and leave some comments for the explorers. Pose a question. Offer insight. Engage.

Peace (inside the research),
Kevin

Do Algorithms Dream of Improvisation?

Here is a convergence of two texts in a feldgang — first, a shared reading of The Art of Is with other CLMOOC friends and then, an article in this week’s The New Yorker by Hua Hsu entitled “Machine Yearning.” In The Art of Is, I am in a place in the text where writer Stephen Nachmanovitch is exploring improvisation and mistakes, and how one (mistakes) often lead to the other (improvisation) to make art. In The New Yorker piece, Hsu focuses in on artist Holly Herndon’s work to create music through a computer-generated voice program she calls Spawn, training it to sing to Herndon’s music on her new album, PROTO.

Hsu then connects Herndon’s work with computers and algorithms to some other movements on the music landscape, including rapper Lil Nas X’s successful maneuver to manipulate the algorithms of pop music charts to create “Old Town Road” (an analysis of top charted songs led the making of this song) and it, of course, has reached the top of the charts.

Further, Hsu notes that a company called Endel is now developing music created only by algorithms to “personalize” a space or environment that, according to Hsu, take ” … into account everything from their (listener) heart rate to the weather and thje time of day.” Endel got signed to Warner.

And Hsu notes that jazz pianist Dan Tepfer is releasing a new album soon called “Natural Machines” in which he plays duets with computer algorithms, in which the algorithms, according to Hsu, are “… designed to respond to his improvisations, producing a more dynamic range of sound than his two hands could make on their own.”

Huh. So, now connecting what I have been reading in the magazine piece to what I have been reading in The Art of Is, a question that keeps popping up into my head is this:

Can algorithms improvise? Will they be able to improvise? What will that mean?

Or is this one of those fault lines between human and machine, where improvisation is an art form that is truly and only human — something that draws from the heart, soul and mind? Or is that statement my own naive thinking, and machines will, if not now then soon enough, come to to learn how to be improvisational machines, creating art in the moment with no pre-programmed instructions? And if so, will we be able to tell the difference?

I’d like to think the first is true — that improvisation is a skill only humans have — and that we will be able to hear and recognize an improvisational solo by machine (Computer vs Coltrane? Saxophonist wins every time … right?) but I am less and less confident on that declaration as the years progress and I see projects like these unfolding.

What do you think?

Peace (I wrote that myself),
Kevin

 

It’s There In the Mistakes Where the Real Art Might Happen

Book nibblers

I’ve been reading, with other CLMOOC friends, the book, The Art of Is by Stephen Nachmanovitch, in an annotation site called NowComment, which has allowed us to engage with the text and have conversations together in the margins.

I reached a section last night about mistakes and improvisation, and how mistakes fuel creativity, but also, how so many people are taught to fear mistakes, how they avoid mistakes at all costs, and how many experience shame when things go awry (partly due to our education systems that teach failure vs success as a zero sum game).

“Mistakes” in improvisation are hard to define, but people recognize when something works and when it doesn’t. — from The Art of Is by Stephen Nachmanovitch

Nachmanovitch suggests otherwise, arguing that the possibilities of art also emerge from places where things are imperfect or gone awry but that finding the art in the mistakes requires your ear to be attuned to the possibilities emerging from the unknown, from the mistakes. This is embedded into improvisation, he suggests, and I agree.

For this is how I write songs. I start at a place where I know I will begin (common chords and common patterns) and then listen for my fingers fumbling on the fretboard of the guitar, knowing that sometimes, something happens — and I need to expect the unexpected, and use the mistake for a new path forward. In those moments, I am often scribbling lyrics like a madman, to capture the idea before it gets away from me.

In my rock and roll band, on my saxophone, when I am soloing, as improv, this, too, is what happens — I often don’t know where I am going with my playing on solos, and sometimes, my fingers take me in a direction that is, well, news to me. This nearly always sparks some internal panic known only to me, Making a mistake in a gathering with other musicians, particularly with a live audience in front of you — that’s tricky business, and stressful, and exciting, too. I’ve learned to trust myself in this high wire act, though. I trust I will know where to go even if I am not aware of it as I’m thinking on it.

Thinking on this concept of mistakes, I wrote a poem for the margins of our shared reading experience …

On Making Mistakes

No one ever noticed,
for more than the second
it takes one to forget,
the perfect song:
the magic of listening
to remember resides
in the blemishes —
the transposed chords,
the slightly off-kilter
phrasing, the slip of the
voice, the chipped reed, the
spit-filled tube, the broken
drumstick, the snapped piano
string, the panic that produced
something to ponder
when the music’s echoes
have since long been over

Peace (where the path goes, follow),
Kevin

Photobooth: A Collaborative Song’s Construction

Photobooth Song Arc Collaboration

I am just wrapping up (but not rapping up) a fourth round of a inspiring collaborative song project called A Whale’s Lantern, which has roots in the Mastodon federated networking space. In each round, participants are randomly partnered with others, and all pairings are given an overall theme to work with as a connector thread, and then, the partners have extended periods of time (usually a few months) to get creating something.

I have been fortunate in each of my pairings to connect with collaborators who have been easy to work with (maybe this is an inherent quality of those who volunteer for the project and reach the ending point). Although each partnership has had a distinct and different feel to it, and my role has been different each time, each round has really pushed my abilities as a songwriter and musician. In the latest collaboration — the music tracks will be released in a few weeks after they get mastered and gathered and posted at Bandcamp — the overarching theme was “portraits.”

My partner, Bobbus, is someone who I had interacted sporadically with on Mastodon, and I know he is a talented and thoughtful musician. We hit it right off the bat in our emails, both of us expressing gratitude for the chance to try to make music in a different format than we are used to and both of us expressing an openness to try any idea the other pitched, and both of us open to a starting point.

With this mind, I sent forward a song to him that I had started on acoustic guitar after thinking a bit on the theme of “portraits.” The proposed song — Photobooth — captured a pining by the narrator of an old photo album of a relationship that is long since gone to dust. The “portrait” might be a picture taken in one of those box photo booths, where you put coins in and an image pops out.

Draft Lyrics Photobooth Song

Bobbus thought the song could work for us (although we were both open to starting over if it didn’t), and the chart/map/graphic at the top of the post here shows some of the ways the song was woven over a few months time, particularly as he used his skills as a sound engineer and solo guitarist to create the song’s sonic landscape, adding unexpected (to me) chord changes and suggesting other parts to break up what began as a pretty traditional pop song of verse/chorus.

On a technical note, we used PCloud storage as a way to share many audio files back forth. I would send him raw music that I was making and he would do rough mixing, and share it back, asking for comments and feedback, and so the revisions would flow. We also used a writing app called Turtl for sharing written notes, lyrics, chord changes and more. I was not familiar with either of those platforms, so it was interesting to try to collaborate with different technology tools. Both worked just fine for us.

My challenge with the recording process, as it is always, was with the vocals, and he did as much he could with effects to make my voice work for the song, although there are points where .. well… I’m not sure I hit the notes I wanted to hit. I did like the way he created the ending section, where I recorded three saxophone parts that he mixed under his guitar … there’s a sense of the world kind of coming apart that works well with the song’s theme itself.

I am grateful and appreciative of Bobbus as a musical partner and collaborator, and for the chance to make more interesting collaborative music and art with the Whale’s Lantern community.

Anytime anyone has the opportunity to make something out of nothing — to pluck melody and harmony and rhythm out of thin air and transform it into something that someone else might hear and maybe even appreciate — particularly when this magic is done with someone from somewhere else in the world connected only by a federated space, is a cause for celebration, and experiences like A Whale’s Lantern provide a powerful counterpoint to so much of the failure of other networking spaces to live up to the promise of a world made better by connections.

Peace (inside the booth),
Kevin

 

Book Review: A Velocity of Being (Letters to a Young Reader)

Some books, you just know you may never want to part with. Ever.

This is one of those books. A Velocity of Being (Letters to a Young Reader) featured dozens of letters written by adults of all walks of life — musicians, writers, poets, media makers, business people, etc. Edited by the wonderfully talented Maria Popova (of Brain Pickings) and Claudia Bedrick, this book is just one gem after another … turn the page and you can’t stop reading.

As Povova writes, the book is …

a collection of original letters to the children of today and tomorrow about why we read and what books do for the human spirit, composed by 121 of the most interesting and inspiring humans in our world: Jane Goodall, Yo-Yo Ma, Jacqueline Woodson, Ursula K. Le Guin, Mary Oliver, Neil Gaiman, Amanda Palmer, Rebecca Solnit, Elizabeth Gilbert, Shonda Rhimes, Alain de Botton, James Gleick, Anne Lamott, Diane Ackerman, Judy Blume, Eve Ensler, David Byrne, Sylvia Earle, Richard Branson, Daniel Handler, Marina Abramović, Regina Spektor, Elizabeth Alexander, Adam Gopnik, Debbie Millman, Dani Shapiro, Tim Ferriss, Ann Patchett, a 98-year-old Holocaust survivor, Italy’s first woman in space, and many more immensely accomplished and largehearted artists, writers, scientists, philosophers, entrepreneurs, musicians, and adventurers whose character has been shaped by a life of reading. — via Brain Pickings

The format caught my eye early on, via Brain Pickings website (which I read regularly and periodically support), where Popova has written about the book’s progress over the last year or two (after working on it for eight years, I guess). To secure dozens of writers and then to secure dozens of illustrators (the art is as fabulous as the letters — see this post to see some of the illustrations), and then to gather them all up into a book that could only be described itself as a work of art … well, that has my attention in the days of digital books. This is one book you need to hold in your hands.

As someone who shares out “small quotes” each morning from books I am reading over at Mastodon, A Velocity of Being has fueled enough mornings for a month or two, and maybe more. Every page seems to have some sentence, some passage, some ideas that rings out for me.

The question is: will young readers read it?

That question has me thinking. I have about 75 sixth grade students. I can’t buy them each this book. (I’m a public school teacher). But what if I made a copy of a page for each student — thinking about what I know of them as readers and making as best a match as possible — before the end of the school year — a letter to a young reader that gets into the hands of a young reader? I like that possibility.

Hmmm …

Peace (read it over and over and over),
Kevin

 

Making is a Verb: Musicking with The Art of Is

Musicking with The Art of IsThere’s a whole section in the book some of us are reading together in NowComment, with annotation conversations unfolding, where writer Stephen Nachmanovitch (in The Art of Is) explores the division of the world into nouns and verbs, emphasizing the forward motion of doing things (verbs) as opposed to merely observing things by breaking them down into parts (nouns). He uses music as his example, noting that the word “musicking” would be a way to encompass the act of making music, often with others, and being creative.

I wondered how I could use the text itself for a way to inspire a new piece of music, to put Nachmanovitch’s idea into motion. I wanted to be musicking within the words of the text. After mulling it over, I decided to use the book title — The Art of Is — and the book subtitle — Improving as a Way of Life — and the author’s name — Stephen Nachmanovitch — as a means to gather chords.

The image above explains how I went about making my song — I only sought existing chords as I read (so, as Wendy asked elsewhere, I did not convert other letters without chords into something else … I just ignored them) and created three distinct sections: title, subtitle, name. I did keep the sequence of chords intact, however, so that in whatever order they were, that’s what I had to work with. I took the liberty of adding minor chords where it would make sense of the structure and sound.

I then went into the Garageband app on my iPad, and began to compose over the course of the afternoon, improvising and experimenting as I went about it.

First, I created drum tracks and worked with the bass, adding some guitar riffs, and then finally, layering in some of the world music instruments. I was slowly adding pieces, and then removing them at the end, to create a sound version of our annotation efforts (OK, this may be a leap, but not for me). For the most part, I think the song works, unfolding itself against the rhythm beat, and certainly, it is a piece of distinct music connected to and inspired by the book (if only in my mind).

You are welcome to remix or download or do whatever you want with the track from Soundcloud.

Peace (in the muse),
Kevin