Poetry: Intersections of Words, Art, Music and Technology

Algorithmic Artists and the Solo Saxophonist

I’ve been sharing out some of my morning poems, where I have been exploring the intersections of art and music and writing with technology. The above poem was inspired by an AI site — Dream — that creates art from keywords (here, my words were Saxophone Nights). I used the image, along with explorations this week with Hour of Code and programming, to spark the idea for the poem.

This morning, after a helpful remembering by Wendy T. yesterday, I used JazzKeys to craft a poem, with jazz piano as a soundtrack for each time my fingers hit the computer keyboard in the spur-of-moment writing. I just let the words flow as I listened to the piano. (I am listening now as I write this, too)

Listen: https://jazzkeys.plan8.co/?msg=-MqOfDSE_Pl2R2bBSNTx 

I also created a blended visual of the same poem with a piano player, using a screenshot of the JazzKeys poem and a Creative Commons image, then merged with Lunapic. I like the ghost notes aspect of the result, as the words are fading (and if you listen to the JazzKeys as you read, the experience is even better, I think).

Ghost Notes

Peace (listening),
Kevin

Sixth Flight (visualization remix)

In my continuing explorations of word and sound, I saw that my friend, Ron, had used a site called Specterr to create a visualization for a Daily Create in DS106.

I decided to check it out and then realized I could further remix the audio of my Sixth Bird in Flight poem from last week (see post about that project), but I quickly knew that the raw MIDI audio track (which was a music file that an AI site created out of the text of a poem) could use something more — more layers, more colors, more thickening.

I added a few layers of instrumentation and a beat underneath the music file (that was a conversion of the text of my poem), and I liked how it came out when my remixing was done. Then I uploaded the audio file into Specterr (in its free account, which is why there is a watermark on it), and tinkered with some animation and color and more.

I like seeing the audio visualization in sync with the beat.

Peace (kicking it in),
Kevin

Turning Text into Music (A Small AI Experiment)

careful now
careful now flickr photo by fibreman shared into the public domain using Creative Commons Public Domain Dedication (CC0)

I was curious the other week about whether I might find any online AI-powered sites that take text and turn those words into music. Honestly, I didn’t think my search would be all that successful. But it was. To a point.

Here are three (free) online sites powered by algorithms that I found and tinkered with. I am going to use the paragraph I just wrote as the intro I just wrote to this post as the text that I want each site to turn into music (See words above). Each of the sites will use the same exact text.

First, there is Typatone, which is one my favorites here.  You can either type the letters/words, and hear the song as you write (which is pretty cool but if you are like me, I make a ton of mistake as I type and so that feature is less useful than it would seem). Or you can input your text and let the site do its thing.

One annoying quirk is that once it starts playing, there’s no pause button. Sorry. I think watching it and listening to it is the best, though, so just an audio file to listen to would feel rather empty as an experience.

Here is my test.

Another is Langorhythm 2.0 (which is explained in a neat TED Talk that assigns notes to letters). I liked this site for its simplicity but soon found that the timbre and instrumentation never changes from the original conversion — it is the same tones for every letter, which makes sense if you know how the algorithm was created. But it makes it sort of … a sameness when doing multiple projects.

That said, the site kicks out a MIDI audio file, which is quite useful for anyone who has a digital music workstation. I use Soundtrap, for example, and so it was easy to change the instrumentation from the generated Rhodes piano into something a little more … interesting.

Listen to original and then my remix (changing the sound/instruments)

The third, and both most robust and clear strangest of the sites, is Melobytes (I worked with the free Pro model — I assume it’s free for a limited time?). Here, you have many more setting options (too many, perhaps), although I was never sure how the piece would sound when I was done with it. And mostly, I found the site interesting in an analytical way but too randomized and jarring to be easy listening, no matter what I did with the settings (and you have a limit on free access to how many times you can reset the conversion). The videos (with AI chosen images) were weird every single time and the vocal sounds, even weirder.

What I did find fascinating, though,  with Melobytes was that the site creates a piece of musical manuscript for the inputted text that forms the basis of the audio file it generates. Here’s my same blog intro, written now as music that I could play. I don’t know the critera for how it determined length or tone of notes, etc. (And I think there may have been a second page with the word “point” on it that I missed.)

What does this all mean? I don’t rightly know. I have only a vague notion of how the sites took my words and kicked out sound. As a writer who loves sound and music, and is both interested and skeptical of the age of AI, I find these experiments to be helpful in understanding both how far computers have come (caveat: free online availability) and how far they have to go.

Peace (sounds like),
Kevin

Digital Poetry Process Notes: Launching Birds of Flight

Last week, I released six “birds in flight” poems, one per day. Here, I’d like to provide some context notes and process decisions, as well as tech tools,  for each poem, as both a way to share my digital compositional practices, to reflect on what worked and didn’t and why, and to archive my notes, for my future self (hello, me).

My poetry collection began not with writing but with reading a poem and sharing it with friends. In an edition of Orion, a nature-writing journal, there was a lovely card stock pullout of a poem called “Poetry” by Chun Yu (one side was English, and the other side, Chinese). I can’t find it online to share here, and I don’t want to infringe on copyright by sharing myself. But the poem was lovely, with a theme of poetry.

I did share it with my poetry friends in the new closed NWPStudio Space, however, and my collaborator and colleague and poetry ping-pong companion, Terry Elliott, paid attention to and noticed the architecture of the poem. Terry then pulled out some guiding prompts that could become a flexible template for writing a poem, inspired by Chun Yu’s “Poetry.” It was from Terry’s excavation of ideas that I wrote a small poem each day, for six days, using the opening lines from Chun Yu’s poem of birds (see above) as my theme.

Here, then, are my six poems — my six Birds in Flight, if you will — and a reflection on how I created the digital versions of them and the decisions that I made to do so.

First Bird in Flight

For poems with small amounts of words, like these, a site like Lumen5 is perfectly situated. It is a digital storytelling site that allows many choices for image and video, with text, and music, and even the opportunity for voice-over (which I decided not to do here, as my experiment with it seemed to take away from the contemplative nature of the visual poem.) The most important decision here for me became the soundtrack, and I grappled with how the music would inform the words and image. In the end, I found what I still think is a perfect sound companion to the poem — it gives it just enough calm, and includes the sounds of birds.

Second Bird in Flight

I knew I would be diving into digital composition with many of these small poems so I wanted to hand-write out a poem, as sort of a counter-measure to complete immersion with digital. Of course, I did it via an app (Sketchpad), and then thought about a reflecting pool or image of the poem, and remembered an effect in LunaPic that could do that. It worked nicely, I think, given the hand-written text a little more depth and wrinkle, or maybe, ripples. That I chose a piece of paper theme for the writing makes it even more interesting in the reflection, I think.

Third Bird in Flight

This poem used an app I tap into quite a bit for animating words. It is called TypiVideo and it has some strange quirks (you can’t control what words on a single screen at any time after you input your entire text, so there are often odd endings of phrasings). But there are neat options for font and color, and I like how the text flows forward, and have come to appreciate the unexpected breaks. After creating it, I felt as if it were missing something, so I created a music track with thoughts of flight and layered it in, giving the words some ambience.

Fourth Bird in Flight

This poem used a text animation app on my iPad called PLAYS that I come back to now and then. It has a solid collection of animated options, some of which are too busy for any use by a poet, though. I found one that had the text moving off the screen like a bird in flight (similar to the next poem’s construction). But when I had built it and exported it, it seemed like it still needed something else. I pulled the animated image into LunaPic (always a useful image editing site) and found an effect that turned the piece yellow and faded at the edges, like a corn husk (sort of) that connected to a phrase in the poem. I like that when the words leave, there is an after-effect of a splotch of light yellow, as if the poem has left a mark.

Fifth Bird in Flight

I knew I wanted this poem to be its own poem but also to reveal a second poem after the words “flew away” into the sky. I used Keynote to do this, and it took some time, as different words and lines had to be their own text boxes that could be animated or remain stationary as the poem flew off like birds in flight. (This could have been done easily enough in Google Slides or Powerpoint, too). I like that the poem I left behind or that was uncovered is more positive and optimistic than the poem pieces that depart. Exporting as a GIF allows for the poem to reset itself each time.

Sixth Bird in Flight

This last poem was the most complex composition of the collection. I had been curious about whether I could turn the words of this poem into music. Of course, I could have sat down with my guitar, but I wanted to push the concept of AI, so I searched around and found two sites: Langorythm (which converts words into midi-file music – see this) and Melobytes (which converts text into what I can only describe as an odd piece of music, with even stranger video, and also, interestingly, a piece of music manuscript). I had been tinkering with both when I realized I could merge the output from both sites, using the melodic music that Langorythm created from the text of the poem beneath the video and manuscript created from my poem by Melobytes, and then, realizing this composition needed some stability to center the actual poem, I added my voice overlay to video. At one point, I had an entire earlier version of this project that I did all the work on, as finished project, and then I could not shake the sense that the “feel” of the Melobytes output was all wrong. So I started over from the beginning, and began construction again. The result is something interesting, if unusual.

I hope this both helps me to remember what I did, but also inspired YOU to tinker and play with digital compositions, to see how we might use technology to further put poems into motion while trying to deepen the composition’s impact on a reader, viewer, listener.

Peace (on wings of words),
Kevin

Book Review: You Look Like a Thing and I Love You (How Artificial Intelligence Works and Why It’s Making the World a Weirder Place)

It’s not easy to wrap the head around the role of algorithms in our social networks and our other online spaces but there they are — always on and always working and maybe causing trouble with unanticipated consequences. Just look at how algorithms push bias and racism, and lead us towards uncharted waters.

Janelle Shane, in her book You Look Like A Thing And I Love You does a fantastic job of explaining the ins and outs of algorithm design and workings, while keeping the mood light and entertaining with humorous stories and simple doodles — but never pure fluff. You’ll learn about mathematical modeling and algorithm coding and be reminded, again and again, how dumb algorithms really are.

It’s the human programmers that are the problem. That, and the ways that algorithms obscure what they are doing deep inside code, so that even as they are learning from past experiences and making adaptations to become more efficient in their job, it is not always clear how they are doing the work they are doing, once launched into their tasks. Shane dispels notions of algorithms taking over the world at any time in the near future, but she does warn that we need to have more openness and clarity about how algorithms work, so we can fix them when they go wrong.

Shane knows her topic well, and knows how to explain it to a non-programming audience. I found her book both entertaining and informative.

Peace (coded for now),
Kevin

At NWP Write Now: It’s Not the Tech; It’s the Teaching

Not the ToolsI was asked to write a piece over at NWP Write Now about the sudden rush to technology that has engulfed us all in the Pandemic, with a reminder that it is the teaching and teacher and pedagogy that is always more important than the app, site or platform. I found it helpful in the writing of the piece to remember my own advice.

Read Never The Tech; Always The Teaching at NWP Write Now.

Peace (on/off),
Kevin

Book Review: The Hyperdoc Handbook

This teaching book is now a few years old (2016) but The Hyperdoc Handbook (Digital Lesson Design Using Google Apps) by Lisa Highfill, Kelly Hilton and Sarah Landis was helpful for me in thinking further on how to integrate the concept of HyperDocs (a way to design a lesson or unit for independent inquiry and reflection for students with links and resources and places for sharing) into my remote and hybrid learning approach. I wrote about my initial foray into Hyperdocs the other week.

And plenty of National Writing Project colleagues and I have been engaged in Twitter discussions about the viability of HyperDocs, as well as the limitations. It is important to note, as the authors do repeatedly, that HyperDocs are not just some amped up worksheet to be given remotely to students. (See Deanna Mascale’s latest post on Hyperdocs for her university instruction) I also know there are criticism of this kind of approach, as being too prescriptive or narrowing in scope for learners.

The three authors of The Hyperdoc Handbook are experienced teachers and instructional coaches and technology advocates, and I appreciated the approach of screenshots and examples and the way they talk through the pedagogical rationale for Hyperdocs as a way to engage all learners in a guided yet independent inquiry process. They explore pedagogy and tap into the ways that well-designed Hyperdocs can extend the idea of Zones of Proximal Development, through layered choices and skills and expectations.

You don’t need buy this book to learn about Hyperdocs (I am one of those own-a-book people and I like to support teachers) and their website has plenty of examples and templates and more that you can examine and borrow, and hack, as the authors tell you in the book.  A blog post at the site even provides some useful thinking on remote teaching with Hyperdocs.

This week, in fact, I am going to use a HyperDoc with teachers as part of a professional development session on Project-Based Learning, in which teachers explore a theme for a short/tiny public service announcement (an idea borrowed from AJ Jacobs).

I’m deep into the design stage of curriculum for the start of our school year (which begins remote and then becomes hybrid, with independent learning days for students in the weekly schedule). I see some possibilities here for my students, although it is important to acknowledge that Hyperdocs as nothing new, really, but more of a way to organize resources for student inquiry and exploration. Webquests, websites, blog posts, etc, all are in the same family. The book is helpful in its range of examples, visuals and testimonials from other educators.

As mentioned, a Hyperdoc (which does NOT have to be a Google Doc or product) is definitely more than a glorified worksheet. It’s more like an anchor or docking point, leading students to other activities and resources. That’s important to remember.

Peace, (linked),
Kevin

Evaluating Technology Tools (But, It’s Not About The Tech)

Dr. Torrey Trust, of the University of Massachusetts Amherst, has been a pretty active and reliable voice in teaching circles since the Pandemic hit, as her academic focus is on teaching with technology. She also writes regularly about privacy issues in relation to students and families and more, and I appreciate her advice and suggestions, and insights into difficult topics related to technology.

I came across her Online Tools for Teaching and Learning site the other day, and while it is focused on the surface on tools, it’s really about the viability of how to use technology to engage students in learning.

Each platform reviewed (which are curated by use and also by year reviewed, with a bunch of recent ones added to the mix) is looked at by her team of academics (I think, or least, that was how the earlier ones were done as part of a graduate class) with analysis on qualities, privacy, accessibility and use by educators. Most come with helpful “how to” advice, as well.

Check out Online Tools for Teaching and Learning

Peace (exploring it),
Kevin

Thinking on HyperDocs for Flexible Teaching and Learning

I’ve been meaning to spend some time looking into the use of HyperDocs — sort of an updated version of Webquests in which a single document with hyperlinks provides students with multiple entries of engagement and exploration. It’s a concept that I have seen from time to time, and thought, yeah, someday, I’ll take a look.

But it was a post at Middleweb by a National Writing Project friend, Jeremy Hyler, another middle grade teacher, and then an interview on NWP Radio with Jeremy on the topic that provided me with a reason to sit down with HyperDocs with intention and ponder how it might be a good fit for a school year of remote and hybrid learning.

I quickly discovered that I appreciate HyperDocs as an approach of using a single document with multiple strands of activities for students, although it obviously requires, as Jeremy notes, work at the start by the teacher to think through sequences of learning activities and also choice opportunities for students to demonstrate understanding, with room for extension for those students who need a bit more.

While I come to the concept via NWP and Jeremy, I want to note that Laura Highfill, Kelly Hilton and Sarah Landis are prominent voices in the mix. The three educators facilitate and oversee the HyperDoc website, along with assorted course offerings, and they say they coined the term and concept in 2013.

At their website, the HyperDoc founders note:

A true HyperDoc is much more than some links on a document.

  • Creators deliberately choose web tools to give students opportunities to Engage • Explore • Explain • Apply • Share • Reflect • Extend the learning.
  • Digital collaboration is choreographed to give every student a voice and a chance to be heard by their classmates.
  • Critical thinking and problem-solving skills can be developed through linked tasks.
  • Students have an opportunity to create authentic digital artifacts to show what they know and connect with a wider audience.

In some ways, HyperDocs consolidates much of what teachers were already doing with research and online media exploration, but maybe doing even more so during forced closures due to the Pandemic. It leverages the resources of the Web, but also integrates well with any online platform, such as Google Classroom. Where I used to have multiple posts with different steps, spread out over a week, let’s say, a HyperDoc contains the entire sequence of activities, with media and text set explorations, in one document, allowing a student to move through the expectations at their own pace. The term “flexibility” comes up a lot with HyperDocs.

While there is no set structure of a HyperDoc, most seem to start with some essential questions and inquiry, leading to application of understanding, and then extension opportunities, with lots of places for reflections on process. Take a look at some samples to get a better sense of the HyperDoc concept. It’s important to note, I think, that you could easily design a HyperDoc as a simple website/blog post, in any text format that has links to the Internet, in Google Slides or presentation software, etc. It does not require a Google Doc, since the most important parts are links to follow, opportunities for reflection and sequencing of information.

The HyperDoc site has samples and lots of information, and I even ordered The HyperDoc Handbook from the HyperDoc folks just to have another resource handy. But there are plenty of other places on the Internet where teachers are sharing templates and ideas. I’ve “borrowed” a few (including the one that Jeremy talks about in the NWP podcast) and have been busy adapting for my own needs.

At this point, I have four different HyperDocs under construction for the start of the year: an icebreaker Back to School Hyperdoc, a literature-themed Hyperdoc focused on a short story and exploration of literary concepts, and a civic action HyperDoc that explores student agency.

HyperDoc Sample

Here is a link to a fourth HyperDoc I am creating as part of a Professional Development I am co-facilitating at the start of the year with colleagues on Project-Based Learning. This HyperDoc that I created utilizes the idea of the tiny Public Service Announcement (inspired by AJ Juliani) to show teachers a way to simulate PBL, and it can be adapted for the classroom, too. It has been built off a design that Jeremy had shared (thank you).

What’s great is that with some initial instruction and guidance for students (I even found a HyperDoc that explains HyperDocs to students), I can use HyperDocs for independent learning in both a Hybrid model (when I will see only half my students at a time but they are expected to be doing things the other half of the time) and for a Remote model (where none of us are going to want to be on the video screen for long stretches of time).

The flexibility and leveraging of online resources, plus the integration of other technological platforms like Padlet, Flipgrid, VoiceThread and others for reflection and sharing points, seems like it could be a winning way to use technology effectively for teaching and learning.

Peace (linked),
Kevin

Book Review: Eyes & Spies (How You’re Tracked and Why You Should Know)

Where’s the line between sparking fear and providing necessary information when it comes to talking to young people about their digital lives? I struggle with this shifting and slippery line every single year I work with my sixth graders on our Digital Life Unit (wetalk about the topics of privacy throughout the year). The line itself keep shifting on us.

Eyes & Spies: How You’re Tracked and Why You Should Know takes the approach of being pretty blunt in its delivery of eye-opening ways that governments, companies and others are exploiting our online and digital lives for surveillance and for profit, and for nefarious activities. Whereas I try to keep more positive in my discussions, this book for middle and high school students does not hold back the punches, not at all, and I suppose that is as it should be, for older users of technology.

This visual book covers a lot of ground, too, but in language and format that is accessible — there are lots of short bursts of information within the larger chapters, and lots of illustrations and color. Charts also offer suggestions for privacy for different topics.

I particularly enjoyed the running pieces that coupled the pros with the cons of topics in the form of short, reasoned arguments — such as why GPS tracking of kids might be used for protection and why it might be an invasion of privacy.

Another feature I appreciated were small stories under the banner of the Creepy Lines of technology, with ethical and moral dilemmas with no clear-cut answer to the issues facing society, such as police using fake identities on social media to find a criminal. Each of these also ends with a question for the reader to ponder.

Overall, I found the book useful for my own talking points but I feel that the text is best for high school students, and maybe in different sections, too. I would also argue that it is useful for parents of teenagers, like myself, to remind us to have these conversations with kids about how they are using technology, how much privacy they are giving up, how to protect themselves, and how to step back to see the larger picture of how our devices and the growing field of technology are invading our lives, for both good and for bad.

Peace (post it),
Kevin