I am a developer and musician who likes to make art and interactive experiences with code. I am especially interested in exploring new ways of making and interfacing with music. In May 2017 I graduated from Tufts University with a degree in Computer Science and German Language and Literature, and now live in New York City.
Verbolect is visual exploration of a conversation between Cleverbot and itself. Cleverbot is a chatbot that uses artificial intelligence to talk with users. First made available in 1997, it learns from its conversations to generate responses, so everything that Cleverbot says has at some point been said to it. In this way, the project is as much an exploration of human tendencies as it is of artificial intelligence.
The installation, which allows you to see and hear the conversation, is running continuously from October 20 to November 19, 2017 at The Boiler in Brooklyn.
My Role: I implemented the projection, which manifests itself as a web application that uses the Cleverbot API to generate conversation. The API provides emotional data that we use to produce visuals that correspond to each piece of the conversation. To get the idea, here is an example response from the API (these are the most relevant fields; the full response has many more).
input:"Nice to meet you, too!",
output:"What are you doing now?",
We use these values to generate color, shape, video, and image by drawing on the HTML canvas, using a D3 force simulation, and calling external APIs (YouTube, stock footage, etc) These "modules" are explored by a roving eye while the conversation takes place. From the press release: The main organizational construct of the projection is of a roving eye — simultaneously the idea of the bot searching outside of itself, into the world, looking for patterns, and of us, looking into its brain as if through a peephole. The emotional intensity of the words the bot speaks will dictate the substance, pace and movements of the projection’s machinations.
Fiber is the result of a two month Summer Lab at the Open Music Initiative, which is a partnership between IDEO and Berklee College of Music. The OMI mission is to create an "open-source protocol for the uniform identification of music rights holders and creators." This currently manifests itself as an API that can be used to register and query information. Our job in the Summer Lab was to imagine a future where this information is open and accessible.
Our team took on the challenge of "identifying individuals for their contributions to single tracks in new works." We expanded on the prompt and focused on interactively telling the whole story of a song.
Tools: Unity3D, D3.js
Shape Your Music is a visual music composition language where shapes are melodies. Edges represent notes, and angles represent the intervals between those notes. Shapes are played by traversing their perimeters at a constant speed, sounding a new note at each vertex.
I wanted to find an answer to the question "What does a shape sound like?" The result is something that I like to think of as a musical geoboard.
The idea is simple: create melodies by drawing shapes. While not a unique idea, my implementation is different from other applications that allow you to “draw” music due to the specific way that it translates a shape’s geometric features to musical properties. A shape represents a melody, where each side of the shape is a note. When a shape plays, a node travels at a constant speed around its perimeter, sounding a new note at each vertex. This means that each edge represents a note, where the side length determines the note length. The actual note values are determined by the angles at each vertex. The note that a shape starts with is dictated by its y position on the plane. Each subsequent note is determined by the angle at the vertex where that note (edge) starts.
The algorithm uses the value of the previous note and the angle to determine the next note. A right turn is a downward interval, and a left turn is an upward interval. Each half-plane (right and left) is divided up into n sections, where n is the number of notes in the musical scale. The more acute the angle, the higher in magnitude the interval is. For example, in a scale with 7 notes, a right turn of 170° means the next note will be down six notes in the scale, whereas a left turn of 10° means that the next note would be up one note in the scale.
Our goal was to build an instrument that could be played like a MIDI keyboard but with much more control over timbre. Its ergonomic design allows the user to control as many parameters as possible with limited hand movement. Fingers control eight touch-sensitive keys that respond to up/down sliding, palms rest on a trackballs that can be rotated as well as pressed down upon, and thumbs control rotary touch controllers. Additional buttons control octave changes and toggle various modes, and the LEDs provide visual feedback when keys are played.
The Xenomod also doubles as a 16-step sequencer that can be controlled dynamically. In sequencer mode, the keys are used to set note and effect values at each step. The trackballs control effect amounts and can be spun to randomize values.
My role: I programmed the Max/MSP logic for reading the sensor data, assigning notes and scales and other parameters, and also designed and wrote the sequencer.
Tools: Sensors(Soft potentiometers, FSRs, switches/buttons), Arduinos, Max/MSP, Reason
For this EP, I limited my audio library to only sounds that I had recorded myself specifically for this project. I brought a recorder wherever I went and compiled recordings from shopping centers, the MBTA (subway), restaurants etc. I imported sounds and manipulated them to define tonal and percussive elements.
Manage Your Deal
During my internship at Manage Your Deal, I worked on developing a new visual identity for their web platform, which connects investors with startups. I designed and implemented new responsive features and pages, templated new layouts for profile cards and profile pages, and redesigned the login page and dashboard.
You can visit the the live site, but much of what I worked on can only be seen by members. Here are several mockups that I created and then implemented in the platform:
JKW-Karate Dojo Redesign
The Project: Redesign a website. Improve the navigability, accessibility, organization, and aesthetic. Use only HTML/CSS.
This project was completed with a partner as part of the User Interface Design course at the University of Tübingen. We chose a local karate club's website. Our primary goal was to make a menu that was clear and intuitive. To do this we replaced organized the list of pages into four drop-down menus. We also implemented a footer with key information and defined a unifying visual style, which included designing social icons and a vector logo. We first developed a paper prototype after storyboarding our average user.
We implemented four pages of our design. Below are the comparisons. Click an image to view the live page.
The Ham Sandwich Cut
I am in a three-piece electronic music group called AJE. I made this website from scratch as an alternative platform for listeners to experience our music and art. Coinciding with the release of our latest album, it includes a music player and pages for each release. It was the first website I made on my own time, and was largely an exercise in the practices of web design and development.
I built this website for my solo music project, JARZ0.
Custom Scenario is a techno duo I am a part of. I made this site as a simple showcase of our new single with a mailing list signup.
Free Lemonade is a record label that I started with friends as a platform to share our music. The website is still in progress.
The Project: Design a poster for a product or company. Pick an inspiration and imitate its style.
The inspiration piece that I chose was this poster by the musician and graphic designer Scott Hansen.
Tools: Photoshop, Illustrator
The Project: Design a poster for a the play Mint. The director wanted me to emulate the stage, which was painted pink, and strewn with mannequin parts.
Tools: Photoshop, Illustrator