KiB

Prototyping DIY smart robots with Arduino and Machine Learning

Ivan Iovine

The workshop aims to teach participants the use of the Arduino platform in conjunction with the Ml5.js Machine Learning framework.

Each participant will be given a DIY robotic arm made of recycled wood, to which an Arduino will be interfaced. Through serial (WebSerial) communication, the Arduino will communicate with a Javascript application and the Ml5.js framework. Participants will be explained and taught the basics of Machine Learning, exploring and experimenting firsthand with pre-trained Machine Learning models for body recognition (PoseNet model), hand recognition (Handpose model), face and facial emotion recognition (FaceApi), as well as real-time object tracking (YOLO). Through the use of these Open Source technologies, workshop participants will be able to learn the basics of Arduino and Ml5.js, experimenting in a hands-on manner and creating customized human-machine interactions based on Machine Learning models.

Ivan Iovine is an interaction designer and media artist currently based in Frankfurt am Main. His artistic research focuses on the field of physical computing, physical interaction, machine learning and robotics. His works have been exhibited at “Maker Faire Europe” in Rome (2016), “JSNation Conference” in Amsterdam (2019), “Lab30” in Augsburg (2019) “Piksel Festival” in Bergen (2020) and “Die Digitale” in Düsseldorf (2021). In 2021 his work Theodore was published in the official journal proceedings of the scientific symposium “Art Machines 2: International Symposium on Machine Learning and Art”. The artwork was then exhibited in the same year at the Run Run Shaw Creative Media Centre in Hong Kong. He is head of the robotics lab at HfG Offenbach and teaches Physical Computing in the university’s art faculty.

Piksel KidZ Lab Messaging with lights in a not internet era!

Messaging with lights in a not internet era!

Saturday November 19th 10:00 to 13:00
Duration: 3 hours.
Age: 8-18 years old.
Place: KUNSTSKOLEN I BERGEN,
Marken 37 i Bergen sentrum, Bergen City

Gratis verksted for barn/unge i alderen 8-18 år for påmelding: piksel22(at)piksel(dot)no

Piksel KidZ Lab is supported by Bergen Kommune and Vestland Fylkeskommune and Fana Sparebank.

What would happen if we no longer had the internet or mobile phones? How would we send messages to each other? Drawing inspiration from insects and ancient forms of signalling using light, we will learn in this workshop how to create our own blinking firefly lanterns for wirelessly transmitting messages.

Sarah Grant (US)

Sarah Grant is an American artist and professor of new media based in Berlin at the Weise7 studio. Her teaching and art practice engages with the electromagnetic spectrum and computer networks as artistic material, social habitat, and political landscape. She holds a Bachelors of Arts in Fine Art from UC Davis and a Masters in Media Arts from New York University’s Interactive Telecommunications Program. Since 2015, she has organized the Radical Networks conference in New York and Berlin, a community event and arts festival for critical investigations and creative experiments in telecommunications.

Intro to PdParty

Dan Wilcox

This is an overview workshop PdParty, a free open-source iOS application for running Pure Data patches on Apple mobile devices using libpd. Directly inspired by Chris McCormick’s DroidParty for Android and the original RjDj by Reality Jockey, PdParty takes a step further by supporting OSC (Open Sound Control), MIDI, & MiFi game controller input as well as implementing the native Pd GUI objects for a WYSIWYG patch to mobile device experience. Various scene types are supported including compatibility modes for PdDroidParty & RjDj and both patches and abstraction libraries can be managed via a built-in web server. Unlike the rise of the single-purpose audio application, PdParty is meant to provide a platform for general purpose digital signal processing via Pure Data patches.

Dan Wilcox is an artist, engineer, musician, and performer who combines live musical performance techniques with experimental electronics and software for the exploration of new expression. He grew up in the Rocket City, and has performed in Europe, Asia, and around the US with his one man band cyborg performance project, robotcowboy.

Neural Networks in Pure Data

Alexandros Drymonitis

This workshop aims to demystify some basic concepts that pertain to neural networks, and their potential in artistic practices. Focusing on Pure Data and the brand new neuralnet object, the participants will be introduced to basic use cases of neural networks in audio (and visuals possibly), while the workshop will end with a collective brainstorming session where participants will either try for themselves, or will share their ideas on how they would like to use a neural network for their own work.

Alexandros Drymonitis is a sound and new media artist. He is a PhD candidate at the Royal Birmingham Conservatoire doing research on the creation of musical works with the programming language Python. His artistic practice focuses on new techniques utilizing new media such as computer programming, AI, or even older practices, like modular synthesis.

He has collaborated with various artists from different art disciplines, plus several ensembles, either interdisciplinary or music ensembles.

He has taught the guitar at the Music School of Amsterdam and ‘Philippos Nakas’ Conservatory in Athens, and electronic music programming at ‘Musical Praxis’ Conservatory in Athens. He is currently a freelancer in the field of electronic music and multimedia programming, teaching several workshops in various venues and undertaking multimedia programming in various events.

What to make [electronic] art about in 2022 and beyond?

Since the enthusiastic adoption of electronic technologies that characterised the electronic and new media art scene in the 1990s, several factors have crept in that changed the game for good and continue to do so. Open source technologies and the related ecosystem of forums, tutorials and downloadable knowledge is one. Another one is the increasingly heavy presence of climate crisis in all aspects of civilisation including the arts. Paul Granjon will will give an overview of his trajectory, from enthusiasm for early robotic art to contemplating the joys and challenges of off-grid living as an art practice.

Paul Granjon is interested in the co-evolution of humans and machines, imagining solutions for alternative futures and sharing his experience of creative technologies. He has been making robots and other machines for exhibitions and performances since 1996. Granjon’s work became known for a trademark combination of humour and serious questions, delivered with absurd machines that made use of recycled components. His Sexed Robots were exhibited in the Welsh Pavilion at the Venice Biennale in 2005. He performs and exhibits internationally. He regularly delivers Wrekshops, public events where participants are invited to take apart electronic waste and build temporary new machines from the bits they find. Granjon’s current work is driven by an ecologist, low-tech and participatory agenda. He teaches Fine-Art in Cardiff School of Art and Design, UK.

Live collaborative radio with Mezcal

August Black

Mezcal is a web app for collaborative sound and live transmission that I have been prototyping and building in collaboration with https://wavefarm.org and multiple artists (such as Anna Friz https://nicelittlestatic.com/, Betsey Biggs https://www.betseybiggs.org/, and Peter Courtemanche http://absolutevalueofnoise.ca/?now).  In this 1 hour workshop, I give an overview of the software, its design intentions and practical implementations, and then split the group up into sections to create a live experimental radio session on-site. (note: this software is not YET free software, but lives in the web as a free service for free cultural institutions such as radio libre in Medellín, Colombia https://red.radiolibre.cc/ and Sound Camp in the UK https://soundtent.org/, among others)
https://august.black/mezcal/

August Black is a hybrid practitioner of art, design and engineering. He makes experimental spatial and acoustic situations, often by building his own technological artifacts and instruments in hardware and software. His past work focused on live networked audio, mixing FM radio with user input through online software. His current interests span the fields of the philosophy of technology, software studies, techno-politics, peer-to-peer networking and AI/machine learning. In the past, he’s been a member of arts organizations such as the ORF Kunstradio and the Ars Electronica Futurelab, as well as a former member of the engineering team at Cycling ‘74, makers of Max/MSP. He has shown works at festivals and venues such as Ars Electronica Festival, Dutch Electronic Arts Festival, Wave Farm, Transmediale, Pixelache, LA Freewaves, Piksel Festival, Polar Circuit and the Tasmanian Museum of Art, among others.He earned a BFA at Syracuse University and was an NSF IGERT Fellow at UC Santa Barbara, where he completed an MS and PhD. He’s taught media and art classes at UC Santa Barbara, University of San Francisco and CU Boulder, where he serves as Assistant Professor of Critical Media Practices.

https://august.black

Coping Strategies, Sarah Grant

Curator Sarah Grant will introduce us to the special program “Coping Strategies” and guest speakers on the first talks sessions of the festival.

Sarah Grant is an American artist and professor of new media based in Berlin at the Weise7 studio. Her teaching and art practice engages with the electromagnetic spectrum and computer networks as artistic material, social habitat, and political landscape. She holds a Bachelors of Arts in Fine Art from UC Davis and a Masters in Media Arts from New York University’s Interactive Telecommunications Program. Since 2015, she has organized the Radical Networks conference in New York and Berlin, a community event and arts festival for critical investigations and creative experiments in telecommunications.

Coping Streategies Curatorial Statement

By now we begin to understand the extent to which our personal and professional interactions are mediated by the digital, from user interfaces to data harvesting networks of surveillance. As digital captives, we have little agency over our membership and the extent of our participation within these obfuscated systems.

Additionally, our dependency upon these systems leaves us vulnerable in a way that can lead to crisis, in the event of critical communications infrastructure or platforms becoming unavailable or unsafe to use.

How can we put some space between ourselves and these dominant structures? How can we push back and reclaim agency over the narrative that is written about ourselves and our communities by these intrusive technologies? How do we mitigate digital crisis?

Coping Strategies is a program of works, including presentations, workshops, and performances, that demonstrate artist-led approaches to recasting our role in the asymmetrical relationship between ourselves and the dominant providers of information technology. They exemplify:

Building infrastructure that centers community- versus profit-driven values

Creating datasets that seek to remove bias against marginalized communities

Reclaiming ownership over our digital selves

Restoring emotional intimacy to digitally mediated personal relationships

Creating new ways of encoding information in service to political activists

Prioritizing existing infrastructures that elevates knowledge and access above commodification and surveillance

By demonstrating concrete actions that we as individuals and as communities can take in response to these domineering information systems, Coping Strategies hopes to provoke excitement and reassurance that we don’t have to passively accept the default settings of our digital lives.

VFRAME

Adam Harvey

VFRAME.io (Visual Forensics and Metadata Extraction) is a computer vision toolkit designed for human rights researchers. It aims to bridge the gap between state-of-the-art artificial intelligence used in the commercial sector and make it accessible and tailored to the needs of human rights researchers and investigative journalists working with large video or image datasets. VFRAME is under active development and was most recently presented at the Geneva International Center for Humanitarian Demining (GICHD) Mine Action Technology Workshop in November 2021.

Adam Harvey (US/DE) is an artist and research scientist based in Berlin focused on computer vision, privacy, and surveillance. He is a graduate of the Interactive Telecommunications Program at New York University (2010) and is the creator of the VFRAME.io computer vision project, Exposing.ai dataset project, and CV Dazzle computer vision camouflage concept.

Sensors and Pd

Kris Kuldkepp

Lecture and workshop on sensors and motion capture in new music and
multimedia performance.

The performer’s body is classically considered secondary in presenting a
musical piece. After all, the composer’s name and the idea of self-contained
artwork are predominantly the reasons for a concert visit rather than particular
performer(s) and their performing modes. Thus, for a classically trained
musician, it presents a conflict of being essentially a practical tool in the
service of a composer rather than a creative agent. However, the research in various music performance studies has resulted in a diverse quest for the importance of musical gestures and performers’ physical movements in transmitting the meaning. Do some movements or gestures of a
performer make the music meaningful? How could one classify musical gestures? How is acousmatic music perceived? How to understand electronic music in which the sound production is decoupled from physical gesture? … These and more are the open questions that circle in musical gesture research.
The focus on the importance of musical gestures has influenced composers and performing musicians to create pieces and improvisations that experiment with motion capture and various sensors to create musical experiences. The lecture introduces the usage of sensors and motor capture systems in new music and multimedia and discusses the philosophical concepts motivating the
research.

The lecture is followed by a practical workshop for absolute beginners in Pure Data (Pd) and programming for movement sensors.It will introduce the first steps for processing the data and the necessary algorithms.

The participants should bring their personal computers and preinstall Pure Data Vanilla (https://puredata.info/downloads/pure-data) as well as external libraries “Cyclone” and “else”.

In order to install the externals, please start up Pure Data and use Pd’s own external download manager:
— go to the “Help” menu
— choose the “find externals” option under the Help menu
— search for “cyclone”.
— Then click on the link to download the “cyclone” to your computer and specify the search path. (By default it should be ~/Documents/Pd/externals).
— Do the same process with the “else” externals.

Now the external libraries are installed in your computer

In order to load the libraries at the startup:
— go to “Preferences” menu in Pd
— choose Startup”,
— then click “New”, type “cyclone” and hit OK.
— Do the same with “else” library.
— Next time you restart Pd, the libraries will be loaded and ready to use.

Also, please download this folder with sound files into your computer. We use these sound files during the workshop as examples.
https://drive.google.com/drive/folders/12znhQbAJnaXWWrMLFPtIS6CZ9h85QhPP

As sensors, we will use our smartphones, and participants should also preinstall an app PdParty (iOS) or
Sensor2OSC (Android) on their phones. A computer mouse can be used to
stimulate the data stream.
During the workshop, we will build examples in Pure Data that introduce the
first essential steps in creating music with sensors and what to do with the raw
data. No previous experience with Pure Data is required.

Kris Kuldkepp

Kris is Hamburg based free improviser performing on double bass, bass guitar, and live-electronics. She is a feminist performer and artist. Kris is currently completing doctoral studies at Hamburg University of Applied Science where she researches spatial sound, free improvised music, and posthumanism. She is an active soloist and ensemble performer and has participated in festivals such as StimmeX, Blurred Edges Festival, and Bruital Furore in Hamburg, LjudOLjud in Stockholm, Tallinn Music Week, St. Petersburg New Music Festival reMusic, Estonian Music Days, she has also been invited to collaborate in various constellations within Europe and throughout South-America.

Kris is also part of the free improvisation quartet ‘double bird’ that recently released an album ‘favourite galaxy’ and is active with the quartet EMN concentrating on performing graphic scores and performative compositions. Kris is a close collaborator of opera director Lisa Pottstock with whom she develops feminist performances focusing on finding new way of dealing with body, materiality, and sound.

Futurabilities

Azahara Cerezo

A bot programmed to read parts of “Futurability. The age of Impotence and the horizon of possibility” (2019) to other chatbots, who answer and progressively learn from the conversation. In this book, Franco “Bifo” Berardi analyzes the global order that shapes our politics and our imagination, proposing that the key to a radical change lies in the cognitive work and its relationship with technologies. “Futurabilities” explores human-automatic conversational possibilities around the current context of connected solitudes. This online action was developed in 2020 and takes as reference a previous project entitled “A connected robot of one’s own”, which was shown in the frame of Piksel Festival in 2014.

Azahara Cerezo researches the particularities and contradictions of the territory, whose physical dimension is liquefied by digitalising processes of global scope. She has exhibited individually at Bòlit Contemporary Art Centre (Girona), Centro de Arte La Regenta (Las Palmas) and MAL (Sevilla). Her projects have been shown in group exhibitions such as “Juntos aparte” (Bienalsur. Cúcuta, Colombia), “Creativate” (National Arts Festival, Makhanda, South Africa), “We are as Gods…” at Nieuwe Vide (Haarlem, Holland), “Provincia 53” at MUSAC (Leon, Spain) or “Especies de espacios” at MACBA (Barcelona).