Searching Tags: algorithms
  • Facebots - Bots of Trust

    Website of the project: http://abelardogfournier.org/botsoftrust

    Bots of trust (aka Facebots) is an installation that consists of a grid of devices similar to points of sale terminals. The bots are specifically designed machines displaying the mechanisms of customer engagement in large online retail stores, with the aim of rendering them experienceable to visitors.

    Each bot downloads a list of "Recommended items" from a popular e-commerce platform. The list is then codified into an image, where human-like faces are detected. Faces are printed, together with the articles they come from, mimicking how customers are gradually being codified inside the databases of algorithm-driven online stores.

  • Algorithmes Créatifs - Stereolux, Nantes, Jan. 2014
    / (1 of 2)

    Increasingly complex interactions with machines blur the differences between matter, life and conscience.

    Following the concepts discussed in the presentation of the documentary "Hello World! Processing ", this workshop will explore in detail the creation of living-like responsive environments. Through the introduction to algorithms coming from the simulation of natural and artificial phenomena, such as Vector Fields and Graphs, this workshop will be focused in the complexification of interaction and the composition of systems, two key issues to explore critically and creatively in our increasingly algorithmic driven world.

    Github of the workshop: https://github.com/abe-/JCC2/tree/master/140131_Workshop_Algorithmes_Creatifs

  • Creative Algorithms - Alhóndiga Bilbao, Sept. 2013

    Algorithms are invisible shapers of our lives and contexts. They decide stuff that affects us, sort the information that reaches us, organize our movements inside cities and countries and analyze each of our digital choices.

    During this workshop we worked on the invisibility of algorithms, on The New Aesthetic topic and on their emergent properties, among other issues, and introduced Processing as a tool to begin to think with and on them.

  • Notas Presentación Teknotrakiana - Diciembre 2014

    Notes for a presentation delivered to the Teknotrakiana encounter held in Pamplona/Iruña in December 2014. On algorithms, non-human creativity and extractive industries. (Spanish only)

    1

    Sabemos de la capacidad de crear en el mundo, fuera del ámbito humano.

    La creación acontece continuamente, a nuestro alrededor, esto no es nuevo

    Lo que es más reciente es la facilidad con la que podemos interactuar con estas formas de creación no humanas

    Tenemos herramientas que simulan, o herramientas generativas que replican estas otras formas de creatividad

    Y todas estas herramientas están articuladas alrededor de la idea de código

    Esto es, de la idea de repetición de una serie de reglas sencillas, unas reglas que toman como input lecturas del mundo

    2

    Pongamos un ejemplo: unas reglas muy sencillas seguidas por una multiplicidad de puntos

    Primero: localiza, en el espacio, el punto que está más próximo a ti

    Segundo: gira alrededor de este, manteniendo la distacia, y con una velocidad de giro que te vendrá dada al azar, en un sentido o en otro

    Es una regla similar a la que puede organizar algunos bailes tradicionales, regidos por pautas programar ha sido comparado a coreografiar procesos

    Si dejamos que la regla se repita una y otra vez, y dibujamos las huellas de los movimientos de los puntos, obtendremos formas inesperadamente complejas, una mezcla de orden y desorden

    Las reglas operan sobre los puntos, mueven los puntos, y las reglas vuelven a causar efectos distintos el sistema se retroalimenta, y aparecen ciclos, trayectorias compatidas, unidos a comportamientos más erráticos

    En cierto sentido, es como si estas reglas, junto a las partículas sobre las que operan, formaran un mundo

    3

    Es interesante también la forma en la que nosotros, humanos, podemos llegar a encontrar este tipo de reglas y retroalimentaciones

    Hay veces en las que estas se te vienen a la cabeza, como en el sistema anterior, las implementas y ya está, tienes el sistema

    Pero otras, la mayor parte de las veces, te las vas encontrando como parte del proceso

    Esto ocurre cuando empiezas con reglas o sistemas sencillos, que vas haciendo crecer gradualmente en complejidad

    Por ejemplo, este segundo sistema: empecemos con una estructura con capacidad de crecimiento, como la dinámica DLA

    Como paso segundo, vinculemos este sistema a los movimientos del ratón, que las nuevas partÏculas aparezcan en la posición del ratón, que el sistema crezca hacia donde el ratón se encuentra

    El sistema es interesante, tiene un comportamiento propio y responde a la interacción de una persona

    Podemos incorporar una capacidad de interactuar las partículas del sistema entre sí y el espacio, a través de lo que se llaman físicas, reglas de simulación de comportamientos físicos

    El sistema se vuelve más interesante, ha crecido, ha ganado en complejidad

    Vemos ahora, cuando lo usamos, nos empuja a nosotros a ciertas acciones, como cerrar los caminos que se abren, dibujar círculos, por decirlo así

    Podemos incorporar ese comportamiento al propio sistema. cuando una rama libre vea que si crece, puede llegar a cerrarse sobre sí misma, o encontrarse con el sistema en un círculo, entonces que crezca

    El sistema así da un salto cualitativo, y claramente muestra su capacidad generativa.

    Y esto lo podemos mostrar con otros elementos gráficos, sin modificar las reglas, para ver lo que ocurre con más claridad

    Nosotros como humanos podemos dibujar con él, pero el sistema de por sí acompaña nuestro dibujo dibujando él mismo

    4

    Este ejemplo es muy interesante porque muestra cómo el código, para crecer en complejidad sus resultados, necesita de nosotros, en tanto que fuentes de datos y de complejidad

    Pero esto no ocurre solamente en los experimentos con código creativo, ocurre con sistemas computacionales en general

    El caso más claro es el del buscador google. su capacidad de encontrar y proporcionar resultados no se debe a su capacidad de lectura y comprensión de los contenidos, sino a su capacidad de medir y conectar las relaciones que nosotros, humanos, establecemos entre contenidos (en este caso, a través de links)

    Y esto ocurre con todas las grandes redes digitales que nos rodean: google, facebook, amazon

    Ganan comportamientos y capacidades gracias a lo que son capaces de extraer de nuestras interacciones

    Tal y como la industria tradicional explota los recursos del planeta, estas industrias explotan los datos resultantes de nuestras interacciones

    Alguien ha dicho incluso que se hacen inteligentes a costa de hacernos a nosotros más estúpidos

    5

    Creo que el código creativo es un lugar desde el que trabajar críticamente con la idea recíproca de creatividad codificada, digitalizada, instrumentalizada por industrias extractivas

    Creo que es importante, no tanto la idea de que todo el mundo tenga que programar, sino que la de que los códigos de los sistemas que nos rodean sean legibles por una mayoría (accesibles, entonces)

    El código creativo nos ayuda a entender estas dimensiones generativas de los sistemas algorítimos y humano-algorítmicos

    Y nos ayuda a comprender cómo estas dimensiones son fuente de riqueza de unas industrias extractivas de nuevo cuño

    Que afectan, como sabemos, a todos los órdenes de nuestras vidas

    De ahí la importancia crítica crucial y radical de este conjunto de prácticas

  • Molecularity and algorithms. The invisible collectivities

    Text of the conference delivered during Interactivos?'14: Rethinking collective behavior and action in Medialab-Prado, in November 2014.

    In this text I will try to present the work I have been doing during the last years in relation to the idea of collectivism and, in particular, when this concept is considered to be large enough to entail not only humans, but also entities such as the continuous flow of interactions between humans, humans and things and things and environment. That is, on the one hand, considering the chemicals we are constantly exchanging and their support structures, for example, our bodies, surfaces, the air in between… and, of course, in the other hand, the whole ensemble of creatures we live with nowadays in our digital times: the swarms of sensors that surround us or that are directly carried by us, the database records we leave as trails and the algorithmic processes that deal with them.

    So, if I’m going to speak about chemicals and about the digital, and the interactions they give rise to, and within a context of art practices, what I’m going to talk about is about media. Media as in film, or as in Media Art, or as in New Media. Media as the set of tools and channels that put us in communication, but in an extended way, so to speak. I will consider media not only as the spaces of potential interaction between humans stemming from the proliferation of communication devices, but media in a broader sense as the spaces of interaction that exist also outside us: that is, a sheet of paper as media, of course, but also, the lawn extensions in our cities, for example: lawn yards as surfaces that somehow register and mold a specific set of public and private space human leisure activities, together with the dynamics of living grass, the presence of insects and other animal forms, as well as chemicals -chemicals against insects, fertilizers, pollutants in water, and so on. Lawn yards in our cities are spaces where we interact with the city, with a neighbourhood or a specific private property as a whole, being their grass a very particular species of media, a kind of organic screen where all the processes leave traces, and an interactive device, also, that encourages certain exchanges between humans and nonhumans inhabiting the city, or a specific area.

    Media in this broad sense are a very interesting way of understanding collectivities of interactions, and if you’re interested to go deep into this view, I’d recommend you the book Insect Media: An Archaeology of Animals and Technology, by the extremely insightful author and media art theorist Jussi Parikka, a book that is at the core of lots of ideas of this presentation.

    I won’t continue with the example of the lawn, although it is something I’m working on now, and I’ll switch to a different media, which is the synthetic production of colors, an area I’ve been working on last year. It is a particular case that I hope will raise some questions regarding the relation between the growth of the collectives, on the one hand, and the profit of the digital industries, on the other.

    In 1834, and thanks to a research carried on by a company that was producing the gas needed for the public lightning in german cities, philosopher-scientist Friedrich Ferdinand Runge synthesized the first artificial color from the wastes of coal, that is, from coal-tar. It was aniline synthetic blue, the first of a large series of aniline based colors. Art historian and writer Esther Leslie has described the unfolding of this discovery within the industrial context of the XIX and XX centuries, in her book Synthetic Worlds: Nature, Art and the Chemical Industry. In her words, “Nasty black waste matter could release from its darkness a world of color”, and that’s a key idea. Apart from the commercial applications of synthetic colors, that is, apart from the industrialization of the production of colors this discovery allowed, since its beginning it inspired the possibility of dialoguing in new ways with nature. These are, for example, images obtained by Runge, published in this book, The Driving Force of Formation of Substances, Visualized by Self-Grown Pictures, where chemicals become expressive technics to make in some sense Nature speak to us.

    That is, with this book, and with a handbook of chemistry for children he published also, Runge worked with the idea of the inner activity of lifeless nature, of minerals as well as waste materials, an inner activity that could be brought to our scale thanks to the new aniline chemistry. Matter is, in some sense, alive, speaking its own chemical language, and open to speak to us in chemical terms.

    The idea of Self-Grown Pictures is eloquent enough by its own, and will probably nowadays bring us to the creative coding scene, where algorithms and data are worked in a very similar way: a scene and a process aesthetics where coding is not meant to achieve specific goals, but rather to visualize the inner activity of coding systems themselves, that is, to bring to our senses the intensive, creative character of the digital substance, in some way. So, these Self-Grown pictures came already in the XIX century as a reminder that creation does not belong to humans, not to living processes only, but to matter also, to things, to ecologies of things, and to the molecules that compound things. Creation happens, we are surrounded by creation, and before the creative capabilities of the human individual, there is this continuous flow of creation all around us.  

    Orbital Relations #2014, Abelardo G. Fournier

    Runge’s personal project of extending this poetic and romantic view of chemistry, however, did not spread in the German education system, and the far more pragmatic view of the discovery was developed instead. The chemical industries adopted the synthesis of colors as their main object, and slowly, a whole new surface of synthetic colors began to cover the whole planet, an extension that spread over painted walls, clothes and objects, as well as a line of new synthetic materials and products: fuel, rubber, plastic, fibres, foams, fertilizers, pharmaceuticals as well as chemical weapons. And, with them, the postulation of an enhanced new world, synthetically produced by controlled systems, built upon substitutes, which was marketed as “more real” than the original one, at is was supported by a greater economic value in a commodity fetichism utopia.

    Additionally, all these colors were fabricated and sold by companies whose importance and scope steadily grew to become the infamous german industrial cartel IG Farben, a prototype of the new organizational methods within the large corporations of the XXth century, and a symbol also of the dangers of these corporation monsters: they developed the Zyklon-B gas for the concentration camps, fuelled experimental rockets and, of course, supported the nazi economies.

    If with Runge’s Self-Grown pictures we see parallelisms with our digital creative coding scene, these corporations should remind us the huge power that corporations, as well as their new distributed organizational principles, are increasingly having within the digital ecologies. Facebook, Google, Apple or Microsoft, among other, are the IG Farben of our times, turning this intensive and creative character of the digital into a big business based on the promise of an utopia of a bright digital and connected future for the humanity as a whole.

    In my work I’ve been dealing with this parallelism -synthetic colors as digital media-, focusing in particular in how an underlying ideology of ubiquitous control is being codified into algorithmic creatures that are brought to existence among us.

    Let me show you briefly an installation, which is called Vividness, a work on the digital uncanny in relation to its appearance in vivid colors. It is an installation that consists of two elements: a table with a vase with dried flowers, and a projector mapping the flowers. Flowers are arranged as a classical knowledge device, as they appear in XVIII-th century botanical illustrations, as ensembles of colors and species, following the traditional image of the fertility of nature when approached by science. In the installation, it is not science but a digital elaboration of the flowers, a photograph with the colors inverted, what is sent to the flowers from the projector, with all its implicit digital creatures flying around. The original color of the flower, then, mixed with the complementary one that has been sent by the projector, result in the viewer’s eye in a desaturated color, that is, a grey tone.

    The idea is that color information is being extracted from the flowers, it is processed, and finally sent back to the world, miniaturizing how digital industries work on us and on everything. If the former industry of synthetic colors spread over the surface of the world a layer of artificial dyes, the characteristic flux of the digital one goes in the opposite direction: rather than spreading, it absorbs and extracts information from the surface of the world; it takes the real, the material presence of the real, in order to operate with its distinctive smartness.

    Colors are then removed from the visual surface of the flowers, in real time, and with a rhythmically oscillating color pulse, in a way that makes the dried flowers seem to come to life with this uncanny, sustained digital breath. Living flesh, so to say, to elaborate on a simple question: what does it mean to be perceived, captured by the digital?

    Perception is not a one-way relation. The perceived entity is affected, in some way, it is brought into a new existence, within the perceiver world; inside the digital ecosystems, in this case.  We are constantly becoming images when we are perceived by these automated surveillance systems that film and monitor us, and we-as-images extend our lives within the relational databases we become part of.  If machines perceive, it is because they are able to act. To perceive is somehow to measure the capacity to act.

    And the point is that they act, certainly. Take for example this work by Sebastian Schmieg, Search by Image, Recursively, Transparent PNG, #1. An image is fed to the “search by image” google algorithm, and the first result of the query is taken to feed again the algorithm and so on and on. The creative force of the algorithm itself explodes in front of us, as in a digital Big Bang, where, why not, an image of ourselves, or of the Vividness flower arrangement, could be part of.

    * * *

    Media artist Nam June Paik wrote that video does not imitate nature, but time. Not nature as we perceive it, but the way nature makes it for us to perceive it. That is, through time, aging and irreversibility.

    Hello World! Processing documentary snapshot

    Two years ago, being part of Ultra-lab, a company devoted to open hardware and creation with technology, I was involved in the process of making a documentary on the coding platform Processing: the documentary Hello World! Processing was the final result. After a first phase of interviewing some of the most recognizable people within this community, I had the opportunity to work during several months with filmmaker Raúl Alaejos to enlarge the content of the interviews with online documents in order to be able to speak about different issues regarding the relation between creation and code. And during our research, we found the text by philosopher Henri Bergson, Creative Evolution,  and this particular quote that opens the documentary:

    "What is time? Time is what hinders everything from being given at once. It retards, or rather it is retardation. It must therefore be elaboration. Is it not then the vehicle of creation and choice? Does the existence of time not prove that there is indeterminacy in things?"

    So, in the documentary, we wanted to start from this idea, that working with code and algorithms makes you aware of their own inner intensive, creative capacity, outside your own, subjective, forces. That there are processes, outside us, humans, that autonomously create, through emergence, complexity and these other forms of intelligence we begin to see outside our human realms. And we wanted to connect this awareness with the somehow related disposition to create collaboratively. That is, once you begin to work with algorithms, you are already working with others, and then it is very easy for you to open your creative processes to other humans as well, and then switch to long-term collaborations and collective modes of creation.

    A very interesting thing we learnt while doing this documentary is that when we approach programming from this perspective, willing to connect to alien forms -so to speak- of creativity, we don’t follow the standard, engineering-like, mode of learning how to code. We exchange instead examples, snippets of code, already programmed agents and behaviours, and start to combine them and change their parameters, in a playful, non transcendental, way.

    It is as if language, instead of being a carrier or a container of information, became an embodied notion within this creative environments, consisting of object-like bodies enacting perceptions, movements and behaviours. A modular, LEGO-like, set of infinite pieces. Think on the idea of learning a human language through snippets of literature, poems or songs. For our individual adult brain it is a really complex task, but in terms of code, and of collective learning, is a wonderful way of learning to create through code -which might be, by the way, a different thing to programming.

    I’ve been working with this idea -the embodiment of language operations- in several workshops. And I’d like to share with you two very special ones we had the opportunity to extensively prepare artist María Andueza and I, in collaboration with the Culturambiente association, two workshops which took place in Nicaragua and El Salvador two years ago. This was a large project to think on complex local conflicts that deal with ecological as well as social concerns. Briefly stated, the project was split in two phases: first, a seminar was proposed to discuss and collect views, arguments and methodologies on a particular eco-social conflict, and then, afterwards, in a second phase, we -María and I- worked together with students and researchers to collectively build from scratch a videogame with the materials resulting from the first stage.

    As we had ten working days for each workshop, we had to propose one of these embodied language strategies to focus more on the creative and discursive possibilities, rather than on the technical normative knowledge itself of coding and designing. We proposed then a working prototype of a simple new language, where the key idea was aggregation. Instead of sequential specification -building a first object (program) to be elaborated procedurally in a sequential way, introducing gradually more details and functions into it- we proposed a data-driven language, where interactive elements could be created as aggregations of pre-existing behaviours, rendering states and parameters. The set of possible behaviours could be extended by the more proficient programmers among the participants, but simple mechanics such as interactive dialogues or resource managements could be learnt by everyone, just creating different lists of interactive blocks.

    TallerVideojuegos-01.jpg

    For programmers in the workshop, working with this language was at the beginning an unpleasant experience. They were forced to approach programming in a different way, and not a really efficient one, as we were dealing with a prototype of a pedagogical tool. And for designers and researchers, the language proved to be simple enough to begin to think with playable results since the first day. This way, we deactivated somehow the traditional power divide between programmers and designers within these workshops, at least during the first days. In the end, in both workshops, and with the pressure to finish the videogames, disciplinary roles re-appeared as in the standard production chain. But these first days were crucial for the success of the workshops, from our point of view, as they allowed to know each other deactivating inherited productive roles, and to discuss since the beginning the conceptual concerns we wanted to deal with during the whole workshop.

    TallerVideojuegos-02.jpg

    The idea of language as an interaction away from informational or representational purposes seems to me very interesting when dealing with certain types of collectivities. If we think on situations where we easily engage in collective behaviours, such as dancing, team sports or simply producing sounds or noises, it is easy to understand the importance of such embodied communications. In more abstract processes, such as the elaboration of a videogame or an interactive project, it is not as clear to find such interaction modes.

    * * *

    Baruch Spinoza wrote in one of his treatises this impressive thought: “It is never we who affirm or deny something of a thing; it is the thing itself that affirms or denies something in us.”

    I don’t know if aware of Spinoza’s philosophy or not, but most of current big online stores seem to  agree with this quote. Parallel to the huge increase in the available information of customers’ habits and preferences, in the last years we’ve seen that when a customer accesses a store, he or she is offered a personalized display of products, that is, the recommended products panel, which conveniently tuned to excite his or her willingness to buy some of them.

    Specialized algorithms are in charge of displaying the appropriate selection of products to a particular customer. They are able to compare customer information databases with catalogs of products, and produce relations that neither the seller nor the customer would be able to expect. Experts -and here I’m quoting the well-known TED conference by Kevin Slavin- say that algorithms are responsible of the 70% of the sales produced in large online stores.

    Bots of Trust, video documentation snapshop, Abelardo G. Fournier

    If this is true, algorithms have then become their most valuable asset. The confidence on their extractive and predictive capabilities transforms customers free will to choose, or their artificially excited desire for a product, into a less important issue for retail managers. In some sense, once you are in the store, products will choose you, and not otherwise.

    I've been playing with these ideas in an ongoing prototype of device. It consists of a bot that prints faces recognized and extracted from the database of books of Amazon. A specifically programmed script crawls the Amazon website, extracting those collections of books that appear together recommended at the same time. Those collections of related books are visualized graphically, and then a face recognition algorithm looks for faces within the resulting images.

    Bots of Trust, Abelardo G. Fournier

    The resulting pixelated faces are funny, as well as the idea of providing to the books with a portrait, or a composite picture, of their future buyer. It is scary, however, to think on being predictable, and not in a statistical way, but on an individual basis.

    The project, of course, does not pretend to affirm something on the current state of algorithmic businesses, but rather to play, fictionally, with this possibility. I’m interested in the idea of the becoming of the subject, in the becoming of the me-as-entity, not in terms of dissolution or immateriality, but rather in terms of constant reassembly.

    Immigrant Sounds (2014), Maria Andueza and Abelardo G. Fournier

    To finish, three months ago María Andueza and I were invited to propose a participatory performance in the public space in Stockholm. We prepared a set of boxes with electronics that produced a cicada-like sound, and distributed them to the participants, with a series of written questions, mainly related to the fact of becoming immigrant to a space because of the unpleasant sound of the boxes and the fact of being related with a community, the rest of the sounding participants. The action took place in a crowded square, which became immediately filled with the pulsating noise of the electronic insects. As bodies in a social space, we explored the transitions between the noisy individual and the teeming, vibrating multiplicity: the comfort space of the community against the violent isolation of the single emitter. Always in terms of becoming. Becoming immigrants, becoming media.

    “We do not so much have media as we are media and of media”, affirms Parikka in the introduction of his aforementioned Insect Media book. Constantly disassembled and reassembled in our acts and perceptions, maintained by the collective, the unplanned and non-human ensemble of interactions that build and perpetuate the illusion of being.

    States of Transition, Abelardo G. Fournier

    Abelardo G. Fournier , 2014

    Licencia Creative Commons
    Molecularity and algorithms. The invisible collectivities por Abelardo Gil-Fournier se distribuye bajo una Licencia Creative Commons Atribución-CompartirIgual 4.0 Internacional.
    Basada en una obra en http://abelardogfournier.org/texts/molecularity-and-algorithms-the-invisible-collectivities.
    Permisos que vayan más allá de lo cubierto por esta licencia pueden encontrarse en http://abelardogfournier.org/about.