4
views
0
recommends
+1 Recommend
0 collections
    0
    shares
      • Record: found
      • Abstract: found
      • Article: found
      Is Open Access

      Generative complex networks within a dynamic memristor with intrinsic variability

      research-article

      Read this article at

      Bookmark
          There is no author summary for this article yet. Authors can add summaries to their articles on ScienceOpen to make them more accessible to a non-specialist audience.

          Abstract

          Artificial neural networks (ANNs) have gained considerable momentum in the past decade. Although at first the main task of the ANN paradigm was to tune the connection weights in fixed-architecture networks, there has recently been growing interest in evolving network architectures toward the goal of creating artificial general intelligence. Lagging behind this trend, current ANN hardware struggles for a balance between flexibility and efficiency but cannot achieve both. Here, we report on a novel approach for the on-demand generation of complex networks within a single memristor where multiple virtual nodes are created by time multiplexing and the non-trivial topological features, such as small-worldness, are generated by exploiting device dynamics with intrinsic cycle-to-cycle variability. When used for reservoir computing, memristive complex networks can achieve a noticeable increase in memory capacity a and respectable performance boost compared to conventional reservoirs trivially implemented as fully connected networks. This work expands the functionality of memristors for ANN computing.

          Abstract

          Designing efficient AI hardware capable of creating artificial general intelligence remains a challenge. Here, the authors present an approach for the on-demand generation of complex networks within a single memristor by harnessing device dynamics with intrinsic cycle-to-cycle variability and demonstrate the effectiveness of memristive complex network-based reservoirs.

          Related collections

          Most cited references59

          • Record: found
          • Abstract: found
          • Article: not found

          Collective dynamics of 'small-world' networks.

          Networks of coupled dynamical systems have been used to model biological oscillators, Josephson junction arrays, excitable media, neural networks, spatial games, genetic control networks and many other self-organizing systems. Ordinarily, the connection topology is assumed to be either completely regular or completely random. But many biological, technological and social networks lie somewhere between these two extremes. Here we explore simple models of networks that can be tuned through this middle ground: regular networks 'rewired' to introduce increasing amounts of disorder. We find that these systems can be highly clustered, like regular lattices, yet have small characteristic path lengths, like random graphs. We call them 'small-world' networks, by analogy with the small-world phenomenon (popularly known as six degrees of separation. The neural network of the worm Caenorhabditis elegans, the power grid of the western United States, and the collaboration graph of film actors are shown to be small-world networks. Models of dynamical systems with small-world coupling display enhanced signal-propagation speed, computational power, and synchronizability. In particular, infectious diseases spread more easily in small-world networks than in regular lattices.
            Bookmark
            • Record: found
            • Abstract: found
            • Article: not found

            Emergence of Scaling in Random Networks

            Systems as diverse as genetic networks or the World Wide Web are best described as networks with complex topology. A common property of many large networks is that the vertex connectivities follow a scale-free power-law distribution. This feature was found to be a consequence of two generic mechanisms: (i) networks expand continuously by the addition of new vertices, and (ii) new vertices attach preferentially to sites that are already well connected. A model based on these two ingredients reproduces the observed stationary scale-free distributions, which indicates that the development of large networks is governed by robust self-organizing phenomena that go beyond the particulars of the individual systems.
              Bookmark
              • Record: found
              • Abstract: found
              • Article: not found

              Harnessing nonlinearity: predicting chaotic systems and saving energy in wireless communication.

              We present a method for learning nonlinear systems, echo state networks (ESNs). ESNs employ artificial recurrent neural networks in a way that has recently been proposed independently as a learning mechanism in biological brains. The learning method is computationally efficient and easy to use. On a benchmark task of predicting a chaotic time series, accuracy is improved by a factor of 2400 over previous techniques. The potential for engineering applications is illustrated by equalizing a communication channel, where the signal error rate is improved by two orders of magnitude.
                Bookmark

                Author and article information

                Contributors
                duanwr10@buaa.edu.cn
                liuqingxue@mail.tsinghua.edu.cn
                macheng@tsinghua.edu.cn
                li_huanglong@mail.tsinghua.edu.cn
                Journal
                Nat Commun
                Nat Commun
                Nature Communications
                Nature Publishing Group UK (London )
                2041-1723
                2 October 2023
                2 October 2023
                2023
                : 14
                : 6134
                Affiliations
                [1 ]Department of Precision Instrument, Center for Brain Inspired Computing Research, Tsinghua University, ( https://ror.org/03cve4549) Beijing, 100084 China
                [2 ]School of Instrument Science and Opto Electronics Engineering, Laboratory of Intelligent Microsystems, Beijing Information Science & Technology University, ( https://ror.org/04xnqep60) Beijing, 100101 China
                [3 ]School of Integrated Circuits, Tsinghua University, ( https://ror.org/03cve4549) Beijing, 100084 China
                [4 ]School of Artificial Intelligence, Southwest University, ( https://ror.org/01kj4z117) Chongqing, 400715 China
                [5 ]Chinese Institute for Brain Research, ( https://ror.org/029819q61) Beijing, 102206 China
                Author information
                http://orcid.org/0000-0002-7791-9686
                http://orcid.org/0000-0003-0730-4202
                http://orcid.org/0000-0002-0040-3796
                http://orcid.org/0000-0003-4496-3514
                http://orcid.org/0000-0002-1777-7807
                Article
                41921
                10.1038/s41467-023-41921-3
                10545788
                37783711
                f8c4b59c-7497-452b-b594-e12d490287a8
                © Springer Nature Limited 2023

                Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article’s Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article’s Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/.

                History
                : 3 February 2023
                : 21 September 2023
                Funding
                Funded by: FundRef https://doi.org/10.13039/501100001809, National Natural Science Foundation of China (National Science Foundation of China);
                Award ID: 61974082
                Award Recipient :
                Categories
                Article
                Custom metadata
                © Springer Nature Limited 2023

                Uncategorized
                electrical and electronic engineering,electronic devices
                Uncategorized
                electrical and electronic engineering, electronic devices

                Comments

                Comment on this article