1
views
0
recommends
+1 Recommend
0 collections
    0
    shares
      • Record: found
      • Abstract: not found
      • Article: not found

      Self-Supervised Representation Learning: Introduction, advances, and challenges

      Read this article at

      ScienceOpenPublisher
      Bookmark
          There is no author summary for this article yet. Authors can add summaries to their articles on ScienceOpen to make them more accessible to a non-specialist audience.

          Related collections

          Most cited references60

          • Record: found
          • Abstract: not found
          • Conference Proceedings: not found

          Deep Residual Learning for Image Recognition

            Bookmark
            • Record: found
            • Abstract: not found
            • Article: not found

            ImageNet: A large-scale hierarchical image database

              Bookmark
              • Record: found
              • Abstract: found
              • Article: not found

              node2vec

              Prediction tasks over nodes and edges in networks require careful effort in engineering features used by learning algorithms. Recent research in the broader field of representation learning has led to significant progress in automating prediction by learning the features themselves. However, present feature learning approaches are not expressive enough to capture the diversity of connectivity patterns observed in networks. Here we propose node2vec, an algorithmic framework for learning continuous feature representations for nodes in networks. In node2vec, we learn a mapping of nodes to a low-dimensional space of features that maximizes the likelihood of preserving network neighborhoods of nodes. We define a flexible notion of a node's network neighborhood and design a biased random walk procedure, which efficiently explores diverse neighborhoods. Our algorithm generalizes prior work which is based on rigid notions of network neighborhoods, and we argue that the added flexibility in exploring neighborhoods is the key to learning richer representations. We demonstrate the efficacy of node2vec over existing state-of-the-art techniques on multi-label classification and link prediction in several real-world networks from diverse domains. Taken together, our work represents a new way for efficiently learning state-of-the-art task-independent representations in complex networks.
                Bookmark

                Author and article information

                Journal
                IEEE Signal Processing Magazine
                IEEE Signal Process. Mag.
                Institute of Electrical and Electronics Engineers (IEEE)
                1053-5888
                1558-0792
                May 2022
                May 2022
                : 39
                : 3
                : 42-62
                Affiliations
                [1 ]MScR degree, University of Edinburgh, Edinburgh, U.K.
                [2 ]School of Informatics, University of Edinburgh, Edinburgh, U.K.
                [3 ]Associate Professor, Nanyang Technological University, Singapore
                [4 ]Artificial Intelligence, University of Edinburgh, Edinburgh, U.K.
                Article
                10.1109/MSP.2021.3134634
                d7625b3b-8eaf-492f-99a5-620d08e5d2f4
                © 2022

                https://ieeexplore.ieee.org/Xplorehelp/downloads/license-information/IEEE.html

                https://doi.org/10.15223/policy-029

                https://doi.org/10.15223/policy-037

                History

                Comments

                Comment on this article