Google scholar, dblp もご参照ください。
査読付き論文
Keisuke Fujii, Koh Takeuchi, Atsushi Kuribayashi, Naoya Takeishi, Yoshinobu Kawahara, Kazuya Takeda
Estimating Counterfactual Treatment Outcomes over Time in Complex Multi-Vehicle Simulation Inproceedings Forthcoming
In: Proceedings of the 30th ACM SIGSPATIAL International Conference on Advances in Geographic Information Systems, Forthcoming.
@inproceedings{fujiiEstimatingCounterfactualTreatment2022,
title = {Estimating Counterfactual Treatment Outcomes over Time in Complex Multi-Vehicle Simulation},
author = {Keisuke Fujii and Koh Takeuchi and Atsushi Kuribayashi and Naoya Takeishi and Yoshinobu Kawahara and Kazuya Takeda},
year = {2022},
booktitle = {Proceedings of the 30th ACM SIGSPATIAL International Conference on Advances in Geographic Information Systems},
}
Naoya Takeishi, Keisuke Fujii, Koh Takeuchi, Yoshinobu Kawahara
Discriminant Dynamic Mode Decomposition for Labeled Spatiotemporal Data Collections Journal Article
In: SIAM Journal on Applied Dynamical Systems, vol. 21, no. 2, pp. 1030–1058, 2022.
@article{takeishiDiscriminantDynamicMode2022,
title = {Discriminant Dynamic Mode Decomposition for Labeled Spatiotemporal Data Collections},
author = {Naoya Takeishi and Keisuke Fujii and Koh Takeuchi and Yoshinobu Kawahara},
doi = {10.1137/21M1399907},
year = {2022},
journal = {SIAM Journal on Applied Dynamical Systems},
volume = {21},
number = {2},
pages = {1030--1058},
}
Extracting coherent patterns is one of the standard approaches toward understanding spatiotemporal data. Dynamic mode decomposition (DMD) is a powerful tool for extracting coherent patterns, but the original DMD and most of its variants do not consider label information, which is often available as side information of spatiotemporal data. In this work, we propose a new method for extracting distinctive coherent patterns from labeled spatiotemporal data collections such that they contribute to major differences in a labeled set of dynamics. We achieve such pattern extraction by incorporating discriminant analysis into DMD. To this end, we define a kernel function on subspaces spanned by sets of dynamic modes and develop an objective to take both reconstruction goodness as DMD and class-separation goodness as discriminant analysis into account. We illustrate our method using a synthetic dataset and several real-world datasets. The proposed method can be a useful tool for exploratory data analysis for understanding spatiotemporal data.
Naoya Ozaki, Kanta Yanagida, Takuya Chikazawa, Nishanth Pushparaj, Naoya Takeishi, Ryuki Hyodo
Asteroid Flyby Cycler Trajectory Design Using Deep Neural Networks Journal Article
In: Journal of Guidance, Control, and Dynamics, vol. 45, no. 8, pp. 1496–1511, 2022.
@article{ozakiAsteroidFlybyCycler2022,
title = {Asteroid Flyby Cycler Trajectory Design Using Deep Neural Networks},
author = {Naoya Ozaki and Kanta Yanagida and Takuya Chikazawa and Nishanth Pushparaj and Naoya Takeishi and Ryuki Hyodo},
doi = {10.2514/1.G006487},
year = {2022},
journal = {Journal of Guidance, Control, and Dynamics},
volume = {45},
number = {8},
pages = {1496--1511},
}
Asteroid exploration has been attracting more attention in recent years. Nevertheless, we have just visited tens of asteroids, whereas we have discovered more than 1 million bodies. As our current observation and knowledge should be biased, it is essential to explore multiple asteroids directly to better understand the remains of planetary building materials. One of the mission design solutions is utilizing asteroid flyby cycler trajectories with multiple Earth gravity assists. An asteroid flyby cycler trajectory design problem is a subclass of global trajectory optimization problems with multiple flybys, involving a trajectory optimization problem for a given flyby sequence and a combinatorial optimization problem to decide the sequence of the flybys. As the number of flyby bodies grows, the computation time of this optimization problem expands maliciously. This paper presents a new method to design asteroid flyby cycler trajectories utilizing a surrogate model constructed by deep neural networks approximating trajectory optimization results. Because one of the bottlenecks of machine learning approaches is the heavy computation time to generate massive trajectory databases, we propose an efficient database generation strategy by introducing pseudo-asteroids satisfying the Karush– Kuhn– Tucker conditions. The numerical result applied to Japan Aerospace Exploration Agency's DESTINY+ mission shows that the proposed method is practically applicable to space mission design and can significantly reduce the computational time for searching asteroid flyby sequences.
Keisuke Fujii, Naoya Takeishi, Kazushi Tsutsui, Emyo Fujioka, Nozomi Nishiumi, Ryoya Tanaka, Mika Fukushiro, Kaoru Ide, Hiroyoshi Kohno, Ken Yoda, Susumu Takahashi, Shizuko Hiryu, Yoshinobu Kawahara
Learning Interaction Rules from Multi-Animal Trajectories via Augmented Behavioral Models Inproceedings
In: Advances in Neural Information Processing Systems 34, pp. 11108–11122, 2021.
@inproceedings{fujiiLearningInteractionRules2021,
title = {Learning Interaction Rules from Multi-Animal Trajectories via Augmented Behavioral Models},
author = {Keisuke Fujii and Naoya Takeishi and Kazushi Tsutsui and Emyo Fujioka and Nozomi Nishiumi and Ryoya Tanaka and Mika Fukushiro and Kaoru Ide and Hiroyoshi Kohno and Ken Yoda and Susumu Takahashi and Shizuko Hiryu and Yoshinobu Kawahara},
year = {2021},
booktitle = {Advances in Neural Information Processing Systems 34},
pages = {11108--11122},
}
Extracting the interaction rules of biological agents from movement sequences pose challenges in various domains. Granger causality is a practical framework for analyzing the interactions from observed time-series data; however, this framework ignores the structures and assumptions of the generative process in animal behaviors, which may lead to interpretational problems and sometimes erroneous assessments of causality. In this paper, we propose a new framework for learning Granger causality from multi-animal trajectories via augmented theory-based behavioral models with interpretable data-driven models. We adopt an approach for augmenting incomplete multi-agent behavioral models described by time-varying dynamical systems with neural networks. For efficient and interpretable learning, our model leverages theory-based architectures separating navigation and motion processes, and the theory-guided regularization for reliable behavioral modeling. This can provide interpretable signs of Granger-causal effects over time, i.e., when specific others cause the approach or separation. In experiments using synthetic datasets, our method achieved better performance than various baselines. We then analyzed multi-animal datasets of mice, flies, birds, and bats, which verified our method and obtained novel biological insights.
Naoya Takeishi, Alexandros Kalousis
Physics-Integrated Variational Autoencoders for Robust and Interpretable Generative Modeling Inproceedings
In: Advances in Neural Information Processing Systems 34, pp. 14809–14821, 2021.
@inproceedings{takeishiPhysicsintegratedVariationalAutoencoders2021,
title = {Physics-Integrated Variational Autoencoders for Robust and Interpretable Generative Modeling},
author = {Naoya Takeishi and Alexandros Kalousis},
year = {2021},
booktitle = {Advances in Neural Information Processing Systems 34},
pages = {14809--14821},
}
Integrating physics models within machine learning models holds considerable promise toward learning robust models with improved interpretability and abilities to extrapolate. In this work, we focus on the integration of incomplete physics models into deep generative models. In particular, we introduce an architecture of variational autoencoders (VAEs) in which a part of the latent space is grounded by physics. A key technical challenge is to strike a balance between the incomplete physics and trainable components such as neural networks for ensuring that the physics part is used in a meaningful manner. To this end, we propose a regularized learning method that controls the effect of the trainable components and preserves the semantics of the physics-based latent variables as intended. We not only demonstrate generative performance improvements over a set of synthetic and realworld datasets, but we also show that we learn robust models that can consistently extrapolate beyond the training distribution in a meaningful manner. Moreover, we show that we can control the generative process in an interpretable manner.
Naoya Takeishi, Yoshinobu Kawahara
Learning Dynamics Models with Stable Invariant Sets Inproceedings
In: Proceedings of the 35th AAAI Conference on Artificial Intelligence, pp. 9782–9790, 2021.
@inproceedings{takeishiLearningDynamicsModels2021,
title = {Learning Dynamics Models with Stable Invariant Sets},
author = {Naoya Takeishi and Yoshinobu Kawahara},
year = {2021},
booktitle = {Proceedings of the 35th AAAI Conference on Artificial Intelligence},
pages = {9782--9790},
}
Invariance and stability are essential notions in dynamical systems study, and thus it is of great interest to learn a dynamics model with a stable invariant set. However, existing methods can only handle the stability of an equilibrium. In this paper, we propose a method to ensure that a dynamics model has a stable invariant set of general classes such as limit cycles and line attractors. We start with the approach by Manek and Kolter (2019), where they use a learnable Lyapunov function to make a model stable with regard to an equilibrium. We generalize it for general sets by introducing projection onto them. To resolve the difficulty of specifying a to-be stable invariant set analytically, we propose defining such a set as a primitive shape (e.g., sphere) in a latent space and learning the transformation between the original and latent spaces. It enables us to compute the projection easily, and at the same time, we can maintain the model's flexibility using various invertible neural networks for the transformation. We present experimental results that show the validity of the proposed method and the usefulness for long-term prediction.
吉川 譲二, 武石 直也, 西山 薫, 高橋 久尚, 河原 吉伸, 木下 直人
SOFCシステムにおける故障予兆検知技術の検証 Journal Article
In: 電気学会論文誌Ｃ（電子・情報・システム部門誌）, vol. 141, no. 5, pp. 712–719, 2021.
@article{yoshikawaVerificationFailureSign2021,
title = {SOFCシステムにおける故障予兆検知技術の検証},
author = {譲二 吉川 and 直也 武石 and 薫 西山 and 久尚 高橋 and 吉伸 河原 and 直人 木下},
doi = {10.1541/ieejeiss.141.712},
year = {2021},
journal = {電気学会論文誌Ｃ（電子・情報・システム部門誌）},
volume = {141},
number = {5},
pages = {712--719},
}
We study a technique of predictive maintenance for systems with solid oxide fuel cells (SOFCs). SOFC-based systems are a digital ecosystem that utilizes energy efficiently because they generate power using oxygen in the air and hydrogen taken out from gas and also make hot water using heat generated during the power generation. Such systems are complicated as they are equipped with many sensors to control fuel flows (i.e., gas and air) and power generation according to power demands. For predictive maintenance of such complicated systems, developing individual algorithms for each individual failure sign is infeasible because of the variety of possible failure signs. Thus, it is necessary to develop a novel algorithm capable of grasping various failure signs. In this work, we develop a method to detect failure signs by performing change-point detection as well as classification analysis of change points to understand the cause of detected change points. In the change-point detection technique, failure signs are detected based on the reconstruction errors calculated with principal component analysis. In the change-point analysis technique, we solve a classification problem on the detected failure signs. Moreover, we propose a method to tell a failure sign that may correspond to unknown types of faults. We show experimental results with data obtained from real SOFC-based systems and confirm the validity of the proposed method.
Anand Srinivasan, Naoya Takeishi
An MCMC Method for Uncertainty Set Generation via Operator-Theoretic Metrics Inproceedings
In: Proceedings of the 2020 IEEE Conference on Decision and Control, pp. 2714–2719, 2020.
@inproceedings{srinivasanMCMCMethodUncertainty2020,
title = {An {MCMC} Method for Uncertainty Set Generation via Operator-Theoretic Metrics},
author = {Anand Srinivasan and Naoya Takeishi},
year = {2020},
booktitle = {Proceedings of the 2020 IEEE Conference on Decision and Control},
pages = {2714--2719},
}
Model uncertainty sets are required in many robust optimization problems, such as robust control and prediction with uncertainty, but there is no definite methodology to generate uncertainty sets for nonlinear dynamical systems. In this paper, we propose a method for model uncertainty set generation via Markov chain Monte Carlo. The proposed method samples from distributions over dynamical systems via metrics over transfer operators and is applicable to general nonlinear systems. We adapt Hamiltonian Monte Carlo for sampling high-dimensional transfer operators in a computationally efficient manner. We present numerical examples to validate the proposed method for uncertainty set generation.
Naoya Takeishi, Yoshinobu Kawahara
Learning Multiple Nonlinear Dynamical Systems with Side Information Inproceedings
In: Proceedings of the 2020 IEEE Conference on Decision and Control, pp. 3206–3211, 2020.
@inproceedings{takeishiLearningMultipleNonlinear2020,
title = {Learning Multiple Nonlinear Dynamical Systems with Side Information},
author = {Naoya Takeishi and Yoshinobu Kawahara},
year = {2020},
booktitle = {Proceedings of the 2020 IEEE Conference on Decision and Control},
pages = {3206--3211},
}
We address the problem of learning multiple dynamical systems, which is a kind of multi-task learning (MTL). The existing methods of MTL do not apply to learning dynamical systems in general. In this work, we develop a regularization method to perform MTL for dynamical systems appropriately. The proposed method is based on an operator-theoretic metric on dynamics that is agnostic of model parametrization and applicable even for nonlinear dynamics models. We calculate the proposed MTL-like regularization by estimating the metric from trajectories generated during training. Learning timevarying systems can be regarded as a special case of the usage of the proposed method. The proposed regularizer is versatile as we can straightforwardly incorporate it into offthe-shelf gradient-based optimization methods. We show the results of experiments on synthetic and real-world datasets, which exhibits the validity of the proposed regularizer.
Naoya Takeishi, Yoshinobu Kawahara
Knowledge-Based Regularization in Generative Modeling Inproceedings
In: Proceedings of the 29th International Joint Conference on Artificial Intelligence, pp. 2390–2396, 2020.
@inproceedings{takeishiKnowledgebasedRegularizationGenerative2020,
title = {Knowledge-Based Regularization in Generative Modeling},
author = {Naoya Takeishi and Yoshinobu Kawahara},
year = {2020},
booktitle = {Proceedings of the 29th International Joint Conference on Artificial Intelligence},
pages = {2390--2396},
}
Prior domain knowledge can greatly help to learn generative models. However, it is often too costly to hard-code prior knowledge as a specific model architecture, so we often have to use general-purpose models. In this paper, we propose a method to incorporate prior knowledge of feature relations into the learning of general-purpose generative models. To this end, we formulate a regularizer that makes the marginals of a generative model to follow prescribed relative dependence of features. It can be incorporated into off-the-shelf learning methods of many generative models, including variational autoencoders and generative adversarial networks, as its gradients can be computed using standard backpropagation techniques. We show the effectiveness of the proposed method with experiments on multiple types of datasets and generative models.
Yoshiyuki Anzai, Takehisa Yairi, Naoya Takeishi, Yuichi Tsuda, Naoko Ogawa
Visual Localization for Asteroid Touchdown Operation Based on Local Image Features Journal Article
In: Astrodynamics, vol. 4, no. 2, pp. 149–161, 2020.
@article{anzaiVisualLocalizationAsteroid2020,
title = {Visual Localization for Asteroid Touchdown Operation Based on Local Image Features},
author = {Yoshiyuki Anzai and Takehisa Yairi and Naoya Takeishi and Yuichi Tsuda and Naoko Ogawa},
year = {2020},
journal = {Astrodynamics},
volume = {4},
number = {2},
pages = {149--161},
}
In an asteroid sample-return mission, accurate position estimation of the spacecraft relative to the asteroid is essential for landing at the target point. During the missions of Hayabusa and Hayabusa2, the main part of the visual position estimation procedure was performed by human operators on the Earth based on a sequence of asteroid images acquired and sent by the spacecraft. Although this approach is still adopted in critical space missions, there is an increasing demand for automated visual position estimation, so that the time and cost of human intervention may be reduced. In this paper, we propose a method for estimating the relative position of the spacecraft and asteroid during the descent phase for touchdown from an image sequence using state-of-the-art techniques of image processing, feature extraction, and structure from motion. We apply this method to real Ryugu images that were taken by Hayabusa2 from altitudes of 20 km-500 m. It is demonstrated that the method has practical relevance for altitudes within the range of 5-1 km. This result indicates that our method could improve the efficiency of the ground operation in the global mapping and navigation during the touchdown sequence, whereas full automation and autonomous on-board estimation are beyond the scope of this study. Furthermore, we discuss the challenges of developing a completely automatic position estimation framework.
Keisuke Fujii, Naoya Takeishi, Motokazu Hojo, Yuki Inaba, Yoshinobu Kawahara
Physically-Interpretable Classification of Biological Network Dynamics for Complex Collective Motions Journal Article
In: Scientific Reports, vol. 10, no. 1, 3005, 2020.
@article{fujiiPhysicallyinterpretableClassificationBiological2020,
title = {Physically-Interpretable Classification of Biological Network Dynamics for Complex Collective Motions},
author = {Keisuke Fujii and Naoya Takeishi and Motokazu Hojo and Yuki Inaba and Yoshinobu Kawahara},
doi = {10.1038/s41598-020-58064-w},
year = {2020},
journal = {Scientific Reports},
volume = {10},
number = {1},
pages = {3005},
}
Understanding biological network dynamics is a fundamental issue in various scientific and engineering fields. Network theory is capable of revealing the relationship between elements and their propagation; however, for complex collective motions, the network properties often transiently and complexly change. A fundamental question addressed here pertains to the classification of collective motion network based on physically-interpretable dynamical properties. Here we apply a data-driven spectral analysis called graph dynamic mode decomposition, which obtains the dynamical properties for collective motion classification. Using a ballgame as an example, we classified the strategic collective motions in different global behaviours and discovered that, in addition to the physical properties, the contextual node information was critical for classification. Furthermore, we discovered the label-specific stronger spectra in the relationship among the nearest agents, providing physical and semantic interpretations. Our approach contributes to the understanding of principles of biological complex network dynamics from the perspective of nonlinear dynamical systems.
Naoya Takeishi
Kernel Learning for Data-Driven Spectral Analysis of Koopman Operators Inproceedings
In: Proceedings of the 11th Asian Conference on Machine Learning, pp. 956–971, 2019.
@inproceedings{takeishiKernelLearningDatadriven2019,
title = {Kernel Learning for Data-Driven Spectral Analysis of {Koopman} Operators},
author = {Naoya Takeishi},
year = {2019},
booktitle = {Proceedings of the 11th Asian Conference on Machine Learning},
pages = {956--971},
}
Spectral analysis of the Koopman operators is a useful tool for studying nonlinear dynamical systems and has been utilized in various branches of science and engineering for purposes such as understanding complex phenomena and designing a controller. Several methods to compute the Koopman spectral analysis have been studied, among which data-driven methods are attracting attention. We focus on one of the popular data-driven methods, which is based on the Galerkin approximation of the operator using a basis estimated in a data-driven manner via the diffusion maps algorithm. The performance of this method with a finite amount of data depends on the choice of the kernel function used in diffusion maps, which creates a need for kernel selection. In this paper, we propose a method to learn the kernel function adaptively to obtain better performance in approximating spectra of the Koopman operator using the Galerkin approximation with diffusion maps. The proposed method depends on the multiple kernel learning scheme, and our objective function is based on the idea that a diffusion operator should commute with the Koopman operator. We also show the effectiveness of the proposed method empirically with numerical examples.
Keisuke Fujii, Naoya Takeishi, Benio Kibushi, Motoki Kouzaki, Yoshinobu Kawahara
Data-Driven Spectral Analysis for Coordinative Structures in Periodic Human Locomotion Journal Article
In: Scientific Reports, vol. 9, no. 1, 16755, 2019.
@article{fujiiDatadrivenSpectralAnalysis2019a,
title = {Data-Driven Spectral Analysis for Coordinative Structures in Periodic Human Locomotion},
author = {Keisuke Fujii and Naoya Takeishi and Benio Kibushi and Motoki Kouzaki and Yoshinobu Kawahara},
doi = {10.1038/s41598-019-53187-1},
year = {2019},
journal = {Scientific Reports},
volume = {9},
number = {1},
pages = {16755},
}
Living organisms dynamically and flexibly operate a great number of components. As one of such redundant control mechanisms, low-dimensional coordinative structures among multiple components have been investigated. However, structures extracted from the conventional statistical dimensionality reduction methods do not reflect dynamical properties in principle. Here we regard coordinative structures in biological periodic systems with unknown and redundant dynamics as a nonlinear limit-cycle oscillation, and apply a data-driven operator-theoretic spectral analysis, which obtains dynamical properties of coordinative structures such as frequency and phase from the estimated eigenvalues and eigenfunctions of a composition operator. Using segmental angle series during human walking as an example, we first extracted the coordinative structures based on dynamics; e.g. the speed-independent coordinative structures in the harmonics of gait frequency. Second, we discovered the speed-dependent time-evolving behaviours of the phase by estimating the eigenfunctions via our approach on the conventional low-dimensional structures. We also verified our approach using the double pendulum and walking model simulation data. Our results of locomotion analysis suggest that our approach can be useful to analyse biological periodic phenomena from the perspective of nonlinear dynamical systems.
Naoya Takeishi
Shapley Values of Reconstruction Errors of PCA for Explaining Anomaly Detection Inproceedings
In: Proceedings of the 2019 International Conference on Data Mining Workshops, pp. 793–798, 2019.
@inproceedings{takeishiShapleyValuesReconstruction2019,
title = {Shapley Values of Reconstruction Errors of {PCA} for Explaining Anomaly Detection},
author = {Naoya Takeishi},
doi = {10.1109/ICDMW.2019.00117},
year = {2019},
booktitle = {Proceedings of the 2019 International Conference on Data Mining Workshops},
pages = {793--798},
}
We present a method to compute the Shapley values of reconstruction errors of principal component analysis (PCA), which is particularly useful in explaining the results of anomaly detection based on PCA. Because features are usually correlated when PCA-based anomaly detection is applied, care must be taken in computing a value function for the Shapley values. We utilize the probabilistic view of PCA, particularly its conditional distribution, to exactly compute a value function for the Shapely values. We also present numerical examples, which imply that the Shapley values are advantageous for explaining detected anomalies than raw reconstruction errors of each feature.
* The published version has typos in Eqs. (14) and (18), which are fixed in the arXiv version.
* The published version has typos in Eqs. (14) and (18), which are fixed in the arXiv version.
Riku Sasaki, Naoya Takeishi, Takehisa Yairi, Koichi Hori
Neural Gray-Box Identification of Nonlinear Partial Differential Equations Incollection
In: no. 11671, pp. 309–321, 2019.
@incollection{sasakiNeuralGrayboxIdentification2019,
title = {Neural Gray-Box Identification of Nonlinear Partial Differential Equations},
author = {Riku Sasaki and Naoya Takeishi and Takehisa Yairi and Koichi Hori},
doi = {10.1007/978-3-030-29911-8_24},
year = {2019},
number = {11671},
pages = {309--321},
series = {Lecture Notes in Computer Science},
}
Many branches of the modern computational science and engineering are based on numerical simulations, for which we must prepare appropriate equations that well reflect the behavior of real-world phenomena and numerically solve them. For these purposes, we may utilize the data-driven identification and simulation technique of nonlinear partial differential equations (NPDEs) using deep neural networks (DNNs). A potential issue of the DNN-based identification and simulation in practice is the high variance due to the complexity of DNNs. To alleviate it, we propose a simple yet efficient way to incorporate prior knowledge of phenomena. Specifically, we can often anticipate what kinds of terms are present in a part of an appropriate NPDE, which should be utilized as prior knowledge for identifying the remaining part of the NPDE. To this end, we design DNN's inputs and the loss function for identification according to the prior knowledge. We present the results of the experiments conducted using three different types of NPDEs: the Korteweg– de Vries equation, the Navier– Stokes equation, and the Kuramoto– Sivashinsky equation. The experimental results show the effectiveness of the proposed method, i.e., utilizing known terms of an NPDE.
Ryo Sakagami, Naoya Takeishi, Takehisa Yairi, Koichi Hori
Visualization Methods for Spacecraft Telemetry Data Using Change-Point Detection and Clustering Journal Article
In: Transactions of the Japan Society for Aeronautical and Space Sciences, Aerospace Technology Japan, vol. 17, no. 2, pp. 244–252, 2019.
@article{sakagamiVisualizationMethodsSpacecraft2019,
title = {Visualization Methods for Spacecraft Telemetry Data Using Change-Point Detection and Clustering},
author = {Ryo Sakagami and Naoya Takeishi and Takehisa Yairi and Koichi Hori},
doi = {10.2322/tastj.17.244},
year = {2019},
journal = {Transactions of the Japan Society for Aeronautical and Space Sciences, Aerospace Technology Japan},
volume = {17},
number = {2},
pages = {244--252},
}
For secure operation of spacecraft, automatic or assistive health monitoring systems utilizing telemetry data are important. However, it is difficult to utilize them comprehensively because they consist of myriad heterogeneous variables. Although various monitoring systems focusing on only a few variables or homogeneous variables have been suggested, a definitive method to deal with the relationship among multiple heterogeneous variables has not yet. This paper proposes a new visualization framework that aims to show the correlation rules underlying multiple variables of spacecraft telemetry data. The proposed framework consists of a change-point detection algorithm based on subspace identification, clustering methods using dimensionality reduction, and a visualization method using heatmaps. In experiments conducted with real telemetry data obtained from JAXA spacecraft SDS-4, the proposed framework demonstrated effective visualizations that reflected the correlations among variables expected from mechanical characteristics of the satellite. Despite differences in scales and/or units, this framework succeeded in visualizing dynamic correlations not only among continuous variables but also among continuous and discrete variables. This framework can be utilized as an initial stage of anomaly detection focusing on the relationship among multiple variables, as well as a method to perceive the overall state of the spacecraft at a glance.
Naoya Takeishi, Takehisa Yairi, Yoshinobu Kawahara
Factorially Switching Dynamic Mode Decomposition for Koopman Analysis of Time-Variant Systems Inproceedings
In: Proceedings of the 2018 IEEE Conference on Decision and Control, pp. 6402–6408, 2018.
@inproceedings{takeishiFactoriallySwitchingDynamic2018,
title = {Factorially Switching Dynamic Mode Decomposition for {Koopman} Analysis of Time-Variant Systems},
author = {Naoya Takeishi and Takehisa Yairi and Yoshinobu Kawahara},
doi = {10.1109/CDC.2018.8619846},
year = {2018},
booktitle = {Proceedings of the 2018 IEEE Conference on Decision and Control},
pages = {6402--6408},
}
The modal decomposition based on the spectra of the Koopman operator has gained much attention in various areas such as data science and optimal control, and dynamic mode decomposition (DMD) has been known as a data-driven method for this purpose. However, there is a fundamental limitation in DMD and most of its variants; these methods are based on the premise that the target system is time-invariant at least within the data at hand. In this work, we aim to compute DMD on time-varying dynamical systems. To this end, we propose a probabilistic model that has factorially switching dynamic modes. In the proposed model, which is based on probabilistic DMD, observation at each time is expressed using a subset of dynamic modes, and the activation of the dynamic modes varies over time. We present an approximate inference method using expectation propagation and demonstrate the modeling capability of the proposed method with numerical examples of temporally-local events and transient phenomena.
Rem Hida, Naoya Takeishi, Takehisa Yairi, Koichi Hori
Dynamic and Static Topic Model for Analyzing Time-Series Document Collections Inproceedings
In: Proceedings of the 56th Annual Meeting of the Association for Computational Linguistics, pp. 516–520, 2018.
@inproceedings{hidaDynamicStaticTopic2018,
title = {Dynamic and Static Topic Model for Analyzing Time-Series Document Collections},
author = {Rem Hida and Naoya Takeishi and Takehisa Yairi and Koichi Hori},
doi = {10.18653/v1/P18-2082},
year = {2018},
booktitle = {Proceedings of the 56th Annual Meeting of the Association for Computational Linguistics},
pages = {516--520},
}
For extracting meaningful topics from texts, their structures should be considered properly. In this paper, we aim to analyze structured time-series documents such as a collection of news articles and a series of scientific papers, wherein topics evolve along time depending on multiple topics in the past and are also related to each other at each time. To this end, we propose a dynamic and static topic model, which simultaneously considers the dynamic structures of the temporal topic evolution and the static structures of the topic hierarchy at each time. We show the results of experiments on collections of scientific papers, in which the proposed method outperformed conventional models. Moreover, we show an example of extracted topic structures, which we found helpful for analyzing research activities.
Naoya Takeishi, Yoshinobu Kawahara, Takehisa Yairi
Learning Koopman Invariant Subspaces for Dynamic Mode Decomposition Inproceedings
In: Advances in Neural Information Processing Systems 30, pp. 1130–1140, 2017.
@inproceedings{takeishiLearningKoopmanInvariant2017,
title = {Learning {Koopman} Invariant Subspaces for Dynamic Mode Decomposition},
author = {Naoya Takeishi and Yoshinobu Kawahara and Takehisa Yairi},
year = {2017},
booktitle = {Advances in Neural Information Processing Systems 30},
pages = {1130--1140},
}
Spectral decomposition of the Koopman operator is attracting attention as a tool for the analysis of nonlinear dynamical systems. Dynamic mode decomposition is a popular numerical algorithm for Koopman spectral analysis; however, we often need to prepare nonlinear observables manually according to the underlying dynamics, which is not always possible since we may not have any a priori knowledge about them. In this paper, we propose a fully data-driven method for Koopman spectral analysis based on the principle of learning Koopman invariant subspaces from observed data. To this end, we propose minimization of the residual sum of squares of linear least-squares regression to estimate a set of functions that transforms data into a form in which the linear regression fits well. We introduce an implementation with neural networks and evaluate performance empirically using nonlinear dynamical systems and applications.
Naoya Takeishi, Takehisa Yairi, Department Aeronautics, The University of Tokyo 7-3-1 Hongo School of Engineering Astronautics
Visual Monocular Localization, Mapping, and Motion Estimation of a Rotating Small Celestial Body Journal Article
In: Journal of Robotics and Mechatronics, vol. 29, no. 5, pp. 856–863, 2017.
@article{takeishiVisualMonocularLocalization2017,
title = {Visual Monocular Localization, Mapping, and Motion Estimation of a Rotating Small Celestial Body},
author = {Naoya Takeishi and Takehisa Yairi and Department Aeronautics and The University of Tokyo 7-3-1 Hongo School of Engineering Astronautics},
doi = {10.20965/jrm.2017.p0856},
year = {2017},
journal = {Journal of Robotics and Mechatronics},
volume = {29},
number = {5},
pages = {856--863},
}
In the exploration of a small celestial body, it is important to estimate the position and attitude of the spacecraft, as well as the geometric properties of the target celestial body. In this paper, we propose a method to concurrently estimate these quantities in a highly automatic manner when measurements from an attitude sensor, inertial sensors, and a monocular camera are given. The proposed method is based on the incremental optimization technique, which works with models for sensor fusion, and a tailored initialization scheme developed to compensate for the absence of range sensors. Moreover, we discuss the challenges in developing a fully automatic navigation framework.
Naoya Takeishi, Yoshinobu Kawahara, Takehisa Yairi
Subspace Dynamic Mode Decomposition for Stochastic Koopman Analysis Journal Article
In: Physical Review E, vol. 96, no. 3, 033310, 2017.
@article{takeishiSubspaceDynamicMode2017,
title = {Subspace Dynamic Mode Decomposition for Stochastic {Koopman} Analysis},
author = {Naoya Takeishi and Yoshinobu Kawahara and Takehisa Yairi},
doi = {10.1103/PhysRevE.96.033310},
year = {2017},
journal = {Physical Review E},
volume = {96},
number = {3},
pages = {033310},
}
The analysis of nonlinear dynamical systems based on the Koopman operator is attracting attention in various applications. Dynamic mode decomposition (DMD) is a data-driven algorithm for Koopman spectral analysis, and several variants with a wide range of applications have been proposed. However, popular implementations of DMD suffer from observation noise on random dynamical systems and generate inaccurate estimation of the spectra of the stochastic Koopman operator. In this paper, we propose subspace DMD as an algorithm for the Koopman analysis of random dynamical systems with observation noise. Subspace DMD first computes the orthogonal projection of future snapshots to the space of past snapshots and then estimates the spectra of a linear model, and its output converges to the spectra of the stochastic Koopman operator under standard assumptions. We investigate the empirical performance of subspace DMD with several dynamical systems and show its utility for the Koopman analysis of random dynamical systems.
* The published version has a typo in the main algorithm, which is fixed in the arXiv version.
* The published version has a typo in the main algorithm, which is fixed in the arXiv version.
Naoya Takeishi, Yoshinobu Kawahara, Takehisa Yairi
Sparse Nonnegative Dynamic Mode Decomposition Inproceedings
In: Proceedings of the 2017 IEEE International Conference on Image Processing, pp. 2682–2686, 2017.
@inproceedings{takeishiSparseNonnegativeDynamic2017,
title = {Sparse Nonnegative Dynamic Mode Decomposition},
author = {Naoya Takeishi and Yoshinobu Kawahara and Takehisa Yairi},
doi = {10.1109/ICIP.2017.8296769},
year = {2017},
booktitle = {Proceedings of the 2017 IEEE International Conference on Image Processing},
pages = {2682--2686},
}
Dynamic mode decomposition (DMD) is a method to extract coherent modes from nonlinear dynamical systems. In this paper, we propose an extension of DMD, sparse nonnegative DMD, which generates a nonlinear and sparse modal representation of dynamics. In particular, this makes DMD more suitable for video processing. We reformulate DMD as a block-multiconvex optimization problem to impose constraints and regularizations directly on the structures of the estimated dynamic modes. We introduce the results of experiments with synthetic data and a surveillance video dataset and show that sparse nonnegative DMD can extract part-based dynamic modes from video streams.
Naoya Takeishi, Yoshinobu Kawahara, Yasuo Tabei, Takehisa Yairi
Bayesian Dynamic Mode Decomposition Inproceedings
In: Proceedings of the 26th International Joint Conference on Artificial Intelligence, pp. 2814–2821, 2017.
@inproceedings{takeishiBayesianDynamicMode2017,
title = {{Bayesian} Dynamic Mode Decomposition},
author = {Naoya Takeishi and Yoshinobu Kawahara and Yasuo Tabei and Takehisa Yairi},
doi = {10.24963/ijcai.2017/392},
year = {2017},
booktitle = {Proceedings of the 26th International Joint Conference on Artificial Intelligence},
pages = {2814--2821},
}
Dynamic mode decomposition (DMD) is a data-driven method for calculating a modal representation of a nonlinear dynamical system, and it has been utilized in various fields of science and engineering. In this paper, we propose Bayesian DMD, which provides a principled way to transfer the advantages of the Bayesian formulation into DMD. To this end, we first develop a probabilistic model corresponding to DMD, and then, provide the Gibbs sampler for the posterior inference in Bayesian DMD. Moreover, as a specific example, we discuss the case of using a sparsity-promoting prior for an automatic determination of the number of dynamic modes. We investigate the empirical performance of Bayesian DMD using synthetic and real-world datasets.
Takehisa Yairi, Naoya Takeishi, Tetsuo Oda, Yuta Nakajima, Naoki Nishimura, Noboru Takata
A Data-Driven Health Monitoring Method for Satellite Housekeeping Data Based on Probabilistic Clustering and Dimensionality Reduction Journal Article
In: IEEE Transactions on Aerospace and Electronic Systems, vol. 53, no. 3, pp. 1384–1401, 2017.
@article{yairiDatadrivenHealthMonitoring2017,
title = {A Data-Driven Health Monitoring Method for Satellite Housekeeping Data Based on Probabilistic Clustering and Dimensionality Reduction},
author = {Takehisa Yairi and Naoya Takeishi and Tetsuo Oda and Yuta Nakajima and Naoki Nishimura and Noboru Takata},
doi = {10.1109/TAES.2017.2671247},
year = {2017},
journal = {IEEE Transactions on Aerospace and Electronic Systems},
volume = {53},
number = {3},
pages = {1384--1401},
}
In the operation of artificial satellites, it is very important to monitor the health status of the systems and detect any symptoms of anomalies in the housekeeping data as soon as possible. Recently, the data-driven approach to the system monitoring problem, in which statistical machine learning techniques are applied to the large amount of measurement data collected in the past, has attracted considerable attention. In this paper, we propose a new data-driven health monitoring and anomaly detection method for artificial satellites based on probabilistic dimensionality reduction and clustering, taking into consideration the miscellaneous characteristics of the spacecraft housekeeping data. We applied our method to the telemetry data of the small demonstration satellite 4 (SDS-4) of the Japan Aerospace Exploration Agency (JAXA) and evaluated its effectiveness. The results show that the proposed system provides satellite operators with valuable information for understanding the health status of the system and inferring the causes of anomalies.
Naoya Takeishi, Takehisa Yairi, Naoki Nishimura, Yuta Nakajima, Noboru Takata
Dynamic Grouped Mixture Models for Intermittent Multivariate Sensor Data Incollection
In: Advances in Knowledge Discovery and Data Mining, vol. 9652, pp. 221–232, 2016.
@incollection{takeishiDynamicGroupedMixture2016,
title = {Dynamic Grouped Mixture Models for Intermittent Multivariate Sensor Data},
author = {Naoya Takeishi and Takehisa Yairi and Naoki Nishimura and Yuta Nakajima and Noboru Takata},
doi = {10.1007/978-3-319-31750-2_18},
year = {2016},
booktitle = {Advances in Knowledge Discovery and Data Mining},
volume = {9652},
pages = {221--232},
series = {Ecture Notes in Computer Science},
}
For secure and efficient operation of engineering systems, it is of great importance to watch daily logs generated by them, which mainly consist of multivariate time-series obtained with many sensors. This work focuses on challenges in practical analyses of those sensor data: temporal unevenness and sparseness. To handle the unevenly and sparsely spaced multivariate time-series, this work presents a novel method, which roughly models temporal information that still remains in the data. The proposed model is a mixture model with dynamic hierarchical structure that considers dependency between temporally close batches of observations, instead of every single observation. We conducted experiments with synthetic and real dataset, and confirmed validity of the proposed model quantitatively and qualitatively.
Naoya Takeishi, Takehisa Yairi, Yuichi Tsuda, Fuyuto Terui, Naoko Ogawa, Yuya Mimasu
Simultaneous Estimation of Shape and Motion of an Asteroid for Automatic Navigation Inproceedings
In: Proceedings of the 2015 IEEE International Conference on Robotics and Automation, pp. 2861–2866, 2015.
@inproceedings{takeishiSimultaneousEstimationShape2015,
title = {Simultaneous Estimation of Shape and Motion of an Asteroid for Automatic Navigation},
author = {Naoya Takeishi and Takehisa Yairi and Yuichi Tsuda and Fuyuto Terui and Naoko Ogawa and Yuya Mimasu},
doi = {10.1109/ICRA.2015.7139589},
year = {2015},
booktitle = {Proceedings of the 2015 IEEE International Conference on Robotics and Automation},
pages = {2861--2866},
}
In an asteroid exploration and sample return mission, accurate estimation of the shape and motion of the target asteroid is essential for selecting a touchdown site and navigating a spacecraft during touchdown operation. In this work, we present an automatic estimation method for the shape and motion of an asteroid, which is planned to be tested in future exploration missions including Japanese Hayabusa-2 [1]. Our task is to estimate the shape and rotation axis of the asteroid, as well as positions of the spacecraft from optical images. The proposed method is based on the expectation conditional-maximization (ECM) framework that consists of an auxiliary particle filter and nonlinear optimization techniques. One of our technical contributions is the estimation of the direction of rotation axis of the asteroid from monocular camera images, which are taken by the moving spacecraft. We conducted two experiments with synthetic data and an asteroid mock-up to show the validity of the proposed method and to present the numerical accuracy.
Naoya Takeishi, Akira Tanimoto, Takehisa Yairi, Yuichi Tsuda, Fuyuto Terui, Naoko Ogawa, Yuya Mimasu
Evaluation of Interest-Region Detectors and Descriptors for Automatic Landmark Tracking on Asteroids Journal Article
In: Transactions of the Japan Society for Aeronautical and Space Sciences, vol. 58, no. 1, pp. 45–53, 2015.
@article{takeishiEvaluationInterestregionDetectors2015,
title = {Evaluation of Interest-Region Detectors and Descriptors for Automatic Landmark Tracking on Asteroids},
author = {Naoya Takeishi and Akira Tanimoto and Takehisa Yairi and Yuichi Tsuda and Fuyuto Terui and Naoko Ogawa and Yuya Mimasu},
doi = {10.2322/tjsass.58.45},
year = {2015},
journal = {Transactions of the Japan Society for Aeronautical and Space Sciences},
volume = {58},
number = {1},
pages = {45--53},
}
The asteroid explorer Hayabusa-2, which is scheduled to be launched in 2014, is going to perform a global mapping mission after it arrives at the target asteroid. Although most of the global mapping sequence will be the same as that of its predecessor Hayabusa, several automation technologies are planned to be tested to reduce the workload of the operators. In particular, the structure from motion (SFM) and simultaneous localization and mapping (SLAM) techniques are expected to significantly contribute to the automation of asteroid shape estimation and visual spacecraft navigation. These frameworks require automatic landmark tracking on the asteroid surface, but no previous work has discussed the method that should be used to track images of the asteroid taken in space, where the absence of scattering light causes dramatic changes in appearance. In this study, we evaluated the performances of SIFT, SURF, BRISK, ORB, Harris-Affine, Hessian-Affine and MSER for images of the asteroid. We found that SIFT is acceptable for use, while SURF, BRISK and ORB can be used with careful parameter tuning. The affine-invariant detectors might contribute to more accurate tracking, but using them is more challenging owing to an extra normalizing process.
Naoya Takeishi, Takehisa Yairi
Anomaly Detection from Multivariate Time-Series with Sparse Representation Inproceedings
In: Proceedings of the 2014 IEEE International Conference on Systems, Man, and Cybernetics, pp. 2651–2656, 2014.
@inproceedings{takeishiAnomalyDetectionMultivariate2014,
title = {Anomaly Detection from Multivariate Time-Series with Sparse Representation},
author = {Naoya Takeishi and Takehisa Yairi},
doi = {10.1109/SMC.2014.6974327},
year = {2014},
booktitle = {Proceedings of the 2014 IEEE International Conference on Systems, Man, and Cybernetics},
pages = {2651--2656},
}
Anomaly detection from sensor data is an important data mining application for efficient and secure operation of complicated systems. In this study, we propose a novel anomaly detection method for multivariate time-series to capture relationships of variables and time-domain correlations simultaneously, without assuming any generative models of signals. The supposed framework in this study is a semi-supervised anomaly detection where we seek unusual parts of test data compared with reference data. The proposed method is based on feature extraction with sparse representation and relationship learning with dimensionality reduction. Our idea comes from the similarity between a sparse feature matrix extracted from multivariate time-series and a term-document matrix. We conducted experiments with synthetic and simulated data, and confirmed that the proposed method successfully detected anomalies in multivariate time-series signals. Especially, it demonstrated superior performance with anomalies in which only relationships of time-series patterns are changed from reference data (multivariate anomalies).
Akira Tanimoto, Naoya Takeishi, Takehisa Yairi, Yuichi Tsuda, Fuyuto Terui, Naoko Ogawa, Yuya Mimasu
Fast Estimation of Asteroid Shape and Motion for Spacecraft Navigation Inproceedings
In: Proceedings of the 2013 IEEE International Conference on Robotics and Biomimetics, pp. 1550–1555, 2013.
@inproceedings{tanimotoFastEstimationAsteroid2013,
title = {Fast Estimation of Asteroid Shape and Motion for Spacecraft Navigation},
author = {Akira Tanimoto and Naoya Takeishi and Takehisa Yairi and Yuichi Tsuda and Fuyuto Terui and Naoko Ogawa and Yuya Mimasu},
doi = {10.1109/ROBIO.2013.6739687},
year = {2013},
booktitle = {Proceedings of the 2013 IEEE International Conference on Robotics and Biomimetics},
pages = {1550--1555},
}
In this paper, we consider fast simultaneous estimation problem of the geometric shape of the asteroid and the relative motion of the spacecraft. In asteroid exploration missions, the information of asteroid shape and motion is needed to find suitable landing sites and navigate the spacecraft safely. In the previous HAYABUSA mission, large part of the estimation was performed manually by ground operators. We propose an efficient automatic estimation method using the image feature matching and matrix decomposition based fast 3D reconstruction techniques. Preliminary experiment results are also shown.
プレプリント
Keisuke Fujii, Naoya Takeishi, Yoshinobu Kawahara, Kazuya Takeda
Policy Learning With Partial Observation and Mechanical Constraints for Multi-Person Modeling Unpublished
2020, arXiv:2007.03155.
@unpublished{arXiv:2007.03155,
title = {Policy Learning With Partial Observation and Mechanical Constraints for Multi-Person Modeling},
author = {Keisuke Fujii and Naoya Takeishi and Yoshinobu Kawahara and Kazuya Takeda},
year = {2020},
note = {arXiv:2007.03155},
}
Extracting the rules of real-world biological multi-agent behaviors is a current challenge in various scientific and engineering fields. Biological agents generally have limited observation and mechanical constraints; however, most of the conventional data-driven models ignore such assumptions, resulting in lack of biological plausibility and model interpretability for behavioral analyses in biological and cognitive science. Here we propose sequential generative models with partial observation and mechanical constraints, which can visualize whose information the agents utilize and can generate biologically plausible actions. We formulate this as a decentralized multi-agent imitation learning problem, leveraging binary partial observation models with a Gumbel-Softmax reparameterization and policy models based on hierarchical variational recurrent neural networks with physical and biomechanical constraints. We investigate the empirical performances using real-world multi-person motion datasets from basketball and soccer games.
Naoya Takeishi, Yoshinobu Kawahara
On Anomaly Interpretation via Shapley Values Unpublished
2020, arXiv:2004.04464.
@unpublished{arXiv:2004.04464,
title = {On Anomaly Interpretation via {Shapley} Values},
author = {Naoya Takeishi and Yoshinobu Kawahara},
year = {2020},
note = {arXiv:2004.04464},
}
Anomaly localization is an essential problem as anomaly detection is. Because a rigorous localization requires a causal model of a target system, practically we often resort to a relaxed problem of anomaly interpretation, for which we are to obtain meaningful attribution of anomaly scores to input features. In this paper, we investigate the use of the Shapley value for anomaly interpretation. We focus on the semi-supervised anomaly detection and newly propose a characteristic function, on which the Shapley value is computed, specifically for anomaly scores. The idea of the proposed method is approximating the absence of some features by minimizing an anomaly score with regard to them. We examine the performance of the proposed method as well as other general approaches to computing the Shapley value in interpreting anomaly scores. We show the results of experiments on multiple datasets and anomaly detection methods, which indicate the usefulness of the Shapley-based anomaly interpretation toward anomaly localization.
Chun Fui Liew, Danielle DeLatte, Naoya Takeishi, Takehisa Yairi
Recent Developments in Aerial Robotics: A Survey and Prototypes Overview Unpublished
2017, arXiv:1711.10085.
@unpublished{arXiv:1711.10085,
title = {Recent Developments in Aerial Robotics: A Survey and Prototypes Overview},
author = {Chun Fui Liew and Danielle DeLatte and Naoya Takeishi and Takehisa Yairi},
year = {2017},
note = {arXiv:1711.10085},
}
In recent years, research and development in aerial robotics (i.e., unmanned aerial vehicles, UAVs) has been growing at an unprecedented speed, and there is a need to summarize the background, latest developments, and trends of UAV research. Along with a general overview on the definition, types, categories, and topics of UAV, this work describes a systematic way to identify 1,318 high-quality UAV papers from more than thirty thousand that have been appeared in the top journals and conferences. On top of that, we provide a bird's-eye view of UAV research since 2001 by summarizing various statistical information, such as the year, type, and topic distribution of the UAV papers. We make our survey list public and believe that the list can not only help researchers identify, study, and compare their work, but is also useful for understanding research trends in the field. From our survey results, we find there are many types of UAV, and to the best of our knowledge, no literature has attempted to summarize all types in one place. With our survey list, we explain the types within our survey and outline the recent progress of each. We believe this summary can enhance readers' understanding on the UAVs and inspire researchers to propose new methods and new applications.
国内会議・ワークショップ等における発表
Naoya Takeishi, Alexandros Kalousis
Variational Autoencoder with Differentiable Physics Engine for Human Gait Analysis and Synthesis Workshop
2021, Deep Generative Models and Downstream Applications Workshop, Online.
@workshop{takeishiVariationalAutoencoderDifferentiable2021,
title = {Variational Autoencoder with Differentiable Physics Engine for Human Gait Analysis and Synthesis},
author = {Naoya Takeishi and Alexandros Kalousis},
year = {2021},
note = {Deep Generative Models and Downstream Applications Workshop, Online},
}
We address the task of learning generative models of human gait. As gait motion always follows the physical laws, a generative model should also produce outputs that comply with the physical laws, particularly rigid body dynamics with contact and friction. We propose a deep generative model combined with a differentiable physics engine, which outputs physically plausible signals by construction. The proposed model is also equipped with a policy network conditioned on each sample. We show an example of the application of such a model to style transfer of gait.
武石 直也
グレーボックス深層生成モデルの学習 Conference
2021, 第24回情報論的学習理論ワークショップ (IBIS), オンライン開催.
@conference{takeishiIBIS2021,
title = {グレーボックス深層生成モデルの学習},
author = {直也 武石},
year = {2021},
note = {第24回情報論的学習理論ワークショップ (IBIS), オンライン開催},
}
深層生成モデル（本発表では特に変分オートエンコーダ）において、生成過程（デコーダ）がニューラルネットと事前知識によるモデル（例：物理的な支配法則）からなる場合を考える。そのようなグレーボックスモデルは学習効率や潜在変数の解釈性などの点で有利であるが、学習の際には、ニューラルネットが事前知識モデルを無視しないように注意する必要がある。本研究では両者のバランスをとって学習するための正則化法を提案する。
藤井 慶輔, 武石 直也, 筒井 和詩, 藤岡 慧明, 西海 望, 田中 良弥, 福代 三華, 井出 薫, 河野 裕美, 依田 憲, 高橋 晋, 飛龍 志津子, 河原 吉伸
生物集団の軌跡から相互作用の規則を学習するための拡張行動モデル Conference
2021, 第24回情報論的学習理論ワークショップ (IBIS), オンライン開催.
@conference{fujiiIBIS2021,
title = {生物集団の軌跡から相互作用の規則を学習するための拡張行動モデル},
author = {慶輔 藤井 and 直也 武石 and 和詩 筒井 and 慧明 藤岡 and 望 西海 and 良弥 田中 and 三華 福代 and 薫 井出 and 裕美 河野 and 憲 依田 and 晋 高橋 and 志津子 飛龍 and 吉伸 河原},
year = {2021},
note = {第24回情報論的学習理論ワークショップ (IBIS), オンライン開催},
}
生物集団の移動系列に内在する個体間の相互作用の規則を抽出することは様々な分野での課題である。本研究では、行動生態学のルールベース理論モデルを深層学習を用いた行動モデルへと拡張し、移動系列からグレンジャー因果（GC)を学習する枠組みを提案する。本手法は、時間変化するGCの解釈可能な符号を提供できる。特定の個体が近づいたり離れたりする現象を例とし、合成データでの検証と、様々な生物集団への応用を示す。
鈴木 崇平, 武石 直也, 岸本 政徳, 吉谷 尚久, 沖野 健太, 河原 吉伸, 廣島 雅人
機械学習による⼀般家庭の翌⽇消費電⼒予測⼿法の開発 Conference
2020, 令和2年 電気学会 電力・エネルギー部門大会, オンライン開催.
@conference{suzukiPES2020,
title = {機械学習による⼀般家庭の翌⽇消費電⼒予測⼿法の開発},
author = {崇平 鈴木 and 直也 武石 and 政徳 岸本 and 尚久 吉谷 and 健太 沖野 and 吉伸 河原 and 雅人 廣島},
year = {2020},
note = {令和2年 電気学会 電力・エネルギー部門大会, オンライン開催},
}
鈴木 崇平, 武石 直也, 岸本 政徳, 吉谷 尚久, 沖野 健太, 河原 吉伸, 廣島 雅人
一般家庭における消費電力予測手法の開発 Conference
2020, 第34回人工知能学会全国大会 (JSAI), オンライン開催.
@conference{suzukiJSAI2020,
title = {一般家庭における消費電力予測手法の開発},
author = {崇平 鈴木 and 直也 武石 and 政徳 岸本 and 尚久 吉谷 and 健太 沖野 and 吉伸 河原 and 雅人 廣島},
year = {2020},
note = {第34回人工知能学会全国大会 (JSAI), オンライン開催},
}
わが国では2011年の東日本大震災を契機に脆弱性が表面化した中央集権型エネルギーシステムの見直しが進んでいる。特に、環境への配慮から再生可能エネルギーを活用した分散型エネルギーシステムへの転換が求められるようになり、一つの解法としてVPP(Virtual Power Plant)と呼ばれる構想が注目されている。2021年に国内に創設される需給調整市場に向けて、本研究は世帯別の消費電力の高精度な予測手法の開発を目的としている。一般家庭における消費電力予測は住人の生活リズムに起因する変動を捉えることが重要となるため、本論文ではデータサンプルの重み付けを考慮した自己回帰モデルを提案する。複数世帯から取得した30分粒度の電力時系列データを利用し、提案手法の有効性を確認した。
Naoya Takeishi
Towards Intelligent Asteroid Exploration: Visual SLAM in Space Conference
2020, invited talk at the 23rd SANKEN International Symposium, Awaji, Japan.
@conference{takeishiIntelligentAsteroidExploration2020,
title = {Towards Intelligent Asteroid Exploration: Visual {SLAM} in Space},
author = {Naoya Takeishi},
year = {2020},
note = {invited talk at the 23rd SANKEN International Symposium, Awaji, Japan},
}
武石 直也, 河原 吉伸
安定不変集合をもつ力学系の学習 Conference
2020, 第23回情報論的学習理論ワークショップ (IBIS), オンライン開催.
@conference{takeishiIBI2020,
title = {安定不変集合をもつ力学系の学習},
author = {直也 武石 and 吉伸 河原},
year = {2020},
note = {第23回情報論的学習理論ワークショップ (IBIS), オンライン開催},
}
データから力学系を学習するとき、事前知識に応じて安定不変集合の存在を保証したいことがある。例えば、対象が自励振動を示す場合には安定なリミットサイクルをもったモデルを学習したい。しかし、既存の方法では不変集合の一種である（有限個の）平衡点しか扱えない。そこで本稿では、リミットサイクルなどを含む一般の安定不変集合の存在を保証する力学系モデルを提案する。このモデルはニューラルネットなどで実装できる。
藤井 慶輔, 武石 直也, 河原 吉伸, 武田 一哉
複数人のモデリングのための部分観測と力学的制約を伴う分散型方策学習 Conference
2020, 第23回情報論的学習理論ワークショップ (IBIS), オンライン開催.
@conference{fujiiIBIS2020,
title = {複数人のモデリングのための部分観測と力学的制約を伴う分散型方策学習},
author = {慶輔 藤井 and 直也 武石 and 吉伸 河原 and 一哉 武田},
year = {2020},
note = {第23回情報論的学習理論ワークショップ (IBIS), オンライン開催},
}
実世界の生物集団行動のルールを抽出する際には、モデルの生物学的妥当性と解釈可能性を考慮する必要がある。本研究では従来のデータ駆動モデルの多くが無視しがちな、部分観測と力学的制約を組込んだ分散型の系列生成モデルを提案する。本問題を分散型模倣学習問題として定式化し、力学的罰則を加えた階層型変分RNNに基づく分散型部分観測方策モデルとして実装して、バスケットボールとサッカーのデータを用いて有効性を示す。
武石 直也
再構成誤差のシャープレイ値による異常検知の説明 Conference
2019, 第22回情報論的学習理論ワークショップ (IBIS), 名古屋.
@conference{takeishiIBIS2019,
title = {再構成誤差のシャープレイ値による異常検知の説明},
author = {直也 武石},
year = {2019},
note = {第22回情報論的学習理論ワークショップ (IBIS), 名古屋},
}
異常検知のプラクティスとして，正常データに対して生成モデルを学習し，その再構成誤差を監視することがある．このとき，どの変数が異常なのかを知るために各変数の再構成誤差を比較することがよくある．しかし，異常な変数の再構成誤差だけが常に大きくなるとは限らない．そこで本稿では，シャープレイ値を用いて異常変数の説明を行うことを提案する．特に，各変数が独立とみなせない場合にシャープレイ値を計算する方法を示す．
藤井 慶輔, 武石 直也, 河原 吉伸
観測量間の動的構造を抽出するグラフ動的モード分解と集団スポーツデータへの応用 Conference
2019, 第22回情報論的学習理論ワークショップ (IBIS), 名古屋.
@conference{fujiiIBIS2019,
title = {観測量間の動的構造を抽出するグラフ動的モード分解と集団スポーツデータへの応用},
author = {慶輔 藤井 and 直也 武石 and 吉伸 河原},
year = {2019},
note = {第22回情報論的学習理論ワークショップ (IBIS), 名古屋},
}
構成要素が相互作用し複雑な動きを見せる集団運動を理解することは、物理学や生物学などにおいて重要な問題である。本発表では、集団運動などにおける観測量間の動的構造を抽出する、グラフ動的モード分解を紹介する。隣接行列系列を時間ダイナミクスとその係数である空間モードに分解することにより、データ駆動的にグラフ力学系の理解を可能にする。その応用例として、集団スポーツの選手集団の動きを分類する方法を紹介する。
Keisuke Fujii, Naoya Takeishi, Yoshinobu Kawahara
Interpretable Classification of Complex Collective Motions Using Graph Dynamic Mode Decomposition Workshop
2019, Workshop on Machine Learning for Trajectory, Activity, and Behavior, Nagoya, Japan.
@workshop{fujiiInterpretableClassificationComplex2019,
title = {Interpretable Classification of Complex Collective Motions Using Graph Dynamic Mode Decomposition},
author = {Keisuke Fujii and Naoya Takeishi and Yoshinobu Kawahara},
year = {2019},
note = {Workshop on Machine Learning for Trajectory, Activity, and Behavior, Nagoya, Japan},
}
武石 直也
時変動的モード分解 Conference
2019, 第33回人工知能学会全国大会 (JSAI), 新潟.
@conference{takeishiJSAI2019,
title = {時変動的モード分解},
author = {直也 武石},
year = {2019},
note = {第33回人工知能学会全国大会 (JSAI), 新潟},
}
本稿では，データに基づく力学系のモード分解手法を提案する．提案する手法は動的モード分解（dynamic mode decomposition, DMD）の発展として位置付けることができ，DMDの応用場面（高次元時系列データの理解，制御器の設計，信号処理など）においてより適切な分析を可能にすると期待される．通常のDMDでは各モードに時間変化しない減衰率や振動数が与えられる一方，提案する手法では時間変化する減衰率や振動数をもつモードへの分解を行うことを目的としている．本稿では，提案する手法が時間変化する力学系のモード分解を行えることを予備的な実験結果とともに示す．
鈴木 透馬, 矢入 健久, 武石 直也, 津田 雄一, 尾川 順子
画像列を用いた小惑星形状・探査機相対運動の逐次推定 Conference
2019, 第33回人工知能学会全国大会 (JSAI), 新潟.
@conference{suzukiJSAI2019,
title = {画像列を用いた小惑星形状・探査機相対運動の逐次推定},
author = {透馬 鈴木 and 健久 矢入 and 直也 武石 and 雄一 津田 and 順子 尾川},
year = {2019},
note = {第33回人工知能学会全国大会 (JSAI), 新潟},
}
小惑星探査ミッションでは探査機を精密に誘導したり，安全に小惑星に着陸させるために小惑星の詳細な形状と運動を把握するグローバルマッピングと呼ばれる作業が不可欠であるが，それらの情報はミッション開始段階では未知なことがほとんどであり，宇宙航空研究開発機構による「はやぶさ」，「はやぶさ２」プロジェクトでは人間が手動で画像を解析し小惑星の形状や探査機の姿勢の推定を行った．これらの作業は多大な人的資源及び時間を消費するものであるため，これらの作業の自動化は強く望まれている．
本研究ではグローバルマッピングの自動化に関する新たなアプローチを提案することを目的としている．提案手法では一度に最適化するパラメタの数を大幅に削減し，小惑星の剛体制約を用いることで，従来手法に比べ精度を多少落としながらも少ない計算資源で高速に大規模な点群を推定するものとなっている．提案手法の有効性を示すために小惑星探査機「はやぶさ２」が撮影した小惑星「リュウグウ」の複数の画像列を用いて実験を行った．実験の結果，本手法のアプローチが有効であることを確認した
本研究ではグローバルマッピングの自動化に関する新たなアプローチを提案することを目的としている．提案手法では一度に最適化するパラメタの数を大幅に削減し，小惑星の剛体制約を用いることで，従来手法に比べ精度を多少落としながらも少ない計算資源で高速に大規模な点群を推定するものとなっている．提案手法の有効性を示すために小惑星探査機「はやぶさ２」が撮影した小惑星「リュウグウ」の複数の画像列を用いて実験を行った．実験の結果，本手法のアプローチが有効であることを確認した
武石 直也
知識グラフによる生成モデル学習の正則化 Conference
2018, 第21回情報論的学習理論ワークショップ (IBIS), 札幌.
@conference{takeishiIBIS2018,
title = {知識グラフによる生成モデル学習の正則化},
author = {直也 武石},
year = {2018},
note = {第21回情報論的学習理論ワークショップ (IBIS), 札幌},
}
データを生成したシステムに関する知識を知識グラフの形で記述できることがある。例えば、工場のセンサデータに関して、センサが取り付けられた機器同士の関係性をグラフとして記述できる。そのようなデータに対する確率的生成モデルの学習において、知識グラフを事前情報として利用したい。ここでは、間接的な知識を含む情報を活用するために、知識グラフの連続値埋め込みを学習の正則化に利用する方法を議論する。
Naoya Takeishi, Kosuke Akimoto
Knowledge-Based Distant Regularization in Learning Probabilistic Models Workshop
2018, the 8th International Workshop on Statistical Relational AI, Stockholm, Sweden.
@workshop{takeishiKnowledgeBasedDistant2018,
title = {Knowledge-Based Distant Regularization in Learning Probabilistic Models},
author = {Naoya Takeishi and Kosuke Akimoto},
year = {2018},
note = {the 8th International Workshop on Statistical Relational AI, Stockholm, Sweden},
}
Exploiting the appropriate inductive bias based on the knowledge of data is essential for achieving good performance in statistical machine learning. In practice, however, the domain knowledge of interest often provides information on the relationship of data attributes only distantly, which hinders direct utilization of such domain knowledge in popular regularization methods. In this paper, we propose the knowledge-based distant regularization framework, in which we utilize the distant information encoded in a knowledge graph for regularization of probabilistic model estimation. In particular, we propose to impose prior distributions on model parameters specified by knowledge graph embeddings. As an instance of the proposed framework, we present the factor analysis model with the knowledge-based distant regularization. We show the results of preliminary experiments on the improvement of the generalization capability of such model.
武石 直也, 秋元 康佑
潜在変数モデルとナレッジグラフ埋め込みの融合 Conference
2018, 第32回人工知能学会全国大会 (JSAI), 鹿児島.
@conference{takeishiJSAI2018,
title = {潜在変数モデルとナレッジグラフ埋め込みの融合},
author = {直也 武石 and 康佑 秋元},
year = {2018},
note = {第32回人工知能学会全国大会 (JSAI), 鹿児島},
}
本稿では、ナレッジグラフの形の事前知識を潜在変数モデルに活用するための方法論を提案する。提案手法はtwo-viewモデリングによる潜在変数モデルの拡張であり、潜在変数モデルのパラメタや潜在変数がナレッジグラフ埋め込みのための確率モデルと共有される。一例として、確率的主成分分析にナレッジグラフを組み合わせる手法を示す。また、予備的な実験の結果も示す。
土肥 宏太, 武石 直也, 矢入 健久, 堀 浩一
動的モード分解を用いた音響データの異常検知 Conference
2018, 第32回人工知能学会全国大会 (JSAI), 鹿児島.
@conference{dohiJSAI2018,
title = {動的モード分解を用いた音響データの異常検知},
author = {宏太 土肥 and 直也 武石 and 健久 矢入 and 浩一 堀},
year = {2018},
note = {第32回人工知能学会全国大会 (JSAI), 鹿児島},
}
計測機器やコンピュータの発達によって大量の観測点を設けてデータを得ることが可能になり、高次元データを分析する手法が重要性を増している。動的モード分解(Dynamic Mode Decomposition, DMD)は近年注目されているデータ駆動型の手法で、データから動的構造を抽出する手法である。本研究では、DMDを用いて異常音と正常音を含む回転機の音響データの分析を行った。音響データのスペクトル分布に対してDMDを適用し、スペクトル分布の動的構造を分析した。異常音のスペクトル分布において、正常音のスペクトル分布におけるよりも減衰構造が支配的になる傾向があることがわかった。
武石 直也, 河原 吉伸, 矢入 健久
動的モード分解のためのKoopman不変空間学習 Conference
2017, 第20回情報論的学習理論ワークショップ (IBIS), 東京.
@conference{takeishiIBIS2017,
title = {動的モード分解のためのKoopman不変空間学習},
author = {直也 武石 and 吉伸 河原 and 健久 矢入},
year = {2017},
note = {第20回情報論的学習理論ワークショップ (IBIS), 東京},
}
Koopman作用素に基づく力学系のモード分解は時系列データの分析、次元削減、特徴抽出等に幅広く利用されている。その計算手法として動的モード分解（dynamic mode decomposition, DMD）がよく用いられるが、非線形性の強い力学系ではデータの非線形変換が必要となる。本研究では、Koopman作用素に対して不変な関数空間を学習することでデータだけに基づく非線形DMDを実現する。
Taichi Kitamura, Naoya Takeishi andTakehisa Yairi, Koichi Hori
2017, Asia Pacific Conference of the Prognostics and Health Management Society, Jeju, Korea.
@conference{kitamuraAbnormalSoundDetection2017,
title = {Abnormal Sound Detection for Rotary Parts in Noisy Environment by One-Class {SVM} and Non-Negative Matrix Factorization.},
author = {Taichi Kitamura and Naoya Takeishi andTakehisa Yairi and Koichi Hori},
year = {2017},
note = {Asia Pacific Conference of the Prognostics and Health Management Society, Jeju, Korea},
}
Riku Sasaki, Naoya Takeishi, Takehisa Yairi, Koichi Hori, Kazunari Ide, Hiroyoshi Kubo
2017, Asia Pacific Conference of the Prognostics and Health Management Society, Jeju, Korea.
@conference{sasakiHealthMonitoringMethod2017,
title = {A Health Monitoring Method for Wind Power Generators With Hidden {Markov} and Probabilistic Principal Components Analysis Models},
author = {Riku Sasaki and Naoya Takeishi and Takehisa Yairi and Koichi Hori and Kazunari Ide and Hiroyoshi Kubo},
year = {2017},
note = {Asia Pacific Conference of the Prognostics and Health Management Society, Jeju, Korea},
}
武石 直也, 河原 吉伸, 矢入 健久
ベイズ的動的モード分解 Conference
2017, 第31回人工知能学会全国大会 (JSAI), 名古屋.
@conference{takeishiJSAI2017,
title = {ベイズ的動的モード分解},
author = {直也 武石 and 吉伸 河原 and 健久 矢入},
year = {2017},
note = {第31回人工知能学会全国大会 (JSAI), 名古屋},
}
動的モード分解（dynamic mode decomposition、DMD）は非線形力学系から得られた時系列データを解析する方法として注目されている。本研究では、DMDを確率的・ベイズ的に拡張し、観測ノイズの考慮、事後分布推論、自動モード数選択、混合モデル拡張などの適用例を示す。
秋元 康佑, 武石 直也, 堀 浩一, 矢入 健久
Markov logic networkを事前分布に持つ潜在変数モデルの検討 Conference
2017, 第31回人工知能学会全国大会 (JSAI), 名古屋.
@conference{akimotoJSAI2017,
title = {Markov logic networkを事前分布に持つ潜在変数モデルの検討},
author = {康佑 秋元 and 直也 武石 and 浩一 堀 and 健久 矢入},
year = {2017},
note = {第31回人工知能学会全国大会 (JSAI), 名古屋},
}
Markov logic networkは一階述語論理の論理式により構成される知識ベースをマルコフ確率場に変換し、知識ベースに基づく確率的な推論を行う手法である。本研究ではより漠然とした概念を含む知識に対応するため、このモデルを潜在変数モデルと組み合わせることにより各述語の取る真理値をあらかじめ既知と仮定せず、連続的な変数から確率的に推論できるように拡張できないかを検討した。
Naoya Takeishi, Takehisa Yairi
Dynamic Visual Simultaneous Localization and Mapping for Asteroid Exploration Conference
2016, the 13th International Symposium on Artificial Intelligence, Robotics and Automation in Space, Beijing, P.R.China.
@conference{takeishiDynamicVisualSimultaneous2016,
title = {Dynamic Visual Simultaneous Localization and Mapping for Asteroid Exploration},
author = {Naoya Takeishi and Takehisa Yairi},
year = {2016},
note = {the 13th International Symposium on Artificial Intelligence, Robotics and Automation in Space, Beijing, P.R.China},
}
In asteroid explorations, it is indispensable to estimate the shape of the target asteroid, which can be solved in a manner similar to one of simultaneous localization and mapping (SLAM). This work proposes a SLAM framework dedicated to the asteroid exploration, which considers both rigid body dynamics of the asteroid and motion of the spacecraft, estimating asteroid’s shape, centroid, rotational axis, angular velocity and phase, as well as spacecraft’s attitude and position relative to the asteroid. Experimental results with artificially generated data show that the proposed method can accurately estimate these quantities using images of a monocular camera and measurements of attitude and inertia sensors.
Kosuke Akimoto, Naoya Takeishi, Takehisa Yairi, Koichi Hori andNaoki Nishimura, Noboru Takata
Tree-Based Nonparametric Prediction of Normal Sensor Measurement Range Using Temporal Information Conference
2016, the 13th International Symposium on Artificial Intelligence, Robotics and Automation in Space, Beijing, P.R.China.
@conference{akimotoTreeBasedNonparametric2016,
title = {Tree-Based Nonparametric Prediction of Normal Sensor Measurement Range Using Temporal Information},
author = {Kosuke Akimoto and Naoya Takeishi and Takehisa Yairi and Koichi Hori andNaoki Nishimura and Noboru Takata},
year = {2016},
note = {the 13th International Symposium on Artificial Intelligence, Robotics and Automation in Space, Beijing, P.R.China},
}
Currently, limit-checking on telemetry sensor data of a spacecraft is widely used to detect its faults and anomalous behavior. Since classical limit-checking usually considers only a priori fixed pair of upper and lower bounds for each sensor variable, it sometimes fails to detect phenomena that are anomalous only in certain operating modes. To handle this problem, we present a method to predict normal ranges of sensor measurements adaptively based on status variables of telemetry data and temporal information. In the proposed method, a regression tree is learned using status variables, and each data point is labeled according to the terminal node of the tree it reached. Three new temporal features are generated from the sequence of the label, and a quantile regression forest is learned using both status variables and the generated features. Normal ranges are calculated from approximate distribution predicted using the quantile regression forest. We apply this method to actual telemetry data with simulated anomalies, and confirmed that the proposed method can detect temporal anomalies with a lower false alarm rate than the previous method.
Naoya Takeishi
Automatic Landmark Recognition for Asteroid by Image Features Conference
2013, the 29th International Symposium on Space Technology and Science, Nagoya, Japan.
@conference{takeishiAutomaticLandmarkRecognition2013,
title = {Automatic Landmark Recognition for Asteroid by Image Features},
author = {Naoya Takeishi},
year = {2013},
note = {the 29th International Symposium on Space Technology and Science, Nagoya, Japan},
}
In exploration missions of asteroids, we have to recognize visual signatures (landmarks) on an asteroid's surface to estimate the geometric shape of the asteroid and the relative position of the spacecraft. This recognition process was conducted manually in the mission of MUSES-C (Hayabusa), and it required a tremendous amount of time and efforts. The purpose of our work is to develop an automatic landmark recognition system. We used scale invariant feature transform, random sampling consensus, graph model of keypoint-match and relative position of keypoint-pair on rigid body. The system succeeded in recognizing landmarks on the asteroid's surface automatically within experimental images, while there was a little erroneous recognition. The error rate of recognition was about 2%. The landmarks detected with this system can be used to reconstruct the solid shape of the asteroid through techniques called structure from motion or simultaneous localization and mapping. Moreover, since some of the landmarks were easy for human operators to recognize, this system might be linked to the previous manual system.