Self-supervised Learning Method Using Transformer for Multi-dimensional Sensor Data Processing
Fuente:
arXiv
Saved in:
| Main Authors: | Kai, Haruki, Okita, Tsuyoshi |
|---|---|
| Format: | Preprint |
| Published: |
2025
|
| Subjects: | |
| Online Access: | |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
Similar Items
High-Performance Self-Supervised Learning by Joint Training of Flow Matching
by: Ukita, Kosuke, et al.
Published: (2025)
by: Ukita, Kosuke, et al.
Published: (2025)
Mathematical Reasoning via Intervention-Based Time-Series Causal Discovery Using LLMs as Concept Mastery Simulators
by: Okita, Tsuyoshi
Published: (2026)
by: Okita, Tsuyoshi
Published: (2026)
Intervention-Based Time Series Causal Discovery via Simulator-Generated Interventional Distributions
by: Okita, Tsuyoshi
Published: (2026)
by: Okita, Tsuyoshi
Published: (2026)
Excluding the Target Domain Improves Extrapolation: Deconfounded Hierarchical Physics Constraints
by: Okita, Tsuyoshi
Published: (2026)
by: Okita, Tsuyoshi
Published: (2026)
Physical Simulators as Do-Operators: Causal Discovery under Latent Confounders for AI-for-Science
by: Okita, Tsuyoshi
Published: (2026)
by: Okita, Tsuyoshi
Published: (2026)
Knowledge Distillation for Reservoir-based Classifier: Human Activity Recognition
by: Kagiyama, Masaharu, et al.
Published: (2025)
by: Kagiyama, Masaharu, et al.
Published: (2025)
Multimodal Foundation Model for Cross-Modal Retrieval and Activity Recognition Tasks
by: Matsuishi, Koki, et al.
Published: (2025)
by: Matsuishi, Koki, et al.
Published: (2025)
Computer Vision Self-supervised Learning Methods on Time Series
by: Lee, Daesoo, et al.
Published: (2021)
by: Lee, Daesoo, et al.
Published: (2021)
Deep Learning with Tabular Data: A Self-supervised Approach
by: Vyas, Tirth Kiranbhai
Published: (2024)
by: Vyas, Tirth Kiranbhai
Published: (2024)
Bridging the Physics-Data Gap with FNO-Guided Conditional Flow Matching: Designing Inductive Bias through Hierarchical Physical Constraints
by: Okita, Tsuyoshi
Published: (2025)
by: Okita, Tsuyoshi
Published: (2025)
Multi-instance Learning as Downstream Task of Self-Supervised Learning-based Pre-trained Model
by: Matsuishi, Koki, et al.
Published: (2025)
by: Matsuishi, Koki, et al.
Published: (2025)
Self-supervised and Multi-fidelity Learning for Extended Predictive Soil Spectroscopy
by: Sun, Luning, et al.
Published: (2025)
by: Sun, Luning, et al.
Published: (2025)
ECG-NAT: A Self-supervised Neighborhood Attention Transformer for Multi-lead Electrocardiogram Classification
by: Gazeran, Mahsa, et al.
Published: (2026)
by: Gazeran, Mahsa, et al.
Published: (2026)
Brain Hematoma Marker Recognition Using Multitask Learning: SwinTransformer and Swin-Unet
by: Hirata, Kodai, et al.
Published: (2025)
by: Hirata, Kodai, et al.
Published: (2025)
Semi-supervised Anomaly Detection via Adaptive Reinforcement Learning-Enabled Method with Causal Inference for Sensor Signals
by: Chen, Xiangwei, et al.
Published: (2024)
by: Chen, Xiangwei, et al.
Published: (2024)
Self-supervised Transformation Learning for Equivariant Representations
by: Yu, Jaemyung, et al.
Published: (2025)
by: Yu, Jaemyung, et al.
Published: (2025)
Self-supervised Graph Transformer with Contrastive Learning for Brain Connectivity Analysis towards Improving Autism Detection
by: Leng, Yicheng, et al.
Published: (2025)
by: Leng, Yicheng, et al.
Published: (2025)
Data-Efficient Contrastive Self-supervised Learning: Most Beneficial Examples for Supervised Learning Contribute the Least
by: Joshi, Siddharth, et al.
Published: (2023)
by: Joshi, Siddharth, et al.
Published: (2023)
Self-supervised Learning for Human Activity Recognition Using 700,000 Person-days of Wearable Data
by: Yuan, Hang, et al.
Published: (2022)
by: Yuan, Hang, et al.
Published: (2022)
A Self-supervised Learning Method for Raman Spectroscopy based on Masked Autoencoders
by: Ren, Pengju, et al.
Published: (2025)
by: Ren, Pengju, et al.
Published: (2025)
Semi-supervised CAPP Transformer Learning via Pseudo-labeling
by: Gross, Dennis, et al.
Published: (2026)
by: Gross, Dennis, et al.
Published: (2026)
Load-Aware Training Scheduling for Model Circulation-based Decentralized Federated Learning
by: Kainuma, Haruki, et al.
Published: (2025)
by: Kainuma, Haruki, et al.
Published: (2025)
Resource-efficient Layer-wise Federated Self-supervised Learning
by: Tun, Ye Lin, et al.
Published: (2024)
by: Tun, Ye Lin, et al.
Published: (2024)
Not All Data are Good Labels: On the Self-supervised Labeling for Time Series Forecasting
by: Yang, Yuxuan, et al.
Published: (2025)
by: Yang, Yuxuan, et al.
Published: (2025)
Adaptive Self-supervised Robust Clustering for Unstructured Data with Unknown Cluster Number
by: Ding, Chen-Lu, et al.
Published: (2024)
by: Ding, Chen-Lu, et al.
Published: (2024)
VIGraph: Generative Self-supervised Learning for Class-Imbalanced Node Classification
by: Hu, Yulan, et al.
Published: (2023)
by: Hu, Yulan, et al.
Published: (2023)
Multi-level Self-supervised Pretraining on Compositional Hierarchical Graph for Molecular Property Prediction
by: Liu, Xiayu, et al.
Published: (2026)
by: Liu, Xiayu, et al.
Published: (2026)
GraphSculptor: Sculpting Pre-training Coreset for Graph Self-supervised Learning
by: Liu, Chuang, et al.
Published: (2026)
by: Liu, Chuang, et al.
Published: (2026)
MiranDa: Mimicking the Learning Processes of Human Doctors to Achieve Causal Inference for Medication Recommendation
by: Wang, Ziheng, et al.
Published: (2024)
by: Wang, Ziheng, et al.
Published: (2024)
CryoLVM: Self-supervised Learning from Cryo-EM Density Maps with Large Vision Models
by: Fu, Weining, et al.
Published: (2026)
by: Fu, Weining, et al.
Published: (2026)
Self-supervised learning on gene expression data
by: Dradjat, Kevin, et al.
Published: (2025)
by: Dradjat, Kevin, et al.
Published: (2025)
Combating Data Imbalances in Federated Semi-supervised Learning with Dual Regulators
by: Bai, Sikai, et al.
Published: (2023)
by: Bai, Sikai, et al.
Published: (2023)
Two stages domain invariant representation learners solve the large co-variate shift in unsupervised domain adaptation with two dimensional data domains
by: Oshima, Hisashi, et al.
Published: (2024)
by: Oshima, Hisashi, et al.
Published: (2024)
SpeGCL: Self-supervised Graph Spectrum Contrastive Learning without Positive Samples
by: Shou, Yuntao, et al.
Published: (2024)
by: Shou, Yuntao, et al.
Published: (2024)
Parking Availability Prediction via Fusing Multi-Source Data with A Self-Supervised Learning Enhanced Spatio-Temporal Inverted Transformer
by: Huang, Yin, et al.
Published: (2025)
by: Huang, Yin, et al.
Published: (2025)
Anomaly Correction of Business Processes Using Transformer Autoencoder
by: Gong, Ziyou, et al.
Published: (2024)
by: Gong, Ziyou, et al.
Published: (2024)
TF-MCL: Time-frequency Fusion and Multi-domain Cross-Loss for Self-supervised Depression Detection
by: Zhao, Li-Xuan, et al.
Published: (2025)
by: Zhao, Li-Xuan, et al.
Published: (2025)
Knowledge Graph Reasoning with Self-supervised Reinforcement Learning
by: Ma, Ying, et al.
Published: (2024)
by: Ma, Ying, et al.
Published: (2024)
Learning to Optimise Climate Sensor Placement using a Transformer
by: Wang, Chen, et al.
Published: (2023)
by: Wang, Chen, et al.
Published: (2023)
Three-dimensional attention Transformer for state evaluation in real-time strategy games
by: Ye, Yanqing, et al.
Published: (2025)
by: Ye, Yanqing, et al.
Published: (2025)
Similar Items
-
High-Performance Self-Supervised Learning by Joint Training of Flow Matching
by: Ukita, Kosuke, et al.
Published: (2025) -
Mathematical Reasoning via Intervention-Based Time-Series Causal Discovery Using LLMs as Concept Mastery Simulators
by: Okita, Tsuyoshi
Published: (2026) -
Intervention-Based Time Series Causal Discovery via Simulator-Generated Interventional Distributions
by: Okita, Tsuyoshi
Published: (2026) -
Excluding the Target Domain Improves Extrapolation: Deconfounded Hierarchical Physics Constraints
by: Okita, Tsuyoshi
Published: (2026) -
Physical Simulators as Do-Operators: Causal Discovery under Latent Confounders for AI-for-Science
by: Okita, Tsuyoshi
Published: (2026)