Learning from the Past: Adaptive Parallelism Tuning for Stream Processing Systems
Fuente:
arXiv
Saved in:
| Main Authors: | Han, Yuxing, Chen, Lixiang, Wang, Haoyu, Chen, Zhanghao, Zhang, Yifan, Yang, Chengcheng, Hao, Kongzhang, Yang, Zhengyi |
|---|---|
| Format: | Preprint |
| Published: |
2025
|
| Subjects: | |
| Online Access: | |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
Similar Items
StreamShield: A Production-Proven Resiliency Solution for Apache Flink at ByteDance
by: Fang, Yong, et al.
Published: (2026)
by: Fang, Yong, et al.
Published: (2026)
PDSP-Bench: A Benchmarking System for Parallel and Distributed Stream Processing
by: Agnihotri, Pratyush, et al.
Published: (2025)
by: Agnihotri, Pratyush, et al.
Published: (2025)
AgileDART: An Agile and Scalable Edge Stream Processing Engine
by: Ching, Cheng-Wei, et al.
Published: (2024)
by: Ching, Cheng-Wei, et al.
Published: (2024)
Lion: Minimizing Distributed Transactions through Adaptive Replica Provision (Extended Version)
by: Zheng, Qiushi, et al.
Published: (2024)
by: Zheng, Qiushi, et al.
Published: (2024)
Parallel R-tree-based Spatial Query Processing on a Commercial Processing-in-Memory System
by: Jannat, Tasmia, et al.
Published: (2026)
by: Jannat, Tasmia, et al.
Published: (2026)
CheetahGIS: Architecting a Scalable and Efficient Streaming Spatial Query Processing System
by: Cao, Jiaping, et al.
Published: (2025)
by: Cao, Jiaping, et al.
Published: (2025)
Streaming SQL Multi-Way Join Method for Long State Streams
by: Hu, Jinlong, et al.
Published: (2024)
by: Hu, Jinlong, et al.
Published: (2024)
Runtime-optimized Multi-way Stream Join Operator for Large-scale Streaming data
by: Hu, Jinlong, et al.
Published: (2024)
by: Hu, Jinlong, et al.
Published: (2024)
Streaming CityJSON datasets
by: Ledoux, Hugo, et al.
Published: (2024)
by: Ledoux, Hugo, et al.
Published: (2024)
ACGraph: An Efficient Asynchronous Out-of-Core Graph Processing Framework
by: Chen, Dechuang, et al.
Published: (2025)
by: Chen, Dechuang, et al.
Published: (2025)
Styx: Transactional Stateful Functions on Streaming Dataflows
by: Psarakis, Kyriakos, et al.
Published: (2023)
by: Psarakis, Kyriakos, et al.
Published: (2023)
CheckMate: Evaluating Checkpointing Protocols for Streaming Dataflows
by: Siachamis, George, et al.
Published: (2024)
by: Siachamis, George, et al.
Published: (2024)
Odyssey: An End-to-End System for Pareto-Optimal Serverless Query Processing
by: Jesalpura, Shyam, et al.
Published: (2025)
by: Jesalpura, Shyam, et al.
Published: (2025)
DIMS: Distributed Index for Similarity Search in Metric Spaces
by: Zhu, Yifan, et al.
Published: (2024)
by: Zhu, Yifan, et al.
Published: (2024)
Data Backup System with No Impact on Business Processing Utilizing Storage and Container Technologies
by: Watanabe, Satoru
Published: (2024)
by: Watanabe, Satoru
Published: (2024)
Democratizing Scalable Cloud Applications: Transactional Stateful Functions on Streaming Dataflows
by: Psarakis, Kyriakos
Published: (2025)
by: Psarakis, Kyriakos
Published: (2025)
Flock: A Low-Cost Streaming Query Engine on FaaS Platforms
by: Liao, Gang, et al.
Published: (2023)
by: Liao, Gang, et al.
Published: (2023)
Embedding Samples Dispatching for Recommendation Model Training in Edge Environments
by: Li, Guopeng, et al.
Published: (2025)
by: Li, Guopeng, et al.
Published: (2025)
Fine-Grained Modeling and Optimization for Intelligent Resource Management in Big Data Processing
by: Lyu, Chenghao, et al.
Published: (2022)
by: Lyu, Chenghao, et al.
Published: (2022)
Probabilistic Top-k Dominating Query Monitoring over Multiple Uncertain IoT Data Streams in Edge Computing Environments
by: Lai, Chuan-Chi, et al.
Published: (2019)
by: Lai, Chuan-Chi, et al.
Published: (2019)
TierBase: A Workload-Driven Cost-Optimized Key-Value Store
by: Shen, Zhitao, et al.
Published: (2025)
by: Shen, Zhitao, et al.
Published: (2025)
Batch Query Processing and Optimization for Agentic Workflows
by: Shen, Junyi, et al.
Published: (2025)
by: Shen, Junyi, et al.
Published: (2025)
A Context-Aware Knowledge Graph Platform for Stream Processing in Industrial IoT
by: Sciarroni, Monica Marconi, et al.
Published: (2026)
by: Sciarroni, Monica Marconi, et al.
Published: (2026)
Towards Serverless Processing of Spatiotemporal Big Data Queries
by: Baumann, Diana, et al.
Published: (2025)
by: Baumann, Diana, et al.
Published: (2025)
EdgeMiner: Distributed Process Mining at the Data Sources
by: Andersen, Julia, et al.
Published: (2024)
by: Andersen, Julia, et al.
Published: (2024)
A Pragmatic Approach to Learned Indexing in RocksDB: Targeted Optimizations with Minimal System Modification
by: Vashisth, Shubham, et al.
Published: (2026)
by: Vashisth, Shubham, et al.
Published: (2026)
Scalable Graph Indexing using GPUs for Approximate Nearest Neighbor Search
by: Li, Zhonggen, et al.
Published: (2025)
by: Li, Zhonggen, et al.
Published: (2025)
A Case Study on Virtual and Physical I/O Throughputs
by: Mirzoev, T., et al.
Published: (2025)
by: Mirzoev, T., et al.
Published: (2025)
EdgeServe: A Streaming System for Decentralized Model Serving
by: Shaowang, Ted, et al.
Published: (2023)
by: Shaowang, Ted, et al.
Published: (2023)
MergePipe: A Budget-Aware Parameter Management System for Scalable LLM Merging
by: Wang, Yuanyi, et al.
Published: (2026)
by: Wang, Yuanyi, et al.
Published: (2026)
Do GPUs Really Need New Tabular File Formats?
by: Luo, Jigao, et al.
Published: (2026)
by: Luo, Jigao, et al.
Published: (2026)
FluxSieve: Unifying Streaming and Analytical Data Planes for Scalable Cloud Observability
by: Vogel, Adriano, et al.
Published: (2026)
by: Vogel, Adriano, et al.
Published: (2026)
ZipLLM: Efficient LLM Storage via Model-Aware Synergistic Data Deduplication and Compression
by: Wang, Zirui, et al.
Published: (2025)
by: Wang, Zirui, et al.
Published: (2025)
Data Caching for Enterprise-Grade Petabyte-Scale OLAP
by: Tang, Chunxu, et al.
Published: (2024)
by: Tang, Chunxu, et al.
Published: (2024)
Ira: Efficient Transaction Replay for Distributed Systems
by: Bhat, Adithya, et al.
Published: (2026)
by: Bhat, Adithya, et al.
Published: (2026)
Demystifying Object-based Big Data Storage Systems
by: Mondal, Anindita Sarkar, et al.
Published: (2024)
by: Mondal, Anindita Sarkar, et al.
Published: (2024)
Did we miss P In CAP? Partial Progress Conjecture under Asynchrony
by: Chen, Junchao, et al.
Published: (2024)
by: Chen, Junchao, et al.
Published: (2024)
SwitchDelta: Asynchronous Metadata Updating for Distributed Storage with In-Network Data Visibility
by: Li, Junru, et al.
Published: (2025)
by: Li, Junru, et al.
Published: (2025)
Performance Optimization in Stream Processing Systems: Experiment-Driven Configuration Tuning for Kafka Streams
by: Chen, David, et al.
Published: (2026)
by: Chen, David, et al.
Published: (2026)
Context Lake: A System Class Defined by Decision Coherence
by: Jiang, Xiaowei
Published: (2026)
by: Jiang, Xiaowei
Published: (2026)
Similar Items
-
StreamShield: A Production-Proven Resiliency Solution for Apache Flink at ByteDance
by: Fang, Yong, et al.
Published: (2026) -
PDSP-Bench: A Benchmarking System for Parallel and Distributed Stream Processing
by: Agnihotri, Pratyush, et al.
Published: (2025) -
AgileDART: An Agile and Scalable Edge Stream Processing Engine
by: Ching, Cheng-Wei, et al.
Published: (2024) -
Lion: Minimizing Distributed Transactions through Adaptive Replica Provision (Extended Version)
by: Zheng, Qiushi, et al.
Published: (2024) -
Parallel R-tree-based Spatial Query Processing on a Commercial Processing-in-Memory System
by: Jannat, Tasmia, et al.
Published: (2026)