Imagen de Portada

Efficient Data Ingestion in Cloud-based architecture: a Data Engineering Design Pattern Proposal

Fuente: arXiv

Guardado en:

Detalles Bibliográficos
Autores principales:	Rucco, Chiara, Longo, Antonella, Saad, Motaz
Formato:	Preprint
Publicado:	2025
Materias:	Databases
Acceso en línea:	Acceder al recurso
Etiquetas:	Agregar Etiqueta Sin Etiquetas, Sea el primero en etiquetar este registro!

Ejemplares similares

Formalizing ETLT and ELTL Design Patterns and Proposing Enhanced Variants: A Systematic Framework for Modern Data Engineering
por: Rucco, Chiara, et al.
Publicado: (2025)

Designing Data Spaces: Navigating the European Initiatives Along Technical Specifications
por: Martella, Angelo, et al.
Publicado: (2025)

MatrixGate: A High-performance Data Ingestion Tool for Time-series Databases
por: Wang, Shuhui, et al.
Publicado: (2024)

CANDY: A Benchmark for Continuous Approximate Nearest Neighbor Search with Dynamic Data Ingestion
por: Zeng, Xianzhi, et al.
Publicado: (2024)

RADx Data Hub: A Cloud Platform for FAIR, Harmonized COVID-19 Data
por: Martinez-Romero, Marcos, et al.
Publicado: (2025)

Automatic String Data Validation with Pattern Discovery
por: Lin, Xinwei, et al.
Publicado: (2024)

Blueprinting the Cloud: Unifying and Automatically Optimizing Cloud Data Infrastructures with BRAD -- Extended Version
por: Yu, Geoffrey X., et al.
Publicado: (2024)

Intra-Query Runtime Elasticity for Cloud-Native Data Analysis
por: Zhang, Xukang, et al.
Publicado: (2025)

Skyrise: Exploiting Serverless Cloud Infrastructure for Elastic Data Processing
por: Bodner, Thomas, et al.
Publicado: (2025)

ByteHouse: ByteDance's Cloud-Native Data Warehouse for Real-Time Multimodal Data Analytics
por: Han, Yuxing, et al.
Publicado: (2026)

Unveiling Challenges for LLMs in Enterprise Data Engineering
por: Bodensohn, Jan-Micha, et al.
Publicado: (2025)

Towards Next Generation Data Engineering Pipelines
por: Kramer, Kevin M., et al.
Publicado: (2025)

SQLAgent: Learning to Explore Before Generating as a Data Engineer
por: Jiang, Wenjia, et al.
Publicado: (2026)

An Empirical Evaluation of Serverless Cloud Infrastructure for Large-Scale Data Processing
por: Bodner, Thomas, et al.
Publicado: (2025)

Brame: Hierarchical Data Management Framework for Cloud-Edge-Device Collaboration
por: Liu, Xianglong, et al.
Publicado: (2025)

SafeLoad: Efficient Admission Control Framework for Identifying Memory-Overloading Queries in Cloud Data Warehouses
por: Wu, Yifan, et al.
Publicado: (2026)

Designing a Secure, Scalable, and Cost-Effective Cloud Storage Solution: A Novel Approach to Data Management using NextCloud, TrueNAS, and QEMU/KVM
por: Aryan, Prakash, et al.
Publicado: (2024)

Evaluating Continuous Basic Graph Patterns over Dynamic Link Data Graphs
por: Gergatsoulis, Manolis, et al.
Publicado: (2022)

TCDRM: A Tenant Budget-Aware Data Replication Framework for Multi-Cloud Computing
por: Bernardin, Santatra Hagamalala, et al.
Publicado: (2025)

AI-Driven Generation of Data Contracts in Modern Data Engineering Systems
por: Bhoite, Harshraj
Publicado: (2025)

A Comprehensive Scalable Framework for Cloud-Native Pattern Detection with Enhanced Expressiveness
por: Mavroudopoulos, Ioannis, et al.
Publicado: (2024)

Task Cascades for Efficient Unstructured Data Processing
por: Shankar, Shreya, et al.
Publicado: (2026)

FREYJA: Efficient Join Discovery in Data Lakes
por: Maynou, Marc, et al.
Publicado: (2024)

A Database Engineered System for Big Data Analytics on Tornado Climatology
por: Bian, Fengfan, et al.
Publicado: (2024)

LASER: A Data-Centric Method for Low-Cost and Efficient SQL Rewriting based on SQL-GRPO
por: Li, Jiahui, et al.
Publicado: (2026)

HistogramTools for Efficient Data Analysis and Distribution Representation in Large Data Sets
por: Malhotra, Shubham
Publicado: (2025)

Accelerating Transfer Learning with Near-Data Computation on Cloud Object Stores
por: Petrescu, Diana, et al.
Publicado: (2022)

Spezi Data Pipeline: Streamlining FHIR-based Interoperable Digital Health Data Workflows
por: Bikia, Vasiliki, et al.
Publicado: (2025)

Efficient Mining of Low-Utility Sequential Patterns
por: Zhu, Jian, et al.
Publicado: (2025)

Validating Temporal Compliance Patterns: A Unified Approach with $MTL_f$ over various Data Models
por: Zaki, Nesma M., et al.
Publicado: (2024)

Efficient Data Valuation Approximation in Federated Learning: A Sampling-based Approach
por: Wei, Shuyue, et al.
Publicado: (2025)

Utility-based Privacy Preserving Data Mining
por: Zhou, Qingfeng, et al.
Publicado: (2025)

Enabling Data Dependency-based Query Optimization
por: Lindner, Daniel, et al.
Publicado: (2024)

Toward a Cognitive Data Model: Exploring a Mind-Inspired Approach to Database Design
por: Pieris, Dhammika
Publicado: (2025)

Turning Multidimensional Big Data Analytics into Practice: Design and Implementation of ClustCube Big-Data Tools in Real-Life Scenarios
por: Cuzzocrea, Alfredo, et al.
Publicado: (2024)

Marlin: Efficient Coordination for Autoscaling Cloud DBMS (Extended Version)
por: Hu, Wenjie, et al.
Publicado: (2025)

Efficient Rare Temporal Pattern Mining in Time Series
por: Long, Van Ho, et al.
Publicado: (2024)

Data Guard: A Fine-grained Purpose-based Access Control System for Large Data Warehouses
por: Tran, Khai, et al.
Publicado: (2025)

Enzyme: Incremental View Maintenance for Data Engineering
por: Yadav, Ritwik, et al.
Publicado: (2026)

Efficient and Effective Table-Centric Table Union Search in Data Lakes
por: Sun, Yongkang, et al.
Publicado: (2026)