<p>Data streams are one of the most important components of big data platforms, as they enable decision-makers to obtain timely insights about a given phenomenon in near real-time. Though big data is often schemaless, little attention has been paid in the literature to schemaless streams. Streaming algorithms typically employ approximation and pre-aggregation strategies to efficiently provide analytical capabilities over data stream; however, the heterogeneous nature of records in a schemaless stream introduces challenges that make related proposals ineffective. In this paper, we propose an approach to overcome these challenges while formulating multidimensional analytical queries under the sliding window paradigm. The approach is called self-adaptive because it automatically keeps up with the heterogeneity of data while being able to propose an interesting query over the current window. The approach is discussed in full detail and evaluated in both terms of efficiency and effectiveness.</p>

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

Self-adaptive analytical querying over schemaless data streams

  • Chiara Forresi,
  • Matteo Francia,
  • Enrico Gallinucci,
  • Matteo Golfarelli

摘要

Data streams are one of the most important components of big data platforms, as they enable decision-makers to obtain timely insights about a given phenomenon in near real-time. Though big data is often schemaless, little attention has been paid in the literature to schemaless streams. Streaming algorithms typically employ approximation and pre-aggregation strategies to efficiently provide analytical capabilities over data stream; however, the heterogeneous nature of records in a schemaless stream introduces challenges that make related proposals ineffective. In this paper, we propose an approach to overcome these challenges while formulating multidimensional analytical queries under the sliding window paradigm. The approach is called self-adaptive because it automatically keeps up with the heterogeneity of data while being able to propose an interesting query over the current window. The approach is discussed in full detail and evaluated in both terms of efficiency and effectiveness.