Previous works mainly focus on query on structured format data, which has been cleansed, filtered and offline processing. However, in big data or cloud computing scenarios, the incoming data is usually huge and need real-time processing. Building indices can reduce query execution time, but introduce issues like slow data updates.
In this paper, the people build up a tool called Dash, an elastic-search engine which provides real-time search and full-text search capability. The data flow is scheme-free, which means that two docs have same type can have different type of fields. The key idea is to use elastic search, which has the good property like scalability, near real-time processing. More precisely, the good performance is due to Apache Lucne's shard, RESTfull server's good charactoristics.
For the shortcoming, Dash lack security like authentication and access control. Furthermore, it is hard for nested query writing, and cannot support JOIN operation.
It is still useful since real-time analysis is important. I think it will still have impact in the future.
No comments:
Post a Comment