Description

Dremio is a data lake storage engine designed for data scientists and analysts. It enables users to make petabyte-level data self-service, empowering data consumers to run live, interactive queries directly against existing data lake storage, eliminating the creation, management, and governance risks associated with unnecessary data copies. Dremio leverages Gandiva/Apache Arrow to accelerate queries and BI dashboarding up to 100x, reduces compute costs and latency issues, and allows more workloads with existing hardware. Features include security controls, data lineage, an elastic deployment model, predictive pipelining for concurrent data fetch, data reflection, Columnar Cloud Cache (C3), full multi-tenancy, integration with data lake storage (such as S3, ADLS, HDFS, AWS, NoSQL and relational databases) and support of BI tools (including Looker, Power BI, Python, Qlik, Spark, SQL, and Tableau).