Bookmarks (64) clear filters

Presto Poised for a Breakout Year as Data Explosion Continues — Presto is a federated SQL query engine developed at Facebook as a follow-on to Apache Hive and its popularity is growing. Facebook uses it for running interactive queries against several internal data stores, including their 300PB data warehouse.

Data Headaches Targeted with a Dose of .BIG — .BIG is a new data file format developed by Exponam to address issues around transferring and sharing large datasets (i.e. where 100 million row CSV files just won’t cut it). It has some similarities to Parquet but with huge compression advantages.

Why Databases Are Needed on the Edge — The proliferation of smart devices and the IoT are putting pressure on developers to adopt more sophisticated processes to manage data.

Pandemic Driving ‘Back to Basics’ in Big Data, Study Suggests — Much as riskier equities tend to get abandoned during crisis times, so too with more fanciful big data projects, it seems. BI and data visualization use is up at the expense of AI and machine learning.

Cassandra Adoption Correlates with Experience — A usage survey has found that Apache Cassandra is predominantly used by companies that consider their operations to be ‘highly advanced’ but a skills gap remains (so if you’re looking for a good database job, Cassandra may well be worth learning..)

Oracle Touts an Exadata Backlog — Oracle reported modest revenue growth in its latest quarter and said that moving more of its flagship database software to the cloud remained a priority. It also noted strong demand for its Exadata platform.

10 Exciting Big Data Statistics — Some fun stats that Datanami has pulled from a variety of places including that the ‘global datasphere’ will be 175 zettabytes (175 billion terabytes) in size by 2025 and that more data is created every hour in 2020 than in the entire of the year 2000. No wonder database technology remains a hot sector!

Cassandra Gets an Indexing Upgrade — A new data storage framework for indexing on Apache Cassandra released this week by DataStax is aimed at easing adoption by eliminating tradeoffs between scale, stability and performance.

How Facebook Accelerates SQL at Extreme Scale — Serving SQL queries on a petabyte of data is one thing, but delivering it at Facebook’s scale is something else entirely. They’ve used an open source virtual distributed file system called Alluxio to do it..

Microsoft Now Developing Its Own Hadoop — Microsoft’s Azure division is working on its own distribution of Hadoop under its ‘HDInsight’ brand.

Make it Automatic: A Future of Tuning SQL with AI? — Most DBAs, as well as developers, do database and SQL query performance tuning manually, whether by intuition or based on the results of tooling and benchmarks. But what if AI could pick up some of the workload? No tech here, just high level thoughts on the potential.

R and Python: The Data Science Dynamic Duo? — Apparently “the language R is in the midst of a sizzling resurgence this summer.” And it’s not hurting Python either.

Big Data Apps Wasting Billions in the Cloud — Where there are big budgets and huge amounts of data, there’s going to be wasted capacity, and Pepperdata has dug into just how much.

Persistent Memory Can Change the Way Enterprises Navigate Advanced Analytics — IDC’s predicts 175 zettabytes of data will exist in the world by 2025 and Intel’s Alper Ilkbahar thinks an increasing amount of it will be kept ‘hot’ closer to the CPU for rapid analysis and use.

Left for Dead, R Surges Again — “Don’t look now, but R, which some had written off as a language in terminal decline in lieu of Python’s immense and growing popularity, appears to be staging a furious comeback.”

Data Prep Still Dominates Data Scientists’ Time, Survey Finds — “Data scientists spend about 45% of their time on data preparation tasks” allegedly. I think there’s still a lot of opportunity to build and grow new data preparation systems as it’s an often overlooked area.

Bitnine Looks to Scale PostgreSQL with AGE — AgensGraph is a transactional graph database built on Postgres but has now morphed into a new project called AGE and is being incubated by Apache.