<img height="1" width="1" style="display:none" src="https://www.facebook.com/tr?id=315693165909440&amp;ev=PageView&amp;noscript=1">

Upstream

The Big Data Blog

Partitioning Data on S3 to Improve Performance in Athena/Presto

Aug 13, 2019 2:04:33 PM / by Eran Levy posted in Data Lake Platform, Amazon Athena, Data Lake ETL, AWS S3, Partitioning

 

Read More

Getting Data Lake ETL Right: 6 Guidelines for Evaluating Tools

Aug 6, 2019 2:52:11 PM / by Eran Levy posted in Database, Data Lake Platform, SQL, Data Lake ETL, Data infrastructure

 

Read More

Real-time Machine Learning: Hype vs Reality

Jul 23, 2019 2:38:27 PM / by Eran Levy posted in Data infrastructure, Machine learning, Data science, Real-time

 

Read More

Databricks Delta Lake vs Data Lake ETL: Overview and Comparison

Jul 18, 2019 3:01:18 PM / by Ori Rafael posted in Data Lake ETL, Delta Lake, Transactional Data

 

Read More

Introducing Upsolver Notebooks: Data Enrichment with SQL

Jul 2, 2019 3:36:39 PM / by Upsolver Team posted in Streaming Data, SQL

Read More

IoT Analytics: Challenges, Applications, and Innovations

Jun 20, 2019 4:56:09 PM / by Upsolver Team posted in Streaming Data, Internet of Things, Data Analytics, IoT

Read More

Upsolver Receives 2019 Rising Star and Premium Usability Awards from Finances Online

Jun 12, 2019 12:54:45 PM / by Upsolver Team posted in Awards, Finances Online

 

Read More

A Data Lake Approach to Event Stream Analytics

Jun 4, 2019 9:14:20 PM / by Ori Rafael posted in Database, Data Lake, Event Streams

 

Read More

ETL Pipelines for Kafka Data: Choosing the Right Approach

May 30, 2019 4:44:59 PM / by Eran Levy posted in Apache Kafka, Streaming Data, ETL

If you’re working with streaming data in 2019, odds are you’re using Kafka - either in its open-source distribution or as a managed service via Confluent or AWS. The stream processing platform, originally developed at LinkedIn and available under the Apache license, has become pretty much standard issue for event-based data, spanning diverse use cases from sensors to application logs to clicks on online advertisements.

Read More

4 Challenges of Using Databases for Streaming Data (and a Solution)

May 21, 2019 1:59:55 PM / by Eran Levy posted in Big Data, Database, Streaming Data

 

Read More