Spark
Understanding Streaming in Spark
- Structured Streaming
- Built on top of Spark SQL Engine
- Handles continuously streaming data
- Improvement from Apache Spark Streaming
- Leverages DataFrame API
- Can be queried with any SQL query
- Use Cases - Real-time scenarios like:
- Sensors
- IoT
- social networks etc.