Query S3 data using Amazon Athena
Introduction Amazon Athena is a interactive query service for S3. It provides SQL interface for your S3 bucket data. There is no separate data lake needed for this and actual data resides in S3 and Athena provide Query platform for the
Apache Kafka consume and produce messages using Kafka CLI command
“kafka-console-producer” and “kafka-console-consumer” command Is used for testing topic message delivery and efficient utility for testing our topic and Apache Kafka environment. We need to specify our Kafka instance / port and topic name as parameter for these commands Kafka Consume
Manage Kafka Topics Using Topic CLI command.
Here we will go through Kafka Topic CLI command to Create and Describe topics. Make sure Apache Kafka and Zookeeper is running before we start using CLI command. If you are new to Apache Kafka, Please go through Kafka Introduction,
Understanding Apache Kafka Topics Partitions and Brokers.
Here we will go through some of the Apache Kafka theory concepts and terms. If you are new to Apache Kafka, Please read Apache Kafka introduction and Installation on windows post before you read this article. This is extremely
Install Apache Kafka on Windows
Hope you are clear about Apache Kafka introduction through my previous post. Here we will go through how we can install Apache Kafka on Windows. STEP 1: Install JAVA 8 SDK Make sure you installed JAVA 8 SDK on your
Apache Kafka Introduction
Apache Kafka allows you to decouple the data streams and system. It is a bridge between your source system and target system. It is created by LinkedIn, Now Open source project maintained by confluent. It is powerful distributed data streaming platform