Example Elassandra-Kafka-Spark

This project is ment to demonstrate working with Elassandra,Kafka and Spark

Software involved

• docker (docker-compose)
• Elassandra
• Node

Requirements

• docker, docker-compose
• node
• npm

1. Run Docker Containers

Make sure you are in the root folder of the repository. Run the following command:

docker-compose up

After a minute or two, run the following command to make sure that the containers are up:

docker ps -a

2. Install the dependencies

npm install

3. Create the topic

docker exec -it kafka /opt/bitnami/kafka/bin/kafka-topics.sh \
    --create \
    --zookeeper zookeeper:2181 \
    --replication-factor 1 \
    --partitions 1 \
    --topic elassandra

4. Run the Consumer and Producer

npm run start:consumer

npm run start:producer

5. Check Cassandra for new data

docker exec -it example-elassandra-kafka-spark_elassandra_1 cqlsh