org.apache.ignite.stream.kafka

Class KafkaStreamer<K,V>

java.lang.Object

org.apache.ignite.stream.StreamAdapter<kafka.message.MessageAndMetadata<byte[],byte[]>,K,V>

org.apache.ignite.stream.kafka.KafkaStreamer<K,V>

public class KafkaStreamer<K,V>
extends StreamAdapter<kafka.message.MessageAndMetadata<byte[],byte[]>,K,V>

Server that subscribes to topic messages from Kafka broker and streams its to key-value pairs into IgniteDataStreamer instance.

Uses Kafka's High Level Consumer API to read messages from Kafka.

See Also:

Consumer Consumer Group Example

Field Summary

Fields inherited from class org.apache.ignite.stream.StreamAdapter

ignite

Constructor Summary

Constructors

Constructor and Description
KafkaStreamer()

Method Summary

Modifier and Type	Method and Description
void	setConsumerConfig(kafka.consumer.ConsumerConfig consumerCfg) Sets the consumer config.
void	setRetryTimeout(long retryTimeout) Sets the retry timeout.
void	setThreads(int threads) Sets the threads.
void	setTopic(String topic) Sets the topic name.
void	start() Starts streamer.
void	stop() Stops streamer.

Methods inherited from class org.apache.ignite.stream.StreamAdapter

addMessage, getIgnite, getMultipleTupleExtractor, getSingleTupleExtractor, getStreamer, getTupleExtractor, setIgnite, setMultipleTupleExtractor, setSingleTupleExtractor, setStreamer, setTupleExtractor

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

KafkaStreamer

public KafkaStreamer()

Method Detail

setTopic

public void setTopic(String topic)

Sets the topic name.

Parameters:

topic - Topic name.

setThreads

public void setThreads(int threads)

Sets the threads.

Parameters:

threads - Number of threads.

setConsumerConfig

public void setConsumerConfig(kafka.consumer.ConsumerConfig consumerCfg)

Sets the consumer config.

Parameters:

consumerCfg - Consumer configuration.

setRetryTimeout

public void setRetryTimeout(long retryTimeout)

Sets the retry timeout.

Parameters:

retryTimeout - Retry timeout.

start

public void start()

Starts streamer.

Throws:

IgniteException - If failed.

stop

public void stop()

Stops streamer.