Kafka Connect examples (9 Part Series)
1 Streaming data from Kafka to S3 – video walkthrough
2 Streaming data from Kafka to a Database – video walkthrough
… 5 more parts…
3 Kafka Connect JDBC Sink: tips & tricks – video walkthrough
4 Kafka Connect JDBC connector: installing a JDBC driver
5 Streaming data from Kafka to Elasticsearch – video walkthrough
6 Loading CSV data into Kafka – video walkthrough
7 Ingesting XML data into Kafka – Option 2: Kafka Connect plus Single Message Transform
8 Ingesting XML data into Kafka – Option 3: Kafka Connect FilePulse connector
9 Kafka Connect JDBC Sink deep-dive: Working with Primary Keys
Check out this tutorial on how to get data from Apache Kafka into a database using the JDBC Sink. The demo is based on MySQL but the connector works for any common database with a JDBC driver – Oracle, Postgres, MS SQL, DB2, etc etc.
Topics covered (click to go directly to that section):
- Populating some data into a test topic
- Creating the JDBC Sink
- Putting the JDBC driver in the correct place
- JDBC Sink connector in action
- Debugging the JDBC Sink connector
- INSERT vs UPSERT
- Dropping fields, adding metadata
- Evolving the target table schema
- JDBC Sink and schemas
- Working with JSON data and the JDBC Sink
- Applying a schema to JSON data with ksqlDB
- Working with CSV data and the JDBC Sink
You can see the instructions and demo code to try yourself here.
Leave a message in the comments with any suggestions for which Kafka Connect question or connector I should walk through next 🙂
Kafka Connect examples (9 Part Series)
1 Streaming data from Kafka to S3 – video walkthrough
2 Streaming data from Kafka to a Database – video walkthrough
… 5 more parts…
3 Kafka Connect JDBC Sink: tips & tricks – video walkthrough
4 Kafka Connect JDBC connector: installing a JDBC driver
5 Streaming data from Kafka to Elasticsearch – video walkthrough
6 Loading CSV data into Kafka – video walkthrough
7 Ingesting XML data into Kafka – Option 2: Kafka Connect plus Single Message Transform
8 Ingesting XML data into Kafka – Option 3: Kafka Connect FilePulse connector
9 Kafka Connect JDBC Sink deep-dive: Working with Primary Keys
原文链接:Streaming data from Kafka to a Database – video walkthrough
暂无评论内容