개발 환경 세팅 & Job 제출

 docker-compose.yml 로 flink cluster 시작

version: '2'
services:
  jobmanager:
    image: flink:1.18.1-scala_2.12-java17
    ports:
      - "8081:8081"
    command: jobmanager
    environment:
      - |
        FLINK_PROPERTIES=
        jobmanager.rpc.address: jobmanager        
    volumes:
      - /mnt/c:/opt/flink/c

  taskmanager:
    image: flink:1.18.1-scala_2.12-java17
    depends_on:
      - jobmanager
    command: taskmanager
    scale: 1
    environment:
      - |
        FLINK_PROPERTIES=
        jobmanager.rpc.address: jobmanager
        taskmanager.numberOfTaskSlots: 2
    volumes:
      - /mnt/c:/opt/flink/c

 

아래 명령어로 flink cluster 시작

• 외부 /mnt/c 위치를 volume mount 해 놓음

docker compose up

 

 

container 에 접속

docker exec -it flink-jobmanager-1 /bin/bash

 

 

example job 제출

WordCount.java

bin/flink run -c com.github.windbird.WordCountExample WordCount.jar --input wc.txt

 

Local dashboard 보기

http://localhost:8081/