Welcome toVigges Developer Community-Open, Learning,Share
Welcome To Ask or Share your Answers For Others

Categories

0 votes
230 views
in Technique[技术] by (71.8m points)

What is the right way to config Flink parallelism?

I am working on a Flink project which requests lots of computation in each operator. I am not sure how should I config the parallelism. It looks like Flink would like to deploy all the instances of each operator to the first taskmanger first and then deploy other parallelisms to the rest of taskmanagers accordingly.

This approach ends up waste lots of resources. For example, assume we total have 4 taksmanagers. We have operators A and B, the parallelism is 2 and 2. And Operator B request lots of resource for computation. Is it possible to deploy operator A in taskmanager 1 and 2 and deploy operator B in taskmanger 3 and 4. This helps to utilize the resources. Otherwise, operators A and B are going to share the resource in the same taskmanager.


与恶龙缠斗过久,自身亦成为恶龙;凝视深渊过久,深渊将回以凝视…
Welcome To Ask or Share your Answers For Others

1 Answer

0 votes
by (71.8m points)
等待大神答复

与恶龙缠斗过久,自身亦成为恶龙;凝视深渊过久,深渊将回以凝视…
Welcome to Vigges Developer Community for programmer and developer-Open, Learning and Share
...