Spark RDD collectAsMap

- 1 min

collectAsMap [Pair]

collect函数相似,不过是用来将KV结构的RDD转换成scala map并返回

函数原型:

def collectAsMap(): Map[K, V]

例子:


val a = sc.parallelize(List(1, 2, 1, 3), 1)
val b = a.zip(a)
b.collectAsMap
res1: scala.collection.Map[Int,Int] = Map(2 -> 2, 1 -> 1, 3 -> 3)
comments powered by Disqus
rss facebook twitter github youtube mail spotify lastfm instagram linkedin google google-plus pinterest medium vimeo stackoverflow reddit quora