Question

I have 2 column in data-frame label(1,2,3,4) and Signal label is Integer type and Signal is wrapped array (Signal: array (nullable = true) | |-- element: long (containsNull = true))

signal_list :one wrapped array contain 9k elements (sample data) 

-116, -123, -129, -133, -136, -137, -139, -140, -140, -141, -141, -142, -144, -145, -146, -146, -146, -146, -146, -144, -142, -139, -134, -130, -126, -123, -121, -119, -118, -116, -115, -113, -112, -110, -108, -106, -104, -101, -99, -97, -95, -92, -91, -88, -86, -84, -81, -78, -74, -70, -67, -64, -63, -62, -63, -65, -68, -70, -73, -76, -78, -80, -82, -84, -86, -88, -91, -93, -94, -95, -96, -97, -97, -96, -95, -94, -93, -92, -92, -93, -93, -93, -93, -92, -92, -91, -91, -90, -90, -89, -89, -89, -90, -90, -91, -91, -88, -86, -83, -82, -80, -78, -76, -73, -72, -70, -69, -69, -68, -67, -67, -67, -67, -67, -67, -67, -66, -65, -64, -63, -62, -61, -60, -60, -59, -57, -56, -54, -52, -47, -32, -20, -7, 5, 20, 29, 35, 40, 45, 47, 47, 44, 39, 32, 24, 17, 8, -1, -9


I want to convert this both into the vector.
i have used following 
val convertUDF = udf((array : Seq[Long]) => {
  Vector(array.toArray)
})

it gives wrapped array inside the vector
 [WrappedArray(-116, -123, -129, -133, -136, -137, -139, -140, -140)]

i want the only element in the vector and I want to ask one more thing will vector handle 9k elements.?

Answer 1

你可以试试这个：

SystemRoot

Answer 2

val convertUDF = udf((array : Seq[Long]) => {
  Vectors.dense(array.toArray.map(_.toDouble))
})

这对我有用

convert wrapped array[long] into vector in scala

2 个答案: