Recent questions tagged HIVE

0 votes

803 views

1 answer

hive - Insert overwrite on partitioned table is not deleting the existing data

I am trying to run insert overwrite over a partitioned table. The select query of insert overwrite omits one ... in case of partitioned tables? See Question&Answers more detail:os...

asked Oct 24, 2021 in Technique[技术] by 深蓝 (71.8m points)

0 votes

617 views

1 answer

hive - Sqoop Import Split by Column Data type

Should the datatype of Split by column in sqoop import always be a number datatype (integer, bignint, numeric)? Can't it be a string? See Question&Answers more detail:os...

asked Oct 24, 2021 in Technique[技术] by 深蓝 (71.8m points)

0 votes

360 views

1 answer

hive - Amazon Elastic MapReduce - mass insert from S3 to DynamoDB is incredibly slow

I need to perform an initial upload of roughly 130 million items (5+ Gb total) into a single DynamoDB table. ... can I be doing wrong here. See Question&Answers more detail:os...

asked Oct 24, 2021 in Technique[技术] by 深蓝 (71.8m points)

0 votes

698 views

1 answer

hive - SQL most recent using row_number() over partition

I'm working with some web clicks data, and am just looking for the most recent page_name with the user_id visited (by a ... | 2 0002 | home | 1 See Question&Answers more detail:os...

asked Oct 24, 2021 in Technique[技术] by 深蓝 (71.8m points)

0 votes

427 views

1 answer

hive - Issues with executing multiple queries using Spark and HiveSQL

I am hoping someone can help me with this issue. Within spark-shell where if I attempt something like below: var ... ? Thanks in advanced!!! See Question&Answers more detail:os...

asked Oct 24, 2021 in Technique[技术] by 深蓝 (71.8m points)

0 votes

655 views

1 answer

hive - python cannot connect hiveserver2

I have tried use the example on https://cwiki.apache.org/confluence/display/Hive/Setting+Up+HiveServer2 but gets the ... version: thrift-0.9.1 See Question&Answers more detail:os...

asked Oct 24, 2021 in Technique[技术] by 深蓝 (71.8m points)

0 votes

627 views

1 answer

hive Expression Not In Group By Key

I create a table in HIVE. It has the following columns: id bigint, rank bigint, date string I want to get ... : Expression Not In Group By Key See Question&Answers more detail:os...

asked Oct 24, 2021 in Technique[技术] by 深蓝 (71.8m points)

0 votes

414 views

1 answer

hive - Why is Spark saveAsTable with bucketBy creating thousands of files?

Context Spark 2.0.1, spark-submit in cluster mode. I am reading a parquet file from hdfs: val spark = ... there options for this in Spark? See Question&Answers more detail:os...

asked Oct 24, 2021 in Technique[技术] by 深蓝 (71.8m points)

0 votes

386 views

1 answer

hive - How to calculate Median in spark sqlContext for column of data type double

I have given the sample table. I want to get the median from "value" column for each group "source" column. ... .scala) Thank you so much! See Question&Answers more detail:os...

asked Oct 17, 2021 in Technique[技术] by 深蓝 (71.8m points)

0 votes

846 views

1 answer

hive - Overwrite only some partitions in a partitioned spark Dataset

How can we overwrite a partitioned dataset, but only the partitions we are going to change? For example, ... are going to be written. See Question&Answers more detail:os...

asked Oct 17, 2021 in Technique[技术] by 深蓝 (71.8m points)

0 votes

806 views

1 answer

hive - Use collect_list and collect_set in Spark SQL

According to the docs, the collect_set and collect_list functions should be available in Spark SQL. However, I cannot ... to fix this? Thanx! See Question&Answers more detail:os...

asked Oct 17, 2021 in Technique[技术] by 深蓝 (71.8m points)

0 votes

468 views

1 answer

hive - What is the difference between Apache Spark SQLContext vs HiveContext?

What are the differences between Apache Spark SQLContext and HiveContext ? Some sources say that since the HiveContext ... using Apache Spark ? See Question&Answers more detail:os...

asked Oct 17, 2021 in Technique[技术] by 深蓝 (71.8m points)

Categories

Just Browsing Browsing

Most popular tags