Recent questions tagged Distributed

0 votes

485 views

1 answer

distributed computing - What is a task in Spark? How does the Spark worker execute the jar file?

After reading some document on http://spark.apache.org/docs/0.8.0/cluster-overview.html, I got some question that ... .jar" step1 and so on? See Question&Answers more detail:os...

asked Oct 17, 2021 in Technique[技术] by 深蓝 (71.8m points)

0 votes

553 views

1 answer

distributed computing - How does Spark aggregate function - aggregateByKey work?

Say I have a distribute system on 3 nodes and my data is distributed among those nodes. for example, I have a ... the rows reside on each node? See Question&Answers more detail:os...

asked Oct 17, 2021 in Technique[技术] by 深蓝 (71.8m points)

0 votes

528 views

1 answer

distributed computing - What are workers, executors, cores in Spark Standalone cluster?

I read Cluster Mode Overview and I still can't understand the different processes in the Spark Standalone cluster ... the number of workers? See Question&Answers more detail:os...

asked Oct 17, 2021 in Technique[技术] by 深蓝 (71.8m points)

0 votes

534 views

1 answer

distributed computing - Spark - repartition() vs coalesce()

According to Learning Spark Keep in mind that repartitioning your data is a fairly expensive operation. Spark also has ... run, how can it avoid data movement? Question&Answers:os...

asked Oct 17, 2021 in Technique[技术] by 深蓝 (71.8m points)

0 votes

715 views

1 answer

distributed computing - TensorFlow Extended Kubeflow Multiple Workers

I have an issue with TFX on Kubeflow DAG Runner. Issues is that I managed to start only one ... //stackoverflow.com/questions/65846689/tensorflow-extended-kubeflow-multiple-workers...

asked Oct 7, 2021 in Technique[技术] by 深蓝 (71.8m points)

0 votes

491 views

1 answer

distributed system - How do raft nodes learn about peers?

I just finished the raft paper and am beginning work on an implementation. However, I realized I am a bit ... .com/questions/65914261/how-do-raft-nodes-learn-about-peers...

asked Oct 7, 2021 in Technique[技术] by 深蓝 (71.8m points)

0 votes

808 views

1 answer

distributed system - Does 2 phase locking need to keep the order of commands?

For example if we have the schedule S1 : r1[C] r2[A] r1[C] w3[B] w2[B] w1[C] commit1 r2[A] ... .com/questions/65922532/does-2-phase-locking-need-to-keep-the-order-of-commands...

asked Oct 7, 2021 in Technique[技术] by 深蓝 (71.8m points)

0 votes

691 views

1 answer

distributed computing - Why isn't RDBMS Partition Tolerant in CAP Theorem and why is it Available?

Two points I don't understand about RDBMS being CA in CAP Theorem : 1) It says RDBMS is not Partition Tolerant ... -rdbms-partition-tolerant-in-cap-theorem-and-why-is-it-available...

asked Oct 6, 2021 in Technique[技术] by 深蓝 (71.8m points)

0 votes

723 views

1 answer

distributed build icecream over vpn

Happy new year! I am trying to get iceccd daemon to connect to a remote icecc-scheduler over a VPN. On the remote ... things to try out or look for will be very much appreciated....

asked Feb 19, 2021 in Technique[技术] by 深蓝 (71.8m points)

0 votes

511 views

1 answer

distributed system - In Cassandra, why does a single value take precedence over quorum nodes empty response?

In Cassandra, tombstones are used in deletion since the writes are written to immutable files. I read that tombstones ... for gc grace seconds before clearing out the tombstones....

asked Feb 19, 2021 in Technique[技术] by 深蓝 (71.8m points)

0 votes

890 views

1 answer

distributed database - Derive the primary horizontal fragmentation of ASG using the foregoing information?

Consider relation ASG in Figure 3.3. Suppose there are two applications that access ASG. The first is ... primary horizontal fragmentation of ASG using the foregoing information...

asked Feb 19, 2021 in Technique[技术] by 深蓝 (71.8m points)

0 votes

718 views

1 answer

distributed database - Derive the primary horizontal fragmentation of ASG using the foregoing information?

Consider relation ASG in Figure 3.3. Suppose there are two applications that access ASG. The first is ... primary horizontal fragmentation of ASG using the foregoing information...

asked Feb 19, 2021 in Technique[技术] by 深蓝 (71.8m points)

Categories

Just Browsing Browsing

Most popular tags