Hacker Read

pchristensen · 2015-02-06 20:58:14

Pedestal Client from Cognitect did this - see https://github.com/pedestal/app-tutorial/wiki/Parallel-Proce... and my notes at http://pchristensen.com/blog/articles/pedestal-tutorial-part... (under "Parallel Processing").

Too bad they stopped working on it.

reply

chrispeel | karma 863 | avg karma 2.28 · | 2016-03-13 15:18:34+00:00

I agree, this would be good. Intel's ParallelAccelerator.jl [1] is making some progress in this area.

[1] http://julialang.org/blog/2016/03/parallelaccelerator

reply

dmose | karma 39 | avg karma 0.81 · | 2008-05-30 14:53:49+00:00

I second that.. also check ms research parallel task library, very cool stuff.

Here's a primer video

http://channel9.msdn.com/Showpost.aspx?postid=384229

reply

simonblanke | karma 37 | avg karma 1.37 · | 2021-02-28 15:01:21

Your parallel computing approach sounds intriguing! Could you provide an example script? I would like to look into this. If you like you could open an issue as a feature request and provide a code snipped there.

jgalt212 | karma 2685 | avg karma 0.84 · | 2015-01-11 13:30:49

Here's a crazy idea:

Cognitect creates a massively parallel CPU which fully demonstrates the power of parallel programming via Clojure.

ClojureMachines.com

reply

pdimitar | karma 9735 | avg karma 1.68 · | 2021-01-29 18:27:44+00:00

Wasn't aware of that one and it looks very promising, thank you. Does it work with `parallel`? Or does it have a similar built-in facility itself?

webmaven | karma 13964 | avg karma 2.46 · | 2014-07-14 15:23:13

Better starting point: https://medium.com/@thechriskiehl/parallelism-in-one-line-40...

JoeAltmaier | karma 27896 | avg karma 1.44 · | 2014-08-10 14:11:49

Definitely THAT can be parallelized. Just play the field!

known | karma 12202 | avg karma 1.61 · | 2014-08-27 17:07:37

https://www.gnu.org/software/parallel/parallel_tutorial.html is very handy

bkendzior | karma 2 | avg karma 1.0 · | 2016-12-01 19:13:22+00:00

You can set up parallelism manually, yes.

ses1984 | karma 2112 | avg karma 2.55 · | 2020-01-28 15:13:50

In the blog post you linked, a library for parallelism is used.

zmanian | karma 3964 | avg karma 7.52 · | 2011-05-13 05:35:14+00:00

Here is a related paper. http://research.microsoft.com/en-us/um/people/simonpj/papers...

rramadass | karma 3951 | avg karma 1.65 · | 2023-03-10 08:40:58

I suggest you also take a look at Parallel Programming: Concepts and Practice by Bertil Schmidt et al.

mynewtb | karma 1183 | avg karma 2.64 · | 2016-12-26 14:02:10+00:00

What was it that you tried to achieve? I find it very easy for trivial parallelisation over files but am quickly lost when it becomes more complex.

jotato | karma 327 | avg karma 2.03 · | 2012-12-04 20:58:51+00:00

Yes, I have used them heavily and just like any other tool you need to know when to use it. You fully misunderstand my statement, and that is probably my fault for being succinct. I wasn't saying that parallelism is the one-all solution, but rather I wouldn't shrug the research off as fallacy when they have a history of delivering.

leephillips | karma 21974 | avg karma 3.76 · | 2020-07-15 18:46:03+00:00

Consider Julia. It has parallel processing built in, and uses MPI under the hood.

pdimitar | karma 9735 | avg karma 1.68 · | 2023-08-21 07:54:00

Never knew about this, thanks! I'll definitely try it because `parallel` has bitten me before in a few more advanced cases. It has rough edges here and there.

damassive | karma 3 | avg karma 1.0 · | 2017-06-23 17:51:51+00:00

Yes! Thank you! Have you done any parallel programming?

adwf | karma 1743 | avg karma 2.55 · | 2014-06-29 14:13:57

I'd hope they'd also first think of:

(reduce #'+ list-of-numbers)

Then using a library like lparallel [1], you can convert it to the parallel version easily:

(preduce '+ list-of-numbers)

[1] http://lparallel.org/preduce/

reply

rpwverheij | karma 96 | avg karma 0.83 · | 2014-04-18 17:01:51

yes I'd be interested to see that too. I mean, ultimately, a unified method for cross browser parallel computing should only be a matter of time right?