Parallel Gibbs Sampling and Neural Networks

Parallel in Variables (Vertexes):

General huge, undirected graph: each vertex is a variable (parallel sampling on a high dimension).

Single Node with multiple cores:

Split into two groups, with non-connected vertexes.
Conditionally independent. [1]
1. Parallel sample in Blue group.
2. Parallel sample in Green group.
(Order can be changed.)
  O(blue) + O(green)
Multiple nodes with multiple cores: Split the dataset
How to deal with the edges(borders)?
Is it reasonable for GS? Conditionally Independent? (I think this part need to be proved.)
Parallel on Neural Networks:
Same idea with the Neural Networks.
Parallel design for a requital network training, to improve efficiency.
Need to read more papers and then decide if it is a nice topic. I can find few papers, but not too many.

Published by Irene

Keep calm and update blog.

Leave a Reply

Fill in your details below or click an icon to log in: Logo

You are commenting using your account. Log Out /  Change )

Twitter picture

You are commenting using your Twitter account. Log Out /  Change )

Facebook photo

You are commenting using your Facebook account. Log Out /  Change )

Connecting to %s

%d bloggers like this: