m8ta
use https for features.
text: sort by
tags: modified
type: chronology
[0] Brockwell AE, Rojas AL, Kass RE, Recursive bayesian decoding of motor cortical signals by particle filtering.J Neurophysiol 91:4, 1899-907 (2004 Apr)

{1534}
hide / / print
ref: -2020 tags: current opinion in neurobiology Kriegeskorte review article deep learning neural nets circles date: 02-23-2021 17:40 gmt revision:2 [1] [0] [head]

Going in circles is the way forward: the role of recurrence in visual inference

I think the best part of this article are the references -- a nicely complete listing of, well, the current opinion in Neurobiology! (Note that this issue is edited by our own Karel Svoboda, hence there are a good number of Janelians in the author list..)

The gestalt of the review is that deep neural networks need to be recurrent, not purely feed-forward. This results in savings in overall network size, and increase in the achievable computational complexity, perhaps via the incorporation of priors and temporal-spatial information. All this again makes perfect sense and matches my sense of prevailing opinion. Of course, we are left wanting more: all this recurrence ought to be structured in some way.

To me, a rather naive way of thinking about it is that feed-forward layers cause weak activations, which are 'amplified' or 'selected for' in downstream neurons. These neurons proximally code for 'causes' or local reasons, based on the supported hypothesis that the brain has a good temporal-spatial model of the visuo-motor world. The causes then can either explain away the visual input, leading to balanced E-I, or fail to explain it, in which the excess activity is either rectified by engaging more circuits or engaging synaptic plasticity.

A critical part of this hypothesis is some degree of binding / disentanglement / spatio-temporal re-assignment. While not all models of computation require registers / variables -- RNNs are Turning-complete, e.g., I remain stuck on the idea that, to explain phenomenological experience and practical cognition, the brain much have some means of 'binding'. A reasonable place to look is the apical tuft dendrites, which are capable of storing temporary state (calcium spikes, NMDA spikes), undergo rapid synaptic plasticity, and are so dense that they can reasonably store the outer-product space of binding.

There is mounting evidence for apical tufts working independently / in parallel is investigations of high-gamma in ECoG: PMID-32851172 Dissociation of broadband high-frequency activity and neuronal firing in the neocortex. "High gamma" shows little correlation with MUA when you differentiate early-deep and late-superficial responses, "consistent with the view it reflects dendritic processing separable from local neuronal firing"

{1267}
hide / / print
ref: -0 tags: stretchable nanoparticle conductors gold polyurethane flocculation date: 12-13-2013 02:12 gmt revision:5 [4] [3] [2] [1] [0] [head]

PMID-23863931 Stretchable nanoparticle conductors with self-organized conductive pathways.

  • 13nm gold nanoparticles, citrate-stabilized colloidal solution
    • Details of fabrication procedure in methods & supp. materials.
  • Films are prepared in water and dried (like paint)
  • LBL = layer by layer. layer of polyurethane + layer of gold nanoparticles.
    • Order of magnitude higher conductivity than the
  • VAF = vacuum assisted floculation.
    • Mix Au-citrate nanoparticles + polyurethane and pass through filter paper.
    • Peel the flocculant from the filter paper & dry.
  • Conductivity of the LBL films ~ 1e4 S/cm -> 1e-6 Ohm*m (pure gold = 2 x 10-8, 50 x better)
  • VAF = 1e3 S/cm -> 1e-5 Ohm*m. Still pretty good.
    • This equates to a resistance of 1k / mm in a 10um^2 cross-sectional area wire (2um x 5 um, e.g.)
  • The material can sustain > 100% strain when thermo-laminated.
    • Laminated: 120C at 20 MPa for 1 hour.
  • See also: Preparation of highly conductive gold patterns on polyimide via shaking-assisted layer-by-layer deposition of gold nanoparticles
    • Patterned via MCP -- microcontact printing(aka rubber-stamping)
    • Bulk conductivity of annealed (150C) films near that of pure gold (?)
    • No mechanical properties, though; unlcear if these films are more flexible / ductile than evaporated film.

{814}
hide / / print
ref: Zhang-2009.02 tags: localized surface plasmon resonance nanoparticle neural recording innovative date: 01-15-2012 23:00 gmt revision:4 [3] [2] [1] [0] [head]

PMID-19199762[0] Optical Detection of Brain Cell Activity Using Plasmonic Gold Nanoparticles

  • Used 140 nm diameter, 40 nm thick gold disc nanoparticles set in a 400nm array, illuminated by 850nm diode laser light.
    • From my reading, it seems that the diameter of these nanoparticles is important, but the grid spacing is not.
  • These nanoparticles strongly scatter light, and the degree of scattering is dependent on the local index of refraction + electric field.
  • The change in scattering due to applied electric field is very small, though - ~ 3e-6 1/V in the air-capacitor setup, ~1e-3 in solution when stimluated by cultured hippocampal neurons.
  • Noteably, nanoparticles are not diffraction limited - their measurement resolution is proportional to their size. Compare with voltage-sensitive dyes, which have a similar measurement signal-to-noise ratio, are diffraction limited, may be toxic, and may photobleach.

____References____

[0] Zhang J, Atay T, Nurmikko AV, Optical detection of brain cell activity using plasmonic gold nanoparticles.Nano Lett 9:2, 519-24 (2009 Feb)

{820}
hide / / print
ref: notes-0 tags: CSV blog article group dynamics steinberg date: 07-05-2010 15:30 gmt revision:1 [0] [head]

Another excellent post from Steinberg regarding treating people as predictable nonlinear fluids. "The system works far better when a column is introduced off-center in front of the door,as demonstrated Mr. Torrens. "It's counterintuitive, but the column sends shock waves through the crowds to break up the congestion patterns." (...) Most traffic jams are emergent phenomena that begin with mistakes from just one or two drivers. According to Horvitz's models, they can actually "un-jam" traffic by calling drivers at a particular location, and giving them very specific instructions: "Move to the left-most lane, and then speed-up to 65."

{94}
hide / / print
ref: bookmark-0 tags: particle_filter unscented monte_carlo MCMC date: 12-11-2007 16:46 gmt revision:2 [1] [0] [head]

images/94_1.pdf

  • covers both the particle filter and the unscented kalman filter ... the unscented kalman filter is used as the proposal distribution.

{176}
hide / / print
ref: Brockwell-2004.04 tags: particle_filter Brockwell BMI 2004 wiener filter population_vector MCMC date: 02-05-2007 18:54 gmt revision:1 [0] [head]

PMID-15010499[0] Recursive Bayesian Decoding of Motor Cortical Signals by Particle Filtering

  • It seems that particle filtering is 3-5 times more efficient / accurate than optimal linear control, and 7-10 times more efficient than the population vector method.
  • synthetic data: inhomogeneous poisson point process, 400 bins of 30ms width = 12 seconds, random walk model.
  • monkey data: 258 neurons recorded in independent experiments in the ventral premotor cortex. monkey performed a 3D center-out task followed by an ellipse tracing task.
  • Bayesian methods work optimally when their models/assumptions hold for the data being analyzed.
  • Bayesian filters in the past were computationally inefficient; particle filtering was developed as a method to address this problem.
  • tested the particle filter in a simulated study and a single-unit monkey recording ellipse-tracing experiment. (data from Rena and Schwartz 2003)
  • there is a lot of math in the latter half of the paper describing their results. The tracings look really good, and I guess this is from the quality of the single-unit recordings.
  • appendix details the 'innovative methodology ;)

____References____

{15}
hide / / print
ref: bookmark-0 tags: monte_carlo MCMC particle_filter probability bayes filtering biblography date: 0-0-2007 0:0 revision:0 [head]

http://www-sigproc.eng.cam.ac.uk/smc/papers.html -- sequential monte carlo methods. (bibliography)