← All topics

brain simulation

3 captures, most recent first.

@shunyaresear

— saved image

Shunya Resear... @shunyaresear... · 29m

Can connectomes help us design neural prostheses? 🧠🦾🪰

We tried to design one for a fruit fly. We give a simulated blind fly a camera and a hand-built motion detector, we then wired everything downstream of that straight into its connectome.

Here's how we did it:

A fly jumps away from anything approaching it, the circuit behind this is small and well mapped: motion detectors feed LPLC2 looming detectors which then feed the Giant Fiber triggering the jump.

Blindness (regardless of the underlying cause) removes the early parts of the above mentioned pathway.

We design a prosthesis with a camera, a model compound eye with 721 facets and an encoder that computes motion signals the fly's own cells would've sent.

[Embedded video, 0:33, labelled "Demo": a simulated orange fruit fly on a checkered floor, with side panels labelled Compound Eye, Encoder, LPLC2 Connectome and Giant Fiber]

2 replies · 3 reposts · 5 likes · 49 views

Shunya Resear... @shunyaresear... · 28m

Everything after the encoder comes from the new male fly connectome (Janelia, Google Research, MRC LMB, Cambridge).
Note from Claude Sonnet 5

Two-part thread by Shunya Research on designing a neural prosthesis for a simulated blind fruit fly by wiring a camera, 721-facet model compound eye and motion encoder into the male fly connectome (LPLC2 looming detectors to Giant Fiber jump circuit). The embedded demo video shows an orange simulated fly on a checkered floor with panels for compound eye, encoder, LPLC2 connectome and giant fiber.

connectomefruit flyneural prosthesisbrain simulationlplc2neuroscience

lyra bubbles @_lyraaaa_

— saved image

lyra bubbles @_lyraaaa_ · 13h
the fly brain can play beat saber

[embedded video, paused at 0:09; on-screen text:]
Among Us Trap Remix
Leonz · Hard · 168 BPM
NEURAL ACTIVITY
165,122 neurons
25.58M connections · 135 foreleg motor neurons
Activity - 0 — 200+ Hz
Pause · 0:22 · 1:04 · 1x speed · Sound on · Side view · About
Note from Claude Sonnet 5

Tweet by lyra bubbles with an embedded video of a Beat Saber-style rhythm game in which a 3D fly model holds a cyan and a red saber and slashes incoming blocks with arrows, while a side panel shows two dot-cloud renderings of a fly brain with a neuron count and activity readout. The video appears to be driven by a simulated fly connectome (165,122 neurons). Kept because the video frame carries the substance.

fly connectomebrain simulationbeat saberneurosciencewhole-brain emulationdrosophila

@timhwang

— saved image

Adam Marblestone reposted
Tim Hwang @timhwang · 11h
I think we can all agree that weekends are for simulating an entire drosophila connectome on your home compute and hooking the brain up to drive a virtual rover around looking for rewards

[embedded video, paused at 0:00]
Ghost in the Fly · rover · canonical · identified-DN geometry positive contr...
Left panel: "FlyWire v783 · exact sampled arbors · group rate (Hz)" — a dark visualization of tangled colored neural fiber tracts
Right panel: "Actual body · segmentation-aligned activation" — a 3D rendered rover/robot body with wheel-like appendages and antennae, on a checkerboard floor, next to a green sphere (reward marker)
Overlaid telemetry text: physical: wheel_lf=5.95e-08, wheel_rh=5.95e-08, wheel_lm=5.95e-08, forward_velocity_mm_s=... applied: forward_velocity_mm_s=1.19e-08, yaw_rate_rad_s=-6.26e-09, antenna_left=0, antenn... decoded for next: forward_velocity_mm_s=9.25e-09, yaw_rate_rad_s=-4.88e-09, antenna_left=0... pose: position[0]=7.74, position[2]=0.631, heading_rad=-0.58, position[1]=0.501
Note from Claude Sonnet 5

Tweet by Tim Hwang joking about weekend hobby projects, showing an embedded video/screenshot of a drosophila (fruit fly) connectome simulation (FlyWire dataset) driving a virtual rover body toward a reward sphere, with live neural activation telemetry overlaid.

connectomicsneurosciencesimulationtwitterbrain simulation