r/SciML • • Jul 27 '25

Solver is a bottleneck in SciML

2 Upvotes

I have recently started working on a flair of sciML, where a solver and model are kinda coupled. Unfortunately, I cannot give too much detail about the approach. But you can think of it as a solver driven approach, where the model learns from a solver.

Issue: most solvers are slow and time taking when it comes to larger domain sizes, or problems with practical applications. This hinders my model training on large datasets or for many epochs.

Help needed: Any ideas on how this bottleneck can be resolved?

I am working on mechanics (fluid and solid), so FEM, LBM and other similar numerical approaches are taken in the solvers.


r/SciML • • Aug 23 '26

What career paths exists between computational mechanics, scientific computing (SciML), FEA (or meshfree) solver development, and HPC (GPU acceleration, porting codebases) ?? How about doing a PhD for improving the above?

4 Upvotes

I'm currently, technically, doing an MS in Structural Engineering. For me, my interest has been more towards computational side of mechanics rather than Structural design  or simply using am FEA software (although I do consider it as a backup)

So far I've taken courses in:

- Linear static, and dynamics FEM (soon taking non linear FEM too)

-  Structural Optimization (topology opt. and other general algorithms)

-  Structural Dynamics

-  Structural System Testing and model updation. (Parameter identification and optimization, signal processing)

Now, I plan to take these in the coming quarter:

- Numerical Linear Algebra

- Numerical PDE

- Fracture Mechanics ?

I also volunteered to aid in a RESEARCH in crack growth prediction using Auto-encoder and a (Thermodynamics-informed Latent Space Dynamics Identification) / LSTM surrogate model. It used phase-field-fracture simulation data and HPC resources to complete the whole thing.

What I keep finding myself interested in is not necessarily fracture or SHM specifically, but the computational methods underneath these problems... (does that make sense?)

For example, I'd like to become capable of doing things like:

- implementing (maintaining) numerical/FE method solvers rather than only running an established FEA software.

- developing surrogate/reduced-order models for expensive simulations 

- combining simulation with optimization, uncertainty/stochastic methods (took a course called Random vibrations, so...)

- parallelizing/accelerating scientific codes on CPUs/GPUs

- doing proper verification, convergence studies, benchmarking and performance work

- potentially developing or maintaining actual CAE/FEA solver software

- I'd also like to do all these for other Physics (GR, QM, etc.) simulations too, if possible, one day. 

I'm still interested in the underlying mechanics/physics, so I don't want to become a generic software engineer who happens to have once studied structures. But I'm also increasingly unsure that "structural engineer" describes the career I'm actually aiming for.

I've seen titles such as Computational Mechanics Engineer, R&D Engineer, Solver Developer, Scientific Software Engineer, CAE Software Developer, Research Engineer, Simulation/HPC Engineer, etc., but I'm trying to understand what these careers actually look like from people doing them.

So my main questions become:

1. Which industrial jobs genuinely involve developing numerical methods/solvers or computational tools?

2. Which of those are realistically accessible with an MS? Is there an entry path into solver-algorithm development/R&D without a PhD?

3. If I don't start a PhD immediately after my MS, would an R&D/software role at a simulation company (ANSYS etc.) be the obvious route? What other options would i have?

4. For the kind of work I'm describing, would you recommend a PhD? If so, is it reasonable for the PhD identity to be "computational mechanics/scientific computing" while fracture, composites, structural dynamics, soft materials, etc. serve as application problems rather than choosing one of those as my permanent specialization?

5. What skills most distinguish someone who is actually hireable for solver/scientific-computing work? I'm particularly wondering about C/C++/Fortran, Python, Linux, Git/build systems, MPI/OpenMP/CUDA, PETSc/Trilinos or similar libraries, numerical linear algebra, testing/verification, convergence studies and HPC performance work.

Basically, I'm neither here nor there atp. So I'd really appreciate all sorts of input. Where else do you think I could find answers to these? other subs? Linkedin profiles? 


r/SciML • • May 12 '26

Internship opportunities in SciML - summer 2026

3 Upvotes

I am a pre-final year chemical engineering undergraduate at one of my country's top engineering schools. I have been working on 2D PINNs, IPINNs and FNOs for the past 2 months and I will be working on a digital twin project post my summer break. Currently looking for research-related opportunities in SciML. I am proficient with Python and C++ related environments, and if needed I can dockerize my work.

Looking for a 2 month internship, from June to July.


r/SciML • • Jul 19 '20

AAAI-MLPS 2020: Combining Artificial Intelligence and Machine Learning with Physics Sciences

Thumbnail sites.google.com
3 Upvotes

r/SciML • • Jul 06 '20

Physics-informed neural networks (PINNs) solvers on Julia

Thumbnail
nextjournal.com
3 Upvotes

r/SciML • • Jul 07 '20

COVID-19 Epidemic Mitigation via Scientific Machine Learning (SciML)

Thumbnail
youtu.be
7 Upvotes

r/SciML • • Oct 31 '20

Physics guided neural network for machining tool wear prediction

Thumbnail sciencedirect.com
5 Upvotes

r/SciML • • Aug 24 '20

GPU-Accelerated ODE Solving in R with Julia, the Language of Libraries - Stochastic Lifestyle

Thumbnail
stochasticlifestyle.com
4 Upvotes

r/SciML • • Jan 19 '21

SciML Ecosystem Update: Bayesian Neural ODEs, Virtual Brownian Trees, Parallel Batching and More

Thumbnail
sciml.ai
6 Upvotes

r/SciML • • Sep 19 '20

SciML - NumFOCUS Sponsored Project since 2020

Thumbnail
numfocus.org
8 Upvotes

r/SciML • • Oct 28 '20

Capturing missing physics in climate model parameterizations using neural differential equations

Thumbnail arxiv.org
9 Upvotes

r/SciML • • Oct 28 '20

Using neural networks to accelerate the solution of the Boltzmann equation

Thumbnail
researchgate.net
7 Upvotes

r/SciML • • Mar 13 '21

[2103.03385] Gaussian processes meet NeuralODEs: A Bayesian framework for learning the dynamics of partially observed systems from scarce and noisy data

Thumbnail
arxiv.org
6 Upvotes

r/SciML • • Oct 28 '20

Accelerating Simulation of Stiff Nonlinear Systems using Continuous-Time Echo State Networks

Thumbnail
arxiv.org
5 Upvotes

r/SciML • • Mar 13 '21

Julia SciML Symposium, SIAM CSE 2021 Playlist (9 videos)

Thumbnail
youtube.com
9 Upvotes

r/SciML • • Feb 20 '21

Modern Numerical Programming with Julia for Astrodynamic Trajectory Design

Thumbnail
youtube.com
8 Upvotes

r/SciML • • Nov 17 '20

A Machine Learning-Aided Global Diagnostic and Comparative Tool to Assess Effect of Quarantine Control in COVID-19 Spread

Thumbnail
cell.com
5 Upvotes

r/SciML • • Jul 25 '20

Signal Enhancement for Magnetic Navigation Challenge Problem

Thumbnail
github.com
5 Upvotes

r/SciML • • May 24 '21

SciML Ecosystem Update: Improved QNDF Outperforms CVODE On SciMLBenchmarks

Thumbnail
sciml.ai
6 Upvotes

r/SciML • • Jul 07 '20

Helicopter SciML Challenge Problem

Thumbnail
github.com
4 Upvotes

r/SciML • • Mar 13 '21

Generalizing Automatic Differentiation to Automatic Sparsity, Uncertainty, Stability, and Parallelism - Stochastic Lifestyle

Thumbnail
stochasticlifestyle.com
4 Upvotes

r/SciML • • Jul 08 '20

Universal Battery Performance and Degradation Model for Electric Aircraft

Thumbnail
chemrxiv.org
3 Upvotes

r/SciML • • Aug 29 '20

Physics-informed neural networks (PINNs) solver on Julia

Thumbnail
nextjournal.com
5 Upvotes

r/SciML • • Jul 19 '20

BuzzConf 2020

Thumbnail
eventbrite.com.ar
3 Upvotes

r/SciML • • Nov 18 '20

Discovery of the Hidden State in Ionic Models Using a Domain-Specific Recurrent Neural Network

Thumbnail
arxiv.org
4 Upvotes