DMF-TONN: Direct Mesh-free Topology Optimization using Neural Networks
We propose a direct mesh-free method for performing topology optimization by
integrating a density field approximation neural network with a displacement
field approximation neural network. We show that this direct integration
approach can give comparable results to conventional topology optimization
techniques, with an added advantage of enabling seamless integration with
post-processing software, and a potential of topology optimization with
objectives where meshing and Finite Element Analysis (FEA) may be expensive or
not suitable. Our approach (DMF-TONN) takes in as inputs the boundary
conditions and domain coordinates and finds the optimum density field for
minimizing the loss function of compliance and volume fraction constraint
violation. The mesh-free nature is enabled by a physics-informed displacement
field approximation neural network to solve the linear elasticity partial
differential equation and replace the FEA conventionally used for calculating
the compliance. We show that using a suitable Fourier Features neural network
architecture and hyperparameters, the density field approximation neural
network can learn the weights to represent the optimal density field for the
given domain and boundary conditions, by directly backpropagating the loss
gradient through the displacement field approximation neural network, and
unlike prior work there is no requirement of a sensitivity filter, optimality
criterion method, or a separate training of density network in each topology
optimization iteration.
Aditya Joglekar, Hongrui Chen, Levent Burak Kara
# DMF-TONN: Direct Mesh-free Topology Optimization using Neural Networks

###### Abstract

We propose a direct mesh-free method for performing topology optimization by integrating a density field approximation neural network with a displacement field approximation neural network. We show that this direct integration approach can give comparable results to conventional topology optimization techniques, with an added advantage of enabling seamless integration with post-processing software, and a potential of topology optimization with objectives where meshing and Finite Element Analysis (FEA) may be expensive or not suitable. Our approach (DMF-TONN) takes in as inputs the boundary conditions and domain coordinates and finds the optimum density field for minimizing the loss function of compliance and volume fraction constraint violation. The mesh-free nature is enabled by a physics-informed displacement field approximation neural network to solve the linear elasticity partial differential equation and replace the FEA conventionally used for calculating the compliance. We show that using a suitable Fourier Features neural network architecture and hyperparameters, the density field approximation neural network can learn the weights to represent the optimal density field for the given domain and boundary conditions, by directly backpropagating the loss gradient through the displacement field approximation neural network, and unlike prior work there is no requirement of a sensitivity filter, optimality criterion method, or a separate training of density network in each topology optimization iteration.

keywords: Topology Optimization, Physics-Informed Neural Network, Implicit Neural Representations, Mesh-free

## 1 Introduction

Topology optimization approaches like SIMP (Solid Isotropic Material with Penalisation) ([1; 2]) find the optimum structure for a given set of boundary conditions by meshing the design domain and using an iterative process where
each iteration involves an FEA calculation for computing the objectives such as compliance. Therefore, removing these iterations completely or creating a new class of solvers with a reparameterization of the design variables in this optimization problem is highly desirable. Advances in neural networks, both in learning from large amounts of data and in learning implicit representations of complex signals show great promise to bring about this transformation, and hence many new approaches trying to utilize neural networks for topology optimization have been recently developed.

Data-driven approaches perform instant optimal topology generation during inference time. However, they require a large training database generation, a long training time and face generalization issues. Online training approaches use a neural network to represent the density field of designs for an alternative parameterization. They do not face any generalization issues. However, meshing and FEA is still required.

One of the first online training topology optimization approaches, TOuNN, was proposed by Chandrasekhar and Suresh [3]. The neural network takes in as inputs the domain coordinates and outputs the density value at each of these coordinates. The loss function consists of the compliance and volume fraction constraint violation. This loss gradient is backpropagated and used for updating the weights of the neural network such that it learns the optimal density distribution for minimizing the loss. The compliance for the density field is calculated as in the traditional SIMP method using FEA. For removing the meshing requirement of FEA and creating a new class of solvers for various partial differential equations (PDEs) in computational mechanics, there have been recent advances and promising results in using physics-informed neural networks (PINNs). Samaniego et al. [4] propose an energy approach for solving the linear elasticity PDEs. The displacement field is parameterized by a neural network which takes as input the domain coordinates and outputs the displacements in each direction at each of these coordinates. The loss function consists of the potential energy, which when minimized, will give static equilibrium displacements.

Though the computational time for the neural network PDE approximation frameworks is worse than the current state of the art FEA solvers, there are several potential advantages of this approach, including the mesh-free nature and an easy modelling of non-linear PDEs. Incorporation of these neural network PDE approximation frameworks in online training topology optimization enables mesh-free topology optimization and a new class of solvers for this complex inverse design problem.

Zehnder et al. [5] were the first to propose such a mesh-free framework for topology optimization with compliance as an objective, where in addition to the density field, the displacement field is also parameterized using a neural network. However, they conclude that connecting the two neural networks directly leads to bad local minima. Hence, they propose using the optimality criterion method and sensitivity filtering for calculating target densities. As such, the density neural network needs to be trained for estimating these target densities in every topology optimization iteration.
In this work, we show that using directly connected displacement field estimation and density field estimation neural networks is indeed an effective approach for mesh-free topology optimization. In particular, we argue that using just one gradient descent step of the density network in each topology optimization iteration without any sensitivity or density filtering leads to comparable results to conventional topology optimization. Moreover, after the initial run of the displacement network, we significantly reduce the number of iterations in each topology optimization iteration. We show that transfer learning applies here and in this high dimensional and non-convex optimization problem setting, approximate loss and gradients can work well.

We devise DMF-TONN as a method not for replacing SIMP, but for adding to and improving the current class of mesh-free solvers for topology optimization, using the advancements in neural networks. We use Fourier Features and a fully connected layer as the architecture of both our neural networks. We verify the effectiveness of our approach with case studies with different boundary conditions and volume fractions. The implementation of this work is available at: [https://github.com/Adityajloglekar/DMF-TONN](https://github.com/Adityajloglekar/DMF-TONN)

Figure 1: Our proposed framework. Each topology optimization iteration consists of: 1) Training the displacement network with current density field, randomly sampled domain coordinates and boundary conditions to obtain static equilibrium displacements. 2) Randomly sampling domain coordinates and performing a forward pass through the density network to obtain current topology output, and displacement network to obtain current compliance, which are passed to the density network loss function 3) Backpropagating density network loss and performing a gradient descent step on density network weights.
## 2 Literature Review

_Topology optimization_: Bendsoe and Kikuchi [6] introduced the homogenization approach for topology optimization. The SIMP method ([1; 2]) considers the relative material density in each element of the Finite Element (FE) mesh as design variables, allowing for a simpler interpretation and optimised designs with more clearly defined features. Other common approaches to topology optimization include the level-set method ([7; 8]) and evolutionary algorithms. Improving the optimization results and speed of these approaches using neural networks has seen a lot of development recently and Woldseth et al. [9] provide an extensive overview on this topic.

_Neural Networks for solving PDEs_: Driven by a neural network's ability to approximate functions, there have been several recent works proposing novel solvers for PDEs. Raissi et al. [10] propose PINNs, neural networks that are trained to solve supervised learning tasks while respecting the laws of physics described by general nonlinear partial differential equations. Samaniego et al. [4] propose an approach using neural networks which does not require labelled data points, and just uses domain coordinates and boundary conditions as input to solve computational mechanics PDEs. Nguyen-Thanh et al. [11] develop a deep energy method for finite deformation hyperelasticity. Sitzmann et al. [12] leverage periodic activation functions for implicit neural representations and demonstrate that these networks are ideally suited for representing complex natural signals and their derivatives and solving PDEs. Tancik et al. [13] show that passing input points through a simple Fourier feature mapping enables a multilayer perceptron to learn high-frequency functions in low-dimensional problem domains. We utilize this concept of Fourier Feature mapping for finding good approximations of the displacement field and density field in the low-dimensional coordinate domain.

_Neural networks for topology optimization_: Several data-driven methods for topology optimization using neural networks [14; 15; 16; 17; 18; 19; 20] have been proposed. In this review we focus on the online training topology optimization methods, i.e. those methods which do not use any prior data, rather train a neural network in a self-supervised manner for learning the optimal density distribution and topology. Chandrasekhar and Suresh [3] explore an online approach where the density field is parameterized using a neural network. Fourier projection based neural network for length scale control ([21]) and application for multi-material topology optimization ([22]) has also been explored. Deng and To [23] propose topology optimization with Deep Representation Learning, with a similar concept of re-parametrization, and demonstrate the effectiveness of their method on compliance minimization and stress-constrained problems. Hoyer et al. [24] use CNNs for density parameterization and directly enforce the constraints in each iteration, reducing the loss function to compliance only. Chen et al. [25] propose a neural network based approach to topology optimization that aims to reduce the use of support structures in additive manufacturing. Chen et al. [26] demonstrate that by using a prior initial field on the unoptimized domain, the efficiency of neural network based topology optimization can
be improved. He et al. [27] and Jeong et al. [28] approximate displacement fields using PINNs, but a continuous density field is not learned and the frameworks are not mesh-free. Lu et al. [29] demonstrate the effectiveness of hard constraints over soft constraints for solving PDEs in various topology optimization problems. Zehnder et al. [5] effectively leverage neural representations in the context of mesh-free topology optimization and use multilayer perceptrons to parameterize both the density and displacement fields. Mai et al. [30] develop a similar approach for optimum design of truss structures. We show that unlike in Zehnder et al. [5], sensitivity filtering, optimality criterion method and separate training of density network in each topology optimization epoch is not necessary for mesh-free topology optimization using neural networks.

## 3 Proposed Method

We parameterize the displacement field as well as the density field using neural networks and integrate them as shown in Figure 1.

```
1:Initialize neural networks: \(Den_{W_{den}}\), \(Disp_{W_{disp}}\)
2:Initialize Adam optimizers: \(Opt_{den}\), \(Opt_{disp}\)
3:Initialize domain \(\rho_{init}\)
4:for\(n_{initdisp}\) iterations do
5: Sample domain coordinates \(X_{disp}\)
6:\(u_{temp}\gets Disp_{W_{disp}}(X_{disp})\)
7:\(W_{disp}\gets Opt_{disp}.step(W_{disp},\frac{\partial L_{disp}(u_{temp },\rho_{init})}{\partial W_{disp}})\)
8:endfor
9:for\(n_{opt}\) iterations do
10:for\(n_{disp}\) iterations do
11: Sample domain coordinates \(X_{disp}\)
12:\(\rho_{temp}\gets Den_{W_{den}}(X_{disp})\)
13:\(u_{temp}\gets Disp_{W_{disp}}(X_{disp})\)
14:\(W_{disp}\gets Opt_{disp}.step(W_{disp},\frac{\partial L_{disp}(u_{temp },\rho_{temp})}{\partial W_{disp}})\)
15:endfor
16: Sample domain coordinates \(X_{den}\)
17:\(\rho\gets Den_{W_{den}}(X_{den})\)
18:\(u\gets Disp_{W_{disp}}(X_{den})\)
19:\(c\gets L_{disp}(u,\rho)+EW\)
20:\(W_{den}\gets Opt_{den}.step(W_{den},\frac{\partial L_{den}(\rho,c)}{ \partial W_{den}})\)
21:endfor
```

**Algorithm 1** DMF-TONN

### Density Neural Network

The density neural network \(\textit{Den}(\textbf{X}_{den})\) can be represented as follows:

\[\textit{Den}(\textbf{X}_{den})=\sigma(\sin(\textbf{X}_{den}\textbf{K}_{den}+ \textbf{b})\textbf{W}_{den}) \tag{1}\]
The input is a batch of randomly sampled domain coordinates \(\mathbf{X}_{den(\text{batchsize}\times 3)}\). We use the domain center as the origin for the coordinates, and the coordinates are normalized with the longest dimension coordinates ranging from -0.5 to 0.5. We use the concept proposed in Tancik et al. [13] and a neural network architecture similar to the one used in Chandrasekhar and Suresh [21]. The first layer weights (kernel \(\mathbf{K}_{den(3\times\text{kernelsize})}\)) are fixed, which create Fourier features after passing through the sine activation. We add a bias term \(\mathbf{b}\) consisting of ones before applying the sine activation to break off the symmetry about the origin. The kernel is created using a grid of number of dimensions same as the number of domain dimensions, and then reshaping the grid coordinates to the matrix \(\mathbf{K}_{den(3\times\text{kernelsize})}\). The grid size in each dimension dictates how good it can represent topological features, and the grid's range of values control the frequency of the output topology, with higher ranges of values giving a topology with more intricate features. Note that this grid is not a mesh structure, and consists solely of coordinates. We find that making the kernel trainable can slightly improve compliance. However, we keep it fixed for all the experiments in this paper assuming that the slight increase in performance may not be preferable to the large number of trainable weights. The next layer weights (\(\mathbf{W}_{den(\text{kernelsize}\times 1)}\)) are trainable and the output is passed through a sigmoid activation (\(\sigma\)). This ensures output values are between 0 and 1, which represent the density, for each of the coordinates in the input batch. We use Adam (Kingma and Ba [31]) as the optimizer, with a learning rate of \(2.0\times 10^{-3}\) for all the experiments.

### Displacement Neural Network

We use a neural network similar to the density neural network for approximating the displacement field. The physics-informed components shown in Samaniego et al. [4] are then added on the displacement output by this neural network \(\mathit{Disp}(\mathbf{X}_{disp})\). This can be represented as follows:

\[\mathit{Disp}(\mathbf{X}_{disp})=\sin(\mathbf{X}_{disp}\mathbf{K}_{disp}+ \mathbf{b})\mathbf{W}_{disp} \tag{2}\]

We use randomly sampled domain coordinates \(\mathbf{X}_{disp}\) in each displacement network iteration. The frequency determined by \(\mathbf{K}_{disp}\) should be greater than or equal to the frequency determined by \(\mathbf{K}_{den}\). This is due to the fact that if the displacement network in unable to capture and pass fine changes in displacement to the density network, and the density network is attempting to create very fine features, incorrect features are created and disconnections are observed in the final topology. For all our experiments, we use the same frequencies and grid sizes for \(\mathbf{K}_{disp}\) and \(\mathbf{K}_{den}\) and find this setting works well. Multiplying the Fourier features with \(\mathbf{W}_{disp(\text{kernelsize}\times 3)}\) gives the displacements in each direction.

#### 3.2.1 Displacement Constraints

Boundary conditions on displacements such as fixed sides, are implemented as hard constraints. The output of \(\mathit{Disp}(\mathbf{X}_{disp})\) is multiplied with a differentiable function that is 0 at the fixed boundary and 1 elsewhere. We use the
exponential function for this. For example, with a cuboidal domain that has the side with all \(x\) coordinates equal to zero, fixed (zero displacement in all three directions), such as in Figure 2a, the hard constraint function takes the form \(2(\frac{1}{(1+\exp(-m(c_{x}+0.5)))}-0.5)\) where \(c_{x}\) is all the \(x\) coordinates in the domain, and \(m\) is a constant which dictates the slope of this function. We find empirically \(m=20\) works well and use it for all our experiments. For multiple fixed sides, the displacements output by the neural network are multiplied by the functions for each fixed side.

#### 3.2.2 Minimum Potential Energy Loss Function

The principle of minimum potential energy is used for approximating the displacement field as proposed in Samaniego et al. [4]. The neural network learns the weights that output the displacements that minimize the potential energy, and thus learns to output static equilibrium displacements. With Monte-Carlo sampling, the loss function of the displacement neural network, \(L_{disp}=\) Potential Energy, for 3d problems, is defined as follows:

\[L_{disp}=ISE-EW \tag{3}\]

\[ISE=\frac{V}{N}\sum_{i}^{N}(\mu\epsilon_{i}:\epsilon_{i}+\frac{\lambda(trace( \epsilon_{i}))^{2}}{2}) \tag{4}\]

\[EW=\frac{A}{N_{b}}\sum_{i}^{N_{b}}Tu_{i} \tag{5}\]

where,

\(ISE=\) Internal Strain Energy

\(EW=\) External Work

\(V=\) domain volume

\(N=\) number of sample points in domain

\(\mu=\frac{E}{2(1+\nu)}\), \(\lambda=\frac{E\nu}{((1+\nu)(1-2\nu))}\)

\(E=\) Young's Modulus

\(\nu=\) Poisson's ratio

\(\epsilon_{i}=\) strain matrix at \(i^{th}\) point

\(A=\) area on which traction is applied

\(N_{b}=\) number of sample points on boundary

\(T=\) traction

\(u_{i}=\) displacement at \(i^{th}\) point

The symbol ':' indicates element wise multiplication, followed by a summation.

The strains are calculated using automatic differentiation in TensorFlow (Abadi et al. [32]). We use Adam as the optimizer, with a learning rate of \(5.0\times 10^{-6}\) for all the experiments.

### Integration of Density and Displacement Neural Networks

A topology optimization epoch starts by training the displacement network with randomly sampled coordinates, the corresponding current topology (found
by a forward pass through the density network) and the boundary conditions. The conventional SIMP method interpolation (\(E=E_{material}(\rho^{3})\), where \(\rho\) is the density) is used for obtaining the Young's modulus \(E\) at each of the randomly sampled domain points in each displacement network iteration. Then, with randomly sampled coordinates, a forward pass is performed through the density network and the displacement network to get the current topology and current compliance (Internal Strain Energy) respectively, which are passed to the density network loss function. The density network loss function is defined as follows:

\[L_{den}=\frac{c}{c_{0}}+\alpha(\frac{v}{V^{*}}-1)^{2} \tag{6}\]

where,

\(c=\) compliance

\(c_{0}=\) initial compliance

\(v=\) volume fraction

\(V^{*}=\) target volume fraction

\(\alpha=\) penalty constant

The compliance (\(c\)) is a function of the densities (\(\rho\)) and displacements (\(u\)), where the displacements are also dependent on the densities. As shown in Zehnder et al. [5], the total gradient of the compliance with respect to the densities is given by \(\frac{dC}{d\rho}=\frac{\partial C}{\partial\rho}+\frac{\partial C}{\partial u }\frac{du}{d\rho}=-\frac{\partial C}{\partial\rho}\), which needs to be incorporated while connecting the two neural networks and backpropagating the loss to the density network weights.

As shown in Algorithm 1, during each topology optimization iteration, the density network weights are updated once with a gradient descent step in Adam. Before starting the topology optimization, the displacement network is run with the initial domain as the topology, for \(n_{dispinit}=1000\) iterations for converging to static equilibrium displacements. Then in each topology optimization iteration, utilizing the concept of transfer learning as the topology does not change too drastically, we run the displacement network only for \(n_{disp}=20\) iterations. We determined the values of the \(n_{dispinit}\) and \(n_{disp}\) variables empirically to give the best results in the cases presented in the paper. Though we have to increase the topology optimization iterations, this reduction of 50 times in displacement network iterations significantly reduces the computational time without compromising the compliance of the results.

We run all of our experiments on a machine with 12th Gen Intel(R) Core(TM) i7-12700 2.10 GHz processor, 16 GB of RAM and Nvidia GeForce RTX 3060 GPU.

## 4 Results

We first compare our results with a conventional SIMP topology optimization (Andreassen et al. [33]) and NTopo (Zehnder et al. [5]) for a 2D cantilever beam problem. Then, for a 3D cantilever problem, we present the initial convergence history of the displacement network, and the convergence history of
the compliance. Subsequently, we perform a case study for the 3D cantilever beam problem over varying volume fractions and load locations, comparing our results with a conventional 3D SIMP topology optimizer (Liu and Tovar [34]), and with a method using the Fourier Features neural network for density representation and FEA for compliance calculation (similar to Chandrasekhar and Suresh [21]). Then, we present an example showcasing the trade-offs in DMF-TONN and SIMP in terms of the compliance and computational time. Lastly, we validate our approach on some additional examples.

The output of our network represents an implicit function of the spatial densities. We use the marching cubes algorithm for generating the renders of the results. It should be noted that with DMF-TONN, one can sample infinitely many points within the domain, as a continuous and differentiable function has been learned by the density network. In this paper, we use twice the number of samples of the FEA grid size in each direction for the DMF-TONN figures for each example. On all solutions obtained by our approach, we run FEA for calculating the final compliance and use this to compare against the compliance obtained by SIMP (using the same FE solver) for consistency. In all the figures, 'c' refers to compliance and 'vf' refers to volume fraction. We ensure the degrees of freedom available are always more for SIMP than for DMF-TONN. Moreover, in SIMP, we use a density filter with a radius 1.5 times the mesh element size in each of the presented examples, ensuring thin features and lower compliances are possible, and there is no compromise in the SIMP results.

\begin{table}
\begin{tabular}{c|c|c|c} \hline \hline Boundary Conditions & SIMP & NTopo & DMF-TONN \\ \hline Convergence Compliance & \(4.94\times 10^{-4}\) & \(4.23\times 10^{-4}\) & \(4.76\times 10^{-4}\) \\ Volume Fraction Achieved & 0.30 & 0.30 & 0.30 \\ Binary Structure Compliance & \(4.55\times 10^{-4}\) & \(3.79\times 10^{-4}\) & \(4.01\times 10^{-4}\) \\ Time & 124 s & 1461 s & 275 s \\ \hline \hline \end{tabular}
\end{table}
Table 2: Comparison for 2D cantilever beam problem with target volume fraction = 0.3

\begin{table}
\begin{tabular}{c|c|c|c} \hline \hline Boundary Conditions & SIMP & NTopo & DMF-TONN \\ \hline Convergence Compliance & \(2.86\times 10^{-4}\) & \(2.54\times 10^{-4}\) & \(2.73\times 10^{-4}\) \\ Volume Fraction Achieved & 0.50 & 0.50 & 0.50 \\ Binary Structure Compliance & \(2.66\times 10^{-4}\) & \(2.40\times 10^{-4}\) & \(2.52\times 10^{-4}\) \\ Time & 69 s & 1465 s & 277 s \\ \hline \hline \end{tabular}
\end{table}
Table 1: Comparison for 2D cantilever beam problem with target volume fraction = 0.5
Figure 3: Case Study of 3D Cantilever Beam Problem

Figure 2: Convergence history of DMF-TONN and result comparison with SIMP for 3D cantilever beam problem with target volume fraction = 0.3
### Comparison of DMF-TONN, SIMP and Ntopo for 2D Cantilever Beam example

We compare the compliances and computational times for a 2D cantilever beam example in Tables 1 and 2. We run the SIMP code (Andreassen et al. (2017)) with the default convergence criterion, and run NTopo for 200 iterations as shown in (Zehnder et al. (2017)) for a similar 2D cantilever beam example. We run our method for \(n_{opt}=2000\) topology optimization iterations (determined empirically for 2D problems), with \(n_{disp}=20\) iterations of the displacement network in each of these topology optimization iterations. We also compare the binary (0 and 1 density values) structure compliance (ensuring the volume fraction remains the same after thresholding) which provides the actual compliance if the optimized structures were to be used in practice. We observe that though our method is slower than SIMP, it results in a mesh-free optimization with a better compliance than SIMP and a faster computational time than NTopo.

### Analysis of a 3D cantilever beam example

In Figure 2, we present the convergence history of DMF-TONN and a comparison with 3D SIMP topology optimization for an example with boundary conditions shown in Figure 2a. We use a \(40\times 20\times 8\) grid for the SIMP FEA, which gives 6400 design variables for the topology optimization, and \(6400\times 3=19200\) degrees of freedom (DOF) for the FEA. We use a lesser DOF model, with the number of trainable weights in both our density and displacement networks being 4096 each. We use an initial topology consisting of uniform densities of 0.5 (\(\rho_{init(40\times 20\times 8)}=\mathbf{0.5}\)) as an input for initial training of the displacement network (PINN) and Figure 2d shows the convergence history. Figures 2e, 2f show the displacement field in the \(y\) direction at the cross-section of the domain where the force is applied and the maximum displacement value at different iterations of the initial run of the displacement network. Figure 2c shows the FEA displacement field at this cross section. We see that at the \(1000^{th}\) iteration, the displacement network can learn a very good approximation of the FEA displacement field.

In each of the \(n_{opt}=700\) topology optimization iterations (determined empirically for 3D problems), we use only \(n_{disp}=20\) displacement network iterations and show that this is adequate for achieving results (2h) similar to SIMP (2b). Figure 2g shows the converge history for the topology optimization, with FEA compliance plotted for consistency with SIMP. Our approach takes 588 seconds compared to 227 seconds for SIMP, but achieves mesh-free topology optimization and a better compliance than SIMP for this example.

### Case Study of 3D Cantilever Beam problem

In Figure 3 we compare our fully mesh-free approach with a Finite Element Analysis based Neural Network Topology Optimization (FENN TO) approach (i.e. using a Fourier Features neural network for representing density field and FEA for compliance calculation) and with the conventional SIMP approach. We vary the load location and target volume fraction for the 3D cantilever
\begin{table}
\begin{tabular}{l|l|l|l} \hline \hline Boundary Conditions & DMF-TONN & SIMP (\(60\times 20\times 8\) grid) & SIMP (90\(\times\)30\(\times\)12 grid) \\ \hline Displacement Calculation & 3456 & 28800 & 97200 \\ Degrees of Freedom & & & \\ No. of Optimization Design & 3456 & 9600 & 32400 \\ Variables & & & \\ Convergence Compliance & \(2.40\times 10^{-3}\) & \(2.65\times 10^{-3}\) & \(2.38\times 10^{-3}\) \\ Volume Fraction Achieved & 0.30 & 0.30 & 0.30 \\ Computational Time & 517 s & 99 s & 807 s \\ \hline \hline \end{tabular}
\end{table}
Table 3: Long cantilever beam with bottom load with target volume fraction \(=0.3\)

Figure 4: Long cantilever beam with center load with target volume fraction \(=0.3\)
beam problem. All approaches are run for 700 iterations. We show the plots of the compliance of all three approaches for all these boundary conditions in Figure 2(b) where the x-axis contains the discrete boundary conditions and y-axis represents the compliance for each of these boundary conditions. Our fully mesh-free approach achieves similar compliance values to the existing SIMP and FENN TO approaches for all the boundary conditions in this case study. The total computational times for running all the examples in this case study are 236 minutes, 96 minutes and 124 minutes for DMF-TONN, SIMP and FENN TO respectively.

### Trade-off Analysis of DMF-TONN and SIMP

In Table 3, we present the results for a right bottom end loaded cantilever beam with the ratio of 3 for the lengths of sides in the \(x\) and \(y\) directions (the orientation of the axes is the same as in Figure 1(a)). For the Top3D (SIMP) method, we use their stated convergence criteria of 200 maximum iterations and 0.01 as tolerance of change in topology. Though the degrees of freedom are lesser for DMF-TONN, it still achieves a better compliance than SIMP with a grid of \(60\times 20\times 8\). However, the computational time is much higher for DMF-TONN. Now, we increase the grid size of SIMP to \(90\times 30\times 12\) for achieving a better compliance than DMF-TONN. However, as seen in Table 3, due to the 1.5 times increase in grid size in each direction, there was an exponential increase in computational time for the SIMP method and the computational time of DMF-TONN is lesser than the fine mesh SIMP. This showcases one of the advantages of the mesh-free nature of DMF-TONN, presenting interesting opportunities for tradeoffs to be explored in future research.

### Additional Examples

In Figure 4, the load acts at the center of the right side of a long cantilever beam. The compliance values obtained by DMF-TONN for these boundary conditions are better than those obtained by Top3D (SIMP) (\(60\times 20\times 8\) grid). In Figure 5, the boundary conditions include two loads twisting a beam fixed on its one side. The ideal topology should be a hollowed-out beam, and DMF-TONN correctly outputs a similar topology. For this example, we observe that the compliance of the SIMP (\(60\times 15\times 15\) grid) result is better than that of DMF-TONN. In Figure 6 we present a case with a passive (non-design) region is present in the upper right quarter of the domain. This condition is enforced using an additional constraint violation objective for the density network, where if the density network outputs density values close to 1 in the passive region, the loss is penalized. For this L-Bracket example, the compliance of the result obtained by DMF-TONN is better than that obtained by SIMP (\(30\times 30\times 10\) grid). In Figure 7, both left and right sides are fixed and the load acts at the center of the beam. The compliances of the results obtained by SIMP (\(60\times 20\times 8\) grid) and DMF-TONN are similar for this example.

The computational time for DMF-TONN for each of the presented examples is less than 600 seconds. We use a Young's Modulus (E) \(=1000N/mm^{2}\), Poisson's ratio of 0.3, \(\text{Force}=0.1N\) and we normalize the domain with the longest
Figure 5: Long cantilever beam with two loads with target volume fraction = 0.5

Figure 6: L-Bracket with target volume fraction = 0.2

Figure 7: Bridge with target volume fraction = 0.3
\(\text{side}=1mm\) for all examples. We use 6000 randomly sampled domain points as the batch in each iteration. We use a kernel grid size of 16 in all three directions and set upper and lower bounds of the kernel values to 35 and -35 respectively. We find this hyper-parameters setting works well for all problems, unless when the domain has a markedly skewed size ratio, such as in the long beam and bridge examples. In those cases, one has to accordingly adjust the kernel size in the different directions. In these examples, we use 24 kernel grid points in the longest direction, and 12 kernel grid points in the other directions, and an upper and lower bounds of the kernel values of 45 and -45 respectively, for the results presented. For each of the presented examples, the degrees of freedom are always more for SIMP than for DMF-TONN.

## 5 Conclusion

We show that using directly connected displacement field estimation and density field estimation neural networks is indeed an effective approach for mesh-free topology optimization. We verify through various examples that DMF-TONN, which involves using just one gradient descent step of the density network in each topology optimization epoch without any sensitivity filtering or density filtering leads to comparable results to conventional topology optimization. We significantly reduce the computational time compared to prior related works and also explore the trade-offs between DMF-TONN and SIMP for a cantilever beam example, showcasing the advantage of the mesh-free nature of DMF-TONN.

There are several limitations observed currently with DMF-TONN. The first one concerns the kernels used in the density and displacement neural network. The kernel grid has to be scaled according to the domain size if there exist sides with ratio of lengths greater than or equal to 3. Moreover, we observed that for low target volume fractions (less than 0.2), the kernel is not able to capture the required features and the optimization does not converge.

The SIMP method is certainly still one of the best methods for performing topology optimization, and we emphasize that the goal of this work is not to beat SIMP, but rather to devise new techniques and a class of mesh-free solvers using the advancements in neural networks, for this complex inverse design problem of topology optimization. We show that DMF-TONN works well for various 3D problems and is a stepping stone towards this goal. Future work involves improving the robustness of the kernel, extending the approach to complex problems, and experimenting with and analyzing the effect and advantages of different domain coordinate sampling methods.

## 6 Declaration of Competing Interest

The authors declare that they have no known competing financial interests or personal relationships that could have appeared to influence the work reported in this paper.