Spacecraft Trajectory Optimization

Trajectory optimization using AI

Spacecraft mission will become more common. There are relevant open projects such that Mars colonization and exploring missions outside the Solar System.

These missions require high accuracy calculations because the error propagates in time and would be able to modify the trajectory.

There are many ways to face this problem: analytical or numerical approaches.

The analytical approaches could only be used for simplified problems, and thus it is really restrictive.

The numerical approaches commonly used and include metaheuristics and nonlinear programming. I have used genetic algorithms to solve a basic problem which consists of optimizing trajectory to travel to Mars from the Earth.

Continue reading “Spacecraft Trajectory Optimization”

Nuclear Fusion + AI

Fusion Reactor Simulations + Deep learning

Fusion power is a proposed form of power generation that would generate electricity by using heat from nuclear fusion reactions.

There are many methods to achieve the fusion: magnetic confinement, inertial confinement, electric pinches, inertial electrostatic confinement, …

magnetic confinement – tokamak

Pulsotron is a Tokamak fusion power reactor. It is an evolutionary prototype that was designed by Javier Luis López. The simulations were made using C++ and OpenGL.

Continue reading “Nuclear Fusion + AI”

CPU vs GPU | Neural Network

GPU vs CPU neural network

I have done two libraries for AI,

  • CPU with Eigen 1 2
  • GPU with CUDA 1 2

They are optimized and work properly. However, there are significant differences in performance.

The GPU library can adapt to other Nvidia graphic card and furthermore improve the time that I obtain within my circumstances. In addition, the graphics card industry is constantly improving their models and we have recently seen the clusters of the graphics card in the business.

The CPU library is stable and can work on any computer because it does not rely on Nvidia hardware, it is a completely cross-platform library that only needs Eigen library which is compatible with every OS.

I have used for the test: i7-7700k vs Nvidia GeForce GTX 1070

Continue reading “CPU vs GPU | Neural Network”

AI + GPU

Deep Neural Network in GPU

I have been developing a neural network API for GPUs. It is based on CUDA technology and I tried to exploit the full potential of the computer.

Most of us, do not know the real potential of GPUs in AI. This kind of hardware is specialized in logical operations and it was used by the industry of engines and videogames. Some years ago, we have experienced a ‘boom’ in graphics cards, the improvement in speed, price and the ease of programming had triggered a new mother-lode.

GPUs provide a bunch of parallelism algorithms to improve performance.

As we know, neural networks use matrix-to-matrix and matrix-to-vector operations. We can take advance in the optimization of them. Unfortunately, feed-forward and backpropagation are linear functions, they can neither be optimized nor parallelized.

    \[Output=\sigma(W*\sigma(...\sigma(W*Input+Bias)...)+Bias)\]

Continue reading “AI + GPU”

RNN, LSTM & GRU

Recurrent Neural Network (RNN), Long-Short Term Memory (LSTM) & Gated Recurrent Unit (GRU)

Is a type of artificial neural network where connections between nodes form a sequence. This allows temporal dynamic behavior for time sequence.
There are 3 types of vanilla recurrent neural network: the simple (RNN), gated recurrent unit (GRU) and long short term memory unit (LSTM).

Continue reading “RNN, LSTM & GRU”

Autonomous Car – Learning Algorithms

Genetic algorithm and Backpropagation in autonomous cars

Autonomous cars need learning in order to recognize their environment and behave consistently. Neural networks give us the opportunity to develop complex behaviors and tasks like driving.

I have implemented two algorithms that are widely used in machine learning: backpropagation (supervised learning) and genetic algorithm (reinforcement learning).

Continue reading “Autonomous Car – Learning Algorithms”