Mastering large data processing with mpi4py in python
Explore the power of mpi4py for simplifying data distribution in parallel computing with its efficient broadcast functionality, which seamlessly sends data f...
For Developers
You write code. Maybe you build data pipelines, tune algorithms, or just enjoy a good hands-on tutorial. Everything on this track — Python, algorithms, DevOps, data engineering, web apps, machine learning — works on its own terms: no earth-science background needed. (When a post uses an earthquake as the example dataset, that's just a more interesting dataset.)
Web apps & computing Tutorial collections All posts
Start with these
Object oriented programming (oop) with examples in python
This post explains the concepts of object-oriented programming (OOP) and its key features, including encapsulation, abstraction, inheritance, and polymorphis...
Build a multilingual local voice journal app with fastapi and whisper (beginner guide)
A beginner-friendly walkthrough to build and run Whisper Journal with multilingual dictation, local Whisper transcription, AI-assisted title/tag generation, ...
Understanding docker: a beginner’s guide for geophysics students
A practical introduction to Docker for geophysics students, including images, containers, volumes, and a simple workflow for reproducible seismic data analys...
How to set up ssh-keys for github
You will learn how to generate and set up an SSH key for github so that you don’t need to always type your username and password when accessing github repo.
All posts on this track (91)
Prefer one chronological stream of everything? See all recent posts.
2026 5
Modern seismic monitoring systems: how ml and the cloud build earthquake catalogs
A tour of how modern earthquake-monitoring systems turn continuous seismic waveforms into earthquake catalogs — the ML pipeline of picking, association, and ...
Build a multilingual local voice journal app with fastapi and whisper (beginner guide)
A beginner-friendly walkthrough to build and run Whisper Journal with multilingual dictation, local Whisper transcription, AI-assisted title/tag generation, ...
Seismoalert: a real-time earthquake monitoring toolkit in python (codes included)
I built SeismoAlert to fetch USGS earthquake data, run statistical analysis, detect anomalies, and generate interactive maps from a single CLI.
From code to monitoring: fastapi calculator devops pipeline (complete beginner guide)
A practical, beginner-friendly walkthrough of a complete FastAPI DevOps workflow: clean code, layered testing, CI with Jenkins and GitHub Actions, and runtim...
Turning your home computer into a home server you can access remotely
Turn your everyday computer into a home server you can access from anywhere using Dynamic DNS, a simple update script, and secure SSH access.
2025 1
Macos file indexing using python
A Python-based solution for indexing and searching files on a macOS system using SQLite, FAISS, and semantic search.
2024 9
The impact of cloud computing on geophysical and seismological research
Cloud computing is transforming geophysical and seismological research by enabling scalable processing, faster collaboration, and reproducible workflows for ...
Understanding docker: a beginner’s guide for geophysics students
A practical introduction to Docker for geophysics students, including images, containers, volumes, and a simple workflow for reproducible seismic data analys...
Getting started with databricks for big data analysis
Learn how to set up Databricks, create your first Spark cluster, upload data, and run PySpark notebooks for scalable big data analysis.
Solving a toy earthquake location problem using a genetic algorithm
Discover how Genetic Algorithms can be applied to solve the earthquake location problem in seismology. This post walks through generating synthetic seismic d...
How to sync zotero files using webdav and google drive with koofr: a step-by-step guide
Learn how to seamlessly sync your Zotero files across devices using WebDAV with Koofr and Google Drive. This step-by-step guide ensures your research materia...
Rabbitmq for seismic waveforms: enabling reliable data communication
Learn how to use RabbitMQ with Python to publish and consume seismic waveform messages reliably in real time for distributed seismology workflows.
Understanding the metropolis-hastings algorithm: a step-by-step guide with python examples
The Metropolis-Hastings algorithm is a cornerstone of Markov Chain Monte Carlo (MCMC) methods, enabling us to generate samples from complex probability distr...
Mastering large data processing with mpi4py in python
Explore the power of mpi4py for simplifying data distribution in parallel computing with its efficient broadcast functionality, which seamlessly sends data f...
How to relocate your anaconda or miniconda installation on linux
Navigating the complexities of relocating your Anaconda or Miniconda installation on a Linux system can be daunting. This concise guide provides a step-by-st...
2023 5
Exploring the multi-taper method: a robust approach for time-frequency analysis
Explore the Multi-Taper Method’s unique ability to refine spectral estimates in seismology. Leveraging multiple orthogonal tapers, this approach minimizes va...
What is pink noise and how is it different from white noise?
Pink noise, also known as 1/f noise or flicker noise, is a type of random signal that has equal energy per octave. It is called pink because it is analogous ...
How to read a scientific research paper using a large language model?
Python script to read a PDF document, and perform question-answering on the document, and to generate an output based on the provided query
Object oriented programming (oop) with examples in python
This post explains the concepts of object-oriented programming (OOP) and its key features, including encapsulation, abstraction, inheritance, and polymorphis...
Using mpi4py for parallel computing in python on supercomputers
The article discusses the mpi4py module, which is a Python wrapper for MPI, used for parallel computing in supercomputing environments. It provides higher-le...
2022 8
How to plot the boundaries of the states on the basemap of the usa
We will plot the boundaries of the states of the USA on a basemap figure
How to set up ssh-keys for github
You will learn how to generate and set up an SSH key for github so that you don’t need to always type your username and password when accessing github repo.
How to load dynamic libraries in c/c++?
We will see how to load shared libraries in C/C++. We will write a library to convert km to degrees and vice-versa. Then we create a utility program to conve...
Read yaml input file in bash, c/c++ and python
We will see how to read a YAML file in Bash, C/C++ and Python.
Threading in c/c++ programming language using pthreads
Using multiple threads in C for concurrent process flow
What are linked lists in data structures?
We look into a quick overview of the idea of linked list data structure with some examples.
Numerical optimization based on the l-bfgs method
We will inspect the L-BFGS optimization method using one example and compare its performance with the gradient descent method
Create beamer slides using python
We will use the Python package to create beamer presentation and append existing figures to each slide
2021 44
How to deal with irregularly sampled time series data
While analyzing time series data, we often come across data that is non-uniformly sampled, i.e., they have non-equidistant time-steps. Infact, most of the re...
The easiest way to publish a python package on pypi using poetry
We will learn how to use the poetry package to create, manage, build and publish Python package on PyPI
Encrypt your data and software with python
Learn to encrypt and decrypt any files, data or software with python
Perform distributed computing easily using ray in python
We will introduce the concepts of distributed computing and then use the open-source Python library Ray to write scalable codes that can work on distributed ...
Using dask python library to read a huge global earthquake catalog file
We will see how we can read a large data file with earthquake catalog in Python using the Dask library
Convolution of waveforms using python compared to matlab
We will see compare the convolution functions in Python (Numpy) with the conv function in MATLAB. If you have tried them both then you would know that its no...
Read and write text files in modern fortran
We will read and write text and numeric data into a file using modern fortran.
Convert any text to lifelike speech using amazon polly
We will see how we can use amazon web services, specifically amazon polly to convert any text into a speech
How to install jekyll on apple m1 macbook
If you have recently bought a M1 mac and have been doing blogging using Jekyll, then you must have experienced that installing Jekyll on the M1 architecture ...
How to create a simple makefile in linux
We learn how to write a Makefile to automate the compilation of our source code. We will use one example from Fortran.
Maximum likelihood estimation for the regression parameters
We will learn the basics of the maximum likelihood method, and then apply it on a regression problem. We will also compare it with the least-squares estimati...
Solving boundary value problems using the shooting method
The boundary value problems require information at the present time and a future time. We will see how we can use shooting method to solve problems where we ...
Efficiently compute spectrogram for large dataset in python
Librosa can efficiently compute the spectrogram for large time series data in seconds. We will use that to plot the spectrogram using matplotlib
How to overlay shapefile data on pygmt maps
We learn how to plot selected shapefile data using geopandas on top of PyGMT maps
Numerically solving initial value problems using the runge-kutta method
Runge-Kutta methods are most popular method to solve ordinary differential equations (ODEs) with a better approximation than the Euler method. We compare the...
Numerically solving initial value problems using the euler method
The simplest algorithm to solve a system of differential equations is the Euler method. We understand the Euler method by looking into a simple heat transfer...
How to link unsplash images directly to your jekyll blog
How can you link unsplash images directly to your blog without hosting it locally.
How to extract station data from the web page
Uses pandas to read the html page and extract the html data into pandas dataframe
How to implement the iterative newton–raphson method to find roots of a function in python
The Newton–Raphson method (commonly known as Newton’s method) is developed for finding roots of a given function or polynomial iteratively. We show two examp...
How to host a http server on your linux computer to share files
Spin up a zero-dependency web server with Python’s built-in http.server to share files or preview a site on your local network.
How effective is the signal denoising using the matlab based wavelet analysis
We see how to download seismic waveforms, convert them into mat format from mini-seed and then perform denoising using wavelet analysis. We first performed w...
Make your python script executable from anywhere in linux
Follow the instructions to make your python script executable from anywhere in Linux system.
How to securely send data from local client to remote server using paramiko (codes included)
Paramiko module can be used in Python to securely send data from the local client to the remote server. It is analogous to the SSH and SCP in Linux.
Towards multi-resolution analysis with wavelet transform
We will learn the basic concepts of wavelet tranform and multi-resolution analysis starting from the Fourier Transform, and Gabor Transform.
Computing cross-correlation and spectrogram of two seismic traces (codes included)
Read the seismic traces from the miniseed files and compute the cross-correlation and spectrogram
Principal component analysis to decompose signals and reduce dimensionality (codes included)
Use Principal Component Analysis (via SVD) to decompose a space-time signal into a few dominant modes and reduce its dimensionality, with Python code.
Signal denoising using fourier analysis in python (codes included)
We will learn the basics of Fourier analysis and implement it to remove noise from the synthetic and real signals
Transfer learning applied on the unsplash data using alexnet pretrained network (codes included)
Transfer learning using the pre-trained deep learning networks from MATLAB can be easily implemented to achieve fast and impressive results
Getting familiar with pytorch data structures (codes included)
In this introduction to the concepts of Pytorch data structures, we will learn about how to create and reshape tensors using Pytorch and compare it with the ...
How to analyze a huge data file with pandas (codes included)
We learn how to read huge csv file containing time series data by breaking it into chunks and then visualizing it with matplotlib
Pyqt5 application for visualizing ambient sound in real-time (codes included)
A PyQt5 application for retrieving and visualizing sound waveforms in real time. Codes included.
How to start using pandas immediately for earth data analysis (codes included)
This tutorial gives a brief description of scientific computing using Pandas by introducing Series, DataFrame, Pandas common operations, methods, conditional...
Introduction to numpy for scientific computing
This tutorial gives a brief description of scientific computing using numpy by introducing arrays, methods, attributes, random numbers, indexing, broadcastin...
A quick look into the sktime for time-series forecasting (codes included)
I used the sktime library to forecast the airline data using NaiveForecaster, KNeighborsRegressor, Statistical forecasters, and auto ARIMA model.
The right way to loop in python (codes included)
What is the fastest and most efficient way to loop in Python. We found that the numpy is fastest and python builtins are the most memory efficient.
Genetic algorithm: a highly robust inversion scheme for geophysical applications (codes included)
An introduction to the basics of genetic algorithm along with a simple numerical example and solution of an earthquake location problem
Genetic algorithm: a highly robust inversion scheme for geophysical applications
An introduction to the basics of genetic algorithm along with a simple numerical example and solution of an earthquake location problem
Easily integrate custom functions in matlab with python (codes included)
How can we use the MATLAB functions in Python? MATLAB implementation are usually reliable as it is developed by the professionals. But the advantages of usin...
Monte carlo methods and earthquake location problem (codes included)
The common geophysical problems most often have multimodal objective function with many possible minima. In this post, we will look into the Monte Carlo meth...
Writing and formatting a scientific manuscript in microsoft word
If you are ready to use the Microsoft Word as your favourite tool for writing your awesome scientific thoughts and ideas into a manuscript, then I would like...
A modern system monitor app in python (codes included)
I built a cross-platform Python desktop app to monitor CPU, RAM, disk, processes, and network usage in real time.
Build a flask web application: sea level rise monitoring (codes included)
This post gives a quick introduction on how to build a web application using Flask and deploy on Heroku server. Then, I share my codes for building advanced ...
Speed-up your codes by parallel computing in python (codes included)
Parallel computing is quickly becoming a necessity. Modern computers comes with more than one process and we most often only use single process to do most of...
Advanced 2d plots with matplotlib in python (codes included)
Codes for plotting advanced 2D plots using matplotlib library in Python. Includes simple 2D plot, error bars, bar graphs, histograms, multiple plots, etc
2020 14
Hypothesis test for the significance of linear trend using the monte carlo simulations (codes included)
We pose a null hypothesis and enquire that given that the null hypothesis is true, how likely is the observed pattern of results? This likelihood is known as...
Writing netcdf4 data using python (codes included)
NetCDF file format has been designed for storing multidimensional scientific data such as temperature, rainfall, humidity, etc. In this post, we will see how...
Time series analysis in python: filtering or smoothing data (codes included)
In this post, we will see how we can use Python to low-pass filter the 10 year long daily fluctuations of GPS time series. We need to use the “Scipy” package...
How to insert equation numbering in ms word
It is essential to insert equation numbers in your thesis and/or any scientific paper. In this post, I will show you some of the easiest ways to insert equat...
Reading netcdf4 data in python (codes included)
In Earth Sciences, we often deal with multidimensional data structures such as climate data, GPS data. It ‘s hard to save such data in text files as it would...
Writing scientific papers in ulysses
Ulysses is a natural, freestyle way of writing. If you got any idea, just write it down, worry about the format and other things when you’re done. Don’t let ...
Plotting track and trajectory of tropical cyclones on a topographic map in python (codes included)
Short demonstration of how to plot the track or trajectory of a hurricane on a map. Codes are included.
![Some handy mac tweaks [macos]](https://earthinversion.s3.us-west-1.amazonaws.com/mac-tweaks/open-in-terminal.jpg)
Some handy mac tweaks [macos]
Some handy tweaks for mac like relocating default screenshot location, renaming batch files etc
![Introduction to automating mac [macos]](https://earthinversion.s3.us-west-1.amazonaws.com/mac-automation/automator.jpg)
Introduction to automating mac [macos]
Mac can be easily automated by the help of several tools such as automator, quick actions, applescripts
![Iphone shortcut to quickly log body temperature [ios]](https://earthinversion.s3.us-west-1.amazonaws.com/iosShortcuts/Fig2.jpg)
Iphone shortcut to quickly log body temperature [ios]
Shortcut code for quickly logging temperature in Apple health app
![Mac quick action to rate the songs in apple music app [macos]](https://earthinversion.s3.us-west-1.amazonaws.com/mac-quick-action/figure0.jpeg)
Mac quick action to rate the songs in apple music app [macos]
Quick action for mac to easily love, dislike, rate songs in apple music app
Monte carlo simulation to test for the correlation between two dataset in matlab (codes included)
We test for the correlation coefficients or the covariance between two sets of random numbers selected from normal distribution using the Monte Carlo simulat...
Easy statistical analysis using the tools of matlab (codes included)
Visualize the statistics of the data using MATLAB: mean, median, std, interquartile range, skewness, kurtosis, t-statistic, degrees of freedom
Hypothesis test in matlab (codes included)
Using Randomization to test the disprove the null hypothesis
2019 4
Estimation of the degrees of freedom of time series in python (codes included)
Two time series with predominant linear trends (very low DOF) can have a very high correlation coefficient, which can hardly be construed as an evidence for ...
Interactive data visualization in python using bokeh
A basic to advanced guide to making interactive plots in Bokeh.
![Why we should use generators? [python]](https://earthinversion.s3.us-west-1.amazonaws.com/results_generators.png)
Why we should use generators? [python]
Generators don’t hold the entire result in memory. It yields one result at a time.
Using github for team collaboration
Tutorial on how to use Git and GitHub for team collaboration on a project. Content includes installing, setting up, creating a repository, making commits, un...
2017 1
Introduction to python for beginners
In this tutorial post, I give a quick demo of how to install Python (using anaconda) and then getting started with writing simple scripts.
Curious what the code is used for?
These are the blog's most algorithm-flavored earth-science posts — no geophysics background needed:
Fresh ideas for builders, in your inbox
Algorithms, data science, and the tools that make modern software tick — delivered as concise, hands-on tutorials you can run today. Unsubscribe anytime.