GitHub topics: data-reduction
johnkerl/miller
Miller is like awk, sed, cut, join, and sort for name-indexed data such as CSV, TSV, and tabular JSON
Language: Go - Size: 201 MB - Last synced at: 5 days ago - Pushed at: 11 days ago - Stars: 9,281 - Forks: 222
autistic-symposium/interstellar-idl 📦
👾 interstellar dust data reduction and analysis obtained from the stony brook mt. telescope
Language: IDL - Size: 3.34 MB - Last synced at: 2 days ago - Pushed at: 7 months ago - Stars: 13 - Forks: 0
autistic-symposium/exolife-idl 📦
👾 detection of exolife is one of the most important goals for future space missions - this research was performed at the mt. stony brook
Language: TeX - Size: 7.38 MB - Last synced at: 2 days ago - Pushed at: 7 months ago - Stars: 11 - Forks: 0
quince-science/QuinCe
QuinCe is an online tool for processing and quality control of data from scientific instruments, with a primary focus on oceanic data.
Language: Java - Size: 46.6 MB - Last synced at: 7 days ago - Pushed at: 7 days ago - Stars: 7 - Forks: 8
easystats/parameters
:bar_chart: Computation and processing of models' parameters
Language: R - Size: 106 MB - Last synced at: 5 days ago - Pushed at: 11 days ago - Stars: 461 - Forks: 39
szcompressor/cuSZ
A GPU accelerated error-bounded lossy compression for scientific data.
Language: C++ - Size: 44.1 MB - Last synced at: 1 day ago - Pushed at: 1 day ago - Stars: 75 - Forks: 30
KILOGAS/kilogas_imaging
Imaging pipeline for KILOGAS ALMA data.
Language: Python - Size: 3.63 MB - Last synced at: 20 days ago - Pushed at: 20 days ago - Stars: 0 - Forks: 0
UM-BGEN632/week10labs
Repo for week 10 of BGEN632
Language: Jupyter Notebook - Size: 123 KB - Last synced at: 21 days ago - Pushed at: 21 days ago - Stars: 0 - Forks: 1
ohyaiamhere/Modified-Transient-Peak-Ratio
Estimate the equivalent 2nd order characteristics using state data of an oscillatory system
Language: MATLAB - Size: 20.5 KB - Last synced at: 23 days ago - Pushed at: 23 days ago - Stars: 0 - Forks: 0
pykoala/pykoala
A multi-instrument library for IFS data reduction
Language: Jupyter Notebook - Size: 949 MB - Last synced at: about 3 hours ago - Pushed at: about 4 hours ago - Stars: 7 - Forks: 18
Matisse-Consortium/tools
The MATISSE python tools are an addition to the standard data reduction software that is distributed separately by ESO
Language: Python - Size: 200 MB - Last synced at: about 1 month ago - Pushed at: about 1 month ago - Stars: 1 - Forks: 0
jilavsky/SAXS_IgorCode
Irena, Nika, and Indra SAXS Igor code by Jan Ilavsky
Language: IGOR Pro - Size: 232 MB - Last synced at: about 2 months ago - Pushed at: about 2 months ago - Stars: 25 - Forks: 9
heucoder/dimensionality_reduction_alo_codes
特征提取/数据降维:PCA、LDA、MDS、LLE、TSNE等降维算法的python实现
Language: Python - Size: 2.11 MB - Last synced at: about 2 months ago - Pushed at: about 2 years ago - Stars: 2,329 - Forks: 622
lgrcia/prose
Modular image processing pipelines with Python. Built for Astronomy.
Language: Python - Size: 86.1 MB - Last synced at: 10 days ago - Pushed at: 10 days ago - Stars: 57 - Forks: 15
sparc4-dev/astropop Fork of juliotux/astropop
The ASTROnomical POlarimetry and Photometry pipeline
Language: Python - Size: 2.64 MB - Last synced at: 16 days ago - Pushed at: 6 months ago - Stars: 7 - Forks: 4
Mulan-94/mulan-94.github.io
Personal website
Language: HTML - Size: 8.51 MB - Last synced at: 2 months ago - Pushed at: 2 months ago - Stars: 0 - Forks: 0
hortica/Mantid_Bilby
Language: Python - Size: 114 MB - Last synced at: 2 months ago - Pushed at: 2 months ago - Stars: 1 - Forks: 0
TLINDEN/tablizer
Manipulate tabular output of other programs
Language: Go - Size: 2.52 MB - Last synced at: 3 days ago - Pushed at: 3 days ago - Stars: 5 - Forks: 0
ivh/PyReduce
A Python port of the popular IDL data reduction package REDUCE.
Language: Python - Size: 8.22 MB - Last synced at: about 1 month ago - Pushed at: 3 months ago - Stars: 5 - Forks: 20
mackerman44/telemetyr
An R package for processing telemetry observation data.
Language: HTML - Size: 570 MB - Last synced at: 3 months ago - Pushed at: 3 months ago - Stars: 3 - Forks: 0
Matisse-Consortium/community
This repository contains code from members of the MATISSE community
Language: Python - Size: 83 KB - Last synced at: 3 months ago - Pushed at: 3 months ago - Stars: 0 - Forks: 0
USCbiostats/partition
A fast and flexible framework for data reduction in R
Language: HTML - Size: 15.1 MB - Last synced at: 5 days ago - Pushed at: 6 months ago - Stars: 36 - Forks: 4
spyderkam/string-manipulator
A set of tools built for coworkers to manipulate large (data) files.
Language: Python - Size: 555 KB - Last synced at: 4 months ago - Pushed at: 4 months ago - Stars: 0 - Forks: 0
ysBach/NICpolpy
Nishi Harima Astronomical Observatory (NHAO)'s Nishiharima-Infrared Camera (NIC) Polarimetry photometry pipeline.
Language: Python - Size: 10.2 MB - Last synced at: 16 days ago - Pushed at: 4 months ago - Stars: 1 - Forks: 1
nasa/ziggy
Ziggy, a portable, scalable infrastructure for science data processing pipelines, is the child of the Transiting Exoplanet Survey Satellite (TESS) pipeline and the grandchild of the Kepler Pipeline.
Language: Java - Size: 27.4 MB - Last synced at: about 1 month ago - Pushed at: 4 months ago - Stars: 18 - Forks: 4
francesca025/Astrophysical-techniques
Coursework written for: Astrophysical Data Reduction and Analysis Techniques, MASS course offered at the University of Belgrade
Language: Jupyter Notebook - Size: 2.01 MB - Last synced at: 4 months ago - Pushed at: 4 months ago - Stars: 0 - Forks: 0
szcompressor/kokkosSZ
Portable Accelerator Implementation of SZ Lossy Compressor for Scientific Data Using Kokkos
Language: C++ - Size: 23.4 KB - Last synced at: 13 days ago - Pushed at: over 4 years ago - Stars: 3 - Forks: 0
yuguangchen1/KcwiKit
Improving KCWI/KDERP pipeline.
Language: Python - Size: 7.62 MB - Last synced at: about 1 month ago - Pushed at: 4 months ago - Stars: 6 - Forks: 5
garethcmurphy/Data-Reduction-for-Astropy-Astronomy-and-Spectrum-Analysis
Data Reduction for Astropy Astronomy and Spectrum Analysis 🌌✨ This repository provides tools and scripts for **data reduction in astronomy**, including spectrum analysis, background cleaning, and processing pipelines for **Level 1** and **Level 2** data using **Astropy**. --- ## Features ✨ - **Spectrum Cleaning**: Remove noise and backgrou
Language: Jupyter Notebook - Size: 2 MB - Last synced at: 5 months ago - Pushed at: 5 months ago - Stars: 0 - Forks: 0
garethcmurphy/SciCatPlot-Automated-Plotting-and-Attachment-Tool-for-Neutron-Experiments-
SciCatPlot 📊✨ Automated Plotting and Attachment Tool for Neutron Experiments Overview 🌟 SciCatPlot is a Python-based tool designed to streamline the visualization and cataloging of neutron experiment data in the SciCat data catalogue.
Language: Python - Size: 271 KB - Last synced at: 3 months ago - Pushed at: 5 months ago - Stars: 0 - Forks: 0
adonath/snakemake-workflow-fermi-lat
A Snakemake workflow for Fermi-LAT data reduction
Language: Python - Size: 88.9 KB - Last synced at: 12 days ago - Pushed at: 5 months ago - Stars: 12 - Forks: 1
MBSck/matadrs
The (modular) MATISSE Automated Data Reduction Software (Matadrs) is a tool written to encompass all the individual steps and files needed to procure and reduce data generally and easily in as few steps as possible
Language: Python - Size: 149 MB - Last synced at: 6 months ago - Pushed at: 6 months ago - Stars: 1 - Forks: 0
gramian/hapod 📦
HAPOD - Hierarchical Approximate Proper Orthogonal Decomposition
Language: MATLAB - Size: 26.4 KB - Last synced at: 6 days ago - Pushed at: over 3 years ago - Stars: 15 - Forks: 4
cylammarco/ASPIRED
Automated SpectroPhotometric Image REDuction (ASPIRED)
Language: Python - Size: 196 MB - Last synced at: 28 days ago - Pushed at: over 1 year ago - Stars: 30 - Forks: 4
njcuk9999/apero-drs
A PipelinE to Reduce Observations - The DRS for SPIRou (CFHT)
Language: Python - Size: 633 MB - Last synced at: 10 days ago - Pushed at: 10 days ago - Stars: 12 - Forks: 1
juliahaas1/STAT449-Midterm
The purpose of this report is to investigate the historical dataset processed.heartdisease.txt that includes 303 patients at risk of heart disease displaying 14 different recorded fields.
Size: 94.7 KB - Last synced at: 7 months ago - Pushed at: 7 months ago - Stars: 0 - Forks: 0
zahiriddin-rustamov/gais
Graph Attention-based Instance Selection (GAIS). Python package for a novel instance selection method utilizing graph attention networks.
Size: 1000 Bytes - Last synced at: 7 months ago - Pushed at: 8 months ago - Stars: 0 - Forks: 0
HoganHPH/RSLDA-in-Python
A Python implementation of RSLDA (paper "Robust Sparse Linear Discriminant Analysis").
Language: Jupyter Notebook - Size: 362 MB - Last synced at: 5 months ago - Pushed at: about 2 years ago - Stars: 3 - Forks: 0
attipaci/crush
Data reduction and imaging for select astronomical cameras
Language: Java - Size: 11.6 MB - Last synced at: 3 months ago - Pushed at: 8 months ago - Stars: 1 - Forks: 0
gabeweible/LBT_Direct_Imaging
Various IDL procedures as part of a direct imaging data reduction and analysis pipeline for LBT data.
Language: IDL - Size: 399 KB - Last synced at: 9 months ago - Pushed at: 9 months ago - Stars: 0 - Forks: 0
YasminFathy/AMDRIoT
A prediction-based data reduction method that exploits LMS adaptive filters in the Internet of Things
Language: Matlab - Size: 71.3 KB - Last synced at: 9 months ago - Pushed at: over 7 years ago - Stars: 8 - Forks: 2
avikhagol/setisim
SETI Synthesis Imaging (SETISIM) : A python based package for Synthesis Imaging using CASA for SETI. Spectral Imaging for uGMRT data
Language: Python - Size: 1.29 MB - Last synced at: 6 days ago - Pushed at: 10 months ago - Stars: 1 - Forks: 0
adonath/snakemake-workflow-chandra
A Snakemake workflow for Chandra data reduction
Language: Python - Size: 518 KB - Last synced at: about 1 month ago - Pushed at: 10 months ago - Stars: 0 - Forks: 0
sPaMFouR/RedPipe
Python Scripts for Data Reduction and Analysis
Language: Jupyter Notebook - Size: 1.84 MB - Last synced at: 11 months ago - Pushed at: 11 months ago - Stars: 7 - Forks: 5
sebastian-raubach/humbug
Humbug is a multi-platform barcode generator which can be used alongside our Germinate Scan application to generate sheets of user-defined barcodes to aid in the recording of data in the field or glasshouse.
Language: Java - Size: 61.9 MB - Last synced at: about 1 year ago - Pushed at: almost 6 years ago - Stars: 1 - Forks: 1
englhardt/OneClassSampling.jl
A Julia package for one-class classification sampling methods.
Language: Julia - Size: 30.3 KB - Last synced at: about 1 year ago - Pushed at: about 3 years ago - Stars: 0 - Forks: 0
mdecleir/DRESSCode
DRESSCode (Data Reduction of Extended SWIFT Sources Code)
Language: Python - Size: 156 KB - Last synced at: about 1 year ago - Pushed at: about 4 years ago - Stars: 3 - Forks: 0
discos/CAP
Cross-scan Analysis Pipeline
Language: IDL - Size: 107 KB - Last synced at: about 1 year ago - Pushed at: over 3 years ago - Stars: 0 - Forks: 0
szcompressor/CEAZ
An implementation of SZ lossy compression in Vivado HLS for Xilinx FPGAs.
Language: C - Size: 348 KB - Last synced at: 13 days ago - Pushed at: almost 4 years ago - Stars: 6 - Forks: 2
bghojogh/Principal-Sample-Analysis
The code for Principal Sample Analysis (PSA) for prototype selection and instance ranking
Language: Python - Size: 1.64 MB - Last synced at: over 1 year ago - Pushed at: over 1 year ago - Stars: 2 - Forks: 0
madhurimarawat/Pattern-Recognition-and-Machine-Learning
This repository contains Pattern Recognition and Machine Learning programs in the Python programming language.
Language: Jupyter Notebook - Size: 3.64 MB - Last synced at: 3 months ago - Pushed at: over 1 year ago - Stars: 0 - Forks: 0
JalalQ/4023-Anaconda-Cutomer-Segmentation
Using Anacnda Jupyter notebook (Python) to perform customer segmentation, and classification of customer based on the segmentation.
Language: Jupyter Notebook - Size: 3.57 MB - Last synced at: over 1 year ago - Pushed at: almost 4 years ago - Stars: 0 - Forks: 0
neutronimaging/ToFImaging
Tool package for neutron time of flight analysis
Language: Jupyter Notebook - Size: 95.1 MB - Last synced at: 26 days ago - Pushed at: over 1 year ago - Stars: 7 - Forks: 2
meganzj/CMU_IntermediaStat_36.705
Size: 60.5 KB - Last synced at: over 1 year ago - Pushed at: over 6 years ago - Stars: 0 - Forks: 0
Dhaif/R_PCA
R routines for Principal Components Analysis, followed by regression and visualization plot.
Language: R - Size: 31.3 KB - Last synced at: over 1 year ago - Pushed at: almost 5 years ago - Stars: 0 - Forks: 0
englhardt/ocs-evaluation
Scripts and notebooks to reproduce the experiments and analyses of the paper Adrian Englhardt, Holger Trittenbach, Daniel Kottke, Bernhard Sick, Klemens Böhm, "Efficient SVDD sampling with approximation guarantees for the decision boundary", Machine Learning (2022).
Language: Jupyter Notebook - Size: 6.74 MB - Last synced at: about 1 year ago - Pushed at: about 3 years ago - Stars: 1 - Forks: 1
astrochun/GNIRSLongSlit
Python 2.7 codes to reduce Longslit data from Gemini-N/GNIRS
Language: Python - Size: 496 KB - Last synced at: about 2 months ago - Pushed at: over 5 years ago - Stars: 0 - Forks: 0
Chen-Si-An/Douglas-Peucker
An algorithm implementing down-sampling for given 2D points
Language: C++ - Size: 121 KB - Last synced at: about 2 years ago - Pushed at: about 2 years ago - Stars: 0 - Forks: 0
ronnyerrmann/HiFLEx
Pipeline to reduce echelle data (taken with a single or bifurcated fiber input)
Language: Python - Size: 194 MB - Last synced at: over 1 year ago - Pushed at: over 1 year ago - Stars: 12 - Forks: 2
spacetelescope/DRESSCode
DRESSCode (Data Reduction of Extended SWIFT Sources Code)
Language: Python - Size: 941 KB - Last synced at: about 1 year ago - Pushed at: almost 2 years ago - Stars: 5 - Forks: 0
Josue-Espinosa-Cruz/GeoJSON_DataReduction
Procedures to minimize GeoJSON data while keeping relevant morphological structures.
Language: Jupyter Notebook - Size: 25.6 MB - Last synced at: about 2 years ago - Pushed at: almost 3 years ago - Stars: 0 - Forks: 0
dennisvang/dope
Douglas-Peucker line simplification
Language: Python - Size: 772 KB - Last synced at: 16 days ago - Pushed at: about 2 years ago - Stars: 0 - Forks: 0
Fatemeh-ameri/Data-science-algorithms
Algorithms for Data Science
Language: Python - Size: 8.79 KB - Last synced at: about 2 years ago - Pushed at: over 2 years ago - Stars: 1 - Forks: 0
dodiku/audio_noise_clustering
https://dodiku.github.io/audio_noise_clustering/results/ ==> An experiment with a variety of clustering (and clustering-like) techniques to reduce noise on an audio speech recording.
Language: Python - Size: 1.04 GB - Last synced at: about 2 years ago - Pushed at: about 8 years ago - Stars: 25 - Forks: 11
apriantoni/DokumentasiTesis2022
Language: Jupyter Notebook - Size: 11.2 MB - Last synced at: about 2 years ago - Pushed at: over 2 years ago - Stars: 0 - Forks: 0
bghojogh/Prototype-Selection-Matrix-Decomposition
The code for prototype selection and instance ranking using matrix decomposition and subspace learning
Language: Python - Size: 23.4 KB - Last synced at: about 2 years ago - Pushed at: over 4 years ago - Stars: 1 - Forks: 0
timur-mufakharov/Tconred
The software for visualised data reduction of the Tianma 65-m telescope cross-scan continuum observations
Language: Python - Size: 33.2 KB - Last synced at: about 2 years ago - Pushed at: almost 3 years ago - Stars: 0 - Forks: 0
timur-mufakharov/Tconred_commandline
Procedures for data reduction of the Tianma 65-m telescope radio continuum data
Language: Python - Size: 20.5 KB - Last synced at: about 2 years ago - Pushed at: almost 3 years ago - Stars: 0 - Forks: 0
behjava/automatic_data_reduction
Fast and automatic data reduction pipeline for small optical telescopes data.
Language: Python - Size: 984 KB - Last synced at: about 2 years ago - Pushed at: over 4 years ago - Stars: 1 - Forks: 0
Foroozani/Machine-Learning
:construction: ML algorithms, employing different approaches
Language: Jupyter Notebook - Size: 46.6 MB - Last synced at: about 2 years ago - Pushed at: over 3 years ago - Stars: 2 - Forks: 1
jeenalee/tv1d
Total variation denoising algorithms for 1D data.
Language: Rust - Size: 120 KB - Last synced at: 19 days ago - Pushed at: about 8 years ago - Stars: 5 - Forks: 2
chr-peters/efficient-probit-regression
This is the accompanying code repository for the AISTATS 2022 publication p-Generalized Probit Regression and Scalable Maximum Likelihood Estimation via Sketching and Coresets by Alexander Munteanu, Simon Omlor and Christian Peters.
Language: Jupyter Notebook - Size: 1.26 GB - Last synced at: about 2 years ago - Pushed at: over 3 years ago - Stars: 3 - Forks: 1
juliandavidmr/TrelloResume
Converts trello data into fast read information
Language: JavaScript - Size: 1.21 MB - Last synced at: about 1 month ago - Pushed at: almost 8 years ago - Stars: 16 - Forks: 5
angelrodes/ICPOES-datared
ICPOES data reduction from Qtegra raw data
Language: MATLAB - Size: 157 KB - Last synced at: about 2 years ago - Pushed at: about 3 years ago - Stars: 0 - Forks: 0
venondev/AlmostCliquePoly
Implementation of the data reduction rule AlmostClique by Böcker et al.. This repository is part of my bachelor thesis.
Language: C++ - Size: 1.1 MB - Last synced at: about 2 months ago - Pushed at: over 3 years ago - Stars: 0 - Forks: 0
zzak00/Bank-Marketing-Campaign-Subscriptions
predict client subscription to bank products
Language: Jupyter Notebook - Size: 2.23 MB - Last synced at: about 2 years ago - Pushed at: over 3 years ago - Stars: 1 - Forks: 0
khushi-411/emotion-recognition
All about emotion recognition.
Language: Jupyter Notebook - Size: 3.83 MB - Last synced at: about 2 years ago - Pushed at: over 3 years ago - Stars: 0 - Forks: 0
geminiplanetimager/gpi_pipeline
Gemini Planet Imager Data Reduction Pipeline
Language: Prolog - Size: 39.1 MB - Last synced at: about 2 years ago - Pushed at: almost 4 years ago - Stars: 8 - Forks: 6
jjlynch2/CentroidBanding
R package providing Centroid Banding
Language: R - Size: 15.4 MB - Last synced at: 7 months ago - Pushed at: over 5 years ago - Stars: 0 - Forks: 0
bghojogh/Curvature-Anomaly-Detection
The code for Curvature Anomaly Detection (CAD), kernel CAD, inverse CAD (iCAD), and kernel iCAD for anomaly detection and prototype selection. It uses the theory of Polyhedron Curvature or angular defect of polyhedron.
Language: Python - Size: 83 KB - Last synced at: about 2 years ago - Pushed at: almost 5 years ago - Stars: 1 - Forks: 0
iwbdr/iwbdr20
The 1st International Workshop on Big Data Reduction
Language: HTML - Size: 86.9 KB - Last synced at: about 2 years ago - Pushed at: over 4 years ago - Stars: 0 - Forks: 0
nejci/PRAr
Partition relevance analysis with the reduction step
Language: MATLAB - Size: 87.2 MB - Last synced at: about 2 years ago - Pushed at: almost 5 years ago - Stars: 2 - Forks: 1
wilsonjefferson/CE_OS
Operating Systems - bachelor's degree course
Language: C - Size: 6.54 MB - Last synced at: over 1 year ago - Pushed at: over 4 years ago - Stars: 0 - Forks: 0
castroavila/xmm_newton_analysis_scripts
Scripts intended to assist in XMM-Newton data reduction and analysis
Language: Shell - Size: 17.6 KB - Last synced at: about 2 years ago - Pushed at: over 5 years ago - Stars: 0 - Forks: 0
USCbiostats/partition.archive
Language: R - Size: 761 KB - Last synced at: 3 months ago - Pushed at: almost 7 years ago - Stars: 0 - Forks: 1
abatten/muse-reduction
A script used to reduce the data from the MUSE instrument on the VLT
Language: Python - Size: 9.77 KB - Last synced at: about 2 years ago - Pushed at: over 7 years ago - Stars: 2 - Forks: 0
emirkmo/GeminiReductionsZTF
Gemini Reductions for ZTF
Language: Matlab - Size: 135 KB - Last synced at: about 2 years ago - Pushed at: over 6 years ago - Stars: 0 - Forks: 0
jhetherly/sparse_linear_binning
Python function for performing a linear binning (a la Wand and Jones) and optimized for sparsity
Language: C++ - Size: 1.55 MB - Last synced at: 30 days ago - Pushed at: over 7 years ago - Stars: 1 - Forks: 0
jhetherly/linear_binning
Python function for performing a linear binning (a la Wand and Jones)
Language: C++ - Size: 994 KB - Last synced at: 23 days ago - Pushed at: over 7 years ago - Stars: 0 - Forks: 0