GitHub topics: large-dataset

Repositories

matteodelabre/saxophone

Fast and lightweight event-driven streaming XML parser in pure JavaScript

Language: JavaScript - Size: 624 KB - Last synced at: 3 days ago - Pushed at: about 2 years ago - Stars: 38 - Forks: 21

DimitriVavoulisPortfolio/aws-serverless-nlp-sentiment-4M-product-reviews

This is a production ready DistilBERT Sentiment Analysis model designed to work as a low cost market research tool with the nuiance of an actual market researcher.

Language: Python - Size: 1.93 MB - Last synced at: 10 days ago - Pushed at: 10 days ago - Stars: 0 - Forks: 0

OpenDriveLab/DriveAGI

[CVPR 2024 Highlight] GenAD: Generalized Predictive Model for Autonomous Driving & Foundation Models in Autonomous System

Language: Python - Size: 13.4 MB - Last synced at: 10 days ago - Pushed at: 3 months ago - Stars: 708 - Forks: 32

gjcampbell/ooffice

Some components for internal, line of business angular apps

Language: TypeScript - Size: 1.75 MB - Last synced at: 15 days ago - Pushed at: over 2 years ago - Stars: 7 - Forks: 2

ec-jrc/Thalassa

Large scale visualizations of unstructured mesh data

Language: Python - Size: 15.6 MB - Last synced at: 9 days ago - Pushed at: 9 days ago - Stars: 22 - Forks: 15

DiskFrame/disk.frame

Fast Disk-Based Parallelized Data Manipulation Framework for Larger-than-RAM Data

Language: R - Size: 4.37 MB - Last synced at: 6 days ago - Pushed at: 8 months ago - Stars: 597 - Forks: 39

DevExpress-Examples/winforms-scheduler-optimize-performance-large-dataset

Optimize Scheduler performance for large datasets.

Language: C# - Size: 1.75 MB - Last synced at: about 1 month ago - Pushed at: about 1 month ago - Stars: 0 - Forks: 3

DevExpress-Examples/winforms-grid-enable-server-mode-for-detail-view

Enable Server Mode for a detail view.

Language: Visual Basic .NET - Size: 69.3 KB - Last synced at: about 1 month ago - Pushed at: about 1 month ago - Stars: 0 - Forks: 0

DevExpress-Examples/winforms-grid-load-refresh-detail-data-from-database

Dynamically load and refresh detail data (master-detail).

Language: Visual Basic .NET - Size: 410 KB - Last synced at: about 1 month ago - Pushed at: about 1 month ago - Stars: 4 - Forks: 1

DevExpress-Examples/winforms-grid-bind-to-linqinstantfeedbacksource

Bind the WinForms Grid control to a queryable source (LinqInstantFeedbackSource).

Language: C# - Size: 69.3 KB - Last synced at: about 1 month ago - Pushed at: about 1 month ago - Stars: 0 - Forks: 0

JJChenCharly/OrthoSLC

OrthoSLC: A pipeline to get Orthologous Genes using Reciprocal Best Blast Hit (RBBH) Single Linkage Clustering, indenpendent of relational database management system

Language: Jupyter Notebook - Size: 13 MB - Last synced at: about 1 month ago - Pushed at: about 1 month ago - Stars: 6 - Forks: 3

MrEshboboyev/cursor-pagination

Cursor Pagination for ASP.NET Core is a high-performance, production-ready pagination system for .NET 9 and PostgreSQL, designed for efficient data retrieval in large datasets. It features cursor-based pagination, optimized queries, bulk data operations, and a million-record test set, ensuring fast and scalable API responses.

Language: C# - Size: 19.5 KB - Last synced at: about 1 month ago - Pushed at: about 1 month ago - Stars: 0 - Forks: 0

Baizhige/EEGUnity

An open source tool for large-scale EEG datasets processing

Language: Python - Size: 5.12 MB - Last synced at: about 1 month ago - Pushed at: about 2 months ago - Stars: 32 - Forks: 3

blasif/cocons

R package for nonstationary spatial modeling with covariate-based covariance functions

Language: R - Size: 15.8 MB - Last synced at: 3 months ago - Pushed at: 3 months ago - Stars: 2 - Forks: 0

Avijit-Jana/Classifying_Cybersecurity_Incidents

This project focuses on building a machine learning classification model to enhance the efficiency of Security Operation Centers (SOCs). Using the comprehensive GUIDE dataset, the model predicts the triage grade of cybersecurity incidents (True Positive, Benign Positive, or False Positive).

Language: Jupyter Notebook - Size: 448 KB - Last synced at: about 2 months ago - Pushed at: 3 months ago - Stars: 1 - Forks: 0

kyegomez/EXA-1 Fork of pliang279/awesome-multimodal-ml

An EXA-Scale repository of Multi-Modality AI resources from papers and models, to foundational libraries!

Language: Jupyter Notebook - Size: 1.15 GB - Last synced at: 27 days ago - Pushed at: about 1 year ago - Stars: 42 - Forks: 2

eholmquist01/CPSC507_Midterm3 📦

This project utilizes examination and analysis of large data sets, as well as work with modeling KNN techniques for machine learning. The data set can be found at the provided URL.

Language: Python - Size: 8.79 KB - Last synced at: 4 months ago - Pushed at: 4 months ago - Stars: 0 - Forks: 0

eMahtab/mysql-test-dataset

Repository for MySQL test data set

Size: 15.6 KB - Last synced at: 22 days ago - Pushed at: 4 months ago - Stars: 1 - Forks: 0

Esri/large-network-analysis-tools

Tools and code samples for solving large network analysis problems in ArcGIS Pro

Language: Python - Size: 4.69 MB - Last synced at: 5 months ago - Pushed at: 5 months ago - Stars: 62 - Forks: 7

siwooyong/imagenet1k

simple pytorch pipeline for pretraining/finetuning vision models on imagenet-1k

Language: Python - Size: 649 KB - Last synced at: 5 months ago - Pushed at: 5 months ago - Stars: 3 - Forks: 0

Lizhecheng02/Kaggle-LLM-Detect_AI_Generated_Text

Detect whether the text is AI-generated by training a new tokenizer and combining it with tree classification models or by training language models on a large dataset of human & AI-generated texts.

Language: Jupyter Notebook - Size: 394 KB - Last synced at: 4 months ago - Pushed at: about 1 year ago - Stars: 3 - Forks: 0

JoetheManHowie/NUSCAN

All the code required to reproduce the results in our paper "Scaling Up Structural Clustering to Large Probabilistic Graphs Using Lyapunov Central Limit Theorem"

Language: C++ - Size: 5.72 MB - Last synced at: 6 months ago - Pushed at: 6 months ago - Stars: 2 - Forks: 0

dudelkuchen/chartjs-plugin-largedatasets

Chart.js plugin for large datasets.

Language: JavaScript - Size: 367 KB - Last synced at: 6 months ago - Pushed at: over 2 years ago - Stars: 3 - Forks: 0

data-preservation-programs/open-panda

A platform for the world's largest open datasets, stored on a decentralized network

Language: Vue - Size: 23.6 MB - Last synced at: about 1 year ago - Pushed at: about 1 year ago - Stars: 4 - Forks: 0

Imtiazkarimik23/SPEC5G

This repository contains the code and data of the paper titled "SPEC5G: A Dataset for 5G Cellular Network Protocol Analysis" published at AACL 2023.

Language: Jupyter Notebook - Size: 289 KB - Last synced at: 9 months ago - Pushed at: over 1 year ago - Stars: 30 - Forks: 9

DevExpress-Examples/out-of-maintenance-how-to-edit-the-grid-when-it-is-bound-to-a-large-data-base-via-xpo-data-source 📦

Size: 1.21 MB - Last synced at: 10 months ago - Pushed at: 10 months ago - Stars: 0 - Forks: 0

kuza2010/read_large_data_example

Example of processing large amount of data from the data source

Language: Java - Size: 13.7 KB - Last synced at: 11 months ago - Pushed at: 11 months ago - Stars: 0 - Forks: 0

fair-acc/chart-fx

A scientific charting library focused on performance optimised real-time data visualisation at 25 Hz update rates for data sets with a few 10 thousand up to 5 million data points.

Language: Java - Size: 23.6 MB - Last synced at: 11 months ago - Pushed at: about 1 year ago - Stars: 479 - Forks: 88

privefl/bigreadr

R package to read large text files based on splitting + data.table::fread

Language: R - Size: 270 KB - Last synced at: 22 days ago - Pushed at: over 2 years ago - Stars: 42 - Forks: 5

zzw922cn/TensorFlow-Input-Pipeline

TensorFlow Input Pipeline Examples based on multi-thread and FIFOQueue

Language: Python - Size: 61.5 KB - Last synced at: 20 days ago - Pushed at: over 7 years ago - Stars: 52 - Forks: 16

Gautamaggrawal/Realtime-logging

A realtime web based watching solution, akin to UNIX's tail -f command, employs Django Channels for real-time monitoring. It obviates page refreshes, efficiently streams updates, supports multiple connections, and shows the last 10 lines of the log.

Language: Python - Size: 13.7 KB - Last synced at: about 1 year ago - Pushed at: about 1 year ago - Stars: 1 - Forks: 0

sahu1shivani/Iowa-Liquour-Sales-Dataset-Analysis

Extract,Transform and load of Iowa Liqour sales dataset comprising of 24M rows

Language: Java - Size: 126 MB - Last synced at: about 1 year ago - Pushed at: about 1 year ago - Stars: 0 - Forks: 0

kaitlynntnguyen/python-challenge

Create a two python scripts to analyze company financial records and election data

Language: Python - Size: 6.59 MB - Last synced at: about 1 year ago - Pushed at: about 1 year ago - Stars: 0 - Forks: 0

vinejain/r-flexdashboard-data-viz

Interactive dashboard in R using JavaScript based libraries (flexdashboard, highcharter, etc.) showing US university statistics. Data sourced from catalog.data.gov for year 1996 to 2017. Size 2.5 GB/1900+ columns.

Language: R - Size: 11.2 MB - Last synced at: about 1 year ago - Pushed at: about 4 years ago - Stars: 0 - Forks: 1

ArtTucker/movies_ETL

Large dataset ETL of JSON and CSV files using pandas, regex, and export to SQL database

Language: Jupyter Notebook - Size: 2.12 MB - Last synced at: over 1 year ago - Pushed at: over 4 years ago - Stars: 0 - Forks: 0

ThomasByr/BioInfo-genome

🧬 large scale genes data analysis software

Language: Python - Size: 7.28 MB - Last synced at: over 1 year ago - Pushed at: over 1 year ago - Stars: 2 - Forks: 1

vjgpt/Home-Credit-Default-Risk

Objective of this competition is to use historical loan application data to predict whether or not an applicant will be able to repay a loan.

Language: Jupyter Notebook - Size: 32.2 KB - Last synced at: 13 days ago - Pushed at: over 6 years ago - Stars: 4 - Forks: 4

P0bbn/Flight-Data-Analysis

A simple Java program to perform quantified data analysis on a very large dataset of air traffic information

Language: Java - Size: 11.7 KB - Last synced at: over 1 year ago - Pushed at: about 2 years ago - Stars: 1 - Forks: 0

DanieleDepiro/Brasil_Traffic_Incidents_EDA

This project entails conducting an exploratory analysis of the Brazil Traffic Accidents spanning from 2007 to 2023. The aim is to utilize Python for merging the records from each year, thoroughly cleansing, validating the data, and subsequently visualizing it in Tableau.

Language: Jupyter Notebook - Size: 44.7 MB - Last synced at: over 1 year ago - Pushed at: over 1 year ago - Stars: 0 - Forks: 0

ChelseaGH/KSL-Guide

KSL-Guide: A Large-scale Korean Sign Language Dataset Including Interrogative Sentences for Guiding the Deaf and Hard-of-Hearing, FG, 2021

Size: 31.3 KB - Last synced at: over 1 year ago - Pushed at: over 1 year ago - Stars: 2 - Forks: 0

vunguyentuan/react-virtual-slider 📦

Virtual Slider/Carousel for React

Language: JavaScript - Size: 5.24 MB - Last synced at: 16 days ago - Pushed at: about 2 years ago - Stars: 8 - Forks: 3

zglu/ivis

IVIS is a chart editor for interactive visualisation, based on jQuery and HighCharts. Chart types include dot/scatter, 2D scatter, line, bar/column, pie, and heat map. It's powerful when analysing large data sets.

Language: JavaScript - Size: 1.3 MB - Last synced at: over 1 year ago - Pushed at: over 6 years ago - Stars: 6 - Forks: 1

VladislavLisovenko/JavaFXCustomChoiceDialogFromLargeTable

JavaFX How To: Custom choice dialog from large table

Language: Java - Size: 63.5 KB - Last synced at: over 1 year ago - Pushed at: almost 4 years ago - Stars: 0 - Forks: 0

sharmaroshan/Fraud-Detection-in-Online-Transactions

Detecting Frauds in Online Transactions using Anamoly Detection Techniques Such as Over Sampling and Under-Sampling as the ratio of Frauds is less than 0.00005 thus, simply applying Classification Algorithm may result in Overfitting

Language: Jupyter Notebook - Size: 300 KB - Last synced at: over 1 year ago - Pushed at: almost 6 years ago - Stars: 56 - Forks: 29

shanewas/npsb-recon

automated payment switch reconciliation script

Language: Python - Size: 367 KB - Last synced at: over 1 year ago - Pushed at: over 3 years ago - Stars: 0 - Forks: 0

sileod/Discovery

Mining Discourse Markers for Unsupervised Sentence Representation Learning

Language: Jupyter Notebook - Size: 541 KB - Last synced at: over 1 year ago - Pushed at: almost 2 years ago - Stars: 57 - Forks: 2

sofiammatias/ice-cube-neutrinos

The goal of this competition is to predict a neutrino particle’s direction, with a model based on data from the "IceCube" detector.

Language: Jupyter Notebook - Size: 7.28 MB - Last synced at: almost 2 years ago - Pushed at: almost 2 years ago - Stars: 0 - Forks: 0

mitulvaghamshi/ElevationsPeak

Java single and multi dimensional arrays.

Language: Java - Size: 1.58 MB - Last synced at: almost 2 years ago - Pushed at: almost 2 years ago - Stars: 0 - Forks: 0

davidssmith/RawArray.jl

Raw array (RA) file format for simple, robust, and user-friendly N-dimensional array storage

Language: Julia - Size: 44.9 KB - Last synced at: 2 days ago - Pushed at: about 5 years ago - Stars: 5 - Forks: 2

jebowe3/maplibre-gl-js-demo

How to map large geojson data sources on the web using vector tiles and MapLibre GL JS, an open-source version of Mapbox GL JS

Language: HTML - Size: 37.7 MB - Last synced at: about 1 year ago - Pushed at: almost 3 years ago - Stars: 1 - Forks: 0

RajkumarGara/Bike_Rental_Data_Analysis

Chicago bike rental data analysis for business insights using R programming

Language: R - Size: 6.84 KB - Last synced at: about 1 month ago - Pushed at: about 2 years ago - Stars: 0 - Forks: 0

arnikz/netclust

Efficient cluster detection tool for large graphs (networks)

Language: C - Size: 56.6 KB - Last synced at: about 1 year ago - Pushed at: over 6 years ago - Stars: 1 - Forks: 0

JakobLS/100-million-rows-with-spark

Is it feasable to train a model on 100 million ratings using nothing more than a common laptop? Let's find out.

Language: Jupyter Notebook - Size: 370 KB - Last synced at: almost 2 years ago - Pushed at: about 3 years ago - Stars: 3 - Forks: 0

SimpleBro/Road-energy-profile

Road energy profile estimation based on vehicle movement historical records

Language: C# - Size: 5.53 MB - Last synced at: 6 months ago - Pushed at: over 2 years ago - Stars: 0 - Forks: 0

oelin/cbs-5

A large dataset containing optimal actions taken by conflict-based search (CBS) with five agents on random 20x20 maps.

Size: 28.7 MB - Last synced at: about 1 month ago - Pushed at: about 2 years ago - Stars: 0 - Forks: 1

hto/redis-large-hset-del

Large HSET keys delete on Redis.

Language: Go - Size: 3.91 KB - Last synced at: 11 months ago - Pushed at: about 5 years ago - Stars: 7 - Forks: 1

samridhishree/Machine-Learning-for-Large-Datasets

Machine Learning models for large datasets

Language: Gnuplot - Size: 26.6 MB - Last synced at: almost 2 years ago - Pushed at: over 7 years ago - Stars: 3 - Forks: 0

imdeepmind/AmazonReview-LanguageGenerationDataset

Processed Amazon Review Dataset for Language Generation (Character Level)

Language: Python - Size: 6.84 KB - Last synced at: 16 days ago - Pushed at: over 5 years ago - Stars: 5 - Forks: 1

tejas-gokhale/music_reco_deep_learning

Project for CMU 15-780 Graduate Artificial Intelligence

Language: Python - Size: 104 MB - Last synced at: over 1 year ago - Pushed at: almost 8 years ago - Stars: 5 - Forks: 1

IrinaKW/Football_ML

A large number of files about football matches since 1990 are to be cleaned and fed to the model. Then, different models are trained with the dataset, and the best performing model is selected. The hyperparameters of this model are tuned, so its performance is improved.

Language: Jupyter Notebook - Size: 3.44 MB - Last synced at: almost 2 years ago - Pushed at: over 2 years ago - Stars: 0 - Forks: 0

Denise-R/FIA_Midwest_Weather_Data

This repository documents how data from three different publicly available databases (FIA DataMart, Climatology Lab, and USFS Insect & Disease Detection Survey) can be combined into one easily understandable data frame.

Size: 62.5 KB - Last synced at: over 1 year ago - Pushed at: over 2 years ago - Stars: 1 - Forks: 0

IidaPeltonen/imdb_react

Dynaaminen verkkosivu-opintojakson largeData-tehtävä, react-osio

Language: JavaScript - Size: 188 KB - Last synced at: almost 2 years ago - Pushed at: over 3 years ago - Stars: 0 - Forks: 0

Shreshth-Shrma/Data-sorting-portal

This is a website to sort different types of data types in large quantities.

Language: HTML - Size: 16.6 KB - Last synced at: about 2 years ago - Pushed at: over 2 years ago - Stars: 1 - Forks: 2

m-wells/AlignedBinaryFormat.jl

Memory-mapping made easy.

Language: Julia - Size: 73.2 KB - Last synced at: 14 days ago - Pushed at: over 1 year ago - Stars: 2 - Forks: 1

muhaimenul/laravel-millions

A laravel-vue application to import large csv to database.

Language: PHP - Size: 693 KB - Last synced at: about 2 years ago - Pushed at: almost 3 years ago - Stars: 0 - Forks: 0

ShreckYe/jgrapht-memory-efficient-bipartite-graph

A memory-efficient matching algorithm (Kuhn–Munkres and Hopcroft–Karp) implementation based on JGraphT in Java

Language: Kotlin - Size: 64.5 KB - Last synced at: 20 days ago - Pushed at: over 5 years ago - Stars: 1 - Forks: 0

SabrinaSuraya/Project3-ImageClassification-ConcreteCrack

Make image classification of the concrete, whether it is crack or not. Image Classification

Language: Python - Size: 9.77 KB - Last synced at: about 2 years ago - Pushed at: almost 3 years ago - Stars: 0 - Forks: 0

SabrinaSuraya/Project4-ImageSegmentationNucleiCell

Determine the image segmentation of nuclei cell from original image in training and testing. Image Segmentation

Language: Python - Size: 20.5 KB - Last synced at: about 2 years ago - Pushed at: almost 3 years ago - Stars: 0 - Forks: 0

drmerlot/Visualizing-3-Billion-Points

Using Dask and Datashader to Visualize a 150 gigabyte, 3 Billion Point Dataset

Language: Jupyter Notebook - Size: 1.94 MB - Last synced at: about 1 year ago - Pushed at: about 7 years ago - Stars: 1 - Forks: 0

suhashollakc/wordle-python

Wordle is considered one of the most viral game in 2022 ⚠

Language: Python - Size: 1.44 MB - Last synced at: 3 months ago - Pushed at: about 3 years ago - Stars: 0 - Forks: 0

mofesolapaul/tableau

Experiment in a bid to produce a custom-design table for presenting large data

Language: HTML - Size: 83 KB - Last synced at: 9 months ago - Pushed at: over 7 years ago - Stars: 3 - Forks: 1

souvikmaji/autocomplete

HTTP service for fuzzy search of English words.

Language: Python - Size: 2.1 MB - Last synced at: about 2 years ago - Pushed at: about 3 years ago - Stars: 0 - Forks: 0

guypeer8/csv-streamer

💧A stream based csv aggregator for limiting RAM usage while processing large data sets.

Language: JavaScript - Size: 104 KB - Last synced at: 18 days ago - Pushed at: about 5 years ago - Stars: 8 - Forks: 2

MaxHalford/tuna

:fish: A streaming ETL for fish

Language: Go - Size: 75.2 KB - Last synced at: 24 days ago - Pushed at: about 6 years ago - Stars: 13 - Forks: 1

ankit-kothari/optimizing_large_datasets

Optimizing Large Datasets

Language: Python - Size: 725 KB - Last synced at: about 2 years ago - Pushed at: over 4 years ago - Stars: 1 - Forks: 0

abdoulsn/clustering-mixte

Apply K-means(pre clustering) then CAH from kmeans labels then K-means

Language: Jupyter Notebook - Size: 25.4 KB - Last synced at: 7 days ago - Pushed at: about 4 years ago - Stars: 0 - Forks: 1

okozolin/SearchPages-Node

NodeJs project. Scrape bookmark urls for searching desired info

Language: JavaScript - Size: 6.8 MB - Last synced at: about 2 years ago - Pushed at: over 2 years ago - Stars: 0 - Forks: 2

prakhargurawa/Twitter-Live-Stream-Spark

Using Spark streaming to stream live Twitter data and performing different kind of operations.

Language: Java - Size: 6.84 KB - Last synced at: about 2 years ago - Pushed at: over 4 years ago - Stars: 0 - Forks: 0

angystallone/Seismology_Stuff

Language: Python - Size: 118 KB - Last synced at: almost 2 years ago - Pushed at: over 4 years ago - Stars: 0 - Forks: 0

MrRaghav/airbnb-in-berlin-2020

A data mining project to analyse Airbnb's data of Berlin for the year 2020 using KDD

Language: Jupyter Notebook - Size: 1.79 MB - Last synced at: about 2 years ago - Pushed at: over 4 years ago - Stars: 1 - Forks: 0

shreyasshivakumara/Reddit-Analysis-Large-Dataset-Scientific-Application

Architected and developed a horizontally scalable data processing solution for the reddit dataset. Demonstrated the scalability (Weak Scalability and Strong Scalability) tests in suitable computational analysis.

Language: Jupyter Notebook - Size: 190 KB - Last synced at: almost 2 years ago - Pushed at: almost 5 years ago - Stars: 0 - Forks: 0