mapreduce | Topic | Ecosyste.ms: Repos

Topic: "mapreduce"

gramian/hapod 📦

HAPOD - Hierarchical Approximate Proper Orthogonal Decomposition

Language: MATLAB - Size: 26.4 KB - Last synced at: 2 days ago - Pushed at: over 3 years ago - Stars: 15 - Forks: 4

kumaab/MapReduce

Implementation of MapReduce in Go.

Language: Go - Size: 1.19 MB - Last synced at: 11 months ago - Pushed at: over 4 years ago - Stars: 15 - Forks: 4

magicxor/MapReduce

LINQ for Delphi (Object Pascal)

Language: Pascal - Size: 165 KB - Last synced at: 3 months ago - Pushed at: almost 5 years ago - Stars: 15 - Forks: 6

CodeMangler/udacity-hadoop-course

My solutions for the problem sets in the Udacity Intro to Hadoop and MapReduce course

Language: Python - Size: 124 MB - Last synced at: about 2 years ago - Pushed at: about 11 years ago - Stars: 15 - Forks: 20

big-data-team/big-data-course

Practice course on Big Data

Language: Jupyter Notebook - Size: 312 KB - Last synced at: 12 months ago - Pushed at: 12 months ago - Stars: 14 - Forks: 36

pscosta/go-strm

A rich Map/Reduce API in Go

Language: Go - Size: 1.17 MB - Last synced at: 7 months ago - Pushed at: over 1 year ago - Stars: 14 - Forks: 0

dayyass/pydfs

Distributed File System written in Python

Language: Python - Size: 61.5 KB - Last synced at: 4 days ago - Pushed at: almost 3 years ago - Stars: 14 - Forks: 0

mcapuccini/MaRe

MaRe leverages the power of Docker and Spark to run and scale your serial tools in MapReduce fashion.

Language: Scala - Size: 4.78 MB - Last synced at: over 1 year ago - Pushed at: about 3 years ago - Stars: 14 - Forks: 8

sylvainhalle/MrSim

A simple MapReduce framework in Java

Language: Java - Size: 1.6 MB - Last synced at: about 1 month ago - Pushed at: about 3 years ago - Stars: 14 - Forks: 13

imehrdadmahdavi/map-reduce-inverted-index

Creating an Inverted Index of words occurring in a large set of documents extracted from web pages using Hadoop MapReduce and Google Dataproc

Language: Java - Size: 94.7 KB - Last synced at: about 1 year ago - Pushed at: over 5 years ago - Stars: 14 - Forks: 13

lizichen/Scholars-Collaboration-Network

Find collaboration strength between NSF awards, awardees, and more.

Language: Jupyter Notebook - Size: 615 MB - Last synced at: about 2 years ago - Pushed at: over 6 years ago - Stars: 14 - Forks: 4

Wangxh329/EventRecommendation

This is a personalization-based event recommendation systems for event search.

Language: Java - Size: 5.52 MB - Last synced at: over 1 year ago - Pushed at: over 7 years ago - Stars: 14 - Forks: 9

dash1291/infantry

Run MapReduce in user's browser.

Language: JavaScript - Size: 54.7 KB - Last synced at: about 1 year ago - Pushed at: over 7 years ago - Stars: 14 - Forks: 2

geekyprawins/MIT-24-CSE-LABS

Lab solutions of MIT Manipal CSE Dept. for Batch of 2024.

Language: C - Size: 93.1 MB - Last synced at: about 1 year ago - Pushed at: about 1 year ago - Stars: 13 - Forks: 0

usc-isi-i2/pyrallel

Yet another easy-to-use python3 parallel library for humans.

Language: Python - Size: 143 KB - Last synced at: 29 days ago - Pushed at: about 4 years ago - Stars: 13 - Forks: 3

EFTEC/DocumentStoreOne

A flat document store for PHP that allows multiples concurrencies

Language: PHP - Size: 292 KB - Last synced at: about 1 month ago - Pushed at: 4 months ago - Stars: 12 - Forks: 3

James-QiuHaoran/distributed-computing-platform-mapreduce

This repository contains a simple Hadoop-like (MapReduce) distributed computing platform implemented in Java. It is extended from a course project at UIUC awarded the best Java version implementation and it's open-sourced for reference.

Language: Java - Size: 454 KB - Last synced at: almost 2 years ago - Pushed at: about 4 years ago - Stars: 12 - Forks: 4

KtorZPersonal/purescript-ifrit

An SQL -> NoSQL compiler for data aggregation

Language: PureScript - Size: 972 KB - Last synced at: 8 days ago - Pushed at: about 8 years ago - Stars: 12 - Forks: 1

conradsnicta/armadillo-gmm

gmm_diag and gmm_full: C++ classes for multi-threaded Gaussian mixture models and Expectation-Maximisation

Language: C++ - Size: 1000 Bytes - Last synced at: 2 days ago - Pushed at: almost 3 years ago - Stars: 11 - Forks: 4

BigDataLaoLiu/BigDataGuide

秋招自学上岸，自学太难了，想总结一份详细的大数据开发资料，包括基础 | 架构 | 源码，让更多自学的伙伴少走弯路。有相关问题可以添加公众号：大数据老刘，联系老刘！

Size: 118 KB - Last synced at: about 2 years ago - Pushed at: over 3 years ago - Stars: 11 - Forks: 2

yyin-dev/MIT6.824-old1 📦

Source code for labs of MIT 6.824 2020

Language: Go - Size: 16.9 MB - Last synced at: about 1 year ago - Pushed at: almost 5 years ago - Stars: 11 - Forks: 3

camilo-v/flint

Main repository of the Flint project for Spark and Amazon EMR.

Language: Python - Size: 5.67 MB - Last synced at: over 1 year ago - Pushed at: over 5 years ago - Stars: 11 - Forks: 5

ly16/Apache-Open-Source-Project

An Improvement for Apache Open Source Software Pig

Size: 1.43 MB - Last synced at: 10 months ago - Pushed at: about 8 years ago - Stars: 11 - Forks: 1

gbegreg/MapReduce

MapReduce with Delphi

Language: Pascal - Size: 402 KB - Last synced at: about 1 year ago - Pushed at: about 1 year ago - Stars: 10 - Forks: 3

therne/lrmr

Less-Resilient MapReduce for Go

Language: Go - Size: 38.9 MB - Last synced at: 4 months ago - Pushed at: about 2 years ago - Stars: 10 - Forks: 0

lithops-cloud/airflow-plugin

Plugin for Apache Airflow to execute serverless tasks using Lithops

Language: Python - Size: 591 KB - Last synced at: about 1 month ago - Pushed at: over 2 years ago - Stars: 10 - Forks: 3

BugenZhao/6.824-MapReduce

An implementation of "6.824 Lab 1: MapReduce (2021)" in async Rust.

Language: Rust - Size: 1.3 MB - Last synced at: 1 day ago - Pushed at: almost 4 years ago - Stars: 10 - Forks: 0

SamQuigley/SpotifyDataAnalysis

This application scrapes data from the Spotify API using the lightweight python library Spotipy. The data is transformed and processed for analysis through R Studio and mapReduce patterns implemented in Python.

Language: R - Size: 1.05 MB - Last synced at: about 2 years ago - Pushed at: over 5 years ago - Stars: 10 - Forks: 2

Messi-Q/Reservation-system

Online ordering system combined with big data statistics

Language: Java - Size: 37.2 MB - Last synced at: about 1 year ago - Pushed at: almost 6 years ago - Stars: 10 - Forks: 0

jaquejbrito/star-join-spark

Two efficient algorithms to process Star Joins using the Spark framework: Spark Bloom-Filtered Cascade Join (SBFCJ) and the Spark Broadcast Join (SBJ)

Language: Java - Size: 27.3 KB - Last synced at: about 2 years ago - Pushed at: over 8 years ago - Stars: 10 - Forks: 0

adamretter/Shadoop Fork of bsdfish/ScalaHadoop

A wrapper for Hadoop in Scala

Language: Scala - Size: 435 KB - Last synced at: 11 months ago - Pushed at: over 10 years ago - Stars: 10 - Forks: 3

eecs485staff/madoop

A light weight MapReduce framework for education

Language: Python - Size: 513 KB - Last synced at: 17 days ago - Pushed at: 17 days ago - Stars: 9 - Forks: 4

nwjlyons/slice

Elixir's Enum module implemented in Go using generics.

Language: Go - Size: 65.4 KB - Last synced at: about 1 month ago - Pushed at: almost 2 years ago - Stars: 9 - Forks: 0

isislab-unisa/sof

Simulation Optimization and exploration Framework on the cloud: SOF

Language: Java - Size: 245 MB - Last synced at: about 1 month ago - Pushed at: over 2 years ago - Stars: 9 - Forks: 4

ffismine/AcademicRecommendation_dlut

面向大连理工大学学者，基于大连理工大学机构知识库，推荐潜在主题词，优化科研方向，促进跨学部、学科、领域科研合作。

Language: Python - Size: 28.4 MB - Last synced at: almost 2 years ago - Pushed at: almost 3 years ago - Stars: 9 - Forks: 1

edydfang/UW-Madison-CS537

Operating System Projects

Language: C - Size: 1.19 MB - Last synced at: about 1 month ago - Pushed at: over 5 years ago - Stars: 9 - Forks: 6

CristianTuretta/DDoS-Network-Flow-Forensics-Analyser-

We are developing a tool for analyse recorded network traffic in order to detect and investigate about IP source address which may had contribute in a DDoS UDP flood attack. This tool also generates sample pcap datasets.

Language: Python - Size: 637 KB - Last synced at: 12 months ago - Pushed at: almost 6 years ago - Stars: 9 - Forks: 2

adriel1997/Twitter-Sentiment-Analysis

Twitter based sentiment analysis using JAVA and Hadoop. In this project we are doing the sentiment analysis on twitter data to analyse whether the tweets posted by people are positive or negative or neutral by checking the tweets with the AFFIN dictionary which has a set of 2500 words along with the value of each word ranging from -5 to +5 denoting whether tweets are positive or negative.

Language: Java - Size: 340 KB - Last synced at: about 1 year ago - Pushed at: about 7 years ago - Stars: 9 - Forks: 2

ketralnis/pipelines-rs

A rust crate for creating concurrent pipelines

Language: Rust - Size: 49.8 KB - Last synced at: about 1 year ago - Pushed at: about 7 years ago - Stars: 9 - Forks: 1

imsure/NeuralGiraph

Graph algorithm implemented with Apache Giraph for large-scale neural network simulation

Language: Java - Size: 3.4 MB - Last synced at: almost 2 years ago - Pushed at: almost 11 years ago - Stars: 9 - Forks: 0

vikhyat/StormyCloud

Ridiculously simple distributed applications in Ruby.

Language: Ruby - Size: 258 KB - Last synced at: 15 days ago - Pushed at: about 11 years ago - Stars: 9 - Forks: 3

asuiu/streamerate

Iterable Java8 style Streams for Python

Language: Python - Size: 486 KB - Last synced at: 21 days ago - Pushed at: about 2 months ago - Stars: 8 - Forks: 3

Alex-At-Home/elasticsearch-sheets

An experimental Google Sheets add-on to view and interact with Elasticsearch indices

Language: JavaScript - Size: 445 KB - Last synced at: about 2 years ago - Pushed at: over 2 years ago - Stars: 8 - Forks: 2

Banyc/MapReduce

In C#. Master-Worker. From scratch. No Hadoop. Done. Depend on DFS.

Language: C# - Size: 1.34 MB - Last synced at: about 18 hours ago - Pushed at: almost 3 years ago - Stars: 8 - Forks: 1

Areesha-Tahir/Hadoop-MapReduce-Sentiment-Analysis-Through-Keywords

A MapReduce program to conduct sentiment analysis of a keyword from a list of comments.

Language: Java - Size: 38.1 KB - Last synced at: about 2 years ago - Pushed at: almost 4 years ago - Stars: 8 - Forks: 0

Hezepeng/Naive-Bayes-Classification

基于Hadoop的朴素贝叶斯分类(MapReduce实现)

Language: Java - Size: 30.3 KB - Last synced at: about 2 years ago - Pushed at: over 5 years ago - Stars: 8 - Forks: 2

AiningWang/Matrix-Multiplication-using-MapReduce

implement by naive algorithm(without partition) and advanced algorithm(with partition)

Language: Python - Size: 6.84 KB - Last synced at: over 1 year ago - Pushed at: about 7 years ago - Stars: 8 - Forks: 6

PerfectlySoft/Perfect-Hadoop

Perfect Hadoop: WebHDFS, MapReduce & Yarn.

Language: Swift - Size: 217 KB - Last synced at: 10 days ago - Pushed at: over 7 years ago - Stars: 8 - Forks: 2

lovnishverma/bigdataecosystem

Complete Big Data Ecosystem on Docker Desktop

Language: Shell - Size: 405 KB - Last synced at: 19 days ago - Pushed at: 19 days ago - Stars: 7 - Forks: 1

cold-bin/mit-6.824-labs

实现2023年的mit6.824的四个labs和三个challenges

Language: Go - Size: 9.53 MB - Last synced at: 15 days ago - Pushed at: about 1 year ago - Stars: 7 - Forks: 0

mixed-farming/CSE-lab-solutions

Comprehensive CSE Lab Solutions repo; encompassing all my lab manuals, codes, documents, and endsem questions from my B.Tech program (2020-2024).

Language: C - Size: 253 MB - Last synced at: over 1 year ago - Pushed at: over 1 year ago - Stars: 7 - Forks: 0

lapets/mr4mp

Thin MapReduce-like layer that wraps the Python multiprocessing library.

Language: Python - Size: 73.2 KB - Last synced at: about 24 hours ago - Pushed at: almost 2 years ago - Stars: 7 - Forks: 2

timvisee/wrdcntr

:dash: A simple yet very fast word counter witten in Rust

Language: Rust - Size: 11.3 MB - Last synced at: about 1 month ago - Pushed at: almost 3 years ago - Stars: 7 - Forks: 1

WilliamX1/cse-2021

A distributed file system similar to Google File System (GFS).

Language: C++ - Size: 158 MB - Last synced at: about 1 month ago - Pushed at: over 3 years ago - Stars: 7 - Forks: 0

leibniz21c/mammoth

Mammoth is a container based hadoop distributed system log analyzer. Sponsed by Mantech and Naver Cloud Platform.

Language: Dart - Size: 31.8 MB - Last synced at: about 2 years ago - Pushed at: over 3 years ago - Stars: 7 - Forks: 5

TheBestOrNothing/MIT-6.824-2017

Finish Lab1-3 of mit 6.824 in 2017 and pass all the tests.

Language: Go - Size: 7.31 MB - Last synced at: 11 months ago - Pushed at: almost 4 years ago - Stars: 7 - Forks: 8

jishnub/MPIMapReduce.jl

An MPI-based distributed map-reduce function for Julia

Language: Julia - Size: 126 KB - Last synced at: about 1 month ago - Pushed at: almost 4 years ago - Stars: 7 - Forks: 0

MariaDukmak/Hadopy

Easy parallel map-reduce command line tool

Language: Python - Size: 28.3 KB - Last synced at: 7 days ago - Pushed at: almost 4 years ago - Stars: 7 - Forks: 0

sudheer/bigdata-essentials

All big data related tools/frameworks in once central repo.

Language: Java - Size: 5.27 MB - Last synced at: about 2 years ago - Pushed at: almost 7 years ago - Stars: 7 - Forks: 3

halu886/legalDocument

:facepunch:基于hbase, mapreduce结合springMVC查询操作/扫描操作,数据分析

Language: HTML - Size: 5.77 MB - Last synced at: about 2 years ago - Pushed at: almost 8 years ago - Stars: 7 - Forks: 1

spider-123-eng/Hadoop

Hadoop Progaming

Language: Java - Size: 97 MB - Last synced at: over 1 year ago - Pushed at: over 9 years ago - Stars: 7 - Forks: 7

rhinempi/sparkhit

sparkhit - analyzing large scale genomic data on the cloud

Language: Java - Size: 104 MB - Last synced at: about 1 year ago - Pushed at: about 2 years ago - Stars: 6 - Forks: 2

PanosAntoniadis/map_reduce-ntua

Lab exercise of Advanced Topics in Database Systems course in NTUA regarding Map Reduce

Language: Python - Size: 2.37 MB - Last synced at: about 2 years ago - Pushed at: over 2 years ago - Stars: 6 - Forks: 0

monisjaved/Data-Processing-With-Hadoop

Text Processing Using Hadoop

Language: Jupyter Notebook - Size: 21 MB - Last synced at: almost 2 years ago - Pushed at: about 3 years ago - Stars: 6 - Forks: 2

HxnDev/Hadoop-MapReduce-to-Analyze-Sentiment-of-Keyword

In this task, we had to write a MapReduce program to analyze the sentiment of a keyword from a list of comments. This was done using Hadoop HDFS.

Language: Java - Size: 1000 KB - Last synced at: 8 days ago - Pushed at: almost 4 years ago - Stars: 6 - Forks: 0

joshi-aditya/Amazon-Reviews-Dataset-Analysis-MapReduce

Amazon Customer Reviews Dataset Analysis using Hadoop MapReduce, Pig. Semester end project for INFO7250 Engineering of Big Data Systems course.

Language: Java - Size: 1.66 MB - Last synced at: over 1 year ago - Pushed at: almost 6 years ago - Stars: 6 - Forks: 2

h-matsuo/madoop 📦

Matsuo Hadoop -- BBVC (Browser-Based Voluntary Computing) based on MapReduce model with WebAssembly Technology

Language: TypeScript - Size: 1.11 MB - Last synced at: about 2 years ago - Pushed at: over 6 years ago - Stars: 6 - Forks: 1

jeffreymkabot/netsuite-task-status

Retrieve and display the status of a NetSuite Map/Reduce task.

Language: TypeScript - Size: 41 KB - Last synced at: about 2 years ago - Pushed at: over 6 years ago - Stars: 6 - Forks: 0

mframpton/seqfam

A package primarily designed for analysing next generation sequencing DNA data from families with pedigree information in order to identify rare variants that are potentially causal of a disease/trait.

Language: Python - Size: 806 KB - Last synced at: almost 2 years ago - Pushed at: almost 7 years ago - Stars: 6 - Forks: 2

ptobarra/Business-Intelligence-on-Big-Data-_-U-TAD-2017-Big-Data-Master-Final-Project

This is the final project I had to do to finish my Big Data Expert Program in U-TAD in September 2017. It uses the following technologies: Apache Spark v2.2.0, Python v2.7.3, Jupyter Notebook (PySpark), HDFS, Hive, Cloudera Impala, Cloudera HUE and Tableau.

Language: Jupyter Notebook - Size: 130 MB - Last synced at: about 1 year ago - Pushed at: about 7 years ago - Stars: 6 - Forks: 1

axsaucedo/hadoop-overview

Hands on Hadoop, services, installation

Language: HTML - Size: 1.75 MB - Last synced at: about 1 month ago - Pushed at: almost 8 years ago - Stars: 6 - Forks: 10

stevecarrea/bigdata_taxi_airquality

Using NYC Taxi Data as a Predictor of Urban Air Quality

Language: Python - Size: 5.4 MB - Last synced at: about 1 year ago - Pushed at: over 8 years ago - Stars: 6 - Forks: 1

bikash/R2Time

R connector for OpenTSDB: Analyzing large time-series data in R environment using data-intensive capabilities.

Language: Java - Size: 60.4 MB - Last synced at: about 1 month ago - Pushed at: about 9 years ago - Stars: 6 - Forks: 4

dasfex/practice

My programming practice from different fields.

Language: C++ - Size: 3.12 MB - Last synced at: 10 months ago - Pushed at: 11 months ago - Stars: 5 - Forks: 2

Coursal/Hadoop-Examples

Some simple, kinda introductory projects based on Apache Hadoop to be used as guides in order to make the MapReduce model look less weird or boring.

Language: Java - Size: 340 KB - Last synced at: 12 months ago - Pushed at: 12 months ago - Stars: 5 - Forks: 2

bkatrenko/kytsya

Golang threading toolkit

Language: Go - Size: 181 KB - Last synced at: over 1 year ago - Pushed at: almost 2 years ago - Stars: 5 - Forks: 0

sramakrishnan247/MapReduce-Framework

MapReduce framework in C++. Supports multi-threading in shared memory models.

Language: C++ - Size: 494 KB - Last synced at: about 2 years ago - Pushed at: over 2 years ago - Stars: 5 - Forks: 0

EthanWng97/ray-mapreduce-kmeans

📚 Build a whole MapReduce on top of Ray and implement clustering algorithm based on that.

Language: Python - Size: 16 MB - Last synced at: about 1 year ago - Pushed at: almost 3 years ago - Stars: 5 - Forks: 2

ubmagh/KMeans_mri_MapReduce

Implementation of Kmeans algorithme on brain MRI, in a parallel manner with MapReduce

Language: Java - Size: 2.49 MB - Last synced at: about 2 years ago - Pushed at: about 3 years ago - Stars: 5 - Forks: 0

HxnDev/Finding-Average-Temperature-of-Each-Year-using-Hadoop-HDFS

In this task, we had to calculate the average temperature for each year from the given dataset using Hadoop HDFS. We had to create a MapReduce function to perform this task.

Language: Java - Size: 451 KB - Last synced at: 8 days ago - Pushed at: almost 4 years ago - Stars: 5 - Forks: 0

SinghHarshita/Clustering-Algorithms-Spark

KMeans, Cure and Canpoy algorithms are demonstrated using Pyspark.

Language: Jupyter Notebook - Size: 150 KB - Last synced at: over 1 year ago - Pushed at: almost 4 years ago - Stars: 5 - Forks: 0

samujjwaal/dblp-mapreduce

Hadoop MapReduce computational model to perform analyses on DBLP publication data

Language: Scala - Size: 79.1 KB - Last synced at: about 2 years ago - Pushed at: about 4 years ago - Stars: 5 - Forks: 1

prakruti-joshi/Massive-Data-Mining

Coursework for CS550 : Massive Data Mining. Topics covered include Map-Reduce, Association Rules, Frequent Itemsets, Locality-Sensitive Hashing (LSH), Singular Value Decomposition (SVD), Page Rank, k-means, Modularity, Spectral Clustering, Clique-based communities, Clustering Data Streams.

Language: Java - Size: 5.82 MB - Last synced at: almost 2 years ago - Pushed at: over 4 years ago - Stars: 5 - Forks: 1