GitHub topics: data-migration

Repositories

quannguyen0103/data_migration_on_GCP

This project aims to migrate data from MongoDB to Google Cloud Storage (GCS) and BigQuery automatically. It enables businesses to easily transfer and analyze the data in the cloud, improving data and cost management.

Language: Python - Size: 144 KB - Last synced at: almost 2 years ago - Pushed at: almost 2 years ago - Stars: 0 - Forks: 0

erubescent/password-migration

🐱‍👤 Simplify password migration from text file to password manager with a unique identifier

Language: Python - Size: 17.6 KB - Last synced at: almost 2 years ago - Pushed at: almost 2 years ago - Stars: 0 - Forks: 0

mike-schenk/dotMigrator

DotNet Data Structure Migrator: A tool to handle the migration of stored data during application deployment or upgrade. Primarily used to handle schema changes in a relational database, but could also be used to manage indexes or collections in a document database, queues in a queing system, etc.

Language: C# - Size: 50.8 KB - Last synced at: about 1 year ago - Pushed at: about 4 years ago - Stars: 2 - Forks: 1

juliushsu07/Reactivities

Language: C# - Size: 2.34 MB - Last synced at: almost 2 years ago - Pushed at: almost 2 years ago - Stars: 0 - Forks: 0

9bridges/synjq-x Fork of alibaba/DataX

SynjqX 是基于 DataX 的离线全量迁移工具

Language: Java - Size: 20.2 MB - Last synced at: over 1 year ago - Pushed at: almost 2 years ago - Stars: 0 - Forks: 0

ni79ls/web-scraper-wordpress-images

This script will help you to migrate posts, pages including a large volume of images from one Wordpress site to another without the use of any (paid) Wordpress migration plug-ins.

Language: Jupyter Notebook - Size: 14.6 KB - Last synced at: about 1 year ago - Pushed at: over 2 years ago - Stars: 2 - Forks: 0

lunohodov/monarch

A library for Rails developers not willing to leave data migrations to chance.

Language: Ruby - Size: 92.8 KB - Last synced at: 2 days ago - Pushed at: 4 months ago - Stars: 3 - Forks: 0

pascalgn/dbmigration

Database migration tool

Language: Kotlin - Size: 117 KB - Last synced at: about 1 month ago - Pushed at: over 7 years ago - Stars: 2 - Forks: 0

Shorouq-Mohammad/CRM_Project

Full Stack CRM tool developed using React, MySQL, Node, Express and MobX, that allows companies to manage everything to-do with their customers

Language: JavaScript - Size: 21.2 MB - Last synced at: about 2 years ago - Pushed at: over 4 years ago - Stars: 3 - Forks: 1

kurt213/mongodb-to-postgresql

Migrate and replicate data from MongoDB to PostgreSQL in Node.js

Language: JavaScript - Size: 229 KB - Last synced at: about 2 years ago - Pushed at: almost 3 years ago - Stars: 29 - Forks: 8

aws-samples/unlock-mainframe-data-files-on-aws

This solution is designed to help you unlock legacy mainframe data by migrating data files from mainframe systems to AWS. By migrating the data, you can make use of the powerful analytics, machine learning, and other services available in AWS to gain insights and make better decisions based on the data.

Language: Python - Size: 1.19 MB - Last synced at: about 2 years ago - Pushed at: over 2 years ago - Stars: 6 - Forks: 0

stanley-george-joseph/MongoDB-Python-Data-Migration-and-Manipulation

This Jupiter notebook covers basic CRUD operations (on MongoDB) using Python, loading a MongoDB Collection into a Pandas DataFrame and loading data from a .csv, .json and a RDBMS into MongoDB.

Language: Jupyter Notebook - Size: 7.81 KB - Last synced at: about 2 years ago - Pushed at: over 3 years ago - Stars: 1 - Forks: 0

jasbanza/osmosis-externals-data-migrator

Periodically push Osmosis's External Gauges data to MongoDB Atlas cloud deployment.

Language: JavaScript - Size: 328 KB - Last synced at: about 2 years ago - Pushed at: over 2 years ago - Stars: 0 - Forks: 0

kai-niemi/roach-batch 📦

A micro-batch oriented data conversion and importing tool for CockroachDB based on Spring Batch.

Language: Java - Size: 2.28 MB - Last synced at: about 2 years ago - Pushed at: over 2 years ago - Stars: 0 - Forks: 0

cirrusdata/cmc-ansible-examples

Ansible playbook examples using Cirrus Data's Cirrus Migrate Cloud to perform live migration

Size: 29.3 KB - Last synced at: about 2 years ago - Pushed at: over 2 years ago - Stars: 0 - Forks: 0

kodie/migrate-acf-field-data-to-repeater

A WordPress plugin that migrates field metadata for ACF fields that have been moved inside of a repeater

Language: PHP - Size: 6.84 KB - Last synced at: 3 months ago - Pushed at: over 2 years ago - Stars: 2 - Forks: 0

francoromanazzi/UTN-GDD-2019-2c

TP de Gestión de Datos UTN FRBA 2c 2019

Language: C# - Size: 391 KB - Last synced at: 10 months ago - Pushed at: over 5 years ago - Stars: 1 - Forks: 0

dontpullthis/shida-core

A data migration tool

Language: Rust - Size: 26.4 KB - Last synced at: about 2 years ago - Pushed at: over 2 years ago - Stars: 0 - Forks: 0

jpilli/SQLDataValidationFramework

Using SQL data validation framework you can build a data validation process to validate data against complex data validation rules.

Language: TSQL - Size: 49.8 KB - Last synced at: about 2 years ago - Pushed at: over 3 years ago - Stars: 1 - Forks: 0

willcsw/data-diff Fork of datafold/data-diff

Efficiently diff rows across two different databases.

Size: 535 KB - Last synced at: about 2 years ago - Pushed at: almost 3 years ago - Stars: 0 - Forks: 0

cirrusdata/dms-ansible-examples

Ansible playbook examples using Cirrus Data's DMS to perform live insertion, migration and zero downtime cutover

Size: 77.1 KB - Last synced at: about 2 years ago - Pushed at: almost 3 years ago - Stars: 0 - Forks: 0

ei-grad/sqlacrossover

SQLAlchemy-based cross-database migration tool

Language: Python - Size: 15.6 KB - Last synced at: about 11 hours ago - Pushed at: over 3 years ago - Stars: 17 - Forks: 2

SushantPupneja/Smart-Office-Backend-Implemetation-using-Django_Rest_Framework-

python , django , REST API using DRF, Custom Model Fields, Mysql

Language: Python - Size: 7.81 KB - Last synced at: about 2 years ago - Pushed at: over 7 years ago - Stars: 1 - Forks: 0

stanley-george-joseph/MySQL-Python-Data-Migration-and-Manipulation

This Jupiter Notebook shows how to migrate data between a Pandas DataFrame and MySQL. It also shows how to manipulate data including writing queries like DDL and DML commands using Python. Libraries used are SQLAlchemy and sql.connector.

Language: Jupyter Notebook - Size: 3.91 KB - Last synced at: about 2 years ago - Pushed at: over 3 years ago - Stars: 1 - Forks: 0

hive-scripts/hivehoney

Extract data from remote Hive to local Windows OS.

Language: Python - Size: 291 KB - Last synced at: 1 day ago - Pushed at: over 4 years ago - Stars: 3 - Forks: 1

Rillke/mdbtools-docker Fork of scottcame/docker

Dockerized MDB Tools - Read Access databases on *nix

Language: Dockerfile - Size: 149 KB - Last synced at: almost 2 years ago - Pushed at: almost 7 years ago - Stars: 2 - Forks: 2

DivineOmega/uxdm-excel

:twisted_rightwards_arrows: Microsoft Excel source and destination for the UXDM data migrator

Language: PHP - Size: 17.6 KB - Last synced at: about 1 month ago - Pushed at: about 4 years ago - Stars: 1 - Forks: 0

silviafracalossi/Mcapstonesensy_migration

Master's repository on the H2-PostgreSQL DB migration for the "Capstone Project" course (09/2020)

Language: Java - Size: 22.5 KB - Last synced at: about 2 years ago - Pushed at: about 4 years ago - Stars: 0 - Forks: 0

pientaa/booking-demo

Project for @PUT.NET. Spring with dockerized MongoDB. Presented both classic MVC and CQRS with Event Sourcing approach.

Language: Kotlin - Size: 198 KB - Last synced at: about 2 years ago - Pushed at: over 4 years ago - Stars: 5 - Forks: 0

mattiasnordqvist/Galactic-Waste-Management

The best SQL Server migration tool I've found so far

Language: C# - Size: 181 KB - Last synced at: about 2 years ago - Pushed at: over 4 years ago - Stars: 2 - Forks: 1

yassineazzouz/tanit

Kraken - A distributed data transfer tool.

Language: Python - Size: 500 KB - Last synced at: 4 days ago - Pushed at: over 4 years ago - Stars: 2 - Forks: 1

AtlasOfLivingAustralia/cmigrate

Tool for migrating between cassandra clusters

Language: Java - Size: 33.2 KB - Last synced at: 2 months ago - Pushed at: about 1 year ago - Stars: 0 - Forks: 0

jango89/docker-compose-migrate-psql-column

Docker compose scripts to help migrate data in batches from one column to another

Language: PLpgSQL - Size: 4.88 KB - Last synced at: about 2 years ago - Pushed at: over 4 years ago - Stars: 0 - Forks: 0

Starryz/VW-Summer-Internship

Some of the data cleaning, data wrangling and data migration work during my summer internship @VentureWell in 2019.

Language: R - Size: 892 KB - Last synced at: about 1 month ago - Pushed at: almost 6 years ago - Stars: 1 - Forks: 0

matt-snider/timetrap-timewarrior

A simple script to migrate timer entries from timetrap to timewarrior.

Language: Python - Size: 5.86 KB - Last synced at: 5 days ago - Pushed at: over 4 years ago - Stars: 0 - Forks: 0

rapidwebltd/uxdm

🔀 UXDM helps developers migrate data from one system or format to another.

Language: PHP - Size: 185 KB - Last synced at: 3 months ago - Pushed at: about 7 years ago - Stars: 2 - Forks: 0

TIBHannover/ffv1_Migration_Tool

Rosetta Migration Plugin. This script plugin migrates audiovisual files to ffv1-Video, Version 3, Matroska with LPCM-Audio. @MerleFri

Language: Shell - Size: 6.84 KB - Last synced at: about 2 years ago - Pushed at: almost 5 years ago - Stars: 0 - Forks: 0

sonisuman/SKI-Student

Core data migration (light and heavy weight migration)

Language: Swift - Size: 435 KB - Last synced at: about 2 years ago - Pushed at: over 5 years ago - Stars: 0 - Forks: 0

ashutoshsahoo/spring-data-jpa-practice

Sample project with spring boot, spring data jpa, h2, postgresql, flyway and jib maven plugin

Language: Java - Size: 15.6 KB - Last synced at: about 2 months ago - Pushed at: about 5 years ago - Stars: 0 - Forks: 0

dinsaw/simplymigrate

Simple utility to migrate data from one database to other.

Language: Kotlin - Size: 93.8 KB - Last synced at: about 2 months ago - Pushed at: about 6 years ago - Stars: 0 - Forks: 1

Tensei-Data/tensei-frontend

The graphical user interface for a tensei system. It consists of a web based frontend and several extensions like cronjobs and triggers.

Language: JavaScript - Size: 2 MB - Last synced at: about 2 years ago - Pushed at: almost 5 years ago - Stars: 4 - Forks: 5

Izakey/fineract-cn-cassandra Fork of apache/fineract-cn-cassandra

Apache Fineract CN library to multi-tenant persistence of data and migrations in cassandra

Language: Java - Size: 111 KB - Last synced at: about 2 years ago - Pushed at: about 7 years ago - Stars: 0 - Forks: 0

rongfengliang/pgloader-gitlab-pg2pg

pgloader-gitlab-pg2pg

Size: 1000 Bytes - Last synced at: 2 days ago - Pushed at: almost 6 years ago - Stars: 0 - Forks: 0

Tensei-Data/tensei-server

The central coordination component of a Tensei-Data system.

Language: Scala - Size: 70.3 KB - Last synced at: about 2 years ago - Pushed at: almost 5 years ago - Stars: 3 - Forks: 4

jan0sch/tensei-server Fork of Tensei-Data/tensei-server

The central coordination component of a Tensei-Data system.

Language: Scala - Size: 70.3 KB - Last synced at: about 2 years ago - Pushed at: almost 5 years ago - Stars: 0 - Forks: 0

jan0sch/tensei-frontend Fork of Tensei-Data/tensei-frontend

The graphical user interface for a tensei system. It consists of a web based frontend and several extensions like cronjobs and triggers.

Language: JavaScript - Size: 2 MB - Last synced at: about 2 years ago - Pushed at: almost 5 years ago - Stars: 0 - Forks: 0

Tensei-Data/tensei-api

An API for the development of Tensei-Data components.

Language: Scala - Size: 103 KB - Last synced at: about 2 years ago - Pushed at: almost 5 years ago - Stars: 3 - Forks: 3

jan0sch/tensei-api Fork of Tensei-Data/tensei-api

An API for the development of tensei components.

Language: Scala - Size: 103 KB - Last synced at: about 2 years ago - Pushed at: almost 5 years ago - Stars: 0 - Forks: 0

jan0sch/tensei-agent Fork of Tensei-Data/tensei-agent

An agent is the workhorse of the Tensei system. It uses an actor system to do the actual work of reading, parsing, transforming and writing the data. It communicates with the tensei-server which is responsible for starting and stopping and agent.

Language: Scala - Size: 4.89 MB - Last synced at: about 2 years ago - Pushed at: almost 5 years ago - Stars: 0 - Forks: 0

Tensei-Data/tensei-agent

Language: Scala - Size: 4.84 MB - Last synced at: about 2 years ago - Pushed at: almost 5 years ago - Stars: 3 - Forks: 3

ImagineLearning/tablestorage-to-dynamo

Migrate data from tablestorage to dynamo db

Language: Go - Size: 480 KB - Last synced at: almost 2 years ago - Pushed at: about 2 years ago - Stars: 1 - Forks: 0

germinateplatform/germinate-daim

Germinate Daim is a Java based desktop application to aid in the upload of experimental datasets into Germinate.

Language: Java - Size: 18.1 MB - Last synced at: about 2 years ago - Pushed at: over 7 years ago - Stars: 1 - Forks: 2

ratanphayade/DataBase-Migration-Tool

This version of migration tool is useful in structural migration. Its really helpful and easy to use tool to migration data from old database to new database.

Language: PHP - Size: 10.7 KB - Last synced at: about 2 years ago - Pushed at: over 7 years ago - Stars: 0 - Forks: 1

Tensei-Data/user-guide

The User Guide contains information about the structure, installation and usage of the Tensei-Data components like the tensei-agent, the tensei-frontend and the tensei-server.

Language: Scala - Size: 322 KB - Last synced at: about 2 years ago - Pushed at: almost 5 years ago - Stars: 2 - Forks: 1

Tensei-Data/developer-guide

The documentation for Tensei-Data which is intended for developers and administrators.

Language: Scala - Size: 28.3 KB - Last synced at: about 2 years ago - Pushed at: almost 5 years ago - Stars: 2 - Forks: 1

jan0sch/developer-guide Fork of Tensei-Data/developer-guide