GitHub topics: data-migration

Repositories

cloudberry-contrib/cbcopy

Help you migrate from Greenplum(GPDB) to Cloudberry(CBDB)

Language: Go - Size: 1.2 MB - Last synced at: 1 day ago - Pushed at: 2 days ago - Stars: 13 - Forks: 7

varunnayak/stripe-migrate

Python script to migrate Stripe data (Products, Prices, Coupons, Subscriptions) between accounts.

Language: Python - Size: 105 KB - Last synced at: 3 days ago - Pushed at: 3 days ago - Stars: 1 - Forks: 0

CrunchyData/pg_parquet

Copy to/from Parquet in S3, Azure Blob Storage, Google Cloud Storage, http(s) stores, local files or standard inout stream from within PostgreSQL

Language: Rust - Size: 696 KB - Last synced at: 2 days ago - Pushed at: 8 days ago - Stars: 484 - Forks: 21

backube/volsync

Asynchronous data replication for Kubernetes volumes

Language: Go - Size: 20.8 MB - Last synced at: 6 days ago - Pushed at: 6 days ago - Stars: 765 - Forks: 72

aws-samples/aws-datasync-deploy-agent-azure

AWS DataSync Agent Azure Deployment Tool: VHDX to VHD Conversion

Language: Shell - Size: 327 KB - Last synced at: 9 days ago - Pushed at: 9 days ago - Stars: 7 - Forks: 2

OsgiliathEnterprise/data-migrator

Generate anonymized test dataset from production data and configurable anonymization sequences. Execute base to base (vendor agnostic) export and import

Language: Java - Size: 2.06 MB - Last synced at: 18 days ago - Pushed at: 18 days ago - Stars: 6 - Forks: 2

dbBridge is an 'SQL Migration Tool' - enabling import of SQL Databases from any supported Dialect (MsSql, MySql, Oracle, PostgreSQL, Sqlite) to any of these supported dialects with just three lines of PHP code.

Language: PHP - Size: 81.1 KB - Last synced at: 14 days ago - Pushed at: over 1 year ago - Stars: 6 - Forks: 1

apecloud/ape-dts

ApeCloud's Data Transfer Suite, written in Rust. Provides ultra-fast data replication between MySQL, PostgreSQL, Redis, MongoDB, Kafka and ClickHouse, ideal for disaster recovery (DR) and migration scenarios.

Language: Rust - Size: 65.3 MB - Last synced at: 21 days ago - Pushed at: 21 days ago - Stars: 428 - Forks: 58

collectionspace/cspace-config-untangler

Generate CollectionSpace data overviews from profile/tenant configs

Language: Ruby - Size: 18.8 MB - Last synced at: 22 days ago - Pushed at: 22 days ago - Stars: 0 - Forks: 4

san089/goodreads_etl_pipeline

An end-to-end GoodReads Data Pipeline for Building Data Lake, Data Warehouse and Analytics Platform.

Language: Python - Size: 1.31 MB - Last synced at: 25 days ago - Pushed at: about 5 years ago - Stars: 1,365 - Forks: 224

IBM/mac-ibm-migration-tool

macOS Utility to facilitate the mass migration of files/apps/preferences between devices.

Language: Swift - Size: 17.5 MB - Last synced at: 7 days ago - Pushed at: 4 months ago - Stars: 73 - Forks: 5

forcedotcom/SFDX-Data-Move-Utility

SFDMU is a cutting-edge Salesforce data migration tool for seamless org population from other orgs or CSV files. It handles all CRUD operations on multiple related objects in one go.

Language: TypeScript - Size: 4.04 MB - Last synced at: 17 days ago - Pushed at: 18 days ago - Stars: 480 - Forks: 80

demasy/Oracle-FNDLOAD-Guide

Oracle FNDLOAD scripts is the generic loader that can move Oracle E-Business Suite data between two instances through text files.

Size: 454 KB - Last synced at: 29 days ago - Pushed at: 29 days ago - Stars: 2 - Forks: 0

jlorente/laravel-data-migrations

An extension to allow you to separate data migrations from structure migrations

Language: PHP - Size: 22.5 KB - Last synced at: 7 days ago - Pushed at: 3 months ago - Stars: 33 - Forks: 11

actiontech/dtle

Distributed Data Transfer Service for MySQL

Language: Go - Size: 99.1 MB - Last synced at: about 1 month ago - Pushed at: over 1 year ago - Stars: 555 - Forks: 135

SAP-samples/commerce-migration-toolkit

SAP Commerce extensions to support data migrations to SAP Commerce Cloud.

Language: Java - Size: 1.31 MB - Last synced at: about 1 month ago - Pushed at: 2 months ago - Stars: 25 - Forks: 4

ozgen/go-sample-rest-api

This is a Go-based RESTful API with Azure Blob Storage integration, utilizing Gorilla Mux for routing and providing comprehensive tools for secure and scalable web application development.

Language: Go - Size: 348 KB - Last synced at: about 1 month ago - Pushed at: about 2 months ago - Stars: 2 - Forks: 1

prescottprue/fireadmin

Application for Managing Firebase Applications. Includes support for multiple environments and data migrations

Language: JavaScript - Size: 21.9 MB - Last synced at: 7 days ago - Pushed at: over 2 years ago - Stars: 239 - Forks: 39

skcc321/deploy_pin

Automate routines before/after deployment

Language: Ruby - Size: 624 KB - Last synced at: 7 days ago - Pushed at: 15 days ago - Stars: 19 - Forks: 8

polardb/polardbx-tools

Tools for PolarDB-X, such as data migration, CSV files import, benchmark, etc.

Language: Java - Size: 6.99 MB - Last synced at: about 1 month ago - Pushed at: about 1 month ago - Stars: 39 - Forks: 20

pzaino/microETL

A simple, reusable, templates based ETL (Extract, Transform and Load) library and framework written in Python

Language: Python - Size: 383 KB - Last synced at: about 1 month ago - Pushed at: about 1 month ago - Stars: 1 - Forks: 1

kstone-io/kstone

Kstone is an etcd management platform, providing cluster management, monitoring, backup, inspection, data migration, visual viewing of etcd data, and intelligent diagnosis.

Language: Go - Size: 4.92 MB - Last synced at: about 1 month ago - Pushed at: over 2 years ago - Stars: 687 - Forks: 105

TroodInc/trood

AI-powered CLI for software troubleshooting—detecting and resolving code, dependency, and configuration issues.

Language: Go - Size: 134 KB - Last synced at: 2 months ago - Pushed at: 2 months ago - Stars: 40 - Forks: 6

cafali/PathScan

PathScan exports information about the contents of directories and hard drives. With a single click, you can create a complete list of all files and paths within a specific folder or across an entire hard drive.

Language: Batchfile - Size: 29.3 KB - Last synced at: about 1 month ago - Pushed at: 2 months ago - Stars: 5 - Forks: 0

gluent/goe

GOE: a simple and flexible way to copy data from an Oracle Database to Google BigQuery.

Language: Python - Size: 44.2 MB - Last synced at: 6 days ago - Pushed at: 2 months ago - Stars: 7 - Forks: 2

forcedotcom/SFDX-Data-Move-Utility-Desktop-App

The SFDMU GUI Desktop Application is a comprehensive tool for Salesforce data migration between SF environments or importing/exporting CSV data into SF environments. It builds upon the capabilities of the SFDX Data Move Utility Plugin (SFDMU), offering a user-friendly interface for seamless data management tasks.

Language: JavaScript - Size: 15.2 MB - Last synced at: 2 months ago - Pushed at: 2 months ago - Stars: 100 - Forks: 31

PyBotDevs/isobot-data-migration-assistant

A tool to help migrate isobot's data from its legacy location to main location.

Language: Python - Size: 0 Bytes - Last synced at: 2 months ago - Pushed at: 2 months ago - Stars: 0 - Forks: 0

sexyrisk6164/easeus-mobimover-6.2.3-crack-license-key

EaseUS MobiMover is a powerful tool for transferring, backing up, and managing data between iOS devices and computers.

Size: 6.84 KB - Last synced at: 2 months ago - Pushed at: 3 months ago - Stars: 0 - Forks: 0

mensenvau/data_migration_validation

Data Validation Documentation for Source and Target Tables in Databricks

Language: Python - Size: 4.88 KB - Last synced at: about 2 months ago - Pushed at: 3 months ago - Stars: 1 - Forks: 0

bezumienikefeed674/easeus-mobimover-6.2.3-crack-license-key

EaseUS MobiMover is a powerful tool for transferring, backing up, and managing data between iOS devices and computers.

Size: 0 Bytes - Last synced at: 3 months ago - Pushed at: 3 months ago - Stars: 0 - Forks: 0

CodexParas/db-migrator

DB Migrator is a Spring Boot-based tool for seamless data migration between MySQL, PostgreSQL, and Oracle databases. Using Spring Batch, it supports efficient batch processing and provides REST APIs for migration and data insertion.

Language: Java - Size: 49.8 KB - Last synced at: about 2 months ago - Pushed at: 3 months ago - Stars: 0 - Forks: 0

DivineOmega/uxdm

🔀 UXDM helps developers migrate data from one system or format to another.

Language: PHP - Size: 464 KB - Last synced at: 3 days ago - Pushed at: almost 5 years ago - Stars: 165 - Forks: 9

brayandm/backup-manager

Backup Manager is a self-hosted tool for centralized backup management across various data types and storage servers. It features scheduling, retention policies, encryption, and notifications, offering a robust solution for backups, migrations, and data integrity.

Language: PHP - Size: 1.5 MB - Last synced at: 3 months ago - Pushed at: 3 months ago - Stars: 9 - Forks: 0

nathadriele/AWS-DMS-task-restart-and-status-checker

The AWS DMS Task Restart and Status Checker is a Python script designed to restart various AWS Database Migration Service (DMS) tasks and check their status. This script leverages AWS SDK (Boto3) and Mage.ai for DMS task integration and management, ensuring efficient and reliable task handling.

Language: Python - Size: 2.48 MB - Last synced at: about 2 months ago - Pushed at: 3 months ago - Stars: 8 - Forks: 0

nathadriele/redshift-to-s3-unload-dag

This Airflow DAG automates the process of extracting data from an Amazon Redshift database and unloading it to Amazon S3 in Parquet format. It runs daily, exporting data from the previous day based on a specified query.

Language: Python - Size: 44.9 KB - Last synced at: about 1 month ago - Pushed at: 3 months ago - Stars: 7 - Forks: 0

AlbertKarapetyan/CryptoCoinBlock

CryptoCoinBlock is a scalable cryptocurrency data management system designed to import and manage blockchain data for multiple coins, including Bitcoin, Dogecoin, Dashcoin, and others. This solution utilizes clean architectural principles, MediatR for CQRS, and a DDD approach to encapsulate business logic effectively.

Language: C# - Size: 57.6 KB - Last synced at: about 1 month ago - Pushed at: 3 months ago - Stars: 1 - Forks: 0

caosiyang/py-mongo-sync

Oplog-based data sync tool that synchronizes data from a replica set to another deployment, e.g.: standalone, replica set, and sharded cluster.

Language: Python - Size: 194 KB - Last synced at: about 1 month ago - Pushed at: over 1 year ago - Stars: 109 - Forks: 46

viordash/MigrateAnyCppData

Versioned Data Migrations

Language: C++ - Size: 405 KB - Last synced at: about 1 month ago - Pushed at: 3 months ago - Stars: 0 - Forks: 0

Agie88/SQL-Server-DBA-Projects

SQL Server DBA Projects

Size: 0 Bytes - Last synced at: 3 months ago - Pushed at: 3 months ago - Stars: 0 - Forks: 0

bliblidotcom/data-migration

Blibli Database Migration Framework

Language: Java - Size: 92.8 KB - Last synced at: about 1 month ago - Pushed at: almost 3 years ago - Stars: 6 - Forks: 11

hextriclosan/mubi2letterboxd-py

A simple GUI application for user data migration from MUBI.com to letterboxd.com

Language: Python - Size: 308 KB - Last synced at: 3 days ago - Pushed at: 3 days ago - Stars: 1 - Forks: 2

Adarsh-Hota/ETL_fintech-data-migration

Data Migration with Azure Synapse, PySpark, and Delta Tables

Language: Jupyter Notebook - Size: 605 KB - Last synced at: 5 months ago - Pushed at: 5 months ago - Stars: 0 - Forks: 0

sodafoundation/strato

SODA Strato (Multi-cloud) project provides a cloud vendor agnostic data management for hybrid cloud, intercloud or intracloud. This project is renamed as 'Strato'

Language: HTML - Size: 88.6 MB - Last synced at: 2 months ago - Pushed at: about 1 year ago - Stars: 233 - Forks: 328

Luisginan/data-migration

A collection of robust tools for seamless data migration between different databases and storage systems. Supports incremental transfers, schema validation, and automated data transformation with built-in error handling and rollback capabilities.

Language: C# - Size: 88.9 KB - Last synced at: 6 months ago - Pushed at: 6 months ago - Stars: 1 - Forks: 0

chrispangg/sf-automation-switch

This script helps with disabling and enabling automation (Triggers, Validation Rules, Duplicate Rules and Flows) in a Salesforce org. Useful for data migrations and data transfer.

Language: Python - Size: 70.3 KB - Last synced at: 6 months ago - Pushed at: 6 months ago - Stars: 1 - Forks: 0

samsamai/ecto_immigrant

Data migrations for your ecto-backed elixir application

Language: Elixir - Size: 71.3 KB - Last synced at: 26 days ago - Pushed at: 6 months ago - Stars: 5 - Forks: 9

davidag/tiddlywiki-migrator

Export tiddlers from a single-file html TiddlyWiki, "classic" or "modern", to Markdown.

Language: Makefile - Size: 73.2 KB - Last synced at: about 1 month ago - Pushed at: about 1 year ago - Stars: 18 - Forks: 5

nilsding/enpass2keepassxc

Converts an Enpass JSON export to a KeePassXC XML export

Language: Crystal - Size: 4.88 KB - Last synced at: 9 days ago - Pushed at: 10 months ago - Stars: 7 - Forks: 0

jsphpl/enpass-to-keepass

Convert an Enpass csv export so it can be imported to a KeePass database using KeePassXC

Language: Python - Size: 17.6 KB - Last synced at: about 2 months ago - Pushed at: about 2 years ago - Stars: 51 - Forks: 6

ka8725/migration_data

Migrate data along with schema migrations in Rails and keep them up to date.

Language: Ruby - Size: 61.5 KB - Last synced at: 5 days ago - Pushed at: 8 months ago - Stars: 365 - Forks: 21

adamfoneil/SqlServerUtil

A grab bag of SQL Server utilities: BulkInsert, SqlMigrator, and ViewMaterializer

Language: C# - Size: 123 KB - Last synced at: 4 days ago - Pushed at: over 1 year ago - Stars: 3 - Forks: 0

mateuszsokola/partman-wizard

📊 A CLI tool to partition PostgreSQL tables and manage data migration efficiently.

Language: JavaScript - Size: 359 KB - Last synced at: about 1 month ago - Pushed at: 9 months ago - Stars: 0 - Forks: 0

spiegelp/Poco.Evolved

Schema and data migration framework for .NET

Language: C# - Size: 90.8 KB - Last synced at: about 1 month ago - Pushed at: about 2 years ago - Stars: 5 - Forks: 3

microsoft/DataMigrationTeam

Repository for the Data Migration Team

Size: 176 MB - Last synced at: 6 days ago - Pushed at: almost 2 years ago - Stars: 110 - Forks: 162

JumpJets/drive-replication

A Python script to replicate drive or a folder within a drive onto another drive

Language: Python - Size: 31.3 KB - Last synced at: 10 months ago - Pushed at: 10 months ago - Stars: 0 - Forks: 0

BrksGuiOrnelas/data_modelling_dw

Criação de um Data Warehouse (DW) utilizando modelagem dimensional em um esquema estrela.

Size: 334 KB - Last synced at: 10 months ago - Pushed at: 11 months ago - Stars: 0 - Forks: 0

erreduarte/data-migration-project

Highlighting expertise in data migration, data normalization and standardization, this project demonstrates successful data transfer from Snowflake to Databricks. It emphasizes optimized data flow and enhanced accessibility through standardization, showcasing a commitment to ethical data practices.

Size: 68.4 KB - Last synced at: 11 months ago - Pushed at: 11 months ago - Stars: 1 - Forks: 0

MaxineXiong/Music-Events-Web-Scraper

A web scraping program built to extract attribute data on music events from a popular event ticketing website. The program collects event data based on the specified country and city, which is then exported to a CSV file for marketing emails and stored efficiently in a local PostgreSQL database.

Language: Python - Size: 118 KB - Last synced at: about 1 month ago - Pushed at: 11 months ago - Stars: 0 - Forks: 0

hextriclosan/mubi2letterboxd

A simple way to migrate user data from MUBI.com to letterboxd.com

Language: HTML - Size: 1.66 MB - Last synced at: 11 months ago - Pushed at: 12 months ago - Stars: 7 - Forks: 2

heliomarpm/SQLDataTransfer

Ferramenta para Cópia de Dados SQL Server, que foi desenvolvida para auxiliar na geração de arquivos e cópia eficiente de dados entre bases de dados SQL Server.

Language: C# - Size: 4.84 MB - Last synced at: about 2 months ago - Pushed at: 12 months ago - Stars: 1 - Forks: 2

ennolan/dm2cloud

Data Transfer to AWS from On-Premise Server

Size: 5.16 MB - Last synced at: 12 months ago - Pushed at: 12 months ago - Stars: 0 - Forks: 0

IlyessAgg/PII

SQL to NoSQL : Automated data migration.

Language: Java - Size: 43.2 MB - Last synced at: about 1 year ago - Pushed at: about 6 years ago - Stars: 0 - Forks: 1

MaxineXiong/Data-Migration-Into-CRM-Apps-RPA

This repository contains RPA solutions that are designed to automate repetitive and time-consuming data entry tasks to streamline customer data entry into both CRM web and desktop applications simultaneously. The robot operates in parallel, ensuring quick and accurate data entry without the need for manual intervention.

Language: C# - Size: 8.58 MB - Last synced at: about 1 month ago - Pushed at: about 1 year ago - Stars: 0 - Forks: 0

lyrasis/cdmtools

Grab data and objects from CONTENTdm API, with an eye toward preparing it for migration into Islandora

Language: Ruby - Size: 136 KB - Last synced at: about 1 year ago - Pushed at: about 1 year ago - Stars: 0 - Forks: 0

admin-remix/Chargebee-to-Chargify-Migration

Internal script used to move all free user accounts to our new billing platform Chargify.

Language: TypeScript - Size: 5.86 KB - Last synced at: about 1 year ago - Pushed at: almost 5 years ago - Stars: 0 - Forks: 0

SantiBalbiani/UTN_TP_GDD_2C_2016

Group Project: Gestión de Datos (Data Management) 2nd Quarter 2016 Professor: Eng. Edgardo Lacquaniti

Language: C# - Size: 18.7 MB - Last synced at: about 1 year ago - Pushed at: over 8 years ago - Stars: 0 - Forks: 0

forcedotcom/scmt-server 📦

Heroku server for the Service Cloud Migration Tool

Language: Java - Size: 413 KB - Last synced at: about 1 year ago - Pushed at: about 3 years ago - Stars: 3 - Forks: 6

benbalter/github_records_archiver 📦

Backs up a GitHub organization's repositories and all their associated information for archival purposes.

Language: Ruby - Size: 120 KB - Last synced at: 20 days ago - Pushed at: about 4 years ago - Stars: 108 - Forks: 22

despark/laravel-data-migration

Data migration helper library for Laravel

Language: PHP - Size: 42 KB - Last synced at: about 1 year ago - Pushed at: almost 8 years ago - Stars: 1 - Forks: 0

cocodroid/verysu-mydata

a lightweight data migration framework

Language: Java - Size: 21.5 KB - Last synced at: about 1 year ago - Pushed at: almost 7 years ago - Stars: 1 - Forks: 0

kenpusney/rec 📦

[DEPRECATED] Record Modeling Utils on JVM

Size: 62.5 KB - Last synced at: about 1 year ago - Pushed at: over 8 years ago - Stars: 0 - Forks: 0

heycarsten/labici-magento-shopify-migrator

Tooling to migrate the La Bicicletta online store from Magento 1.9 to Shopify

Language: Ruby - Size: 103 KB - Last synced at: about 1 year ago - Pushed at: over 5 years ago - Stars: 4 - Forks: 6

nagasudhirpulla/wbes_sch_warehouse

migrates WRLDC latest schedule data to archive database for the sake of faster analytics

Language: Python - Size: 73.2 KB - Last synced at: about 1 year ago - Pushed at: almost 5 years ago - Stars: 1 - Forks: 0

Revanthkasinathan/Data-Migration-and-Transformation

This project entails migrating and transforming data, with a key focus on extracting data, storing it in AWS, and then pushing it to a database table.

Language: Python - Size: 8.79 KB - Last synced at: about 1 year ago - Pushed at: about 1 year ago - Stars: 0 - Forks: 0

jacobeturpin/sagemaker-studio-efs-migration

A Python-based library for automating the migration of EFS storage from one SageMaker Studio domain to another using AWS DataSync

Language: Python - Size: 6.84 KB - Last synced at: about 1 year ago - Pushed at: almost 3 years ago - Stars: 1 - Forks: 0

zproksi/bpatch

Tool & library for binary data processing according JSON formatted rules

Language: C++ - Size: 89.8 KB - Last synced at: about 1 year ago - Pushed at: about 1 year ago - Stars: 2 - Forks: 1

DanMartins/DataManager

Tools for data handling and management.

Language: Python - Size: 231 KB - Last synced at: over 1 year ago - Pushed at: over 4 years ago - Stars: 1 - Forks: 0

pratiksha2712/ETL-Pipeline

An end-to-end GoodReads Data Pipeline for Building Data Lake, Data Warehouse and Analytics Platform.

Language: Python - Size: 1.47 MB - Last synced at: over 1 year ago - Pushed at: over 1 year ago - Stars: 0 - Forks: 0

beyondstorage/beyond-tp

Neutral data migration service

Language: Dart - Size: 795 KB - Last synced at: 18 days ago - Pushed at: about 2 years ago - Stars: 8 - Forks: 4

Revanthkasinathan/Youtube-Data-Harvesting-And-Warehousing

This project is a Streamlit application which is focussing on ETL concept. It is particularly designed to provide users with seamless access and analysis of data from multiple YouTube channels.

Language: Python - Size: 13.7 KB - Last synced at: over 1 year ago - Pushed at: over 1 year ago - Stars: 0 - Forks: 0

cerenakaslan/yemekproje

KITCHO - A website that user can discover new recipes based on ingredients and upload own recipes.

Language: C# - Size: 5.24 MB - Last synced at: over 1 year ago - Pushed at: over 1 year ago - Stars: 1 - Forks: 0

bcostaaa01/hubmigrate

An open-source Python library is designed to simplify the process of migrating data to HubSpot, a powerful customer relationship management (CRM) platform. Whether you're moving contacts, companies, deals, or any other data to HubSpot, this library provides an easy-to-use interface for managing your migration tasks.

Language: Python - Size: 52.7 KB - Last synced at: over 1 year ago - Pushed at: over 1 year ago - Stars: 0 - Forks: 0

statebox/cql

CQL: Categorical Query Language implementation in Haskell

Language: Haskell - Size: 616 KB - Last synced at: over 1 year ago - Pushed at: about 2 years ago - Stars: 155 - Forks: 14

gagoyal01/mongodb-rdbms-sync

Bi-directional data sync between Relational Databases (Oracle, MySql) & MongoDB.

Language: Java - Size: 1.44 MB - Last synced at: over 1 year ago - Pushed at: over 7 years ago - Stars: 40 - Forks: 27

jubildinoop/odoo

This Git repository hosts an Odoo project, a powerful and highly customizable open-source ERP (Enterprise Resource Planning) and CRM (Customer Relationship Management) system. Our project focuses on customizing, configuring, and extending Odoo to meet the unique business needs of our organization or clients.

Size: 77.1 KB - Last synced at: over 1 year ago - Pushed at: over 1 year ago - Stars: 0 - Forks: 0